Heed the data gap: Guidelines for using incomplete datasets in annual stream temperature analyses
Not provided.
Biodiversity & Conservation↗
SEARCH · Search NASA
Results for “data gaps”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Filling in Subsurface Storage Open Data Gaps - Updates to CCS Data Availability on EDX and EDX Spatial (FWP-1022465)
There is a need to preserve and efficiently access data resources to drive the next generation of research and development while ensuring compliance with DOE regulations. Over the last 10+ years, there has been ongoing efforts by the DOE Carbon Storage Program to ensure that there is effective data curation and preservation of DOE funded research leveraging the NETL-FECM data repository, the Energy Data eXchange (EDX). This talk presents updates about ongoing efforts to continue to support the mission of ensuring that carbon storage data is findable, accessible, interoperable, and reusable to the carbon storage stakeholder community through EDX and EDX Spatial. Presented at the NETL Carbon Management Review Meeting, Pittsburgh, 2024.
Morkner, Paige↗
Meeting Data Gaps in CCS Research: Data Collection, Aggregation, and Management to Drive Subsurface Modeling and Research
Carbon Storage BIL Workshop, Santa Fe, NM, May 1-3, 2023
Morkner, Paige↗
Offshore Geologic Carbon Storage Data Collection and Data Gaps Analysis
This is a TRS documenting the Offshore Geologic Carbon Storage Data Collection. It describes the Data Collection web application and its creation as well as an accompanying Data Gaps Assessment. We present an interactive data collection and data gaps analysis to aggregate, understand, and disseminate the data that are publicly available to support offshore GCS in the United States. This data collection and data gaps analysis can be leveraged by stakeholders to understand where GCS may be viable offshore, create GCS project analogs, and address challenges to GCS in offshore environments.
58 GEOSCIENCES↗
A Proxy Method to Bridge LCA Data Gaps Using Automated Material Classification and Probabilistic Under-Specification
Life cycle assessments (LCAs) are essential for understanding the environmental impacts of material production. However, gaps in life cycle inventory (LCI) data for material and chemical inputs present a key challenge for LCA practitioners, especially in the early design stages. Strategies for filling in these gaps require additional time and expertise, which can hinder the LCA’s completion. This study combined automatic material classification and probabilistic under-specification to create a time-efficient method to fill material LCI data gaps. To illustrate the proposed method, proxy environmental impact distributions were generated using publicly available material LCI data classified into the ChemOnt chemical taxonomy using the open-source chemical classification software ClassyFire. Input materials with data gaps were then classified into the same taxonomy, where proxy environmental impact values could be selected from the available distributions to quickly fill in any data gaps. Although these methods were applied to classify material production processes available in the Federal LCA Commons and Ecoinvent databases, they can be applied to any LCA database. This study shows that classifying materials by their chemical structure produces taxonomies with increased granularity relative to industrial classification, improving the ability of under-specified proxy data to be used for differentiating the environmental impacts of competing designs.
biological databases↗
Geothermal Data Gap Analysis Over the Western US
NREL, as part of the Play Fairway Analysis Retrospective, compiled and mapped publicly available geologic and geophysical data in relation to the 2008 USGS geothermal potential analysis. Included in this submission are maps displaying the publicly available data for LIDAR coverage, aeromagnetic coverage, gravity station locations, and geologic map coverage over the Western United States.
15 GEOTHERMAL ENERGY↗
Technical note: Using long short-term memory models to fill data gaps in hydrological monitoring networks
Abstract. Quantifying the spatiotemporal dynamics in subsurface hydrological flows over a long time window usually employs a network of monitoring wells. However, such observations are often spatially sparse with potential temporal gaps due to poor quality or instrument failure. In this study, we explore the ability of recurrent neural networks to fill gaps in a spatially distributed time-series dataset. We use a well network that monitors the dynamic and heterogeneous hydrologic exchanges between the Columbia River and its adjacent groundwater aquifer at the U.S. Department of Energy's Hanford site. This 10-year-long dataset contains hourly temperature, specific conductance, and groundwater table elevation measurements from 42 wells with gaps of various lengths. We employ a long short-term memory (LSTM) model to capture the temporal variations in the observed system behaviors needed for gap filling. The performance of the LSTM-based gap-filling method was evaluated against a traditional autoregressive integrated moving average (ARIMA) method in terms of error statistics and accuracy in capturing the temporal patterns of river corridor wells with various dynamics signatures. Our study demonstrates that the ARIMA models yield better average error statistics, although they tend to have larger errors during time windows with abrupt changes or high-frequency (daily and subdaily) variations. The LSTM-based models excel in capturing both high-frequency and low-frequency (monthly and seasonal) dynamics. However, the inclusion of high-frequency fluctuations may also lead to overly dynamic predictions in time windows that lack such fluctuations. The LSTM can take advantage of the spatial information from neighboring wells to improve the gap-filling accuracy, especially for long gaps in system states that vary at subdaily scales. While LSTM models require substantial training data and have limited extrapolation power beyond the conditions represented in the training data, they afford great flexibility to account for the spatial correlations, temporal correlations, and nonlinearity in data without a priori assumptions. Thus, LSTMs provide effective alternatives to fill in data gaps in spatially distributed time-series observations characterized by multiple dominant frequencies of variability, which are essential for advancing our understanding of dynamic complex systems.
54 ENVIRONMENTAL SCIENCES↗
OpenET: Filling a Critical Data Gap in Water Management for the Western United States
The lack of consistent, accurate information on evapotranspiration (ET) and consumptive use of water by irrigated agriculture is one of the most important data gaps for water managers in the western United States (U.S.) and other arid agricultural regions globally. The ability to easily access information on ET is central to improving water budgets across the West, advancing the use of data-driven irrigation management strategies, and expanding incentive-driven conservation programs. Recent advances in remote sensing of ET have led to the development of multiple approaches for field-scale ET mapping that have been used for local and regional water resource management applications by U.S. state and federal agencies. The OpenET project is a community-driven effort that is building upon these advances to develop an operational system for generating and distributing ET data at a field scale using an ensemble of six well-established satellite-based approaches for mapping ET. Key objectives of OpenET include: Increasing access to remotely sensed ET data through a web-based data explorer and data services; supporting the use of ET data for a range of water resource management applications; and development of use cases and training resources for agricultural producers and water resource managers. Here we describe the OpenET framework, including the models used in the ensemble, the satellite, meteorological, and ancillary data inputs to the system, and the OpenET data visualization and access tools. We also summarize an extensive intercomparison and accuracy assessment conducted using ground measurements of ET from 139 flux tower sites instrumented with open path eddy covariance systems. Results calculated for 24 cropland sites from Phase I of the intercomparison and accuracy assessment demonstrate strong agreement between the satellite-driven ET models and the flux tower ET data. For the six models that have been evaluated to date (ALEXI/DisALEXI, eeMETRIC, geeSEBAL, PT-JPL, SIMS, and SSEBop) and the ensemble mean, the weighted average mean absolute error (MAE) values across all sites range from 13.6 to 21.6 mm/month at a monthly timestep, and 0.74 to 1.07 mm/day at a daily timestep. At seasonal time scales, for all but one of the models the weighted mean total ET is within ±8% of both the ensemble mean and the weighted mean total ET calculated from the flux tower data. Overall, the ensemble mean performs as well as any individual model across nearly all accuracy statistics for croplands, though some individual models may perform better for specific sites and regions. We conclude with three brief use cases to illustrate current applications and benefits of increased access to ET data, and discuss key lessons learned from the development of OpenET.
54 ENVIRONMENTAL SCIENCES↗
Analysis of Selected Publicly Available Geothermal Exploration Data Gaps
As part of a United States Department of Energy (DOE) supported retrospective analysis of DOE's Play Fairway Analysis (PFA) projects, the National Renewable Energy Laboratory (NREL) compiled and analyzed publicly available geothermal exploration datasets to identify and highlight data gaps in areas prospective for hosting geothermal resources. The analysis was intended to understand the existing geographic coverage of selected datasets commonly utilized both by the PFA projects and geothermal developers during resource assessments including geologic mapping, temperature gradient drilling, and aeromagnetic, gravimetric, and lidar surveys. Results indicate that broad areas of the western United States estimated to have geothermal potential lack sufficient geologic and geophysical coverage necessary for even regional resource exploration. The study directly informed the recent Geoscience Data Acquisition for Western Nevada, or GeoDAWN - which united DOE's Geothermal Technologies Office (GTO) with the U.S. Geological Survey (USGS) of the U.S. Department of the Interior to assist U.S. needs for energy and critical minerals. The study also has the potential to inform public investment in further data acquisition for characterization of the Earth both for geothermal and other natural resource assessments.
data↗
Where are the Data? Automating a Workflow for Carbon Storage Data Gap Analyses
This presentation demonstrates a spatial analysis workflow to assess data availability for the many components of geologic carbon storage technical viability. The workflow relies upon a knowledge-data framework that links the different components of GCS technical viability to the data types needed for evaluation. Using this contextual information, a combination of data science methods (e.g., natural language processing) and spatial analyses are applied to identify areas where sufficient data exists for a given component. The results are aggregated into maps illustrating data density and spatial gaps across all technical viability factors and data categories, as well as the individual component and category level for a more nuanced understanding. Presented at the FECM NETL Carbon Management Program Review Meeting 2024.
Creason, Christopher↗
Where are the Data? Automating a Workflow for Carbon Storage Data Gap Analyses
This presentation demonstrates a spatial analysis workflow to assess data availability for the many components of geologic carbon storage technical viability. The workflow relies upon a knowledge-data framework that links the different components of GCS technical viability to the data types needed for evaluation. Using this contextual information, a combination of data science methods (e.g., natural language processing) and spatial analyses are applied to identify areas where sufficient data exists for a given component. The results are aggregated into maps illustrating data density and spatial gaps across all technical viability factors and data categories, as well as the individual component and category level for a more nuanced understanding. Presented at the Geological Society of America Connects 2024 Annual Meeting in Anaheim, California, 22-25 September 2024.
Creason, Christopher↗
A novel data gaps filling method for solar PV output forecasting
This study proposes a modified gaps filling method, expanding the column mean imputation method and evaluated using randomly generated missing values comprising 5%, 10%, 15%, and 20% of the original data on power output. The XGBoost algorithm was implemented as a forecasting model using the original and processed datasets and two sources of solar radiation data, namely, Shortwave Radiation (SWR) from Advanced Himawari Imager 8 (AHI-8) and Surface Solar Radiation Downward (SSRD) from ERA5 global reanalysis data. Further, the accuracy of the two sets of forecasted power output was evaluated using Root Mean Square Error (RMSE) and Mean Absolute Error (MAE). Results show that by applying the proposed gap filling method and using SWR in forecasting solar photovoltaic (PV) output, the improvement in the RMSE and MAE values range from 12.52% to 24.30% and from 21.10% to 31.31%, respectively. Meanwhile, using SSRD, the improvement in the RMSE values range from 14.01% to 28.54% and MAE values from 22.39% to 35.53%. To further evaluate the accuracy of the proposed gap-filling method, the proposed method could be validated using different datasets and other forecasting methods. Future studies could also consider applying the said method to datasets with data gaps higher than 20%.
Energy & Fuels↗
Life Cycle Inventories and Data Gap Analysis for Rare Earth Elements: Neodymium and Dysprosium from Mining to Magnets
The United States demand for Neodymium-Iron-Boron (NdFeB) magnets, produced from rare earth elements (REEs) such as (Nd) and Dysprosium (Dy), far exceeds its nascent domestic production capacity, rendering it reliant on vulnerable global supply chains dominated by China. To guide research and development investments in securing U.S. REE supply, defensible benchmark metrics across environmental, economic, and social dimensions are needed. In this study, we built globally-representative, process-based cradle-to-cradle life cycle inventories for Nd and Dy in NdFeB magnets lifecycles, encompassing primary material acquisition, beneficiation, smelting and refining, metal processing, specialty alloy and chemical transformation, subcomponent manufacturing, consumer application (use phase) and end-of-life management. We carried out detailed literature review, and applied process engineering principles to build industry-representative upscaled life cycle inventories for both metals. We used these models to conduct bottom-up literature review and gap analysis on existing literature, compilation of data sources for each life cycle stage (and transformations where necessary), and a preliminary technoeconomic analysis (TEA)/life cycle costing analysis (LCCA). Findings from this work emphasize the need for metal specific, representative REE LCIs to establish robust benchmarks for advancing sustainable REE technologies and guiding R&D in REE supply chains.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
Electricity demand in South Asia – data gaps and pathways for research and modeling
South Asia is one of the fastest growing regions - economically and energy-wise in the world. However, there are significant uncertainties in how the energy demand would grow given the rapidly rising incomes, urbanization, industrialization, access to energy, warming climate and technological change. The transition to clean energy in the region is a priority and is critical to limiting emissions in the region and increasing regional energy security. The power sector will play an important role in decarbonization of energy systems, lowering emissions in other sectors through electrification. However, as existing end uses are scaled up more and new end uses are electrified, the temporal and spatial patterns of electricity consumption could change. These changes have implications for the magnitude, shape, and timing of peak demand, which in turn affects the power sector’s investments and operations, and ability to provide reliable power. In this report, we outline key uncertainties in demand growth that South Asian countries would face in the near to medium term, along with summarizing insights from stakeholder consultations we held over the past 6 months.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
Bridging HPC Data Gaps: Novel Tools for GPU Resource Monitoring and Scheduler
Explore the source record for details and available documents.
Computer science↗
A Comparison of Time Series Gap-Filling Methods to Impute Solar Radiation Data
Complete solar resource datasets play a critical role at every stage of solar project phases. However, measured or modeled solar resource data come with significant uncertainties and usually suffer from several issues, including but not limited to, data gaps, data quality issue, etc. In order to mitigate these issues an appropriate data imputation method should be implemented to build a complete and reliable temporal (and spatial) database. Being motivated by this, in this study we compare the performances of eight different gap filling methods extensively by creating random and artificial data gaps in (i) hourly irradiance data for one year using a few locations of the National Solar Radiation Database (NSRDB) and (ii) one-minute ground measurement dataset from Surface Radiation Budget Network (SURFRAD) stations.
clearness index↗
Data Centers Gap Analysis [Slides]
Data centers and other large loads are a significant driver of unprecedented, near-term demand growth in the United States. Power system planners, utilities, regulators, and other stakeholders are grappling with how to integrate data centers on the system without comprising reliability, resiliency, and energy affordability. NLR is pursuing work to develop a siting and decision-making tool that would draw on power systems modeling expertise to achieve granular representation of trade-offs involved in data center sitting and development. This slide deck supports the same workstream by reviewing the literature to identify mitigation options to facilitate near-term integration of large loads and by presenting options for pursuing data development and/or modeling projects to improve representation of siting options.
29 ENERGY PLANNING, POLICY, AND ECONOMY↗
A Critical Review of High Burnup Fuel Fragmentation, Relocation, and Dispersal under Loss-Of-Coolant Accident Conditions
High burnup fuel in excess of ~6268 GWd/MTU has been observed to severely fragment when subjected to temperature transient conditions as in a loss-of-coolant accident. In the event of cladding failure, the severely fragmented fuel can relocate into the balloon region and potentially disperse through the burst opening into the reactor’s primary system. This observation has led to implementation of several independent test programs designed to focus on various aspects of fuel fragmentation, relocation, and dispersal. The purpose of this review is to perform a critical, holistic assessment of fuel fragmentation, relocation, and dispersal under loss-of-coolant conditions to identify data gaps in the experimental data base. Phenomena have been identified and well defined through the various testing programs, and general agreement regarding the governing parameters (temperature, burnup, heating rate, cladding deformation, etc.) has been established. However, there is a significant data gap connecting research to commercial application. Furthermore, previous research attempted to evaluate the problem holistically, but has yet to provide a comprehensive understanding of the problem. Major identified data gaps consist of (1) a comprehensive understanding of pretransient fuel rod conditions (fuel temperature, fuel stress, rod internal pressures, microstructure, etc.), (2) definition of prototypic loss-of-coolant accident conditions (heating rate, fuel temperatures, fuel stress), (3) identification of the differences between nuclear and electrical integral loss-of-coolant accident tests, and connection of fuel rod performance (cladding ballooning, burst opening, potential relocation, fragmentation susceptibility, etc.) to fuel fragmentation, relocation, and dispersal severity. Finally, the content of this manuscript provides a clear path for connecting testing and data acquisition to commercial application by providing concrete means for filling data gaps and prioritized testing regimes.
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗