SEARCH · Search NASA

Results for “dataset shift”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

DOE OSTI2023

Low-Temperature Geothermal Geospatial Datasets: An Example from Alaska: Preprint

This project is part of a broader effort focused on geothermal heating and cooling with the purpose of demonstrating the multi-faceted value of integrating GHC/GHX into national decarbonization plans and community energy plans. Currently, there is a need to better define and evaluate low-temperature geothermal resource potential to provide the basis for supporting private sector investment. For shallow GHC/GHX fields, there is no formal compilation of subsurface characteristics shared among industry practitioners that can improve system design and operations. Alaska is specifically noted in this work, because heretofore, it has not received a similar focus in geothermal potential evaluations as the contiguous United States. The methodology consists of leveraging relevant data generate a baseline low-temperature resources (< 150 degrees C) geospatial dataset to compare and analyze information accessible to anyone trying to understand the potential of GHC/GHX and small-scale low-temperature geothermal power in Alaska (e.g., energy modelers, communities, planners, and policymakers). Importantly, this project is identifying data related to (1) the evaluation of GHC/GHX in the shallow subsurface, and (2) the evaluation of low-temperature geothermal resource availability. Additionally, data is being compiled to assess repurposing of oil and gas wells to contribute co-produced fluids toward the geothermal direct use and heating and cooling resource potential. The goal of this project is facilitating future deployment of GHC/GHX analysis and community-led programs and update the low-temperature geothermal resources assessment of Alaska. A better understanding of shallow potential for geothermal heat exchange (GHX) will improve design and operations of highly efficient GHC systems. The deployment and impact that can be achieved for low temperature geothermal resources will contribute to decarbonization goals and facilitate widespread electrification by shaving and shifting grid loads.

bottom-hole temperature↗

DOE OSTI2021

Multiscale Effects Masked the Impact of the COVID-19 Pandemic on Electricity Demand in the United States

Shelter-in-place orders and business closures related to COVID-19 changed the hourly profile of electricity demand and created an unprecedented source of uncertainty for the grid. The potential for continued shifts in electricity profiles has implications for electricity sector investment and operating decisions that maintain reserve margins and provide grid reliability. This study reveals that understanding this uncertainty requires an understanding of the underlying drivers at the customer-class scale. This paper utilizes three datasets to compare the impacts of COVID-19 on electricity consumption across a range of spatiotemporal and customer scales. At the utility/customer-class scale, COVID-19-induced shutdowns in the spring of 2020 shifted weekday residential load profiles to resemble weekend profiles from previous years. Total commercial loads declined, but the commercial diurnal load profile was unchanged. With only total loads available at the balancing authority scale, the apparent impact of COVID-19 was smaller during the summer due in part to phased re-opening and spatial variability in re-opening, but there were still clear variations once total loads were broken down zonally. Monthly data at the state scale showed an increase in state-level residential electricity sales, a decrease in commercial sales, and a small net decrease in total sales in most states from April-August 2020. Analyses that focus on total load or a single scale may miss important changes that become apparent when the load is broken down regionally or by customer class.

COVID-19, electricity demand, multiscale, Commonwe↗

DOE OSTI2021

The effect of price-based demand response on carbon emissions in European electricity markets: The importance of adequate carbon prices

Price-based demand response (PBDR) has recently been attributed great economic but also environmental potential. However, the determination of its short-term effects on carbon emissions requires the knowledge of marginal emission factors (MEFs), which compared to grid mix emission factors (XEFs), are cumbersome to calculate due to the complex characteristics of national electricity markets. This study, therefore, proposes two merit order-based methods to approximate hourly MEFs and applies them to readily available datasets from 20 European countries for the years 2017–2019. Based on the calculated electricity prices, standardized daily load shifts were simulated which indicated that carbon emissions increased for 8 of the 20 countries and by 2.1% on average. Thus, under specific circumstances, PBDR leads to carbon emissions increases, mainly due to the economic advantage fuel sources such as lignite and coal have in the merit order. MEF-based load shifts reduced the mean resulting carbon emissions by 35%, albeit with 56% lower monetary cost savings compared to price-based load shifts. Finally, by repeating the load shift simulations for different carbon price levels, the impact of the carbon price on the resulting carbon emissions was analyzed. The Spearman correlation coefficient between carbon intensity and marginal cost along the German merit order substantially increased with increasing carbon price. The coefficients were -0.13 for the 2019 carbon price of 24.9 €/t, 0 for 42.6 €/t, and 0.4 for 100.0 €/t. Therefore, with adequate carbon prices, PBDR can be an effective tool for both economical and environmental improvement.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2021

Reanalysis of Water Withdrawal for Irrigation, Electric Power, and Public Supply Sectors in the Conterminous United States, 1950–2016

Accurately measuring water use by the economy is essential for developing reliable models of water resource availability. Indeed, these models rely on retrospective analyses that provide insights into shifting human population demands and adaptions to water shortages. However, accurate, methodologically consistent, empirically authentic, and spatiotemporally comprehensive historical datasets for water withdrawals are scarce. Herein, we present a reanalysis of annual resolution (1950–2016) historical data set on irrigation, electric power, and public supply water withdrawal within the conterminous United States (US) at the county-level, and, for power plants, at the site-level. To estimate electric power water use, we synthesized a historically comprehensive list of generators and historic patterns in generation across fuels, prime movers, and cooling technologies. Irrigation water use estimation required building a crop-demand model that utilized historical information on irrigated acreage for crops and golf courses, stage-specific crop water demand, and climate information. To estimate public water supply use, we developed a random forest model constructed from information on population, infrastructure, climate, and land cover. These estimates generally agree with total county and state water use information provided by the US Geological Survey (USGS) water use circular and estimates generated from independent studies for specific years. However, we also observed discrepancies between our estimates and USGS data that appear to be caused by inconsistencies in the methods used by the USGS's primary data sources at the state level over decades of data collection, highlighting the importance of reanalysis to yield spatiotemporally consistent and intercomparable estimates of water use.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2026

SpaceNet 9—Cross-Sensor Alignment of Optical and SAR Imagery

Precise registration of high-resolution synthetic aperture radar (SAR) and optical imagery is necessary for realizing the full potential and benefits of multimodal image analysis. However, two significant challenges presently exist. First, there is a lack of annotated datasets and benchmarks available for high-resolution SAR–optical image registration. Second, an assessment of efficient and reliable image registration methods that can precisely align these modalities is lacking. Here, we present a holistic description of the SpaceNet 9 Challenge and its results. We present a description of the dataset and baseline algorithm along with the results of the challenge, including a description of the winning algorithms. We release the SpaceNet 9 dataset along with open-sourcing the winning algorithms and baseline. The objective of SpaceNet 9 was to compute a dense displacement map that indicates the shift needed to align pixels in an optical image to the pixels in a SAR image. The challenge launched in April 2025 and was active for approximately two months. The top five solutions reduced image alignment error from approximately 34 m to under 13 m for public and private test data, with the best results obtaining a registration error of only 8.5 and 6.7 m on the public testing and private testing dataset, respectively. Usage of pretrained image matching models, robust outlier rejection with RANSAC, and estimating local displacement were common among the top solutions. The results of this challenge provide insight into high-resolution SAR–optical image registration and offer opportunities for future benchmarking in this domain. The baseline algorithm, winning solutions, and datasets are available at https://spacenet.ai/sn9-challenge/.

benchmark datasets↗

DOE OSTI2025

The DECADE cosmic shear project III: validation of analysis pipeline using spatially inhomogeneous data

We present the pipeline for the cosmic shear analysis of the Dark Energy Camera All Data Everywhere (DECADE) weak lensing dataset: a catalog consisting of 107 million galaxies observed by the Dark Energy Camera (DECam) in the northern Galactic cap. The catalog derives from a large number of disparate observing programs and is therefore more inhomogeneous across the sky compared to existing lensing surveys. First, we use simulated data-vectors to show the sensitivity of our constraints to different analysis choices in our inference pipeline, including sensitivity to residual systematics. Next we use simulations to validate our covariance modeling for inhomogeneous datasets. Finally, we show that our choices in the end-to-end cosmic shear pipeline are robust against inhomogeneities in the survey, by extracting relative shifts in the cosmology constraints across different subsets of the footprint/catalog and showing they are all consistent within 1σ to 2σ. This is done for forty-six subsets of the data and is carried out in a fully consistent manner: for each subset of the data, we re-derive the photometric redshift estimates, shear calibrations, survey transfer functions, the data vector, measurement covariance, and finally, the cosmological constraints. Our results show that existing analysis methods for weak lensing cosmology can be fairly resilient towards inhomogeneous datasets. This also motivates exploring a wider range of image data for pursuing such cosmological constraints.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

China’s carbon sinks from land-use change underestimated

The size and attribution of the regional net carbon flux from land-use change (LUC) activities (E LUC ) are often highly debated, especially in regions such as China, which has experienced decades-long extensive reforestation activities. Here, in this work, using a LUC dataset incorporating remote-sensing and national forest inventory data with two modelling approaches, we show that E LUC in China shifted from a carbon source to a sink in the 1990s, contributing to a net cumulative CO 2 removal of 2.0 Pg C during 1981–2020. From 2001 to 2020, the average E LUC was -0.14 Pg C yr -1 , accounting for over one-third of the national land carbon sinks. Forest-related LUC activities contributed greatly to national carbon fluxes, while non-forest-related activities played a dominant role in certain areas. Our findings suggest that the carbon sinks from LUC activities in China may be largely underestimated in global assessments, underscoring the need to develop region-specific modelling for evaluation and potential regulation.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

Synthesizing land use and demographic change in Southeast Asia’s smaller urbanized areas from 2000–2015

The majority of the human population now reside in urban areas today. The United Nations estimates that nearly half of all urban dwellers currently live in cities smaller than 500 000 persons and the majority of future urban growth will take place in Asia and Africa, likely in these smaller urban areas, not mega cities. Thus, understanding the factors that influence urban demographic trajectories in small urban areas is critical to address sustainable and equitable policy initiatives related to food security, changing climate hazard exposure, and economic opportunities. Here we focus on Southeast Asia—a region historically characterized by lower urban population proportions, yet with a rapidly shifting dynamic demographic—to examine correlates of demographic change among smaller cities. We combine two open-source satellite-informed datasets: GHS urban center database (2015) and age-sex gridded data from WorldPop to calculate socio-demographic characteristics to model drivers of change in annualized urban population growth from 2000–2015 for 505 urbanized places. We find a general pattern of decreasing dependency ratios as city-size increases for most urban areas in Southeast Asia. Higher rates of growth and more variation is observed for smaller cities—those with fewer than 300 000 persons, the lowest population limit for UN data on urbanization. When examining covariates of urban population growth, we find significant statistical associations of population change in smaller urbanized areas with climatic, economic, and land cover/land use variables, but with country-specific variations. Characterizing a continuum of urban population development in the context of changing environmental, economic and climate conditions has been an important sustainable development and equity issue for decades, but newer analysis of city-level drivers allows for systematic inquiry thus moving beyond total population counts for policy-relevant insight.

Southeast Asia synthesis↗

DOE OSTI2025

The Importance of Being Adaptable: An Exploration of the Power and Limitations of Domain Adaptation for Simulation-Based Inference with Galaxy Clusters

The application of deep machine learning methods in astronomy has exploded in the last decade, with new models showing remarkably improved performance on benchmark tasks. Not nearly enough attention is given to understanding the models' robustness, especially when the test data are systematically different from the training data, or "out of domain." Domain shift poses a significant challenge for simulation-based inference, where models are trained on simulated data but applied to real observational data. In this paper, we explore domain shift and test domain adaptation methods for a specific scientific case: simulation-based inference for estimating galaxy cluster masses from X-ray profiles. We build datasets to mimic simulation-based inference: a training set from the Magneticum simulation, a scatter-augmented training set to capture uncertainties in scaling relations, and a test set derived from the IllustrisTNG simulation. We demonstrate that the Test Set is out of domain in subtle ways that would be difficult to detect without careful analysis. We apply three deep learning methods: a standard neural network (NN), a neural network trained on the scatter-augmented input catalogs, and a Deep Reconstruction-Regression Network (DRRN), a semi-supervised deep model engineered to address domain shift. Although the NN improves results by 17% in the Training Data, it performs 40% worse on the out-of-domain Test Set. Surprisingly, the Scatter-Augmented Neural Network (SANN) performs similarly. While the DRRN is successful in mapping the training and Test Data onto the same latent space, it consistently underperforms compared to a straightforward Yx scaling relation. These results serve as a warning that simulation-based inference must be handled with extreme care, as subtle differences between training simulations and observational data can lead to unforeseen biases creeping into the results.

Ntampaka, Michelle [Baltimore, Space Telescope Sci↗

DOE OSTI2023

Low-Temperature Geothermal Geospatial Datasets: An Example from Alaska

This project is a component of a broader effort focused on geothermal heating and cooling (GHC) with the aim of illustrating the numerous benefits of incorporating GHC and geothermal heat exchange (GHX) into community energy planning and national decarbonization strategies. To better assist private sector investment, it is currently necessary to define and assess the potential of low-temperature geothermal resources. For shallow GHC/GHX fields, there is no formal compilation of subsurface characteristics shared among industry practitioners that can improve system design and operations. Alaska is specifically noted in this work, because heretofore, it has not received a similar focus in geothermal potential evaluations as the contiguous United States. The methodology consists of leveraging relevant data to generate a baseline geospatial dataset of low-temperature resources (less than 150 degrees C) to compare and analyze information accessible to anyone trying to understand the potential of GHC/GHX and small-scale low-temperature geothermal power in Alaska (e.g., energy modelers, communities, planners, and policymakers). Importantly, this project identifies data related to (1) the evaluation of GHC/GHX in the shallow subsurface, and (2) the evaluation of low-temperature geothermal resource availability. Additionally, data is being compiled to assess repurposing of oil and gas wells to contribute co-produced fluids toward the geothermal direct use and heating and cooling resource potential. In this work we identified new data from three different datasets of isolated geothermal systems in Alaska and bottom-hole temperature data from oil and gas wells that can be leveraged for evaluation of low-temperature geothermal resource potential. The goal of this project is to facilitate future deployment of GHC/GHX analysis and community-led programs and update the low-temperature geothermal resources assessment of Alaska. A better understanding of shallow potential for GHX will improve design and operations of highly efficient GHC systems. The deployment and impact that can be achieved for low-temperature geothermal resources will contribute to decarbonization goals and facilitate widespread electrification by shaving and shifting grid loads.

15 GEOTHERMAL ENERGY↗

DOE OSTI2023

KBase Credit Metadata Schema

As part of KBase’s commitment to promote open science, we offer users the ability to obtain a DOI (Digital Object Identifier) for their work, which can then be cited in an associated science publication. To further support the community-wide shift towards FAIR (Findable, Accessible, Interoperable, Reusable) data, KBase is expanding our data descriptors so that KBase DOIs have comprehensive citations for datasets, in addition to referencing publications or software used in the workflow. This helps encourage a culture of giving attribution for all research inputs and outputs; standard practice for literature, but still relatively new for software products or datasets. It also promotes open science by building trust that contributors get credit for their work, and accelerates knowledge discovery by supporting and incentivizing the release of data.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2023

Slater transition methods for core-level electron binding energies

Methods for computing core-level ionization energies using self-consistent field (SCF) calculations are evaluated and benchmarked. These include a “full core hole” (or “ΔSCF”) approach that fully accounts for orbital relaxation upon ionization, but also methods based on Slater’s transition concept in which the binding energy is estimated from an orbital energy level that is obtained from a fractional-occupancy SCF calculation. A generalization that uses two different fractional-occupancy SCF calculations is also considered. The best of the Slater-type methods afford mean errors of 0.3–0.4 eV with respect to experiment for a dataset of K-shell ionization energies, a level of accuracy that is competitive with more expensive many-body techniques. An empirical shifting procedure with one adjustable parameter reduces the average error below 0.2 eV. Here, this shifted Slater transition method is a simple and practical way to compute core-level binding energies using only initial-state Kohn–Sham eigenvalues. It requires no more computational effort than ΔSCF and may be especially useful for simulating transient x-ray experiments where core-level spectroscopy is used to probe an excited electronic state, for which the ΔSCF approach requires a tedious state-by-state calculation of the spectrum. As an example, we use Slater-type methods to model x-ray emission spectroscopy.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2020

How analytic choices can affect the extraction of electromagnetic form factors from elastic electron scattering cross section data

Scientists often try to incorporate prior knowledge into their regression algorithms, such as a particular analytic behavior or a known value at a kinematic endpoint. Unfortunately, there is often no unique way to make use of this prior knowledge, and thus, different analytic choices can lead to very different regression results from the same set of data. In this paper, to illustrate this point in the context of the proton electromagnetic form factors, we use the Mainz elastic data with its 1422 cross section points and 31 normalization parameters. Starting with a complex unbound non-linear regression, we will show how the addition of a single theory-motivated constraint removes an oscillation from the magnetic form factor and shifts the extracted proton charge radius. We then repeat both regressions using the same algorithm, but with a rebinned version of the Mainz dataset. These examples illustrate how analytic choices, such as the function that is being used or even the binning of the data, can dramatically affect the results of a complex regression. These results also demonstrate why it is critical when using regression algorithms to have either a physical model in mind or a firm mathematical basis

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

DOE OSTI2020

Apparatus and method for determining state of change (SOC) and state of health (SOH) of electrical cells

Systems and methods for prediction of state of charge (SOH), state of health (SOC) and other characteristics of batteries using acoustic signals, includes determining acoustic data at two or more states of charge and determining a reduced acoustic data set representative of the acoustic data at the two or more states of charge. The reduced acoustic data set includes time of flight (TOF) shift, total signal amplitude, or other data points related to the states of charge. Machine learning models use at least the reduced acoustic dataset in conjunction with non-acoustic data such as voltage and temperature for predicting the characteristics of any other independent battery.

25 ENERGY STORAGE↗

DOE OSTI2022

Data Curation for Machine Learning Applied to Geothermal Power Plant Operational Data for GOOML: Geothermal Operational Optimization with Machine Learning: Preprint

Geothermal Operational Optimization with Machine Learning (GOOML) is a transferable and extensible component-based geothermal asset modeling framework that considers complex steamfield relationships and identifies optimization prospects using a data-driven approach to physics-guided, data-centric machine learning. This framework has been used to develop digital twins that provide steamfield operators with operational environments to analyze and understand historical and forecasted power production, explore new steamfield configuration possibilities, and seek optimal asset management in real world applications. To create, test, and apply the GOOML framework, diverse time-series datasets spanning multiple years were sourced from various geothermal power plant components within several complex real-world geothermal operations. These operations are based in the United States and New Zealand and include a variety of technologies, end-uses and configurations, collectively covering nearly all relevant operating conditions for modern geothermal fields. Datasets were acquired from multiple sources to ensure that machine learning experiments generalized properly to various operating conditions. It was found that the data varied in quality, format, and completeness. To ensure consistency between the various datasets, a standardized data curation process was developed to reliably streamline data preparation. This paper will discuss best practices as learned from the GOOML data curation process which takes the following steps: 1) acquisition of large quantities of data from power plant operators, 2) digestion of data to gain an initial understanding of what is included, 3) data transformation, which includes converting the data into a standardized machine-readable format so that they can be visualized, quality checked, and cleaned, 4) quality assurance and quality control, involving identification of significant data gaps and apparent anomalies through mapping of data features to real world componentry via the GOOML historical model, followed by discussion with modelers and power plant operators to identify additional data needs and to resolve issues, 5) use in machine learning algorithms, and 6) repetition of steps one through five until all data needs are met and data are deemed suitable for producing trustworthy modeling results which may be disseminated, ideally along with the curated dataset. This iterative process is focused on improving the quality of the data rather than tuning machine learning model parameters and supports a shift towards data-centric AI as a means to improving real-world applicability of geothermal machine learning projects.

access↗

DOE OSTI2023

Apparatus and method for determining state of change (SOC) and state of health (SOH) of electrical cells

Steingart, Daniel Artemis↗

DOE OSTI2024

An overview of the Western United States Dynamically Downscaled Dataset (WUS-D3)

Abstract. Predicting future climate change over a region of complex terrain, such as the western United States (US), remains challenging due to the low resolution of global climate models (GCMs). Yet the climate extremes of recent years in this region, such as floods, wildfires, and drought, are likely to intensify further as climate warms, underscoring the need for high-quality and high-resolution predictions. Here, we present an ensemble of dynamically downscaled simulations over the western US from 1980–2100 at 9 km grid spacing, driven by 16 latest-generation GCMs. This dataset is titled the Western US Dynamically Downscaled Dataset (WUS-D3). We describe the challenges of producing WUS-D3, including GCM selection and technical issues, and we evaluate the simulations' realism by comparing historical results to temperature and precipitation observations. The future downscaled climate change signals are shaped in physically credible ways by the regional model's more realistic coastlines and topography. (1) The mean warming signals are heavily influenced by more realistic snowpack. (2) Mean precipitation changes are often consistent with wetting on the windward side of mountain complexes, as warmer, moister air masses are uplifted orographically during precipitation events. (3) There are large fractional precipitation increases on the lee side of mountain complexes, leading to potentially significant changes in water resources and ecology in these arid landscapes. (4) Increases in precipitation extremes are generally larger than in the GCMs, driven by locally intensified atmospheric updrafts tied to sharper, more realistic gradients in topography. (5) Changes in temperature extremes are different from what is expected by a shift in mean temperature and are shaped by local atmospheric dynamics and land surface feedbacks. Because of its high resolution, comprehensiveness, and representation of relevant physical processes, this dataset presents a unique opportunity to evaluate societally relevant future changes in western US climate.

Rahimi, Stefan (ORCID:0000000331884462)↗

DOE OSTI2021

SFA-VirOmics

PNNL's Soil Microbiome Science Focus Area (SFA) is focused on understanding the basic biology underpinning how interactions among various soil microbial community members, across trophic levels, lead to the emergence of community functions. Moisture, in particular, drives microbial interactions and influences everything from cell function to substrate fate within soils. The group predicts this results in repeatable, predictable phenotypes. The sum of these phenotypes comprises the “soil metaphenome”. Understanding how the soil metaphenome shifts in response to moisture will provide a basis for modeling and predicting these shifts in reaction network responses. Visit the PNNL Soil Microbiome Science Focus Area Program homepage for more information. PNNL’s Soil Microbiome SFA Virome Dataset Annotation page is an extension to the PNNL Soil Microbiome SFA repository on DataHub allows for exploring and downloading integrated experimental omics dataset annotations, associated experimental metadata, pre- and post-processed viral data files, and other associated materials directly related to experimental viral project data.

59 BASIC BIOLOGICAL SCIENCES↗