Search NASA⌕ Search

SEARCH · Search NASA

Results for “dataset shift”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11
All sourcesNASA NTRSDOE OSTI
NASA NTRS2008

Creating User-Friendly Tools for Data Analysis and Visualization in K-12 Classrooms: A Fortran Dinosaur Meets Generation Y

During the summer of 2007, as part of the second year of a NASA-funded project in partnership with Christopher Newport University called SPHERE (Students as Professionals Helping Educators Research the Earth), a group of undergraduate students spent 8 weeks in a research internship at or near NASA Langley Research Center. Three students from this group formed the Clouds group along with a NASA mentor (Chambers), and the brief addition of a local high school student fulfilling a mentorship requirement. The Clouds group was given the task of exploring and analyzing ground-based cloud observations obtained by K-12 students as part of the Students' Cloud Observations On-Line (S'COOL) Project, and the corresponding satellite data. This project began in 1997. The primary analysis tools developed for it were in FORTRAN, a computer language none of the students were familiar with. While they persevered through computer challenges and picky syntax, it eventually became obvious that this was not the most fruitful approach for a project aimed at motivating K-12 students to do their own data analysis. Thus, about halfway through the summer the group shifted its focus to more modern data analysis and visualization tools, namely spreadsheets and Google(tm) Earth. The result of their efforts, so far, is two different Excel spreadsheets and a Google(tm) Earth file. The spreadsheets are set up to allow participating classrooms to paste in a particular dataset of interest, using the standard S'COOL format, and easily perform a variety of analyses and comparisons of the ground cloud observation reports and their correspondence with the satellite data. This includes summarizing cloud occurrence and cloud cover statistics, and comparing cloud cover measurements from the two points of view. A visual classification tool is also provided to compare the cloud levels reported from the two viewpoints. This provides a statistical counterpart to the existing S'COOL data visualization tool, which is used for individual ground-to-satellite correspondences. The Google(tm) Earth file contains a set of placemarks and ground overlays to show participating students the area around their school that the satellite is measuring. This approach will be automated and made interactive by the S'COOL database expert and will also be used to help refine the latitude/longitude location of the participating schools. Once complete, these new data analysis tools will be posted on the S'COOL website for use by the project participants in schools around the US and the world.

Chambers, L. H.↗
DOE OSTI2025

Linking groundwater variability to ecosystem carbon and water use efficiencies across India

Carbon use efficiency (CUE) and water use efficiency (WUE) are important indicators of ecosystem health, reflecting the balance between carbon uptake and allocation, and the relationship between carbon assimilation and water loss. Although India shows large spatiotemporal variation in water table depth (WTD), and increasing groundwater stress, the influence of WTD on ecosystem functioning remains underexplored. This study uses satellite-based, modeled, and in-situ datasets to (1) quantify variations in CUE and WUE under shallow (SWTD) and deep (DWTD) WTD conditions across six homogeneous meteorological regions (HMRs), (2) evaluate temporal roles of gross primary productivity (GPP), net primary productivity (NPP), and evapotranspiration (ET) in driving these efficiencies, and (3) examine temporal responses to WTD shifts. SWTD regions generally showed 12 to 18 % higher GPP, 10 to 15 % higher NPP, and 10 to 20 % higher ET than DWTD zones, especially in semi-arid croplands and forests, leading to 8 to 12 % higher CUE and WUE. However, in humid and heavily irrigated regions such as northeastern and hilly India, CUE was up to 10 % higher in DWTD zones, possibly due to reduced respiration and better soil aeration compared to SWTD areas affected by waterlogging. During the Kharif (wet) season, DWTD croplands in humid zones had higher efficiencies, while in the Rabi (dry) season, SWTD croplands in northern India benefited from irrigation and cooler temperatures. These results highlight strong influence of WTD on carbon and water use processes and support the need for region-specific groundwater strategies.

Carbon use efficiency↗
DOE OSTI2023

Development of a hardware-in-the-loop testbed for laboratory performance verification of flexible building equipment in typical commercial buildings

The goals of reducing energy costs, shifting electricity peaks, increasing the use of renewable energy, and enhancing the stability of the electric grid can be met in part by fully exploiting the energy flexibility potential of buildings and building equipment. The development of strategies that exploit these flexibilities could be facilitated by publicly available high-resolution datasets illustrating how control of HVAC systems in commercial buildings can be used in different climate zones to shape the energy use profile of a building for grid needs. This article presents the development and integration of a Hardware-In-the-Loop Flexible load Testbed (HILFT) that integrates physical HVAC systems with a simulated building model and simulated occupants with the goal of generating datasets to verify load flexibility of typical commercial buildings. Compared to simulation-only experiments, the hardware-in-the-loop approach captures the dynamics of the physical systems while also allowing efficient testing of various boundary conditions. The HILFT integration in this article is achieved through the co-simulation among various software environments including LabVIEW, MATLAB, and EnergyPlus. Although theoretically viable, such integration has encountered many real-world challenges, such as: 1) how to design the overall data infrastructure to ensure effective, robust, and efficient integration; 2) how to avoid closed-loop hunting between simulated and emulated variables; 3) how to quantify system response times and minimize system delays; and 4) how to assess the overall integration quality. Lessons-learned using the examples of an AHU-VAV system, an air-source heat pump system, and a water-source heat pump system are presented.

Chen, zhelun↗
NASA NTRS2015

Contribution of Phenological and Physiological Variations on Northern Vegetation Productivity Changes over Last Three Decades

Plant phenology and maximum photosynthetic state determine spatiotemporal variability of gross primary productivity (GPP) of vegetation. Recent warming induced impacts accelerate shifts of phenology and physiological status over Northern vegetated land. Thus, understanding and quantifying these changes are very important. Here, we investigate 1) how vegetation phenology and physiological status (maximum photosynthesis) are evolved over last three decades and 2) how such components (phenology and physiological status) contribute on inter-annual variation of the GPP during the last three decades. We utilized both long-term remotely sensed (GIMMS (Global Inventory Modeling and Mapping Studies), NDVI3g (Normalized Difference Vegetation Index 3rd generation) and MODIS (Moderate Resolution Imaging Spectroradiometer)) to extract larger scale phenology metrics (growing season start, end and duration); and productivity (i.e., growing season integrated vegetation index, GSIVI) to answer these questions. For evaluation purpose, we also introduced field-measured phenology and productivity datasets (e.g., FLUXNET) and possible remotely-sensed and modeled metrics at continental and regional scales. From this investigation, we found that onset of the growing season has advanced by 1.61 days per decade and the growing season end has delayed by 0.67 days per decade over the circumpolar region. This asymmetric extension of growing season results in a longer growing-season trend (2.96 days per decade) and widespread increasing vegetation-productivity trend (2.96 GSIVI per decade) over Northern land. However, the regionally-diverged phenology shift and maximum photosynthetic state contribute differently characterized productivity, inter-annual variability and trend. We quantified that about 50 percent, 13 percent and 6.5 percent of Northern land's inter-annual variability are dominantly controlled by the onset of the growing season, the end of the growing season and the maximum photosynthetic state, respectively. Productivity characterization over the other approximately 30 percent region has been driven by these co-dominant drivers. Our study clearly shows that regionally different contribution of phenological and physiological components on characterizing vegetation production over the last three decades.

productivity↗
NASA NTRS2019

Comparing ASCAT and CYGNSS Winds near Tropical Convection

Gradient Features identified in ASCAT (Advanced Scatterometer) data correspond well to observed CYGNSS (Cyclone Global Navigation Satellite System) wind shifts: Comparing ASCAT and CYGNSS winds near tropical convection. Gradient wind magnitude in ASCAT observations has been recently shown to be a useful proxy for the presence of tropical convection cold pools. To help confirm this in the vicinity of precipitation we perform a comparison with the L-band CYGNSS wind dataset. Integrated Multi-satellite Retrievals for GPM (Global Precipitation Measurement)) IMERG.

Convection↗
DOE OSTI2024

A machine learning approach for determining temperature-dependent bandgap of metal oxides utilizing Allen–Heine–Cardona theory and O’Donnell model parameterization

To evaluate the high temperature sensing properties of metal oxide and perovskite materials suitable for use in combustion environments, it is necessary to understand the temperature dependence of their bandgaps. Although such temperature-driven changes can be calculated via the Allen–Heine–Cardona (AHC) theory, which assesses electron–phonon coupling for the bandgap correction at given temperatures, this approach is computationally demanding. Another approach to predict bandgap temperature-dependence is the O’Donnell model, which uses analytical expressions with multiple fitting parameters that require bandgap information at 0 K. This work employs data-driven Gaussian process regression (GPR) to predict the parameters employed in the O’Donnell model from a set of physical features. We use a sample of 54 metal oxides for which density functional theory has been performed to calculate the bandgap at 0 K, and the AHC calculations have been carried out to determine the shift in the bandgap at non-zero temperatures. As the AHC calculations are impractical for high-throughput screening of materials, the developed GPR model attempts to alleviate this issue by predicting the O'Donnell parameters purely from physical features. To mitigate the reliability issues arising from the very small size of the dataset, we apply a Bayesian technique to improve the generalizability of the data-driven models as well as quantify the uncertainty associated with the predictions. The method captures well the overall trend of the O’Donnell parameters with respect to a reduced feature set obtained by transforming the available physical features. Quantifying the associated uncertainty helps us understand the reliability of the predictions of the O’Donnell parameters and, therefore, the bandgap as a function of temperature for any novel material.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Multi-INT Signature Collection and Exploitation for Security Los Alamos LDRD Report

This project demonstrates the feasibility of a 2-D passive tracking capability for ground-based and airborne moving sources using multi-INT signal processing of acoustic and seismic signals. We leveraged the recent DDSTE-supported investment in rapid deployable sensors (the Los Alamos Rapid-deployable Sensor Array—LARSA), and used uncrewed aerial vehicles (UAV) as a data source. Moving source types are characterized by their variability with time (exemplified but not limited to the Doppler shift of a passing vehicle) and the signatures used for detection should have similar characteristics. We have demonstrated that time-varying sensor signatures (TVS) combined with time-stable sensor signatures provide a more complete understanding of moving source behavior and drive towards path prediction. Importantly, we have collected a new, relevant LANL dataset of moving sources (small UAV flights and vehicle movement), developed new signatures, and demonstrated a capability to identify, track and forecast the position of TVS.

42 ENGINEERING↗
DOE OSTI2025

RINO: Renormalization Group Invariance with No Labels

A common challenge with supervised machine learning (ML) in high energy physics (HEP) is the reliance on simulations for labeled data, which can often mismodel the underlying collision or detector response. To help mitigate this problem of domain shift, we propose RINO (Renormalization Group Invariance with No Labels), a self-supervised learning approach that can instead pretrain models directly on collision data, learning embeddings invariant to renormalization group flow scales. In this work, we pretrain a transformer-based model on jets originating from quantum chromodynamic (QCD) interactions from the JetClass dataset, emulating real QCD-dominated experimental data, and then finetune on the JetNet dataset -- emulating simulations -- for the task of identifying jets originating from top quark decays. RINO demonstrates improved generalization from the JetNet training data to JetClass data compared to supervised training on JetNet from scratch, demonstrating the potential for RINO pretraining on real collision data followed by fine-tuning on small, high-quality MC datasets, to improve the robustness of ML models in HEP.

Hao, Zichun [Caltech] (ORCID:0000000256244907)↗
DOE OSTI2020

Chemometric modeling of power conversion efficiency of organic dyes in dye sensitized solar cells for the future renewable energy

The present study reports chemometric modeling of power conversion efficiency (PCE) of dye sensitized solar cells (DSSCs) using the biggest available data set till date which comprises around 1200 dyes covering 7 chemical classes. To extract the best structural features required for higher PCE, we have developed multiple partial least squares (PLS) quantitative structure-property relationship (QSPR) models for the Triphenylamine, Phenothiazine, Indoline, Porphyrin, Coumarin, Carbazole and Diphenylamine chemical classes using descriptors derived from the best subset selection method followed by selection of best five models in each dataset based on the Mean Absolute Error (MAE) values. The models were validated both internally and externally followed by the consensus predictions employing “Intelligent Consensus Predictor” tool to examine whether the quality of predictions can be improved with the “intelligent” selection of multiple PLS models. The quality of predictions for the respective external sets showed that the consensus models (CM) are better than the individual models (IM) in most of the cases. From the insights of the developed models, we concluded that attributes like a packed structure toward higher conductivity of electrons, auxiliary donor fragment of aromatic tertiary amines, number of thiophenes inducing the bathochromic shift and augmenting the absorption, presence of additional electron donors, enhancement of electron-donating abilities, number of non-aromatic conjugated C(sp 2 ) which helps as conjugation extension units to broaden the absorption and highly conjugated $π$-systems exert positive contributions to the PCE. On the contrary, features negatively contributing to PCE are the followings: fragments which lower the tendency of localized $π–π*$ transition, fragments related to larger volume and surface area of dyes along with hydrophobicity resulting in poor adhesion, fragment RC = N causing dye hydrolysis, steric hindrance for π electronic mobility, fragments enhancing polarity, etc. Finally, the identified features from the best QSPR model of the coumarin dataset was employed in designing of ten more efficient coumarin dyes (predicted %PCE ranging from 8.93 to 10.62) than the existing ones.

14 SOLAR ENERGY↗
DOE OSTI2026

Validation of Hermes-3 turbulence simulations against the TCV-X21 diverted L-mode reference case

Electrostatic flux-driven turbulence simulations with the Hermes-3 code are performed in TCV L-mode conditions in forward and reversed toroidal field configurations, and compared to the TCV-X21 reference dataset (Oliveira et al 2022 Nucl. Fusion 62 096001) qualitatively and with a quantitative methodology. Using only the magnetic equilibrium, total power across the separatrix (120 kW) and total particle flux to the targets (3 x 10 21 s −1 ) as inputs, the simulations produce time-averaged plasma profiles in good agreement with experiment. Shifts in the target peak location when the toroidal field direction is reversed are reproduced in simulation, including the experimentally observed splitting of the outer strike point into two density peaks. The overall normalized discrepancy between simulation and observation is better than any previously reported in the reversed field configuration, and matches the best previously reported in forward field configuration. Differences between simulation and experiment include density profiles inside the separatrix and at the inner target in forward (favorable $\bigtriangledown B$) field configuration. These differences in target temperature in forward field configuration lead to differences in the balance of current to the inner and outer divertor in the private flux region. The cause of these differences is most likely the lack of neutral gas in these simulations, indicating that even in low recycling regimes neutral gas plays an important role in determining edge plasma profiles. These conclusions are consistent with findings in Oliveira et al (2022 https://github.com/SPCData/TCV-X21).

Physics - Plasma physics↗
DOE OSTI2020

Quasi-stationary Planetary Scale Waves in Modern Climate Models

We evaluate climate model simulations of geopotential height at the largest space-time scales, considering the first Fourier components (in longitude) of long-term climatological means. Quasi-stationary planetary scale waves emerge from this analysis. Variations of these waves are important components of climate change, for example associated with regional drought. Systematic examination of their long-term climatology provides context for understanding their evolution in time. We compare four reanalysis datasets with “historical runs” from the latest version of the Coupled Model Intercomparison Project (CMIP) and find general agreement, but we also identify model errors outside the range of both observational uncertainty and the uncertainty implied by interannual variability. Errors in wave phase have possible implications for climate model projections of regional climate and of shifting weather patterns. One model in the set we examine, originally created nearly 20 years before the others, exhibits noticeably greater errors.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Graph learning for particle accelerator operations

Particle accelerators play a crucial role in scientific research, enabling the study of fundamental physics and materials science, as well as having important medical applications. This study proposes a novel graph learning approach to classify operational beamline configurations as good or bad. By considering the relationships among beamline elements, we transform data from components into a heterogeneous graph. We propose to learn from historical, unlabeled data via our self-supervised training strategy along with fine-tuning on a smaller, labeled dataset. Additionally, we extract a low-dimensional representation from each configuration that can be visualized in two dimensions. Leveraging our ability for classification, we map out regions of the low-dimensional latent space characterized by good and bad configurations, which in turn can provide valuable feedback to operators. This research demonstrates a paradigm shift in how complex, many-dimensional data from beamlines can be analyzed and leveraged for accelerator operations.

43 PARTICLE ACCELERATORS↗
DOE OSTI2024

Algorithms for Non-Negative Matrix Factorization on Noisy Data With Negative Values

Non-negative matrix factorization (NMF) is a dimensionality reduction technique that has shown promise for analyzing noisy data, especially astronomical data. For these datasets, the observed data may contain negative values due to noise even when the true underlying physical signal is strictly positive. Prior NMF work has not treated negative data in a statistically consistent manner, which becomes problematic for low signal-to-noise data with many negative values. In this paper we present two algorithms, Shift-NMF and Nearly-NMF, that can handle both the noisiness of the input data and also any introduced negativity. Both of these algorithms use the negative data space without clipping or masking and recover non-negative signals without any introduced positive offset that occurs when clipping or masking negative data. We demonstrate this numerically on both simple and more realistic examples, and prove that both algorithms have monotonically decreasing update rules.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2023

Weak phylogenetic and habitat effects on root trait variation of 218 Neotropical tree species

Tropical forests harbor a large diversity of closely related tree species that can thrive across habitats. This biodiversity has been found to correspond to large functional diversity in aboveground traits, and likely also relates to belowground trait variation. Globally, root trait (co-)variation is driven by different belowground resource strategies of species, environmental variation, and phylogeny; however, these patterns mostly reflect observations from temperate biomes and remain unconfirmed in tropical trees. We examine phylogenetic and environmental effects on root trait (co-)variation of trees across habitats in an Amazonian rainforest. Roots of 218 tree species from ten dominant families were sampled across three major habitats near Manaus, Brazil. We quantified five morphological and architectural root traits to (i) investigate how they reflected different resource strategies across species, (ii) compare them between families and superorders to test phylogenetic effects, and (iii) compare them between habitats to determine environmental effects on root trait expressions and variability. Root traits discriminated species along a tradeoff between root diameter and root branching and, secondly, due to variation in root tissue density. Our results further show weak phylogenetic effects on tropical tree root variation, for example, families from the same superorder showed large divergence in their root traits, while those from different superorders often overlapped in their root morphology and architecture. Root traits differed significantly between habitats but habitat type had only little effect on overall root trait variation. Our work suggests that the dimensions and drivers that underlie (co-)variation in tropical root traits may differ from global patterns defined by mostly temperate datasets. Due to (a)biotic environmental differences, different root trait dimensions may underlie the belowground functional diversity in (Neo)tropical forests, and we found little evidence for the strong phylogenetic conservatism observed in root traits in temperate biomes. We highlight important avenues for future research on tropical roots in order to determine the degree of, and shifts in functional diversity belowground as communities and environments change in tropical forests.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2021

Jobos Bay Water Resources: Using Earth Observations to Analyze Shoreline Changes and Understand the Effects of Sea Level Rise in Southern Puerto Rico

Jobos Bay is located on the southern coast of Puerto Rico, which is known for intense hurricane seasons and increased seasonal storm surge. Scientists at Jobos Bay National Estuarine Research Reserve (JBNERR) are concerned that sea level rise will exacerbate coastal damage from these weather events. Using NASA Earth observations, our team analyzed coastal change, land use land cover change (LULC), mangrove forest extent, and water quality of Jobos Bay. Using Google Earth Engine, we evaluated coastal change and mangrove forest habitat within the study region by classifying NASA Earth observation imagery. We created historic LULC composite images to observe how land use changes over time and improve understanding of urbanization in the watershed. Leveraging previous water quality studies, our team compared water quality datasets generated by the Optical Reef and Coastal Area Assessment (ORCAA) tool to in situ sensors provided by JBNERR partners to understand the overall quality of water in the study area with respect to turbidity, chlorophyll-a, sea surface temperature, and colored dissolved organic matter (CDOM) concentrations. We discovered that 17% of the reserve has shifted from land to water since 1997 and lost 4.85 square kilometers of mangrove habitat over the past decade. Results from this study will inform the scientists of JBNERR and community members of the regional impacts of sea level rise. Being the first comprehensive study done in the estuary in nearly a decade, this serves as a baseline for future conservation efforts and research in the estuary.

Olivia Spencer↗
DOE OSTI2021

Gaussian processes for autonomous data acquisition at large-scale synchrotron and neutron facilities

The execution and analysis of complex experiments are challenged by the vast dimensionality of the underlying parameter spaces. Although an increase in data-acquisition rates should allow broader querying of the parameter space, the complexity of experiments and the subtle dependence of the model function on input parameters remains daunting owing to the sheer number of variables. New strategies for autonomous data acquisition are being developed, with one promising direction being the use of Gaussian process regression (GPR). GPR is a quick, non-parametric and robust approximation and uncertainty quantification method that can be applied directly to autonomous data acquisition. We review GPR-driven autonomous experimentation and illustrate its functionality using real-world examples from large experimental facilities in the USA and France. We introduce the basics of a GPR-driven autonomous loop with a focus on Gaussian processes, and then shift the focus to the infrastructure that needs to be built around GPR to create a closed loop. Finally, the case studies we discuss show that Gaussian-process-based autonomous data acquisition is a widely applicable method that can facilitate the optimal use of instruments and facilities by enabling the efficient acquisition of high-value datasets.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Pervasive shifts in forest dynamics in a changing world

Forest dynamics arise from the interplay of environmental drivers and disturbances with the demographic processes of recruitment, growth, and mortality, subsequently driving biomass and species composition. However, forest disturbances and subsequent recovery are shifting with global changes in climate and land use, altering these dynamics. Changes in environmental drivers, land use, and disturbance regimes are forcing forests toward younger, shorter stands. Rising carbon dioxide, acclimation, adaptation, and migration can influence these impacts. Recent developments in Earth system models support increasingly realistic simulations of vegetation dynamics. In parallel, emerging remote sensing datasets promise qualitatively new and more abundant data on the underlying processes and consequences for vegetation structure. In combination, these advances hold promise for improving the scientific understanding of changes in vegetation demographics and disturbances.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Attribute-Guided Adversarial Training for Robustness to Natural Perturbations

We report while existing work in robust deep learning has focused on small pixel-level norm-based perturbations, this may not account for perturbations encountered in several real world settings. In many such cases although test data might not be available, broad specifications about the types of perturbations (such as an unknown degree of rotation) may be known. We consider a setup where robustness is expected over an unseen test domain that is not i.i.d. but deviates from the training domain. While this deviation may not be exactly known, its broad characterization is specified a priori, in terms of attributes. We propose an adversarial training approach which learns to generate new samples so as to maximize exposure of the classifier to the attributes-space, without having access to the data from the test domain. Our adversarial training solves a min-max optimization problem, with the inner maximization generating adversarial perturbations, and the outer minimization finding model parameters by optimizing the loss on adversarial perturbations generated from the inner maximization. We demonstrate the applicability of our approach on three types of naturally occurring perturbations --- object-related shifts, geometric transformations, and common image corruptions. Our approach enables deep neural networks to be robust against a wide range of naturally occurring perturbations. We demonstrate the usefulness of the proposed approach by showing the robustness gains of deep neural networks trained using our adversarial training on MNIST, CIFAR-10, and a new variant of the CLEVR dataset.

97 MATHEMATICS AND COMPUTING↗