Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

NASA Giovanni: Analyze, Compare, and Visualize 2000+ Earth Satellite and Model Variables Without Downloading Data and Software

Over vast oceans and remote continents, observations are often scarce and discontinuous. Satellite and model data play a critical role in research and applications. However, finding and accessing satellite and model data can be a daunting task for many, especially those outside the community. The NASA Goddard Earth Sciences (GES) Data and Information Services Center (DISC), one of 12 NASA Science Mission Directorate Data Centers, provides Earth science data, information, and services to everyone such as researchers, application users, educators, and students. GES DISC archives and supports datasets applicable to several NASA Earth Science Focus Areas including Atmospheric Composition, Water & Energy Cycles, Carbon Cycle & Ecosystem, and Climate Variability. To facilitate data discovery, evaluation, and exploration, GES DISC has developed the Geospatial Interactive Online Visualization ANd aNalysis Infrastructure (Giovanni), an online tool to analyze and visualize NASA remote sensing and model data without downloading data and software. As of this writing, over 2000 Earth satellite and model variables are available in Giovanni, including several wellknown NASA satellite missions (e.g., TRMM, GPM) and projects (e.g., MERRA-2, GPCP). Giovanni provides twenty-two plots that can be used to analyze, compare, and explore Earth data across different disciplines. Results can be shared with colleagues and downloaded for further analysis. Over the years, Giovanni has helped publish over 3000 referral papers. In this presentation, we will showcase key variables and plot types in Giovanni with examples. In particular, we will present several popular precipitation products from GPM and CPCP for evaluation and comparison.

data analysis↗

Using "AI Poincare" to analyze non-linear integrable optics

This study dives into the applicability of using automated discovery of conserved quantities in dynamical systems relevant to accelerator physics. Specifically, we explore the performance of AI Poincaré in analyzing numerical trajectory data obtained using the McMillan system of non-linear integrable optics. A comprehensive evaluation of the algorithm's performance is conducted through diverse methodologies. These include the analysis of the estimated number of conserved quantities embedded in a dataset and the deviation of interpolated points on the inferred manifold with respect to points in actually in the dataset. the investigation identifies an optimal range of perturbation distances where the underlying manifold extraction algorithm inside AI Poincaré exhibits optimal performance. Additionally, an improved neural network architecture is proposed based on the observed results. Finally, we apply the algorithm to preliminary experimental data from the Integrable Optics Test Accelerator at Fermilab to successfully infer the number of conserved quantities even in the presence of fast decoherence of the measured signal.

Osmanov, Lazare [Free U. Tbilisi]↗

CaloTrilogy: Toward a Breakthrough in One-Step, End-to-End, Physics-Guided Shower Generation for Modern Calorimeters

High-precision calorimeter simulation at current and future colliders imposes rapidly growing computational demands, motivating the development of machine-learning surrogates for traditional Monte Carlo tools such as Geant4. Flow matching and diffusion-based generative models have become leading approaches for high-dimensional fast simulation because of their sample quality, but typically require ${\cal O}(100)$ function evaluations at inference and often rely on auxiliary networks to constrain global observables, compromising streamlined end-to-end generation. We introduce a unified framework that improves the balance between speed, shower quality, and physics fidelity. The method combines: (i) an average velocity field integrator that enables sampling in one or a few evaluations; (ii) a learned generative prior in shower space, constructed from data rather than random noise; and (iii) physics-guided loss terms that impose inductive biases on key observables during training. These elements are training time regularizers, preserving end-to-end inference with no additional cost. With only one or a few evaluation steps, the model achieves shower quality competitive with state-of-the-art flow and diffusion approaches, tested on several public high granularity calorimeter datasets. The results demonstrate inter-layer shower structure consistent with the underlying physics, providing a strong candidate for future fast simulation workflows.

Jiang, Cheng [Edinburgh U.]↗

Evaluation of present-day extreme precipitation over the United States: an inter-comparison of convection and dynamic permitting configurations of E3SMv1

Abstract Accurate simulation of the present-day characteristics of mean and extreme precipitation at regional scales remains a challenge for Earth system models, which is due in part to deficiencies in model physics such as convective parameterization (CP), and coarse resolution. High horizontal resolution (HR, ∼25 km) and multiscale modeling framework (MMF, i.e. replacing conventional CP with embedded km-scale cloud-resolving models) are two promising directions that could help improve the interaction between subgrid-scale physical processes and large-scale climate. Here, we evaluate simulated extreme precipitation over the United States (US) across three configurations (i.e. low-resolution [LR], HR, and MMF) of the Energy Exascale Earth System Model (E3SMv1) and intercompare them against two gridded observation datasets (climate prediction center daily US precipitation and integrated multi-satellite retrievals for global precipitation measurement). We assess the model’s ability to simulate very heavy seasonal precipitation (illustrated by the difference between the 99th and 90th percentile values) as well as the spatial distributions of several extreme precipitation indices defined by the expert team on climate change detection and indices. Our results show that both the dry (i.e. consecutive dry days (CDD)) and wet (i.e. consecutive wet days, maximum 5 day precipitation, and very wet days) extremes evaluated herein show some improvement as well as degradation with MMF and HR relative to LR. These results vary across seasons and US subregions. For instance, only the very heavy precipitation of winter is improved with MMF and HR. Both configurations alleviate the well-known drizzling bias evident in LR across both winter and summer in many parts of the US, largely due to the overall improvement in intensity and frequency of precipitation. Additionally, our results suggest that while E3SMv1-MMF has higher intensity rates when it does rain, it has too many CDD during the summer, contributing to a low mean precipitation bias.

54 ENVIRONMENTAL SCIENCES↗

Assembly of 500,000 inter-specific catfish expressed sequence tags and large scale gene-associated marker development for whole genome association studies

Background-Through the Community Sequencing Program, a catfish EST sequencing project was carried out through a collaboration between the catfish research community and the Department of Energy's Joint Genome Institute. Prior to this project, only a limited EST resource from catfish was available for the purpose of SNP identification. Results-A total of 438,321 quality ESTs were generated from 8 channel catfish (Ictalurus punctatus) and 4 blue catfish (Ictalurus furcatus) libraries, bringing the number of catfish ESTs to nearly 500,000. Assembly of all catfish ESTs resulted in 45,306 contigs and 66,272 singletons. Over 35percent of the unique sequences had significant similarities to known genes, allowing the identification of 14,776 unique genes in catfish. Over 300,000 putative SNPs have been identified, of which approximately 48,000 are high-quality SNPs identified from contigs with at least four sequences and the minor allele presence of at least two sequences in the contig. The EST resource should be valuable for identification of microsatellites, genome annotation, large-scale expression analysis, and comparative genome analysis. Conclusions-This project generated a large EST resource for catfish that captured the majority of the catfish transcriptome. The parallel analysis of ESTs from two closely related Ictalurid catfishes should also provide powerful means for the evaluation of ancient and recent gene duplications, and for the development of high-density microarrays in catfish. The inter- and intra-specific SNPs identified from all catfish EST dataset assembly will greatly benefit the catfish introgression breeding program and whole genome association studies.

99 GENERAL AND MISCELLANEOUS↗

Unraveling the Threads of Environmental Justice in Critical Mineral Extraction: A Framework for Regionalized Life Cycle Data

As we transition to a more sustainable energy system, the extraction and processing of critical minerals becomes increasingly important. However, these industries often raise concerns about environmental and social impacts, particularly in disadvantaged communities. To address these concerns, our research focuses on regionalizing environmental life cycle data to connect it with communities affected by mineral extraction. A framework was developed for collecting life cycle background data that supports the Justice40 Toolset, a market-based approach to evaluating net benefits and costs of critical mineral material recovery pathways. A goal was to alleviate public skepticism around mineral extraction processes, including secondary and unconventional feedstocks, by highlighting both environmental and social impacts. To achieve this, computational analysis and geospatial data science techniques were employed, such as within-scale and across-scale methods and proxy dataset usage. By doing so, we were able to develop a framework for identifying and disaggregating data down to regions small enough to support Justice40 goals. Our approach not only provides valuable tools fo insight into the environmental implications of mineral extraction but also helps policymakers evaluate the social impacts on local communities. This research contributes to a more just and equitable transition to a sustainable energy system, ensuring that marginalized voices are heard in decision-making process.

Davis, Tyler [NETL Site Support Contractor, Nation↗

New Particle Formation Event Dataset at the Southern Great Plains (SGP) Observatory from 2018 to 2023

This data set contains observations of new particle formation (NPF) events collected at the U.S. Department of Energy’s Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) observatory from 2018 to 2023. Measurements include particle number size distributions, radiance measurements, and associated meteorological variables from onsite instrumentation relevant for identifying and characterizing NPF events. Events were identified using standardized criteria and documented to support investigations of aerosol nucleation, growth dynamics, and their interactions with local atmospheric conditions. The data set provides a multi-year record that enables evaluation of seasonal and interannual variability in NPF occurrence and intensity at a mid-continental site. These data are intended to support studies of aerosol-cloud-climate interactions and model evaluation within both ARM and the broader atmospheric science community. More information can be found within the README_NPF_SGP_2018_2023.docx file.

event↗

Longitudinal data analysis in support of functional stability concepts for leachate management at closed municipal landfills

Highlights: • Longitudinal data analysis using a mixed-effects regression model. • Dataset consisted of a total of 1402 samples from 101 closed municipal landfills. • Target analytes and classes generally showed predictable degradation trends. • Validates historical studies focused on macro organic indicators such as BOD. • BOD can serve as “gateway” indicator for planning leachate management. - Abstract: Landfill functional stability provides a target that supports no environmental threat at the relevant point of exposure in the absence of active control systems. With respect to leachate management, this study investigates “gateway” indicators for functional stability in terms of the predictability of leachate characteristics, and thus potential threat to water quality posed by leachate emissions. Historical studies conducted on changes in municipal solid waste (MSW) leachate concentrations over time (longitudinal analysis) have concentrated on indicator compounds, primarily chemical oxygen demand (COD) and biochemical oxygen demand (BOD). However, validation of these studies using an expanded database and larger constituent sets has not been performed. This study evaluated leachate data using a mixed-effects regression model to determine the extent to which leachate constituent degradation can be predicted based on waste age or operational practices. The final dataset analyzed consisted of a total of 1402 samples from 101 MSW landfills. Results from the study indicated that all leachate constituents exhibit a decreasing trend with time in the post-closure period, with 16 of the 25 target analytes and aggregate classes exhibiting a statistically significant trend consistent with well-studied indicators such as BOD. Decreasing trends in BOD concentration after landfill closure can thus be considered representative of trends for many leachate constituents of concern.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Utah FORGE: Triaxial Direct Shear Results - February 2025

This dataset contains results from nine triaxial direct shear tests conducted by Los Alamos National Laboratory on samples from FORGE Well 16A(78)-32. The primary objectives of this work were to determine the shear strength in both intact and residual states, evaluate dilation against displacement, assess permeability in relation to displacement, time, and normal stress, understand the relationship between aperture and normal stress, and monitor the effluent chemistry as a function of time. The data includes time-series measurements of stress, displacement, permeability, and effluent chemistry, with and without experimental dilution corrections. Additional materials include profilometry data, photographic documentation of the experimental setups and apparatus, and test notes. The dataset is organized into folders corresponding to each test, containing hydromechanical data, effluent chemistry measurements, and images. The hydromechanical data consists of detailed time-series records capturing parameters such as shear force, confining pressure, permeability, and temperature. Effluent chemistry data tracks fluid composition changes over time. Also included are conference papers, presentation slides, and a summary document outlining the experiments.

15 GEOTHERMAL ENERGY↗

Machine Learning meets Algebraic Combinatorics: A Suite of Benchmark Datasets to Accelerate AI for Mathematics Research

The use of benchmark datasets has become an important engine of progress in machine learning (ML) over the past 15 years. Recently there has been growing interest in utilizing machine learning to drive advances in research-level mathematics. However, off-the-shelf solutions often fail to deliver the types of insights required by mathematicians. This suggests the need for new ML methods specifically designed with mathematics in mind. The question then is: what benchmarks should the community use to evaluate these? On the one hand, toy problems such as learning the multiplicative structure of small finite groups have become popular in the mechanistic interpretability community whose perspective on explainability aligns well with the needs of mathematicians. While toy datasets are a useful benchmark for initial work, they lack the scale, complexity, and sophistication of many of the principal objects of study in modern mathematics. To address this, we introduce a new collection of benchmark datasets, Algebraic Combinatorics Benchmarks (ACBench), representing either classic or open problems in algebraic combinatorics, a subfield of mathematics that studies discrete structures arising from abstract algebra. After describing the datasets, we discuss the challenges involved in constructing “good” mathematics benchmarks, describe baseline model performance, and discuss some of the insights these datasets can provide that may be of interest even to those who are not interested in mathematics research itself.

97 MATHEMATICS AND COMPUTING↗

Evaluating offshore legacy wells for geologic carbon storage: A case study from the Galveston and Brazos areas in the Gulf of Mexico

In this article, federal offshore waters in the Gulf of Mexico are of interest for large-scale geologic carbon storage (GCS). However, more than 80,000 offshore oil and gas wells exist in the region, which could impact the integrity of sealing intervals. In this study, we propose a screening methodology for ranking offshore legacy wells based on the challenge they may present to GCS. The methodology relies on the review of well regulatory records to 1) identify leakage pathways and assess the potential hazards that wells pose to planned GCS operations, 2) evaluate well features that impact the accessibility of wells to determine the feasibility of potential corrective actions, and 3) rank wells based on the overall challenge they may pose for GCS. We demonstrate our framework by evaluating the construction and abandonment of 156 wells across eight areas of interest (AOIs) in shallow federal waters along the Texas Gulf Coast. The majority (99.3 %) of wells considered were constructed and plugged in a manner that did not isolate prospective GCS targets in the Upper and Lower Miocene formations and may potentially require a challenging or uncertain corrective action prior to GCS. Dataset trends suggest that the observed well construction and plugging designs may be common in shallow offshore federal waters along the Texas Gulf Coast. Consequently, operators pursuing offshore GCS projects in the region may consider selecting areas that avoid challenging wells or performing robust evaluations of legacy well leakage risks to plan corrective action prior to CO 2 injection.

58 GEOSCIENCES↗

Carbon and Nitrogen Stocks and Fluxes at ORNL FACE, Oak Ridge, Tennessee, 1998-2008

This dataset contains carbon (C) and nitrogen (N) stocks and fluxes from the Oak Ridge National Laboratory Free-Air Carbon Dioxide Enrichment (ORNL FACE) Experiment located in Oak Ridge, TN from 1998-2008. Measurements include net primary production, mass and productivity of dry mass, C, and N in wood, leaf, coarse root, and fine root fractions, leaf trait characteristics, absorbed photosynthetically active radiation, nitrogen use efficiency, nitrogen uptake, and annual litter dry mass, C, and N inputs. These data were used to evaluate the responses of C and N in plants and soils exposed to elevated carbon dioxide (CO2). Norby et al. (2010) used these data to explore how increased productivity under elevated CO2 is limited by nitrogen availability. This dataset contains five data files in comma separate (.csv) format. Additional metadata are provided: five data dictionaries and a file-level metadata file in comma separate (.csv) format.

absorbed photosynthetically active radiation↗

Robust deep learning framework for constitutive relations modeling

Modeling the full-range deformation behaviors of materials under complex loading and materials conditions is a significant challenge for constitutive relations (CRs) modeling. Here, we propose a general encoder-decoder deep learning framework that can model high-dimensional stress-strain data and complex loading histories with robustness and universal capability. The framework employs an encoder to project high-dimensional input information (e.g., loading history, loading conditions, and materials information) to a lower-dimensional hidden space and a decoder to map the hidden representation to the stress of interest. We evaluated various encoder architectures, including gated recurrent unit (GRU), GRU with attention, temporal convolutional network (TCN), and the Transformer encoder, on two complex stress-strain datasets that were designed to include a wide range of complex loading histories and loading conditions. All architectures achieved excellent test results with an root-mean-square error (RMSE) below 1 MPa. Additionally, we analyzed the capability of the different architectures to make predictions on out-of-domain applications, with an uncertainty estimation based on deep ensembles. The proposed approach provides a robust alternative to empirical/semi-empirical models for CRs modeling, offering the potential for more accurate and efficient materials design and optimization.

36 MATERIALS SCIENCE↗

Machine learning and ligand binding predictions: A review of data, methods, and obstacles

We report that computational predictions of ligand binding is a difficult problem, with more accurate methods being extremely computationally expensive. The use of machine learning for drug binding predictions could possibly leverage the use of biomedical big data in exchange for time-intensive simulations. This paper reviews current trends in the use of machine learning for drug binding predictions, data sources to develop machine learning algorithms, and potential problems that may lead to overfitting and ungeneralizable models. A few popular datasets that can be used to develop virtual high-throughput screening models are characterized using spatial statistics to quantify potential biases. We can see from evaluating some common benchmarks that good performance correlates with models with high-predicted bias scores and models with low bias scores do not have much predictive power. A better understanding of the limits of available data sources and how to fix them will lead to more generalizable models that will lead to novel drug discovery.

59 BASIC BIOLOGICAL SCIENCES↗

Genetic algorithm optimization of a chemical kinetic mechanism for propane at engine relevant conditions

Propane has demonstrated significant potential for reductions in greenhouse gas and pollutant emissions in medium- and heavy-duty engine applications, but further improvements require accurate, compact, and scalable chemical kinetic mechanisms to design the next generation of propane fueled engines, particularly at the boosted operating conditions necessary to meet the power density demand of medium- and heavy-duty applications. In this work, six key chemical reactions were identified in a reduced mechanism with 70 species and 352 reactions through a sensitivity analysis performed at conditions typical of thermodynamic trajectories observed in a high compression ratio, long stroke engine operated on propane from throttled to boosted operating conditions. While the original mechanism was validated against rapid compression machine (RCM) data, it was found to overpredict experimental autoignition tendencies in 2-zone, 0-D SI engine simulations performed in Chemkin Pro. Subsequently, a genetic algorithm approach was used to optimize the six reaction rate parameters within established uncertainty bounds by performing RCM simulations and comparing to two independent sets of literature ignition delay times for propane, thus generating two new kinetic mechanisms. The first optimization achieved a mean absolute percent error (MPE) reduction in 2nd stage ignition delay of 61.4% in seven generations, while the second optimization utilized a newer experimental RCM dataset, and achieved MPE reduction of 56.7% in seven generations, and further marginal improvement to 57.8% reduction in 34 generations. Finally, the two mechanisms were then evaluated again in the 2-zone 0-D SI engine model in Chemkin Pro comparing typical mean and knocking cycle trajectories, and it was found that the second optimized mechanism provided better prediction of knock onset at the representative conditions evaluated in this work, particularly for higher load operating conditions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Modeling the potential effects of rooftop solar on household energy burden in the United States

Policymakers at the federal and state level have begun to incorporate energy burden into equity goals and program evaluations, aiming to reduce energy burden below a high level of 6% for lower income households in the United States. Pairing an empirical household-level dataset spanning United States geographies together with modeled hourly energy demand curves, we show that rooftop solar reduces energy burden across a majority of adopters during our study period from a median of 3.3% to 2.6%. For low- and moderate-income adopters (at or below 80% and 120% of area median income, respectively), solar reduces median 2021 energy burden from 7.7% to 6.2%, and 4.1% to 3.3%, respectively. Importantly, solar reduces the rate of high or severe energy burden from 67% of all low-income households before adoption to 52% of households following adoption, and correspondingly from 21% to 13% for moderate-income households. Here, we show rooftop solar can support policy goals to reduce energy burden along with strategies such as weatherization and bill assistance.

14 SOLAR ENERGY↗

Foundation models for atomistic simulation of chemistry and materials

Conventional computational methods for modeling chemical and materials systems are limited by system size and timescale, forcing a trade-off between quantum-mechanical accuracy and the sampling needed for realistic observables. Large language and vision foundation models — pre-trained on massive datasets using transformer architectures — have revolutionized many fields. It is thus interesting to ask whether a foundation model — subject to suitable data, parameter scaling and training — could enable learned simulations of chemistry and materials. Here, in this study, we review the field of machine-learned interatomic potentials (MLIPs) and posit that scaling up large and diverse chemical and materials datasets and highly expressive architectures using advanced training strategies should result in models that are: more efficient, transferable, robust to out-of-distribution scenarios, and easier to fine-tune to a variety of downstream physical observables than models trained from scratch on small datasets corresponding to specific, targeted atomistic simulation tasks. We provide specific criteria for creating such large-scale MLIP foundation models, coordinated strategies for their development, evaluation and deployment, and highlight potential emergent capabilities that could transform predictive simulations in chemistry and materials science and accelerate discovery across multiple technological domains.

Yuan, Eric C.-Y. [University of California, Berkel↗

PERSIANN-CCS-CDR, a 3-hourly 0.04° global precipitation climate data record for heavy precipitation studies

Accurate long-term global precipitation estimates, especially for heavy precipitation rates, at fine spatial and temporal resolutions is vital for a wide variety of climatological studies. Most of the available operational precipitation estimation datasets provide either high spatial resolution with short-term duration estimates or lower spatial resolution with long-term duration estimates. Furthermore, previous research has stressed that most of the available satellite-based precipitation products show poor performance for capturing extreme events at high temporal resolution. Therefore, there is a need for a precipitation product that reliably detects heavy precipitation rates with fine spatiotemporal resolution and a longer period of record. Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks-Cloud Classification System-Climate Data Record (PERSIANN-CCS-CDR) is designed to address these limitations. This dataset provides precipitation estimates at 0.04° spatial and 3-hourly temporal resolutions from 1983 to present over the global domain of 60°S to 60°N. Evaluations of PERSIANN-CCS-CDR and PERSIANN-CDR against gauge and radar observations show the better performance of PERSIANN-CCS-CDR in representing the spatiotemporal resolution, magnitude, and spatial distribution patterns of precipitation, especially for extreme events.

54 ENVIRONMENTAL SCIENCES↗