Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

HAPPA: A Modular Platform for HPC Application Resilience Analysis with LLMs Embedded

High-performance computing (HPC) systems are increasingly vulnerable to soft errors, which pose significant challenges in maintaining computational accuracy and reliability. Predicting the resilience of HPC applications to these errors is crucial for robust code protection and detailed resilience analysis. In this study, we present HAppA, a modular platform designed for HPC Application Resilience Analysis. Embedding Large Language Models (LLMs), HAppA addresses understanding the context information of long code sequences typical in HPC applications. HAppA implements a novel code representation module that chunks the code into fixed-size segments and aggregates the embeddings of these segments. Three aggregation methods have been explored: MeanPooling, MaxPooling, and LSTM-based techniques. We built a DAtaset for REsilience analysis using Fault Injection (FI), named DARE. Using our DARE dataset, HAppA is trained for regression prediction tasks. Our evaluation results demonstrate the predictive accuracy of HAppA compared to other models, particularly noting that the LSTM-based aggregation method -- HAppA-LSTM -- achieves a mean squared error (MSE) of 0.078 for SDC prediction, surpassing the existing state-of-the-art PARIS model, which recorded an MSE of 0.1172. Additionally, HAppA with the KeyBERT model extracts a list of keywords representing the source code. A comprehensive importance analysis of these keywords further elucidates the code patterns contributing to the error rate. These findings highlight the effectiveness of HAppA in analyzing the resilience of HPC applications and establish a new benchmark for predictive accuracy in resilience.

Jiang, Hailong [Kent State University]↗

Microstructural Materials Design Via Deep Adversarial Learning Methodology

Identifying the key microstructure representations is crucial for computational materials design (CMD). However, existing microstructure characterization and reconstruction (MCR) techniques have limitations to be applied for microstructural materials design. Some MCR approaches are not applicable for microstructural materials design because no parameters are available to serve as design variables, while others introduce significant information loss in either microstructure representation and/or dimensionality reduction. In this work, we present a deep adversarial learning methodology that overcomes the limitations of existing MCR techniques. In the proposed methodology, generative adversarial networks (GAN) are trained to learn the mapping between latent variables and microstructures. Thereafter, the low-dimensional latent variables serve as design variables, and a Bayesian optimization framework is applied to obtain microstructures with desired material property. Due to the special design of the network architecture, the proposed methodology is able to identify the latent (design) variables with desired dimensionality, as well as capturing complex material microstructural characteristics. The validity of the proposed methodology is tested numerically on a synthetic microstructure dataset and its effectiveness for microstructural materials design is evaluated through a case study of optimizing optical performance for energy absorption. Additional features, such as scalability and transferability, are also demonstrated in this work. In essence, the proposed methodology provides an end-to-end solution for microstructural materials design, in which GAN reduces information loss and preserves more microstructural characteristics, and the GP-Hedge optimization improves the efficiency of design exploration.

Engineering↗

SU-E-J-107: The Impact of the Tumor Location to Deformable Image Registration

Purpose: For four-dimensional planning and adaptive radiotherapy, the accuracy of deformable image registration (DIR) is essential. We evaluated the accuracy of an in-house program with the free-downloadable DIR software library package (NiftyReg) and two commercially available DIR software programs (MIM Maestro and Velocity AI) in lung SBRT cancer patients. In addition to it, the relationship between the tumor location and the accuracy of the DIRs was investigated. Methods: The free-form deformation was implemented in the in-house program and the MIM. The Velocity was based on the B-spline algorithm. The accuracy of the three programs was evaluated in comparison for the structures on 4DCT image datasets between at the peak-inhale and at the peak-exhale. The dice similarity coefficient (DSC) and normalized DSC (NDSC) were measured for the gross tumor volumes from 19 lung SBRT patients. Results: The DSC measurement showed the median values of the DSC were 0.885, 0.872 and 0.798 for the In-house program, the MIM and the Velocity, respectively. The Velocity showed significant difference compared to the others. The median NDSC values were 1.027, 1.005 and 0.946 for the In-house, the MIM and the Velocity, respectively. This indicated that the spatial overlap agreement between the reference and the deformed structure for the in-house and MIM was comparable with the accuracy within 1mm uncertainty. There was larger discrepancy within 1–2mm uncertainty for the Velocity. The In-house and the MIM showed the higher NDSC values than the median values when the GTV was not attached to the chest wall and diaphragm(p < 0.05). However, there is no relationship between the accuracy and the tumor location in the Velocity. Conclusion: The difference of the DIR program would affect different accuracy and the accuracy may be reduced when the tumor is located or attached to chest wall or diaphragm.

60 APPLIED LIFE SCIENCES↗

A single-tree algorithm to compute the Euclidean minimum spanning tree on GPUs

Computing the Euclidean minimum spanning tree (Emst) is a computationally demanding step of many algorithms. While work-efficient serial and multithreaded algorithms for computing Emst are known, designing an efficient GPU algorithm is challenging due to a complex branching structure, data dependencies, and load imbalances. In this paper, we propose a single-tree $Bor\mathring{u}vka$-based algorithm for computing Emst on GPUs. We use an efficient nearest neighbor algorithm and reduce the number of the required distance calculations by avoiding traversing subtrees with leaf nodes in the same component. The developed algorithms are implemented in a performance portable way using ArborX, an open-source geometric search library based on the Kokkos framework. We evaluate the proposed algorithm on various 2D and 3D datasets, show and compare it with the current state-of-the-art open-source CPU implementations. We demonstrate 4-24 × speedup over the fastest multi-threaded implementation. We prove the portability of our implementation by providing results on a variety of hardware: AMD EPYC 7763, Nvidia A100 and AMD MI250X. We show scalability of the implementation, computing Emst for 37 million 3D cosmological dataset in under a 0.5 second on a single A100 Nvidia GPU.

Prokopenko, Andrey↗

REDI – Readiness Engine for Data Integration

The Readiness Engine for Data Integration (REDI) is an open-source framework for automating, standardizing, and assessing the process of preparing scientific data for AI training. REDI implements a five-stage pipeline (ingest, preprocess, transform, structure, output) with per-stage provenance instrumentation via Flowcept, domain-aware transformation logic (PII anonymization, regridding, graph encoding, and more), and built-in readiness assessment and validation modes. REDI has been evaluated across climate, proteomics, materials science, and nuclear fusion datasets, demonstrating near-ideal parallel scaling to 100 nodes on OLCF's Frontier system. REDI is deployable as an agent-callable skill in coding environments such as Claude Code and OpenAI Codex, and is complemented by SetGo for FAIR compliance and catalog publication.

Brewer, Wesley [Oak Ridge National Laboratory (ORN↗

Anomaly Detection and Identification Using a Leave-One-Variable-Out Method

At nuclear power plants (NPPs), anomaly detection and identification (i.e., determining the causes of anomalies) are important tasks for ensuring the safe and efficient operation of NPPs. These tasks are currently labor-intensive and costly, and are made more difficult by the size and complexity of NPP systems. An alternative approach to conducting these tasks is to automate them, such as via the reconstruction-based contribution method, which is a well-researched unsupervised machine learning method that uses a data-driven model of anomaly-free behavior to detect events and then identify each variable’s contributions to those events. The present effort developed a novel contribution approach that utilized a leave-one-variable-out (LOVO) model, with which each variable is predicted using all the other variables. The novelty lay in transforming this model into a reconstruction model and modifying the identification algorithm to work with the new reconstruction model. To evaluate this method in a controlled environment, a synthetic dataset based on spring-mass-damper (SMD) systems (commonly found in mechanical engineering references) was used, with known anomalies introduced into the system. The proposed method successfully detected the anomalies and afforded insights into their causes, thus enabling the appropriate identifications to be made.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Using spatio-temporal graph neural networks to estimate fleet-wide photovoltaic performance degradation patterns

Accurate estimation of photovoltaic (PV) system performance is crucial for determining its feasibility as a power generation technology and financial asset. PV-based energy solutions offer a viable alternative to traditional energy resources due to their superior Levelized Cost of Energy (LCOE). A significant challenge in assessing the LCOE of PV systems lies in understanding the Performance Loss Rate (PLR) for large fleets of PV systems. Estimating the PLR of PV systems becomes increasingly important in the rapidly growing PV industry. Precise PLR estimation benefits PV users by providing real-time monitoring of PV module performance, while explainable PLR estimation assists PV manufacturers in studying and enhancing the performance of their products. However, traditional PLR estimation methods based on statistical models have notable drawbacks. Firstly, they require user knowledge and decision-making. Secondly, they fail to leverage spatial coherence for fleet-level analysis. Additionally, these methods inherently assume the linearity of degradation, which is not representative of real world degradation. To overcome these challenges, we propose a novel graph deep learning-based decomposition method called the Spatio-Temporal Graph Neural Network for fleet-level PLR estimation (PV-stGNN-PLR). PV-stGNN-PLR decomposes the power timeseries data into aging and fluctuation components, utilizing the aging component to estimate PLR. PV-stGNN-PLR exploits spatial and temporal coherence to derive PLR estimation for all systems in a fleet and imposes flatness and smoothness regularization in loss function to ensure the successful disentanglement between aging and fluctuation. We have evaluated PV-stGNN-PLR on three simulated PV datasets consisting of 100 inverters from 5 sites. Experimental results show that PV-stGNN-PLR obtains a reduction of 33.9% and 35.1% on average in Mean Absolute Percent Error (MAPE) and Euclidean Distance (ED) in PLR degradation pattern estimation compared to the state-of-the-art PLR estimation methods.

14 SOLAR ENERGY↗

Renewable Energy Potential Model: Hawaii Geothermal Supply Curves

This dataset extends the development of the Renewable Energy Potential (reV) model to include geothermal energy, with a specific focus on Hawaii. Provided here are the results of two scenarios that were modeled for geothermal energy in Hawaii: binary enhanced geothermal systems (EGS) at a depth of 2.5 km and hydrothermal binary systems at a depth of 1.5 km. The resource data for both scenarios were derived from Lautze and Haskins (2024) using an exponential method. The PFA probability of heat map was used as a look up table for which temperature gradient to use (Lautze and Haskins, 2024). The dataset provides geospatial and techno-economic details for evaluating geothermal energy potential. It includes spatial coordinates, estimated capacity factors, developable area, resource potential, and annual energy production metrics. Economic details such as levelized cost of electricity (LCOE), site development costs, transmission costs, and fixed-charge rates are also included. The reV model, originally developed for wind and solar energy, incorporates these variables to evaluate deployment constraints related to land use, environmental and cultural factors, and grid integration.

15 GEOTHERMAL ENERGY↗

Agricultural Impacts on Nitrogen Cycling: Climate and Air Pollution (Final Technical Report)

We have successfully added a parameterization of ammonia emissions from synthetic fertilizer and manure from agriculture to Earth System Models. We have evaluated how emissions change in the future and the processes driving these changes. We have examined the impact of agricultural ammonia emissions on present-day air quality and have evaluated the impact of resolving the emissions with high temporal resolution. We have also examined the impact of how Earth System Models treat the cycling of emissions in soils. Our code, the Flows of Agricultural Nitrogen – version 2 – model (FANv2) has been run in both the CLM framework and the ELM framework. To my knowledge the code has not yet been fully implemented into ELM. Volatilization of ammonia (NH3) from fertilizers and livestock wastes forms a significant pathway of nitrogen losses in agricultural ecosystems and constitutes the largest source of atmospheric emissions of NH3. We have provided a major update to the process model FAN (Flow of Agricultural Nitrogen), which evaluates NH3 emissions interactively within an Earth system model; in this work, the Community Earth System Model (CESM) is used. The updated version (FANv2) includes a more detailed treatment of both physical and agricultural processes, which allows the model to differentiate between the volatilization losses from animal housings, manure storage, grazed pastures, and the application of manure and different types of mineral fertilizers. The modeled ammonia emissions are first evaluated at a local scale against experimental data for various types of fertilizers and manure, and they are subsequently run globally to evaluate NH3 emissions for 2010–2015 based on gridded datasets of fertilizer use and livestock populations. Comparison of regional emissions shows that FANv2 agrees with previous inventories for North America and Europe and is within the range of previous inventories for China. However, due to higher NH3 emissions in Africa, India, and Latin America, the global emissions simulated by FANv2(48 Tg N) are 30 %–40 % higher than in the existing inventories.

54 ENVIRONMENTAL SCIENCES↗

Cybersecurity Center for Offshore Wind Energy (Final Project Report)

This project establishes a Cybersecurity Center for Offshore Wind Energy with the objective of designing and operating a cyber-physical testbed for wind energy farms (WEFs) that enables comprehensive cybersecurity research. The testbed incorporates a Supervisory Control and Data Acquisition (SCADA) system connected to turbine models via industrial-grade programmable logic controllers (PLCs) and remote terminal units (RTUs). It supports side-channel data acquisition, implementation and analysis of various cyberattack scenarios, and development of attack detection, mitigation, and best-practice guidance tailored to wind energy systems. During the project, the team expanded the number and fidelity of mathematical turbine models (MTMs), integrated these models with SCADA infrastructure, and deployed a scaled physical turbine and associated sensors. High-resolution operational and side-channel data streams were collected and used to refine machine-learning (ML)-based attack detection systems and to extend the WindCRAFT framework to multi-turbine threat scenarios. The project demonstrated a realistic, scalable environment for evaluating cyber threats, validated attack detection approaches using enriched datasets, and identified new multi-turbine and inter-turbine communication attack vectors. The resulting testbed, models, and security mechanisms provide a foundation for ongoing R&D and deployment of cyber-resilient offshore wind energy systems.

17 WIND ENERGY↗

Portable and Transparent Message Compression in MPI Libraries to Improve the Performance and Scalability of Parallel Applications

The goal of this project has been to develop a lossless compression algorithm for message-passing libraries that can accelerate HPC systems by reducing the communication time. Because both compression and decompression have to be performed in software in real time, the algorithm has to be extremely fast while still delivering a good compression ratio. During the first half of this project, they designed a new compression algorithm called FPC for scientific double-precision data, made the source code available on the web, and published two papers describing its operation, the first in the proceedings of the Data Compression Conference and the second in the IEEE Transactions on Computers. At comparable average compression ratios, this algorithm compresses and decompresses 10 to 100 times faster than BZIP2, DFCM, FSD, GZIP, and PLMI on the three architectures tested. With prediction tables that fit into the CPU's L1 data acache, FPC delivers a guaranteed throughput of six gigabits per second on a 1.6 GHz Itanium 2 system. The C source code and documentation of FPC are posted on-line and have already been downloaded hundreds of times. To evaluate FPC, they gathered 13 real-world scientific datasets from around the globe, including satellite data, crash-simulation data, and messages from HPC systems. Based on the large number of requests they received, they also made these datasets available to the community (with permission of the original sources). While FPC represents a great step forward, it soon became clear that its throughput was too slow for the emerging 10 gigabits per second networks. Hence, no speedup can be gained by including this algorithm in an MPI library. They therefore changed the aim of the second half of the project. Instead of implementing FPC in an MPI library, they refocused their efforts to develop a parallel compression algorithm to further boost the throughput. After all, all modern high-end microprocessors contain multiple CPUs on a single die and will undoubtedly contain even larger numbers of CPUs in the future. Hence, a compute node in a parallel system is likely to have multiple processors per interconnection link. Thus, they investigated how to best exploit multiple CPUs to compress and decompress data for a single link, i.e., they developed a parallel version of the FPC algorithm called pFPC. On a 4-core 3 GHz Xeon system, pFPC exceeds 10 gigabits per second both in compression and decompression throughput while still reaching a compression ratio of 18%, which is reasonable for their double-precision floating-point datasets. At half this throughput, it achieves a 41% compression ratio. Moreover, the algorithm scales well to four cores and promises even higher throughputs on larger machines. Additional results and a description of the pFPC algorithm have recently been published in the proceedings of the Data Compression Conference. The C source code of pFPC is also publicly available.

97 MATHEMATICS AND COMPUTING↗

Shallow cloud variability in Houston, Texas, during the ESCAPE and TRACER field experiments

Shallow convection plays an important role in Earth's climate system by regulating the vertical transport of heat, moisture, and momentum in the lower troposphere. Aerosols, large-scale meteorology, and low-level convergence influence the spatiotemporal variability in shallow convection, and the coastal urban area of Houston, Texas, is an ideal laboratory to investigate these complex interactions. Here, geostationary satellite and ground-based radar observations from June to September 2022 during the TRacking Aerosol Convection interactions ExpeRiment (TRACER) and Experiment of Sea Breeze Convection, Aerosols, Precipitation, and Environment (ESCAPE) field campaigns are used to characterize the spatial coverage, vertical extent, and precipitation fraction of shallow convective clouds. The fused operational remote sensing datasets over a 250 km × 250 km domain are evaluated against profiling observations. The domain-wide diurnal shallow cloud fractions are used to identify four distinct modes of shallow convection. In all clusters, the domain-wide cloud fractions are consistently higher than the domain-wide precipitation fractions, and shallow cloud fractions are higher over water than they are over land, while the shallow precipitation fractions show the opposite behavior. In the two modes with minimal deep cloud activity, shallow cloud frequency is highest over ocean in the early morning, and there is a transition to higher shallow cloud frequency over land by the afternoon in one cluster or to high shallow cloud frequencies everywhere by the afternoon in the other. Lastly, we find regions with higher shallow cloud top heights and a large region along the coastline where shallow clouds are more likely to precipitate.

54 ENVIRONMENTAL SCIENCES↗

An improved mechanistic model for ammonia volatilization in Earth system models: Flow of Agricultural Nitrogen version 2 (FANv2)

Abstract. Volatilization of ammonia (NH 3 ) from fertilizers and livestock wastes forms a significant pathway of nitrogen losses in agricultural ecosystems and constitutes the largest source of atmospheric emissions of NH 3 . This paper describes a major update to the process model FAN (Flow of Agricultural Nitrogen), which evaluates NH 3 emissions interactively within an Earth system model; in this work, the Community Earth System Model (CESM) is used. The updated version (FANv2) includes a more detailed treatment of both physical and agricultural processes, which allows the model to differentiate between the volatilization losses from animal housings, manure storage, grazed pastures, and the application of manure and different types of mineral fertilizers. The modeled ammonia emissions are first evaluated at a local scale against experimental data for various types of fertilizers and manure, and they are subsequently run globally to evaluate NH3 emissions for 2010–2015 based on gridded datasets of fertilizer use and livestock populations. Comparison of regional emissions shows that FANv2 agrees with previous inventories for North America and Europe and is within the range of previous inventories for China. However, due to higher NH 3 emissions in Africa, India, and Latin America, the global emissions simulated by FANv2 (48 Tg N) are 30 %–40 % higher than in the existing inventories.

Vira, Julius↗

The PERSIANN family of global satellite precipitation data: a review and evaluation of products

Abstract. Over the past 2 decades, a wide range of studies have incorporated Precipitation Estimation from Remotely Sensed Information using Artificial Neural Networks (PERSIANN) products. Currently, PERSIANN offers several precipitation products based on different algorithms available at various spatial and temporal scales, namely PERSIANN, PERSIANN-CCS, and PERSIANN-CDR. The goal of this article is to first provide an overview of the available PERSIANN precipitation retrieval algorithms and their differences. Secondly, we offer an evaluation of the available operational products over the contiguous US (CONUS) at different spatial and temporal scales using Climate Prediction Center (CPC) unified gauge-based analysis as a benchmark. Due to limitations of the baseline dataset (CPC), daily scale is the finest temporal scale used for the evaluation over CONUS. Additionally, we provide a comparison of the available products at a quasi-global scale. Finally, we highlight the strengths and limitations of the PERSIANN products and briefly discuss expected future developments.

54 ENVIRONMENTAL SCIENCES↗

Comparison of simulated cloud cover with satellite obsrvations over the Western United States

Satellite imagery datasets and regional climate model results are intercompared for evaluation of model accuracy in the simulation of cloud cover. Both monthly average individual simulation times are analyzed. To provide a consistent comparison, satellite data are first mapped into the model's geographic projection, grid domain, and resolution. It is found that September 1988 monthly average cloud fraction results from the modeled simulations correspond to observations, in both spatial pattern and magnitude, with bias less than +/- 20% cloud fraction over the entire inland West. Agreement in the pattern of cloud fraction also is evident for monthly average cloud fraction in July, but there is no negative bias of 10%-30% cloud fraction in the model diagnosis of cloud cover. Correlations between the spatial distributions of model-derived and observed cloud fractions are found to exceed 0.80 for certain geographic regions of the West, and these correlations are largest over mountainous areas during summer. Case studies of a series of daily cloud cover demonstrate the ability of the model to simulate the effects of frontal passage on cloud distribution. The ability of the RegCM1 to simulate daily cloud fraction and diurnal cloud evolution is somewhat weak for the summer convective season. It is anticipated that a more recent version of the regional climate model may improve the simulation of summer season cloud cover, through changes in cloud parameterization and improvements in model resolution.

Wetzel, Melanie A.↗

Evaluation of Landscape Structure Using AVIRIS Quicklooks and Ancillary Data

Currently the best tool for examining landscape structure is remote sensing, because remotely sensed data provide complete and repeatable coverage over landscapes in many climatic regimes. Many sensors, with a variety of spatial scales and temporal repeat cycles, are available. The Airborne Visible/Infrared Imaging Spectrometer (AVIRIS) has imaged over 4000 scenes from over 100 different sites throughout North America. For each of these scenes, one-band "quicklook" images have been produced for review by AVIRIS investigators. These quicklooks are free, publicly available over the Internet, and provide the most complete set of landscape structure data yet produced. This paper describes the methodologies used to evaluate the landscape structure of quicklooks and generate corresponding datasets for climate, topography and land use. A brief discussion of preliminary results is included at the end. Since quicklooks correspond exactly to their parent AVIRIS scenes, the methods used to derive climate, topography and land use data should be applicable to any AVIRIS analysis.

Sanderson, Eric W.↗

Using TRMM Field Campaign Data for Assessing GEOS Forecast and Assimilation Products

The wealth of in-situ measurements gathered during Tropical Rain Measuring Mission (TRMM) field campaigns over a wide range of tropical conditions constitute an important data source for evaluating the quality of global model forecasts and assimilated datasets. In this study we use selected observations of cloud microphysics and atmospheric sounding from TEFLUN-1998, SCEMEX-1998, and TRMMLBA-1999 to examine the assimilation and forecast fields produced by the operational GEOS-3 (Goddard Earth Observing System - version 3) global data assimilation system (DAS) and a new finite-volume DAS under development at the Data Assimilation Office. Additionally, TRMM field campaign measurements are used to verify the impact of assimilating rainfall and moisture data derived from TRMM Microwave Imager and Special Sensor Microwave/Imager instruments on the GEOS analysis. We will also explore issues concerning the 'error of representativeness' in using in-situ observations of quantities with large spatial and temporal variability such as precipitation for validating gridded global data products.

Hou, Arthur Y.↗

Integrating Enhanced Grace Terrestrial Water Storage Data Into the U.S. and North American Drought Monitors

NASA's Gravity Recovery and Climate Experiment (GRACE) satellites measure time variations nf the Earth's gravity field enabling reliable detection of spatio-temporal variations in total terrestrial water storage (TWS), including ground water. The U.S. and North American Drought Monitors are two of the premier drought monitoring products available to decision-makers for assessing and minimizing drought impacts, but they rely heavily on precipitation indices and do not currently incorporate systematic observations of deep soil moisture and groundwater storage conditions. Thus GRACE has great potential to improve the Drought Monitors hy filling this observational gap. Horizontal, vertical and temporal disaggregation of the coarse-resolution GRACE TWS data has been accomplished by assimilating GRACE TWS anomalies into the Catchment Land Surface Model using ensemble Kalman smoother. The Drought Monitors combine several short-term and long-term drought indices and indicators expressed in percentiles as a reference to their historical frequency of occurrence for the location and time of year in question. To be consistent, we are in the process of generating a climatology of estimated soil moisture and ground water based on m 60-year Catchment model simulation which will subsequently be used to convert seven years of GRACE assimilated fields into soil moisture and groundwater percentiles. for systematic incorporation into the objective blends that constitute Drought Monitor baselines. At this stage we provide a preliminary evaluation of GRACE assimilated Catchment model output against independent datasets including soil moisture observations from Aqua AMSR-E and groundwater level observations from the U.S. Geological Survey's Groundwater Climate Response Network.

Housborg, Rasmus↗