Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation datasets”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80

Data-driven projection pursuit adaptation of polynomial chaos expansions for dependent high-dimensional parameters

Uncertainty quantification (UQ) and inference involving a large number of parameters are valuable tools for problems associated with heterogeneous and non-stationary behaviors. The difficulty with these problems is exacerbated when these parameters are statistically dependent requiring statistical characterization over joint measures. Probabilistic modeling methodologies stand as effective tools in the realms of UQ and inference. Among these, polynomial chaos expansions (PCE), when adapted to low-dimensional quantities of interest (QoI), provide effective yet accurate approximations for these QoI in terms of an adapted orthogonal basis. These adaptation techniques have been cast as projection pursuits in Gaussian Hilbert space in what has been referred to as a projection pursuit adaptation (PPA) by Xiaoshu Zeng and Roger Ghanem (2023). The PPA method efficiently identifies an optimal low-dimensional space for representing the QoI and simultaneously evaluates an optimal PCE within that space. The quality of this approximation clearly depends on the size of the training dataset, which is typically a function of the adapted reduced dimension. Here, the complexity of the problem is thus mediated by the complexity of the low-dimensional quantity of interest and not the complexity of the high-dimensional parameter space.

Data-driven↗

Plant traits, productivity, biomass and soil properties from forest sites in the Pacific Northwest, 1999–2014

Plant trait measurements are needed for evaluating ecological responses to environmental conditions and for ecosystem process model development, parameterization, and testing. Here, we present a standardized dataset integrating measurements from projects conducted by the Terrestrial Ecosystem Research and Regional Analysis- Pacific Northwest (TERRA-PNW) research group between 1999 and 2014 across Oregon and Northern California, where measurements were collected for scaling and modeling regional terrestrial carbon processes with models such as Biome-BGC and the Community Land Model. The dataset contains measurements of specific leaf area, leaf longevity, leaf carbon and nitrogen for 35 tree and shrub species derived from more than 1,200 branch samples collected from over 200 forest plots, including several AmeriFlux sites. The dataset also contains plot-level measurements of forest composition, structure (e.g., tree biomass), and productivity, as well as measurements of soil structure (e.g., bulk density) and chemistry (e.g., carbon). Publically-archiving regional datasets of standardized, co-located, and geo-referenced plant trait measurements will advance the ability of earth system models to capture species-level climate sensitivity at regional to global scales.

09 BIOMASS FUELS↗

The first full orbit of η Carinae seen by Fermi

The binary system η Carinae has completed its first 5.54 y orbit since the beginning of science operation of the Fermi Large Area Telescope (LAT). We are now able to investigate the high-energy γ-ray source at the position of η Carinae over its full orbital period. By this, we can address and confirm earlier predictions for temporal and spectral variability. Here, newer versions of the LAT datasets, instrument response functions and background models allow for a more accurate analysis. Therefore it is important to re-evaluate the previously analyzed time period along with the new data to further constrain location, spectral shape, and flux time history of the γ-ray source. As a result, we confirm earlier predictions of increasing flux values above 10 GeV toward the next periastron passage. For the most recent part of the data sample, flux values as high as those before the first periastron passage in 2008 are recorded. A comparison of spectral energy distributions around periastron and apastron passages reveals strong variation in the high-energy band. This is due to a second spectral component that is present only around periastron. In conclusion, improved spatial consistency with the γ-ray source at the position of η Carinae along with the confirmation of temporal variability above 10 GeV in conjunction with the orbital period strengthens the argument for unambiguous source identification. Spectral variability provides additional constraints for future modeling of the particle acceleration and γ-ray emission in colliding-wind binary systems.

79 ASTRONOMY AND ASTROPHYSICS↗

Avoiding biases in binned fits

Abstract Binned maximum likelihood fits are an attractive option when analysing large datasets, but require care when computing likelihoods of continuous PDFs in bins.For many years the widely used statistical modelling package evaluated probabilities at the bin centre, leading to significant biases for strongly curved probability density functions.We demonstrate the biases with real-world examples, and introduce a PDF class to that removes these biases.The physics and computation performance of this new class are discussed.

Instruments & Instrumentation↗

Data Jockey: Automatic Data Management for HPC Multi-Tiered Storage Systems

We present the design and implementation of Data Jockey, a data management system for HPC multi-tiered storage systems. As a centralized data management control plane, Data Jockey automates bulk data movement and placement for scientific workflows and integrates into existing HPC storage infrastructures. Data Jockey simplifies data management by eliminating human effort in programming complex data movements, laying datasets across multiple storage tiers when supporting complex workflows, which in turn increases the usability of multitiered storage systems emerging in modern HPC data centers.Specifically, Data Jockey presents a new data management scheme called “goal driven data management” that can automatically infer low-level bulk data movement plans from declarative high-level goal statements that come from the lifetime of iterative runs of scientific workflows. While doing so, Data Jockey aims to minimize data wait times by taking responsibility for datasets that are unused or to be used, and aggressively utilizing the capacity of the upper, higher performant storage tiers.We evaluated a prototype implementation of Data Jockey under a synthetic workload based on a year’s worth of Oak Ridge Leadership Computing Facility’s (OLCF) operational logs. Our evaluations suggest that Data Jockey leads to higher utilization of the upper storage tiers while minimizing the programming effort of data movement compared to human involved, per-domain adhoc data management scripts.

Shin, Woong↗

ChatGPT and Other Large Language Models for Cybersecurity of Smart Grid Applications

Cybersecurity breaches targeting electrical substations constitute a significant threat to the integrity of the power grid, necessitating comprehensive defense and mitigation strategies. Any anomaly in information and communication technology (ICT) should be detected for secure communications between devices in digital substations. This paper proposes large language models (LLMs), e.g., ChatGPT, for the cybersecurity of IEC 61850-based communications. Multi-cast messages such as generic object oriented system events (GOOSE) and sampled values (SV) are used for case studies. The proposed LLM-based cybersecurity framework includes, for the first time, data pre-processing of communication systems and human-in-the-loop (HITL) training (considering the cybersecurity guidelines recommended by humans). The results show a comparative analysis of detected anomaly data carried out based on the performance evaluation metrics for different LLMs. A hardware-in-the-loop (HIL) testbed is used to generate and extract a dataset of IEC 61850 communications.

ChatGPT↗

Measuring and Improving the Core Resilience of Networks

The concept of k-cores is important for understanding the global structure of networks, as well as for identifying central or important nodes within a network. It is often valuable to understand the resilience of the k-cores of a network to attacks and dropped edges (i.e., damaged communications links). We provide a formal definition of a network»s core resilience, and examine the problem of characterizing core resilience in terms of the network»s structural features: in particular, which structural properties cause a network to have high or low core resilience? To measure this, we introduce two novel node properties,Core Strength andCore Influence, which measure the resilience of individual nodes» core numbers and their influence on other nodes» core numbers. Using these properties, we propose theMaximize Resilience of k-Core algorithm to add edges to improve the core resilience of a network. We consider two attack scenarios - randomly deleted edges and randomly deleted nodes. Through experiments on a variety of technological and infrastructure network datasets, we verify the efficacy of our node-based resilience measures at predicting the resilience of a network, and evaluate MRKC at the task of improving a network»s core resilience. We find that on average, for edge deletion attacks, MRKC improves the resilience of a network by 11.1% over the original network, as compared to the best baseline method, which improves the resilience of a network by only 2%. For node deletion attacks, MRKC improves the core resilience of the original network by 19.7% on average, while the best baseline improves it by only 3%.

Laishram, Ricky↗

Fleet Utilization

A key goal of NextGen Profiles' fleet utilization study was to conduct a comprehensive, strategic, and standardized assessment of the operational behavior and utilization patterns across EV and EVSE production-ready fleets. These data-driven insights were intended to inform current fleet management strategies and support future infrastructure planning, ensuring the effective adoption and adaptation of the growing EV fleet market. The study applied a series of metrics defined in NextGen Profiles to evaluate diverse fleet operations across various use cases, emphasizing trends in charging, routing, and other critical behaviors. The fleet utilization dataset includes these three sets of metrics from 17 EV fleets, each consisting of a wide range of vehicle types and operational categories, as well as two EVSE fleets. Data were collected from a variety of sources and reformatted into a unified structure before metric computation, ensuring consistency and comparability across all fleets. To protect confidentiality, all fleet metadata are anonymized, and the publicly released metric datasets are aggregated to an hourly cadence.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Evaluating Symmetry in 3-dimensional Simulation Data

The increasing use of three-dimensional simulations has led to an increased need for effective verification and validation, or V&V. Unfortunately, the high computational cost associated with three-dimensional simulations makes many standard V&V techniques cost-prohibitive. Given these circumstances, we must pay close attention to V&V metrics that can be evaluated using only a single simulation. One of the simplest of these metrics is the evaluation of physical symmetries. This report details a method of computing the deviation from symmetry in a three-dimensional dataset with an arbitrarily distributed mesh. Examples are presented for spherical and axisymmetric systems using the Paraview post-processing analysis workflow.

97 MATHEMATICS AND COMPUTING↗

Deep Learning for Full Waveform Inversion of Elastic Active-Source Seismic Data to Estimate P-Wave Velocity Models

Seismic imaging methods are critical for Global Security and Energy & Homeland Security missions and activities that rely on subsurface characterization, but traditional methods remain computationally expensive and require significant labor hours and expertise to execute. Within the past few years, machine learning (ML), namely deep learning (DL), has been used to develop data-driven end-to-end full waveform inversion (FWI) methods to estimate 2D P-wave velocity (Vp) models in a fraction of the time as conventional FWI. These methods, however, are trained on simplistic acoustic wave seismic data and Vp models that are not realistic nor representative of real-world observations, leaving a large gap between the state-of-the-art and deployable, feasible, and practical DL FWI methods. Here, we generate a synthetic active-source, 3D, elastic wave seismic data set and a variety of Vp models with realistic geologic structure for training DL FWI methods. We evaluate six different methods that have performed well for acoustic DL FWI or medical imaging tasks using our more realistic dataset. We find that these six trained models do not match the performance of published acoustic end-to-end DL FWI methods, indicating more training data may be needed, physics may need to be incorporated to achieve good accuracy at the sacrifice of the end-to-end advantage, and/or novel methods need to be developed to enable end-to-end DL FWI methods to perform well for real-world seismic data.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Data Integration and Visualization for Enhanced Resilience and Sustainability in Hydropower (DIVERS-H)

U.S. hydropower plants face potential threats from shrinking water supply, rising demands, and warmer stream temperatures from various causes. Power plant owners, operators, and regulators require new tools to take advantage of and interpret the diverse range of scientific data being produced by both observational methods (for example, satellite, radar, stream gauges) and computer modeling methods that evaluate and predict how earth's dynamic systems (atmosphere, oceans, land surface, and sea ice) are changing and interacting. Combining datasets such as these with AI-based analyses introduces a novel decision support system to help users anticipate and address potential impacts on power generation stations. This new technology has been named DIVERS-H for "Data Integration and Visualization for Enhanced Resilience and Sustainability in Hydropower." In Phase I, technical feasibility was established with the development and demonstration of all the new technologies that are required. Most notably, DIVERS-H will use new artificial intelligence (AI) methods to capture the complex dynamics of water availability, demand, and environmental changes. In addition, new data management software was developed, and a prototype user interface was implemented as the precursor to a full scale decision support system. With technical research complete, the project focus now shifts to development of a commercial software product to provide users with actionable insight into water availability and the risk/resilience of critical systems at their locations of interest. Although DIVER-H was originally conceived as a tool for hydroelectric power applications, the same underlying technology can be readily applied to other water-consuming systems including coal, natural gas, oil, and nuclear power plants.

Chaudhary, Aashish [Kitware, Inc., Clifton Park, N↗

The Role of the U.S. Electric Distribution System in Serving Data Center and Other Large Loads

The rapid expansion of data centers in the United States is reshaping how the electric distribution system must plan for and accommodate large load interconnections. This report evaluates the role of the distribution grid in serving these loads, from small edge facilities to hyperscale campuses. Using national datasets, utility filings, and industry studies, we assess demand growth, reliability requirements, interconnection thresholds, and infrastructure needs at substations and feeders. The analysis highlights the mismatch between fast data center development timelines and slower utility planning and construction cycles, as well as strategies such as phased energization, on-site generation, hosting capacity maps, and structured interconnection frameworks. While focused on data centers, the insights also apply to other high-density loads such as advanced manufacturing, hydrogen production, and electrified transportation. The report concludes with approaches to align planning processes, transparency tools, and regulatory frameworks so utilities can manage new large loads in ways that support a reliable and resilient grid.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Chemically Enabled CO 2 -Enhanced Oil Recovery in Multi-Porosity, Hydrothermally Altered Carbonates in the Southern Michigan Basin - Task 2 Topical Report

This attachment A is a detailed Topical Report for Task 2 (Advanced Field Characterization and Machine Learning Based Data Integration) under the project "Chemically Enabled CO 2 -Enhanced Oil Recovery in Multi-Porosity, Hydrothermally Altered Carbonates in the Southern Michigan Basin." The overall project activity and finding, including the field pilot testing of CO 2 injection are summarized in the companion Final Technical Report The Advanced Field Characterization and Machine Learning Based Data Integration task (Task 2) involved a systematic geologic characterization of the Trenton-Black River (TBR) play in the SMB which included the development of comprehensive datasets, advanced data analytics, risk assessment, and piggyback field characterization. These activities aimed to address the complex carbonate systems by evaluating the extent of fractures, dolomitization, facies, and reservoir properties with the primary objective of informing the static and dynamic modeling, field injection test, and providing input into the development strategy plan. The task was divided into four subtasks: • Subtask 2.1 – Data compilation, review, and analysis • Subtask 2.2 – Risk Assessment • Subtask 2.3 – Advanced Field Characterization • Subtask 2.4 – Integrated Physics-Based Machine Learning and Advanced Data Analytics

02 PETROLEUM↗

Observed Atmospheric River Events

This dataset contains observed landfalling atmospheric river (AR) events over the Northeast Pacific and U.S. West Coast used to initialize and evaluate the Deep-AR synthetic atmospheric river framework. It includes 1,434 held-out events whose observed records begin 48 hours before diagnosed AR landfall and continue at 6-hour intervals over a 144-hour event window. Each HDF5 file provides high-resolution 0.25° gridded fields of integrated vapor transport components (qu, qv), 10 m wind components (u10, v10), and 6-hour accumulated precipitation. IVT components and precipitation are sourced from EDARA; 10 m winds are sourced from ERA5. The records share a common 200 × 480 grid over the Northeast Pacific and U.S. West Coast and include coordinate and datetime arrays. These events support atmospheric-river hazard analysis, evaluation of synthetic event generation, precipitation-extremes research, and regional stress testing.

17 WIND ENERGY↗

Southeast Pacific atmospheric composition and variability sampled along 20˚S during VOCALS-REx

The VAMOS Ocean-Climate-Atmosphere-Land Regional Experiment (VOCALS-REx) was conducted from 15 October to 15 November 2008 in the South East Pacific region to investigate interactions between land, sea and atmosphere in this unique tropical eastern ocean environment and to improve the skill of global and regional models in representing the region. This study synthesises selected aircraft, ship and surface site observations from VOCALS-REx to statistically summarise and characterise the atmospheric composition and variability of the Marine Boundary Layer (MBL) and Free Troposphere (FT) along the 20{sup o} S parallel between 70{sup o} W and 85{sup o} W. Significant zonal gradients in mean MBL sub-micron aerosol particle size and composition, carbon monoxide, ozone and sulphur dioxide were seen over the campaign, with a generally more variable and polluted coastal environment and a less variable, more pristine remote maritime regime. Gradients are observed to be associated with strong gradients in cloud droplet number. The FT is often more polluted in terms of trace gases than the MBL in the mean; however increased variability in the FT composition suggests an episodic nature to elevated concentrations. This is consistent with a complex vertical interleaving of airmasses with diverse sources and hence pollutant concentrations as seen by generalised back trajectory analysis, which suggests contributions from both local and long-range sources. Furthermore, back trajectory analysis demonstrates that the observed zonal gradients both in the boundary layer and the free troposphere are characteristic of marked changes in airmass history with distance offshore - coastal boundary layer airmasses having been in recent contact with the local land surface and remote maritime airmasses having resided over ocean for in excess of ten days. Boundary layer composition to the east of 75{sup o} W was observed to be dominated by coastal emissions from sources to the west of the Andes, with evidence for diurnal pumping of the Andean boundary layer above the height of the marine capping inversion. The climatology presented here aims to provide a valuable dataset to inform model simulation and future process studies, particularly in the context of aerosol-cloud interaction and further evaluation of dynamical processes in the SEP region for conditions analogous to those during VOCALS-REx.

54 ENVIRONMENTAL SCIENCES↗

Improved method for temporally interpolating radiosonde profiles in the convective boundary layer

A significantly improved technique for temporally interpolating radiosonde (RS) profiles of potential temperature and water vapor mixing ratio in the planetary boundary layer during daytime is introduced. The key innovation of this technique is its operation on a height grid normalized with the planetary boundary layer height. This study utilized a three-month dataset of three-hourly soundings from the Atmospheric Radiation Measurement Facility's Southern Great Plains site. The technique was evaluated for convective boundary layer cases, with the necessary boundary layer height data obtained from a ground-based infrared spectrometer. A total of 79 comparisons were conducted between reference soundings and interpolated profiles that did and did not employ height normalization. The results demonstrated a substantial improvement in the representation of interpolated profiles using the new technique, characterized by enhanced correlation, improved amplitude representation, and reduced bias for potential temperature, as well as improved correlation and reduced bias for water vapor mixing ratio.

convective boundary layer↗

Radiation Risk Assessment of the Individual Astronaut: A Complement to Radiation Interests at the NIH

Predicting human risks following exposure to space radiation is uncertain in part because of unpredictable distribution of high-LET and low-dose-derived damage amongst cells in tissues, unknown synergistic effects of microgravity upon gene- and protein-expression, and inadequately modeled processing of radiation-induced damage within cells to produce rare and late-appearing malignant cancers. Furthermore, estimation of risks of radiogenic outcome within small numbers of astronauts is not possible using classic epidemiologic study. It therefore seems useful to develop strategies of risk-assessment based upon large datasets acquired from correlated biological models useful for resolving radiogenic risk-assessment for irradiated individuals. In this regard, it is suggested that sensitive cellular biodosimeters that simultaneously report 1) the quantity of absorbed dose after exposure to ionizing radiation, 2) the quality of radiation delivering that dose, and 3) the biomolecular risk of malignant transformation be developed in order to resolve these NASA-specific challenges. Multiparametric cellular biodosimeters could be developed using analyses of gene-expression and protein-expression whereby large datasets of cellular response to radiation-induced damage are analyzed for markers predictive for acute response as well as cancer-risk. A new paradigm is accordingly addressed wherein genomic and proteomic datasets are registered and interrogated in order to provide statistically significant dose-dependent risk estimation in individual astronauts. This evaluation of the individual for assessment of radiogenic outcomes connects to NIH program in that such a paradigm also supports assignment of a given patient to a specific therapy, the diagnosis of response of that patient to therapy, and the prediction of risks accumulated by that patient during therapy - such as risks incurred by scatter and neutrons produced during high-energy Intensity-Modulated Radiation Therapy. Value of assessment of radiogenic outcome for individuals exposed to radiation is suggested to be common to both NASA and NIH.

Richmond, Robert C.↗

Assessment of Global Cloud Datasets from Satellites: Project and Database Initiated by the GEWEX Radiation Panel

Clouds cover about 70% of the Earth's surface and play a dominant role in the energy and water cycle of our planet. Only satellite observations provide a continuous survey of the state of the atmosphere over the whole globe and across the wide range of spatial and temporal scales that comprise weather and climate variability. Satellite cloud data records now exceed more than 25 years in length. However, climatologies compiled from different satellite datasets can exhibit systematic biases. Questions therefore arise as to the accuracy and limitations of the various sensors. The Global Energy and Water cycle Experiment (GEWEX) Cloud Assessment, initiated in 2005 by the GEWEX Radiation Panel, provided the first coordinated intercomparison of publically available, standard global cloud products (gridded, monthly statistics) retrieved from measurements of multi-spectral imagers (some with multiangle view and polarization capabilities), IR sounders and lidar. Cloud properties under study include cloud amount, cloud height (in terms of pressure, temperature or altitude), cloud radiative properties (optical depth or emissivity), cloud thermodynamic phase and bulk microphysical properties (effective particle size and water path). Differences in average cloud properties, especially in the amount of high-level clouds, are mostly explained by the inherent instrument measurement capability for detecting and/or identifying optically thin cirrus, especially when overlying low-level clouds. The study of long-term variations with these datasets requires consideration of many factors. A monthly, gridded database, in common format, facilitates further assessments, climate studies and the evaluation of climate models.

Stubenrauch, C. J.↗