SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

All sources NASA NTRS DOE OSTI

DOE OSTI2025

A Comprehensive Review of Working Fluids for High-Temperature Heat Pumps: History, Selection, and Evaluation

High-temperature heat pumps (HTHPs) are essential for enhancing energy efficiency across various industrial applications, especially in terms of integrating with renewable energy sources and recovering waste heat. This article thoroughly investigates suitable working fluids for HTHPs, highlighting the evolution from traditional refrigerants to contemporary alternatives with low global warming potential (GWP). It proposes comprehensive selection criteria for these working fluids, pre-selects low-GWP working fluids, and outlines a screening methodology. The pre-selected low-GWP working fluids are evaluated for applications in three typical industrial scenarios involving HTHPs. Furthermore, this study demonstrates that regulatory compliance and environmental impacts significantly influence the development of next-generation refrigerants. The choice of working fluids is closely linked to the types of vapor compression cycles, tailored to the specific industrial applications for HTHPs. This study emphasizes areas for future research, including the development of innovative working fluids; integrated strategies that account for performance, safety, and regulatory standards; alignment of HTHP components; exploration of natural working fluids; and broadening the applications of existing working fluids.

Compression↗

DOE OSTI2025

ORBIT-2 Dataset for Scaling Exascale Vision Foundation Models for Weather and Climate Downscaling

This dataset release corresponds to the work conducted in ORBIT-2: Scaling Exascale Vision Foundation Models for Weather and Climate Downscaling, where large-scale AI methods were applied to improve climate and weather resolution. The collection integrates four widely used, publicly available datasets: ERA5, PRISM, DAYMET, and IMERG. To prepare the data for ORBIT-2 model training and evaluation, we applied a preprocessing pipeline that generates paired low-resolution and high-resolution samples, enabling supervised downscaling experiments. The transformation from coarse to fine scales was performed using bilinear regridding, consistent with the procedures described in WeatherBench2, a community benchmark for weather and climate AI models. This dataset supports the development and evaluation of foundation models designed for weather and climate downscaling at exascale. Additional details on methodology and applications can be found in Wang et al., ORBIT-2 (arXiv:2505.04802, 2025).

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Refining Principal Stress Measurements in Reservoir Underburden in Regions of Induced Seismicity through Seismological Tools, Laboratory Experiments - Final Technical Report

This project developed methodologies to measure the in-situ principal stress in the deep subsurface through use of multiple independent, but complementary, seismic methods, laboratory verification, and development of theoretical frameworks. By leveraging existing regional and local datasets we developed, tested, and refined a set of diagnostic tools for determining the in-situ stress state with reduced uncertainty at and below reservoir depths (1.5-6 km). A set of novel tools was produced that are scale independent, such that their utility is equivalent on regional, field scale, and near borehole monitoring of principal stresses in reservoir underburden for carbon storage projects. During a 4-year Department of Energy (DOE) and Southern Company funded project, carried out by the Electric Power Research Institute (EPRI), Lawrence Livermore National Laboratory (LLNL), the University of Oklahoma (OU), and the U.S. Geological Survey (USGS), the project team developed methodologies to measure the far-field in-situ principal stress in the deep subsurface, leveraging induced seismicity data from waste-water disposal projects. These methodologies consisted in the use of well-established and technically advanced seismic processing methods, such as virtual seismometer method-moment tensor (VSM-MT) and shear wave splitting (SWS), that are adept at recovering the stress orientation and certain components of the stress tensor. These methods were applied to robust seismicity catalogs created with matched filter techniques near sites of active fluid disposal—a proxy for carbon storage sites where such datasets are more limited. Estimates of the stress orientation made with seismic processing tools were considered along with laboratory acoustic emission experiments conducted on rock samples from the region of interest. Stress orientations in the studied region do not vary significantly across distances of ~100 km, nor are they found to rotate through time as a consequence of local wastewater disposal, as previously speculated. Finally, the project team investigated the trade-offs among the different seismic methods and evaluated the range of uncertainty that is generated with these methodologies, which led to a practical use and refinement of the VSM-MT technique when it is applied to field datasets. Understanding the trade-offs between these different methods highlighted the potential benefits of improved quantification of uncertainties on stress field estimations.

58 GEOSCIENCES↗

DOE OSTI2022

Evaluation of the GaAs displacement damage metric using updated nuclear data

The emerging use of the physics-based athermal recombination-corrected displacement per atom (arc-dpa) model for the displacement damage efficiency has motivated a re-evaluation of the historical empirically-derived GaAs damage response function with the purpose of highlighting needs for future analytical and experimental work. The 1-MeV neutron damage equivalence methodology used in the ASTM E-722 standard for GaAs has been re-evaluated using updated nuclear data. This yielded a higher fidelity representation of the GaAs displacement kerma and, through the use of the refined PKA recoil energy-dependent damage efficiency model, an updated 1-MeV(GaAs) displacement damage function. This re-evaluation included use of the Norgett-Robinson-Torrens (NRT) model for an updated threshold treatment, rather than the sharp-threshold Kinchin-Pease model used in the current ASTM standard. The underlying nuclear data evaluations have been updated to use the ENDF/VIII.0 {sup 75}As and TENDL-2019 {sup 71}Ga/{sup 69}Ga evaluations. The displacement kerma and 1-MeV-equivalent damage responses were calculated using a modified NJOY-2016 code which allowed for refinements in some of the damage models. This paper shows that an updated displacement damage function, based upon the latest nuclear data, is consistent with the experimental data used to develop the current ASTM E-722 GaAs standard. Using a double ratio approach to compare the available experimental data with the calculated response, the average legacy double ratio was found to be 0.97 ± 0.05 and the average updated double ratio was found to be 0.94 ± 0.05. (authors)

36 MATERIALS SCIENCE↗

DOE OSTI2024

Robust Containment Queries over Collections of Rational Parametric Curves via Generalized Winding Numbers

Point containment queries for regions bound by watertight geometric surfaces, i.e., closed and without self-intersections, can be evaluated straightforwardly with a number of well-studied algorithms. When this assumption on domain geometry is not met, such methods are either unusable, or prone to misclassifications that can lead to cascading errors in downstream applications. More robust point classification schemes based on generalized winding numbers have been proposed, as they are indifferent to these imperfections. However, existing algorithms are limited to point clouds and collections of linear elements. We extend this methodology to encompass more general curved shapes with an algorithm that evaluates the winding number scalar field over unstructured collections of rational parametric curves. In particular, we evaluate the winding number for each curve independently, making the derived containment query robust to how the curves are arranged. We ensure geometric fidelity in our queries by treating each curve as equivalent to an adaptively constructed polyline that provably has the same generalized winding number at the point of interest. Our algorithm is numerically stable for points that are arbitrarily close to the model, and explicitly treats points that are coincident with curves. We demonstrate the improvements in computational performance granted by this method over conventional techniques as well as the robustness induced by its application.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2021

Quality Guidelines for Energy Systems Studies: Cost Estimation Methodology for NETL Assessments of Power Plant Performance

This paper summarizes the methodology employed by the National Energy Technology Laboratory (NETL) in calculating power plant costs in its techno-economic studies, such as the Cost and Performance Baseline for Fossil Energy Systems series of reports. It also outlines the approach used to calculate the cost of electricity by which NETL evaluates electric power plants. These metrics and a clear understanding of the methodology used are essential in allowing different power plant technologies to be compared on a similar basis. These guidelines are tailored for power producing plants, although they can be applied to a variety of different revenue generating plants (e.g., coal to liquids, syngas generation, hydrogen).

20 FOSSIL-FUELED POWER PLANTS↗

DOE OSTI2024

New ASME Section III, Division 5 Creep-Fatigue Design Rules Based on EPP and SMT Approaches

The integrated elastic-perfectly plastic (EPP) and simplified model test (SMT) creep-fatigue (CF) design methodology, referred to as the EPP-SMT method, is being developed as an alternative for CF evaluation in the design of pressure boundary components for high-temperature reactors. This report reviews the conceptual basis of the EPP-SMT methodology, summarizes the SMT experimental development efforts and results, and provides the technical basis for finalizing the EPP-SMT CF design curves for Alloy 617, based on a combined experimental and numerical approach conducted in FY 2024. This report presents the effect of hold time on the CF design curves for Alloy 617 at elevated temperatures. It includes proposed EPP-SMT CF design curves and tabulated values for continuous cycling, along with the effects of maximum hold time, for the use of this EPP-SMT CF evaluation method.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Complementing Dynamical Downscaling With Super‐Resolution Convolutional Neural Networks

Despite advancements in Artificial Intelligence (AI) methods for climate downscaling, significant challenges remain for their practicality in climate research. Current AI-methods exhibit notable limitations, such as limited application in downscaling Global Climate Models (GCMs), and accurately representing extremes. To address these challenges, we implement an AI-based methodology using super-resolution convolutional neural networks (SRCNN), trained and evaluated on 40 years of daily precipitation data from a reanalysis and a high-resolution dynamically downscaled counterpart. The dynamical downscaled simulations, constrained using spectral nudging, enable the replication of historical events at a higher resolution. This allows the SRCNN to emulate dynamical downscaling effectively. Modifications, such as incorporating elevation data and data pre-processing enhances overall model performance, while using exponential and quantile loss functions improve the simulation of extremes. Our findings show SRCNN models efficiently and skillfully downscale precipitation from GCMs. Future work will expand this methodology to downscale additional variables for future climate projections.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

A Mixed Fracture-Matrix Model for Evaluating Well Orientation and Completion Options for the Utah FORGE Site

Orientation and completion for well pairs that have been subjected to multi-zonal stimulation play a critical role in the long-term performance of an Enhanced Geothermal Reservoir. Here we present the development of a methodology to rapidly and efficiently numerically simulate mixed fracture-matrix flow systems for evaluation of well design and completion options. An example evaluation based on a small fracture network representative of FORGE Well 16(A and B)-78(32) follows a discussion of the theory and model validation.

58 GEOSCIENCES↗

DOE OSTI2021

A Mixed Fracture-Matrix Model for Evaluating Well Orientation and Completion Options for the Utah FORGE Site

15 GEOTHERMAL ENERGY↗

DOE OSTI2021

Production and Performance of High Sulfur Concentration Waste Glasses (FY21)

In FY21 Savannah River National Laboratory (SRNL) was tasked to investigate the practical aspects of low activity waste (LAW) glass production with high sulfur loading for the Office of River Protection (ORP). Relationships between sulfur solubility, retention, and melter resonance need to be evaluated to refine waste loading limits and the super saturated melting (triple melt, grind, and wash) methodology. The impact of high sulfur concentration on durability and phase stability (crystallization and liquid-liquid immiscibility) during slow cooling also needs to be further evaluated. To accomplish this, SRNL proposed scaled melter testing using simulants with matched physicochemical properties to melter feed, as opposed to laboratory reagents. This type of testing is expected to validate applicability to design parameters and functional criteria expected during unit operations. This work was expected to commence in FY21, with the first melter tests being performed near the end of the FY. However, reduced access to Savannah River Site and personnel availability during the COVID-19 pandemic significantly reduced the amount of time and resources available to perform the task. This report documents the experimental plan and progress towards this task. The following is a summarized list of scheduled testing that will be performed on feed, condensate, cold cap and glass: 1) Melter runs; 2) Product consistency test (PCT); 3) Inductively coupled plasma optical emission spectroscopy (ICP-OES); and 4) Optical (OM) and scanning electron microscopy (SEM).

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2024

Evaluation of Converter Performance Considering Static and Dynamic Device Part-to-Part Variability

This paper presents a methodology to incorporate and analyze the impact of semiconductor device part-to-part variation on power converter performance. By integrating extensive static and dynamic device characterization data with an automated compact model generation process that reflects manufacturing variability, device models with inherent variability features are utilized in converter simulations for a comprehensive assessment of performance impacts. The traditional converter performance evaluation process typically yields fixed efficiency values, often dismissing the inherent part-to-part variability caused by the manufacturing process of semiconductor devices. To address this limitation, a large population of devices was characterized to capture variations in static parameters-such as transfer, output, and capacitance characteristics-as well as dynamic behaviors, including switching losses. This data-driven approach enables the development of individual compact models, which were then integrated into converter simulations to evaluate efficiency ranges rather than single point estimated values. The converter simulation results show that part-to-part component variation can lead to significant efficiency deviations, exceeding several percentage points in high-power conversion applications. By offering a more accurate representation of converter behavior under real-world manufacturing conditions, this methodology enables designers to anticipate performance variability, improving the robustness of power converter designs.

device characterization↗

DOE OSTI2026

Ten questions concerning low-cost indoor air quality sensors: Perspectives from research and practice

Low-cost indoor air quality (IAQ) sensors are increasingly being used in homes and commercial and public buildings, driven by growing concerns about the impact of air on health, cognitive performance, and occupant wellbeing. These sensors offer a potentially transformative opportunity to increase spatial and temporal coverage of IAQ monitoring at a fraction of the cost of conventional reference instruments. However, their widespread use raises questions around accuracy, calibration, placement, data handling and interpretation, and integration into existing standards and workflows. This paper presents ten critical questions concerning the use of low-cost IAQ sensors in buildings, drawing on the latest empirical research, field deployments, and emerging practice. It discusses potential frameworks for deployment and evaluation, examines current sensor capabilities for measuring common pollutants, identifies methodological gaps in validation and uncertainty quantification, and outlines the extent to which existing IAQ standards can accommodate sensor-based evidence. The paper also explores how monitoring needs and deployment models vary by building type, the potential of real-time IAQ data to support building operations, and the ethical and legal implications of widespread sensor use. While significant challenges remain in ensuring data quality and building stakeholder trust, new applications are emerging through open data initiatives and advances in analytics and visualization. As the technology, science, and standards co-evolve, low-cost IAQ sensors are poised to become integral to routine building operation, building science, and environmental health research.

Parkinson, Thomas↗

DOE OSTI2027

A multi-region approach for the analysis of porous materials and gas-solid reactions using USAXS-SAXS-WAXS: application to CaO carbonation

The reaction rate of gas-solid non-catalytic reactions is typically investigated using reactant conversion data over time and ex-situ measurements of the porous solid reactant textural properties; these data enable the experimental estimation of the initial intrinsic reaction rate, whereas the evolution of the textural properties and the reaction rate over time are evaluated theoretically using reaction models. In this work, a different methodology is presented, based on: a) in-situ time-resolved USAXS-SAXS-WAXS measurements of the solid sample, and b) a multi-region modeling approach; this methodology allows for the estimation of the textural properties and the intrinsic reaction rate at any time during the reaction. Referring to a reaction in which a solid product is obtained from a solid reactant and a gaseous reactant, the porous particle is described as consisting of several distinct regions with different microstructural properties, and both a gas-solid reaction model and a SAXS model are derived and applied to the carbonation of porous CaO. The proposed reaction model highlights the role of the inaccessible reactant and accurately predicts the solid reactant conversion versus time profile. The SAXS model accurately predicts the measured linear trends of the Porod invariant and of the pre-factor of the power law scattering profile versus CaO mass fraction; in the absence of chemical reactions, the proposed equations extend classical SAXS theory to porous materials containing macropores and nonporous solid phases in addition to standard nanoscale inhomogeneous regions.

CO2 solid sorbents↗

DOE OSTI2020

Ultrafast Relaxations in Ruthenium Polypyridyl Chromophores Determined by Stochastic Kinetics Simulations

Maximizing the efficiency of solar energy conversion using dye assemblies rests on understanding where the energy goes following absorption. Transient spectroscopies in solution are useful for this purpose, and the time-resolved data are usually analyzed with a sum of exponentials. This treatment assumes that dynamic events are well separated in time, and that the resulting exponential prefactors and phenomenological lifetimes are related directly to primary physical values. Such assumptions break down for coincident absorption, emission, and excited state relaxation that occur in transient absorption and photoluminescence of tris(2,2'-bipyridine)ruthenium(2+) derivatives, confounding the physical meaning of the reported lifetimes. Here, we use inductive modeling and stochastic chemical kinetics to develop a detailed description of the primary ultrafast photophysics in transient spectroscopies of a series of Ru dyes, as an alternative to sums of exponential analysis. Commonly invoked three-level schemes involving absorption, intersystem crossing (ISC), and slow nonradiative relaxation and incoherent emission to the ground state cannot reproduce the experimentally measured spectra. The kinetics simulations reveal that ultrafast decay from the singlet excited state manifold to the ground state competes with ISC to the triplet excited state, whose efficiency was determined to be less than unity. The populations predicted by the simulations are used to estimate the magnitudes of transition dipoles for excited state excitations and evaluate the influence of specific ligands. The mechanistic framework and methodology presented here are entirely general, applicable to other dye classes, and can be extended to include charge injection by molecules bound to semiconductor surfaces.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2025

A comparative analysis of YOLOv8 and U-Net image segmentation approaches for transmission electron micrographs of polycrystalline thin films

Metallic thin films offer a platform to experimentally study the dynamics of microstructural evolution, but the required transmission electron microscopy (TEM)-based imaging generates complex images that are challenging to segment and quantify. This work provides a comparative analysis of a new YOLOv8 model and an established U-Net model for bright-field TEM images of polycrystals, employing a framework leveraging physical observables to evaluate performance against two hand-traced benchmark datasets. This methodology obviates the comparison of large, diversely structured, and manually labeled datasets that are required to assess performance on a per-image/per-pixel basis. It is found that the YOLOv8 model, adapted for real-time instance segmentation, has up to 43× faster inferencing (NVIDIA GeForce RTX 4090) compared to U-Net and reconstructs hand-traced grain size distributions (GSDs) with excellent fidelity, finding mean diameter within 3% for grains near an optimal magnification; for grains that deviate from the optimal pixel-diameter, the size of small- (large)-diameter grains is systematically over- (under)-estimated. This is partially mitigated by including scale-aware augmentations during training. Moreover, when the bias is corrected post-inference by a rigid shift in distribution, the YOLOv8 model reproduces ground truth GSDs with exceptional fidelity, with statistical tests indicating <5% probability that the distributions are distinct. Based on ground truth data, calibration curves pertaining to this shift can be constructed for a given model. This issue is not present in the U-Net model’s results, indicating that for quantitative measurements where the true size of objects is of interest, special procedures must be implemented for YOLO-based models.

36 MATERIALS SCIENCE↗

DOE OSTI2026

Meta-analysis of North American Arctic and boreal aboveground biomass datasets: assessing accuracy, dynamics, and similarities

The North American arctic and boreal regions (ABRs) are rapidly warming and experiencing intensifying disturbances. Accurately quantifying aboveground biomass (AGB) is critical for understanding the impacts of these changes on the carbon cycle and for designing climate change mitigation strategies. Several AGB maps have been developed for the North American ABRs, including recent contributions from National Aeronautics and Space Administration’s Arctic-Boreal Vulnerability Experiment (ABoVE) campaign. However, these maps differ widely in training data, methodology, and resulting AGB density estimates. Presently, a comprehensive comparative evaluation is lacking, making it difficult for users to select datasets suited to their research or management needs. Here, in this study, we conducted a comparative analysis of nine AGB density datasets across North American ABRs, specifically for Alaska and Canada. We (1) summarized AGB by ecoregion and Canadian provinces, (2) evaluated their accuracy against field-based measurements, (3) analyzed spatial and temporal similarities among datasets, and (4) assessed their ability to capture disturbance (fire and harvest) impacts on AGB. We found substantial variation in regional and local AGB estimates across datasets, with overall accuracy ranging from R 2 = 0.25–0.62 and Bias% from −47.8% to 69.9% when validated against field plots. Despite these differences, most datasets have comparatively consistent spatial patterns in AGB (r > 0.8 for most cases). In contrast, agreement on the temporal patterns of AGB change is generally low. We found datasets with spatial resolutions ⩽300 m are capable of capturing disturbance impacts on AGB dynamics, though sensitivity varies across products. Our findings and dataset summary provide guidance for selecting appropriate AGB datasets for different applications within our study area. Our analysis also highlights the need to decrease map bias and increase capability to detect temporal change to decrease uncertainty of AGB datasets potentially by using training data which is representative of major plant functional types within the mapped area.

ABoVE↗

DOE OSTI2022

Effect of emitters on quantum state transfer in coupled cavity arrays

Over the last decade, conditions for perfect state transfer in quantum spin chains have been discovered and their experimental realizations addressed, as have their extensions to more complex geometries of coupled cavity-emitter arrays. In this paper we further consider such studies and situations in which quantum state transfer can occur with high fidelity, even when the cavity-cavity coupling rates and cavity-emitter interaction rates are comparable. This is accomplished through the development and use of a Monte Carlo approach to the inverse eigenvalue problem, which allows the determination of coupling rates which optimize quantum state transfer fidelity and subsequent time evolution of the polariton wave function through exact diagonalization of the resulting Jaynes-Cummings-Hubbard Hamiltonian. The effect of inhomogeneous emitter locations is also evaluated. Furthermore, our key results include the demonstration that our methodology can be used successfully to establish Hamiltonian parameters for high-fidelity state transfer in more general lattice geometries and excitation number sectors, and also a determination of the effects of fluctuations in those parameters about their optimal values.

77 NANOSCIENCE AND NANOTECHNOLOGY↗