Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Analysis of Uncertainty Impacts on Emissions and Fuel Economy Evaluation for Chassis Dynamometer Testing

This study illustrates a methodology for quantifying the uncertainties encountered in the measurement of tailpipe emissions and in the fuel consumption measurements for light-duty conventional vehicles tested on a four-wheel drive chassis dynamometer. The study leverages high-fidelity experimental data collected over three standard drive cycles, UDDS, HWY and US06, intended to simulate a wide range of operating conditions. Here, a method is developed to estimate the measurement uncertainties in fuel consumption for a test cycle, which occur due to the accumulation of measurement uncertainties propagated through the system. The uncertainty determination model uses statistical analysis and standard propagation techniques to evaluate and combine the uncertainties introduced from various sources (including the vehicle, chassis dynamometer, driver, and instrumentation). The analysis also examines three different experimental methods for determining the fuel consumption: 1) carbon mass balance, 2) volumetric fuel scale and 3) gravimetric fuel scale, and takes into consideration the properties of the instrumentation used. The results show that the most significant influence on the determination of the emissions comes from the concentration measurement, and similarly the biggest impact on the total fuel consumption uncertainty comes from the uncertainty in the determination of the carbon dioxide mass, due to the large presence of this pollutant in the overall emissions. It was found that the fuel consumption uncertainties are in the range of ±1-2% for all three methods analyzed, with the lowest values being obtained for measurements performed using the gravimetric method for all three drive cycles considered.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2025

Summary of FY25 activities on the project Realistic Reaction Evaluations for Fission Products Off Stability (RREFPOS)

Applications such nonproliferation, post-detonation forensics, spent-fuel assay, reactor burnup and design, as well as astrophysics, rely on the accurate description of the neutron interaction with unstable fission products. Current neutron-induced cross-section descriptions for these nuclei are either non-existent or based on simplified assumptions, leading to unquantified impacts on predicted cross-sections. The goal of the Realistic Reaction Evaluations for Fission Products Off Stability (RREFPOS) project is to develop a reproducible methodology leading to a more predictive and realistic new set of evaluated nuclear data, improving the reliability of applications involving fission products off stability. The current report documents the activities related to the RREFPOS project in its first year, corresponding to the Fiscal Year of 2025 (FY25).

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2021

Assessment of task‐based performance from five clinical DBT systems using an anthropomorphic breast phantom

Purpose Digital breast tomosynthesis (DBT) is a limited‐angle tomographic breast imaging modality that can be used for breast cancer screening in conjunction with full‐field digital mammography (FFDM) or synthetic mammography (SM). Currently, there are five commercial DBT systems that have been approved by the U.S. FDA for breast cancer screening, all varying greatly in design and imaging protocol. Because the systems are different in technical specifications, there is a need for a quantitative approach for assessing them. In this study, the DBT systems are assessed using a novel methodology with an inkjet‐printed anthropomorphic phantom and four alternative forced choice (4AFC) study scheme. Method A breast phantom was fabricated using inkjet printing and parchment paper. The phantom contained 5‐mm spiculated masses fabricated with potassium iodide (KI)‐doped ink and microcalcifications (MCs) made with calcium hydroxyapatite. Images of the phantom were acquired on all five systems with DBT, FFDM, and SM modalities where available using beam settings under automatic exposure control. A 4AFC study was conducted to assess reader performance with each signal under each modality. Statistical analysis was performed on the data to determine proportion correct (PC), standard deviations, and levels of significance. Results For masses, overall detection was highest with DBT. The difference in PC was statistically significant between DBT and SM for most systems. A relationship was observed between increasing PC and greater gantry span. For MCs, performance was highest with DBT and FFDM compared to SM. The difference between PC of DBT and PC of SM was statistically significant for all manufacturers. Conclusions This methodology represents a novel approach for evaluating systems. This study is the first of its kind to use an inkjet‐printed anthropomorphic phantom with realistic signals to assess performance of clinical DBT imaging systems.

Ikejimba, Lynda C.↗
DOE OSTI2026

A Guide to Nonaqueous Electrochemistry of f-Element Complexes

Electrochemistry is a powerful tool for assessing and understanding the redox chemistry of molecular complexes. Cyclic voltammetry enables the f-element community to study molecules in unusually high or low oxidation states, which potentially pose important broad-scope questions of electronic structure. In the pursuit of boundary-pushing compounds, reactive air- and moisture-sensitive species are often encountered, which can be challenging to characterize, especially when they are chemically incompatible with certain solvents, electrolytes, or electrodes or when their potentials lie outside of common electrochemical windows. Nonaqueous solvents and pseudo reference electrodes complicate many of the standard practices in acquiring high-quality and reproducible electrochemical data. This guide presents a detailed discussion of selecting appropriate cell conditions and referencing and addresses metrics for evaluating electrochemical and chemical reversibility. These methodological approaches have been extended to best practices for the electrochemical analysis of radioactive transuranic complexes.

Electrodes↗
DOE OSTI2021

Methodology for interpretable reinforcement learning model for HVAC energy control

Deep reinforcement learning (DRL) approaches have been used in various application areas to improve efficiency, optimization, or automation. However, very little is known about how the DRL algorithms make decisions and what features affect their performance. Using a case study of a DRL based Heating, Ventilation and Air Conditioning (HVAC) optimization methodology, we demonstrate how we can address these challenges by applying interpretability tools and systematically exploring the model inputs for better understanding the DRL behaviour and decision making process. We developed a methodology for interpretable reinforcement learning and evaluated our approach in real-world house located in Knoxville, TN. Our findings explain the reasoning behind DRL-based optimization decisions under different circumstances which has been discussed and confirmed by the experts in the field.

Kotevska, Olivera↗
DOE OSTI2024

Towards Full Field-of-View Fourier Ptychography for Extreme Ultraviolet Microscope

We evaluate various Fourier ptychographic microscopy (FPM) reconstruction algorithms using both simulated and experimental data acquired from an Extreme Ultraviolet (EUV, 13.5 nm wavelength) microscope. We specifically focus on the algorithms' ability to robustly address field-dependent aberrations, which enables increased spatial resolution and quantitative phase imaging across an expanded field of view. We systematically compare the algorithms' performance under aberrations for a single zoneplate imaging system, utilizing Fourier Ring Correlation (FRC) as a systematic metric for assessing reconstruction quality. Furthermore, we explore the impact of systematic errors on the reconstruction of experimental data, aiming to increase the effective field of view by 25-fold, from the nominal 5x5 um2 diffraction-limited area. Additionally, our evaluation incorporates innovative FPM-adjacent methodologies, including the Angular Ptychographic Imaging with Closed-form method (APIC), for reconstructing EUV images.

Gu, Chaoying↗
DOE OSTI2021

A Compact 50kW High Power Density, Hybrid 3-Level Paralleled T-type Inverter for More Electric Aircraft Applications

The demand for high performing, lightweight, reliable inverters, increased the scope of wide bandgap and high-switching frequency based solutions. To achieve such high efficiency inverters, it is vital to focus on the system level design considerations to maximize the benefits of these advanced technologies. This paper presents an improved design based on considerations to further reap the benefits of choosing the right inverter topology; increased capabilities through paralleling devices, with reduced total number of switches; and designing a planarized inverter with PCB based busbar. Appropriate thermal analysis and heatsink design has aided in increased system power density along with the overall efficiency. Demonstration of a 50kW 3-phase 3-level paralleled T-type SiC inverter operating at 40kHz switching frequency for aircraft applications is shown to evaluate the benefits of proposed design methodology. Here, the prototype achieves a high power density of 11kW/L.

42 ENGINEERING↗
DOE OSTI2025

Tunable electrochemical pathway for high-purity REMs and CMs

This report details a comprehensive research initiative focused on developing a technical research plan for the efficient and sustainable production of rare earth elements (REEs) and critical materials (CMs) from coal-based resources, specifically lignite coal from the Williston Basin in North Dakota. The project’s methodology centers on the design and evaluation of a tunable electrochemical pathway (TEP), an innovative approach aimed at achieving high-purity rare earth oxides (REOs), rare earth salts (RES), and CMs. This research is crucial for addressing the growing demand for these materials in clean energy technologies, electric vehicles, and high-tech applications, while reducing the United States’ reliance on foreign supply chains.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2025

Tunable Electrochemical Pathway for High-Purity REMs and CMs

This report details a comprehensive research initiative focused on developing a technical research plan for the efficient and sustainable production of rare earth elements (REEs) and critical materials (CMs) from coal-based resources, specifically lignite coal from the Williston Basin in North Dakota. The project’s methodology centers on the design and evaluation of a tunable electrochemical pathway (TEP), an innovative approach aimed at achieving high-purity rare earth oxides (REOs), rare earth salts (RES), and CMs. This research is crucial for addressing the growing demand for these materials in clean energy technologies, electric vehicles, and high-tech applications, while reducing the United States’ reliance on foreign supply chains. The project was structured into four key tasks, each designed to build upon the previous one and contribute to the overarching goal of developing a viable technical research plan.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2025

A harmonized protocol to assess the single-cell performance of proton exchange membrane water electrolyzers

The harmonization of testing protocols for proton exchange membrane (PEM) electrolyzers is essential for ensuring accurate and reliable performance assessments and accelerating the development of hydrogen production technologies. This protocol provides a structured approach to PEM electrolyzer setup and testing, incorporating key considerations for test station design and single-cell characterization techniques. Polarization curves and electrochemical impedance spectroscopy (EIS) are detailed, along with best practices from academic and industry research groups to enhance data accuracy and comparability. By addressing material variability and harmonizing testing methodologies, this framework enables more precise evaluations of membrane electrode assemblies and electrolyzer components. Harmonized protocols not only streamline development efforts but also foster collaboration across institutions, ultimately supporting the commercialization of hydrogen solutions through improved stack efficiency and durability.

08 HYDROGEN↗
DOE OSTI2025

Mid-Atlantic US observations of radiocarbon in CO 2 : fossil and biogenic source partitioning and model evaluation

Accurately quantifying regional anthropogenic CO 2 fluxes is fundamental to improving our understanding of the carbon cycle and for creating effective carbon mitigation policies, and the radiocarbon to total carbon ratio in atmospheric CO 2 (Δ 14 CO 2 ) is a robust tracer of fossil fuel CO 2 that can discriminate between biogenic and fossil fuel CO 2 sources. NASA's Atmospheric Carbon and Transport-America (ACT-America) airborne mission between 2016 and 2019 aimed to improve the accuracy of regional greenhouse gas flux estimates, through refining our understanding and characterization of fluxes and flux uncertainties in models. Δ 14 CO 2 observations from 26 flights are presented for examining seasonal CO 2 source partitioning in the Mid-Atlantic USA. Observed variability in boundary layer CO 2 at timescales ranging from intra-day to seasonal was largely driven by biogenic CO 2 (CO 2bio ) variability that ranged from −19.7 ppm in summer to 16.2 ppm in fall, while fossil fuel CO 2 (CO 2ff ) variability remained at 3.3±2.0 ppm. Carbonyl sulfide uptake was well-correlated with CO 2bio uptake, and examining this relationship, as well as that between CO 2 and CO 2bio variability reinforces the seasonal extent of gross primary productivity response throughout ACT-America. We use airborne Δ 14 CO 2 flask sampling alongside in situ carbon monoxide measurements to calculate high-frequency CO 2ff and evaluate the magnitude and diurnal variability of modeled CO 2ff , deducing likely transport errors in an example flight. Although ACT-America CO 2ff signals were attenuated due to the broad source regions sampled, results illustrate the value of Δ 14 CO 2 sampling and observation-based methodologies for regional CO 2 flux attribution, evaluation and improvement of modeled CO 2 .

Baier, Bianca C. [National Oceanic and Atmospheric↗
DOE OSTI2022

Common Cause Failure Evaluation of High Safety-significant Safety-related Digital Instrumentation and Control Systems

Digital instrumentation and control (DI&C) systems in nuclear power plants (NPPs) have many advantages over analog systems but also pose different engineering and technical challenges, such as potential threats due to common cause failures (CCFs). This paper proposes a Platform for Risk Assessment of DI&C (PRADIC) developed by Idaho National Laboratory for dealing with potential software CCFs in DI&C systems of NPPs. The methodology development of PRADIC on the quantitative evaluation of software CCFs in high safety-significant safety-related DI&C systems in NPPs is illustrated in this paper. In PRADIC, qualitative hazard analysis and quantitative reliability and consequence analysis are successively implemented to obtain quantitative risk information, compare with respective risk evaluation acceptance criteria, and provide suggestions for risk reduction and design optimization. A comprehensive case study was also performed and documented in this paper. Results show that PRADIC can effectively identify potential digital-based CCFs, estimate their failure probabilities, and evaluate their impacts to system and plant safety.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Test and Evaluation of Systems with Embedded Machine Learning Components

As Machine Learning (ML) continues to advance, it is being integrated into more systems. Often, the ML component represents a significant portion of the system that reduces the burden on the end user or significantly improves task performance. However, the ML component represents an unknown complex phenomenon that is learned from collected data without the need to be explicitly programmed. Despite the improvement in task performance, the models are often black boxes. Evaluating the credibility and the vulnerabilities of ML models poses a gap in current test and evaluation practice. For high consequence applications, the lack of testing and evaluation procedures represents a significant source of uncertainty and risk. To help reduce that risk, here we present considerations to evaluate systems embedded with an ML component within a red-teaming inspired methodology. We focus on (1) cyber vulnerabilities to an ML model, (2) evaluating performance gaps, and (3) adversarial ML vulnerabilities.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Qualitative Risk Assessment of Legacy Wells within the Estimated Prairie State Generating Company Area of Review

This report details the digitization of a legacy wellbore database, including data processing assumptions, parameter estimation, and risk assessment methodology. The database, comprising 6,454 documents, was provided by ISGS. It includes valuable data from the Prairie State Generating Company (PSGC) and One Earth Energy (OEE) sites of the CarbonSAFE Phase III – Illinois Storage Corridor project. The report focuses on wells within a 15-mile radius from the Lively Grove #1 (LG#1) well at PSGC site, evaluating subsurface conditions and potential risks. A total of 4,386 wellbores within 15 miles of the LG#1 well were filtered based on depth and formation codes. LG#1 is the stratigraphic well at the PSGC site drilled in 2021. Ninety-four (94) wells penetrating the Maquoketa Shale Group (the primary confining unit) within the estimated area-of-review (AoR) for the PSGC site were evaluated using a qualitative risk assessment (QRA) methodology. The QRA developed by Arbad et al. 2022 focuses on legacy wells within the AoR and categorizes them based on well construction details. The QRA identifies wells that need immediate attention by categorizing them based on penetration depth and protection. Wells within the AoR were categorized into nine groups based on penetrations and protections. These categories range from Type 1 wells, with no documentation, to Type 9 wells, which do not penetrate the primary confining unit or storage reservoir (unit). Well accessibility within the AoR varies based on well status, including Dry & Abandoned (DA), Plugged & Abandoned (PA), Injection (INJ), Oil/Gas Producing (PROD), and Observation (Obs) wells. Accessibility levels were determined by well construction, with DA wells being the least accessible and Observation wells the most accessible, impacting gas leakage detection possibilities. Remedial action priority of wells decreases from Type 1 to Type 9 wells. Type 1 to Type 6 wells with status DA and PA require immediate attention, while Type 7 and Type 8 wells are low priority. A risk matrix used to prioritize corrective actions for legacy wells is proposed to categorize wells within an AoR based on penetrations, protections, and accessibility. The methodology involves data acquisition, well categorization into nine types, and determining CO 2 leakage pathways using well schematics and geospatial mapping. This approach is particularly useful for managing the integrity of legacy wells throughout the lifecycle of a Carbon Capture and Storage (CCS) project. A qualitative risk assessment of 94 wells within the AoR of the PSGC site identified 54 wells with high priority for corrective action due to penetration of the primary containment seal. The assessment utilizes color-coded maps to categorize well types and prioritize corrective actions, providing a comprehensive analysis. Schematics of wells penetrating the primary confining unit were drawn, and leakage pathways were identified. Details of all wells penetrating the confining zone are provided in the appendix, including information on well types, plugging, and casing status.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2021

Multiscale Airborne Infectious Disease Transmission

Airborne disease transmission is central to many scientific disciplines, including agriculture, veterinary biosafety, medicine, and public health. Legal and regulatory standards are in place to prevent agricultural, nosocomial, and community airborne disease transmission. However, the overall importance of the airborne pathway is underappreciated; e.g., the U.S. National Library of Medicine’s Medical Subjects Headings (MESH) thesaurus lacks an airborne disease transmission indexing term. This has practical consequences, as airborne precautions to control epidemic disease spread may not be taken when airborne transmission is important but unrecognized. Publishing clearer practical methodological guidelines for surveillance studies and disease outbreak evaluations could help address this situation. To inform future work, this paper highlights selected, well-established airborne transmission events, largely cases replicated in multiple, independently conducted scientific studies. Methodologies include field experiments, modeling, epidemiology studies, disease outbreak investigations, and mitigation studies. Collectively, this literature demonstrates that airborne viruses, bacteria, and fungal pathogens have the ability to cause disease in plants, animals, and humans over multiple distances, from near range (<5 m) to continental (>500 km) in scale. The plausibility and implications of undetected airborne disease transmission are discussed, including the notable underreporting of disease burdens for several airborne-transmitted diseases.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Draft Methodology for Cybersecurity Analysis for Adoption of Wireless Technology in Nuclear Power Plants

The report is delivered as DOE-NE Cybersecurity Program Milestone M2CT-22IN1104014-Industry cybersecurity guidance adoption status. The milestone is specifically to document the process and the status of the efforts towards developing guidance in support of industry’s adoption of wireless communication technologies. To transform the operation of nuclear power plants, including domestic light-water reactors, advanced reactors, microreactors, and fission battery, for grid and non-grid applications, secure and resilient wireless capabilities are required. In addition, to realize new operational concepts such as autonomous operation and remote monitoring, advanced sensor, and instrumentation, wireless technology is essential. However, industry implementation is low, and there is no technical basis for how to understand and address potential risks for wireless communications for critical plant functions. A methodology with a technical basis for implementing secure wireless communication is crucial. This wireless adoption methodology is intended to assist a licensee in identifying an appropriate technological approach for securing wireless communications in nuclear power plant. However, this methodology does not provide guidance for addressing wireless design criteria or for addressing all the cybersecurity commitments in licensees’ cybersecurity plans (CSPs) including addressing security impact analysis that a licensee must perform before an update to a Critical Digital Asset (CDA). This methodology guides a licensee through a process of evaluating a proposed wireless implementation and drafting a plant change notification for an example use case. The example is a generic/nonproprietary version of the first test case of the methodology, which, if successfully implemented, is part of the consideration for protecting other functions’ use of wireless in a cybersecure manner.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Low-Temperature Geothermal Geospatial Datasets: An Example from Alaska: Preprint

This project is part of a broader effort focused on geothermal heating and cooling with the purpose of demonstrating the multi-faceted value of integrating GHC/GHX into national decarbonization plans and community energy plans. Currently, there is a need to better define and evaluate low-temperature geothermal resource potential to provide the basis for supporting private sector investment. For shallow GHC/GHX fields, there is no formal compilation of subsurface characteristics shared among industry practitioners that can improve system design and operations. Alaska is specifically noted in this work, because heretofore, it has not received a similar focus in geothermal potential evaluations as the contiguous United States. The methodology consists of leveraging relevant data generate a baseline low-temperature resources (< 150 degrees C) geospatial dataset to compare and analyze information accessible to anyone trying to understand the potential of GHC/GHX and small-scale low-temperature geothermal power in Alaska (e.g., energy modelers, communities, planners, and policymakers). Importantly, this project is identifying data related to (1) the evaluation of GHC/GHX in the shallow subsurface, and (2) the evaluation of low-temperature geothermal resource availability. Additionally, data is being compiled to assess repurposing of oil and gas wells to contribute co-produced fluids toward the geothermal direct use and heating and cooling resource potential. The goal of this project is facilitating future deployment of GHC/GHX analysis and community-led programs and update the low-temperature geothermal resources assessment of Alaska. A better understanding of shallow potential for geothermal heat exchange (GHX) will improve design and operations of highly efficient GHC systems. The deployment and impact that can be achieved for low temperature geothermal resources will contribute to decarbonization goals and facilitate widespread electrification by shaving and shifting grid loads.

bottom-hole temperature↗