Search NASASearch

SEARCH · Search NASA

Results for “performance metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Refining seasonal performance metrics for room air-conditioning in emerging markets: Integrating building simulations with real-world equipment performance data

Buildings significantly impact worldwide energy consumption, emphasizing the need to reduce the cooling energy demand, especially in warm climates. Minimum energy performance standards (MEPS) and seasonal performance metrics such as the Cooling Seasonal Performance Factor (CSPF) are crucial for improving room air conditioning (RAC) efficiency. However, challenges remain, particularly in emerging markets like Brazil, where seasonal performance metrics have recently been introduced. This study assesses the factors influencing country-level seasonal efficiency metrics and proposes a framework to refine these calculations by considering local climates and expected RAC usage in real-world households via building simulations. Key considerations include outdoor air temperature binning for different climates, RAC usage patterns (i.e., daytime and nighttime usages), envelope thermal performance of households, and urban heat island (UHI) effects. The results reveal that CSPF values can vary significantly based on climate conditions, with observed CSPF ranging from 4.10 to 11.59 Wh/Wh across 577 Brazilian climates. The inclusion of UHI effects led to a reduction in CSPF values by up to 29% during nighttime operations in hot urban areas. Additionally, building envelope efficiency showed contrasting impacts on RAC performance, with CSPFs reaching up to 15.35 Wh/Wh under specific optimized conditions. These findings highlight the need for transparent policymaking in RAC performance databases, facilitating the application of approaches like those proposed in this study and supporting diverse stakeholders in decision-making.

Bavaresco, Mateus

Inferring performance metrics for laser direct drive experiments on OMEGA

Quantifying performance improvements on the OMEGA laser facility requires robust inference of established no-alpha performance metrics, which requires, at minimum, a model to infer the shocked fuel mass and pressure of the confined fusion plasma. In this work, we describe the methodology used to infer performance metrics on OMEGA and present the current state-of-the art model used to infer these metrics from OMEGA experiments. In particular, since neutron images of cryogenic implosions are not available on OMEGA at present, we present how x-ray sizes are determined on OMEGA using a Gaussian Process regression model and how the neutron production region's size is inferred from them. As a result, we end by benchmarking the model using synthetic data and 1-D LILAC simulations and test its experimental self-consistency across available x-ray diagnostic channels.

Gopalaswamy, V. [Laboratory for Laser Energetics,

A hybrid numerical and machine learning framework for evaluating the performance of a 780 cm 2 aqueous organic redox flow battery

Aqueous organic redox flow battery (AORFB) is a promising cost-competitive technology for large-scale energy storage. Among existing work, the dihydroxyphenazine (DHP)-based AORFB has demonstrated high energy density and low capacity degradation in 10 cm2 cells during lab tests. However, its commercial-scale performance in more complex environments remains unknown, posing a barrier for commercialization. To address this gap, this work presents a comprehensive performance evaluation of a 780 cm 2 DHP-based AORFB by combining physics-based numerical model, machine learning (ML)-based surrogate models, and ML-derived sensitivity quantification. Specifically, we first select 12 key battery parameters that include 10 physicochemical quantities and 2 operation quantities, then select 6 performance metrics that include energy efficiency (EE), discharging capacity, charging energy, and power losses due to concentration, activation, and ohmic over-potentials. With such selection, 12800 combinations of the 12 parameters are subsequently generated using the Latin Hypercube Sampling method. These combinations, together with 38 pre-defined State of Charge, are then integrated to a validated AORFB model developed in COMSOL to compute the performance metrics. With both input parameters and performance metrics, 60 deep neural network (DNN) surrogate models are then trained to approximate the relationship between the 10 physicochemical quantities and 6 performance metrics at each flow rate and current density. Sensitivity scores are then calculated based on the DNN models. Two additional sensitivity analysis tools, i.e., MARS, and SHAP, are also used to cross-validate the sensitivity scores from the DNN. The results demonstrate that 1) the standard potential ranks the first in controlling EE and charging energy, 2) the membrane conductivity is most critical for power loss and EE, and 3) specific area and reaction rate control activation power loss.

25 ENERGY STORAGE

Evaluating large scale aqueous organic redox flow battery performance with a hybrid numerical and machine learning framework

Aqueous organic redox flow battery (AORFB) is a promising cost-competitive technology for large-scale energy storage. Among existing work, the dihydroxyphenazine (DHP)-based AORFB has demonstrated high energy density and low-capacity degradation in 10 cm$^2$ cells during lab tests. However, its commercial-scale performance in more complex environments remains unknown, posing a barrier to commercialization. To address this gap, this work presents a comprehensive performance evaluation of a 780 cm$^2$ DHP-based AORFB by combining a physics-based numerical model, machine learning (ML)-based surrogate models, and ML-derived sensitivity quantification. Specifically, we first select 12 key battery parameters that include 10 physicochemical and 2 operation quantities, then select 6 performance metrics that include energy efficiency (EE), discharging capacity, charging energy, and power losses due to concentration, activation, and ohmic over-potentials. With such selection, 12800 combinations of the 12 parameters are subsequently generated using the Latin Hypercube Sampling method. Such combinations, together with 38 pre-defined State of Charge, are then integrated to a validated AORFB model developed in COMSOL to compute the performance metrics. With both input parameters and performance metrics, 60 deep neural network (DNN) surrogate models are then trained to approximate the relationship between the 10 physicochemical quantities and 6 performance metrics at each flow rate and current density. Sensitivity scores are then calculated based on the DNN models. Two additional sensitivity analysis tools, i.e., MARS, and SHAP, are also used to cross-validate the sensitivity scores from the DNN. The results demonstrate that 1) the standard potential ranks first in controlling EE and charging energy, 2) the membrane conductivity is most critical for power loss and EE, and 3) specific area and reaction rate control activation power loss.

25 ENERGY STORAGE

Underwater Target Detection Software Demonstration on the RivGen Turbine

This repository contains data and processing scripts necessary to train the object detection models utilized in the underwater target detection software demonstration on the RivGen turbine project and to produce performance metrics (precision, recall, mAP50, mAP50-95). - Contents - Data consist of "images" and "labels". Each image has an associated label, both share the same time string in its file name (e.g., 2024_05_25_09_01_57.98.jpg and 2024_05_25_09_01_57.98.txt). Time strings have the format %yyyy_%mm_%dd_%HH_%MM_%SS.%3f. Images and labels were curated from 2021 and 2024 smolt outmigration periods at the project site in Igiugig, AK. Images are monochrome 8-bit images of objects (smolt, debris, and other) passing through the field of view of the deployed cameras during various operational stages of the RivGen turbine. Labels are text files indicating the class and bounding polygon of each object in an image. The provided labels use the "YOLO" label format. - Requirements - Python3.8+ is required to install and run the train and validation script. The README.md provides instruction for installing the requirements from the requirements.py file. - Instructions - The "example_train.py" file ingests the provided data, trains a model, and produces model performance metrics at completion. NOTE: model performance metrics will vary from run to run as a consequence of the random selection of training and validation data.

16 TIDAL AND WAVE POWER

Energy Storage Cost and Performance Database

In support of the U.S. Department of Energy’s Energy Storage Grand Challenge, Pacific Northwest National Laboratory is applying its rich history of battery research and development to provide the U.S. Department of Energy (DOE) and industry with a guide to current energy storage costs and performance metrics for various technologies. Cost and performance metrics for individual technologies track the following to provide an overall cost of ownership for each technology: cost to procure, install, and connect an energy storage system; associated operational and maintenance costs; and end-of-life costs. These metrics are intended to support DOE and industry stakeholders in making sound decisions about future R&D directions and priorities that move the United States closer to its goal of energy independence. The technologies currently being evaluated are lithium-ion [lithium iron phosphate (LFP) and nickel manganese cobalt (NMC)] batteries, vanadium redox flow batteries, lead-acid batteries, zinc-based batteries, hydrogen energy storage, pumped storage hydropower, gravitational energy storage, compressed air energy storage, and thermal energy storage.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI

Evaluating Tools and Technologies for Monitoring Baleen Whales During Offshore Wind Foundation Installation

Impacts to baleen whales are of particular concern in the context of offshore wind development because of their conservation status, the overlap of their habitat with current and planned offshore wind energy facilities, and their expected sensitivity to low-frequency sounds, such as those produced during pile driving. Therefore, this report focuses on monitoring technologies capable of detecting this species group. The scope of this report is to assess the current state of technologies and methods for monitoring baleen whales in low- and no-light conditions in conjunction with offshore wind foundation installation. This work considers the performance of various sensing technologies that can be used to observe the presence of baleen whales near offshore construction activities. The scope of work includes: 1. Technology Performance Metrics – Identify metrics that can be used to assess technology performance. 2. Technology Evaluation – Synthesize the past performance of technologies with respect to the performance metrics based on available literature. 3. Technology Characterization Framework – Describe a potential framework to characterize technology performance with a standardized approach. 4. Technology Research and Development Needs – Identify future needs and opportunities for research, development, and deployment to improve technologies.

17 WIND ENERGY

Identifying materials-level sources of performance variation in superconducting transmon qubits

The Superconducting Quantum Materials and Systems Center, a U. S. Department of Energy National Quantum Information Science Research Center, has conducted a comprehensive and coordinated study using superconducting transmon qubit chips with known performance metrics to identify the underlying materials-level sources of device-to-device performance variation. Following qubit coherence measurements, these qubits of varying base superconducting metals and substrates have been examined with various non-destructive and invasive material characterization techniques at Northwestern University, Ames National Laboratory, and Fermilab as part of a blind study. We find trends in variations of the depth of the etched substrate trench, the thickness of the surface oxide, and the geometry of the sidewall, which when combined, lead to correlations with the T1 lifetime across different qubits on the same chip. In addition, we provide a list of features that varied from device to device, for which the impact on performance requires further studies. Finally, we identify two low-temperature characterization techniques that may potentially serve as proxy tools for qubit measurements. These insights provide materials-oriented solutions to not only reduce performance variations across neighboring devices but also to engineer and fabricate devices with optimal geometries to achieve performance metrics beyond the state-of-the-art values.

Murthy, Akshay A. [Fermilab] (ORCID:00000001767768

Quantum Instrumentation and Control Kit (QICK) for Quantum Networks

We report the first demonstration of using the Quantum Instrumentation and Control Kit (QICK) system on RFSoC FPGA technology to drive an entangled photon pair source and to detect the photon signals. With the QICK system, we achieve high levels of performance metrics including coincidence-to-accidental ratio exceeding 150, and entanglement visibility exceeding 95%, consistent with performance metrics achieved using conventional waveform generators. We also demonstrate simultaneous detector readout using the digitization functional of QICK, achieving internal system synchronization time resolution of 3.2 ps. The work reported in this paper represents an explicit demonstration of the feasibility for replacing commercial waveform generators and time taggers with RFSoC-FPGA technology in the operation of a quantum network, representing a cost reduction of more than an order of magnitude.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND

Data-Driven Performance Optimization of Gamma Spectrometers With Many Channels

In gamma spectrometers with variable spectroscopic performance across many channels (e.g., many pixels or voxels), a tradeoff exists between including data from successively worse-performing readout channels and increasing efficiency. Brute-force calculation of the optimal set of included channels is exponentially infeasible as the number of channels grows, and approximate methods are required. In this work, we present a data-driven framework for attempting to find near-optimal sets of included detector channels. The framework leverages non-negative matrix factorization (NMF) to learn the behavior of gamma spectra across the detector and clusters similarly-performing detector channels together. Performance comparisons are then made between spectra with channel clusters removed, which is more feasible than brute force. The framework is general and can be applied to arbitrary, user-defined performance metrics depending on the application. We apply this framework to optimizing gamma spectra measured by H3D M400 CdZnTe (CZT) spectrometers, which exhibit variable performance across their crystal volumes. In particular, we show several examples optimizing various performance metrics for uranium and plutonium gamma spectra in non-destructive assay (NDA) for nuclear safeguards, and explore trends in performance versus parameters such as clustering algorithm type. We also compare the NMF + clustering pipeline to several non-machine-learning (ML) algorithms, including several greedy algorithms. Although, we find that the NMF + clustering pipeline tends to find the best-performing set of detector voxels, significantly improving over the unoptimized spectra, but that a greedy accumulation of spectra segmented by detector depth can, in some cases, give similar performance improvements in much less computation time.

Energy resolution

Exxon Mobil-NETL Testing of DAC Materials

This joint initiative is aimed at extending our understanding of real DAC testing conditions at the NETL DAC testbed facility. Of particular focus will be: • Small Scale testing of powdered and formulated materials (supplied by ExxonMobil) to evaluate various performance metrics under DAC process cycles • Pilot scale testing of formulated materials at larger scales ExxonMobil will work with NETL to shake down equipment, validate testing methods, and define best practices for data analysis. Three tasks are proposed: 1. Validation of multi-cycle test data on powdered and formulated materials to benchmark various performance metrics of these materials. 2. Steam regeneration of powdered samples at small scale to define baseline performance under commercially relevant conditions. 3. Pilot scale testing of larger formulated materials to test commercially relevant samples under actual process cycles.

36 MATERIALS SCIENCE

Applying queueing theory to evaluate wait-time-savings of triage algorithms

Abstract In the past decade, artificial intelligence (AI) algorithms have made promising impacts in many areas of healthcare. One application is AI-enabled prioritization software known as computer-aided triage and notification (CADt). This type of software as a medical device is intended to prioritize reviews of radiological images with time-sensitive findings, thus shortening the waiting time for patients with these findings. While many CADt devices have been deployed into clinical workflows and have been shown to improve patient treatment and clinical outcomes, quantitative methods to evaluate the wait-time-savings from their deployment are not yet available. In this paper, we apply queueing theory methods to evaluate the wait-time-savings of a CADt by calculating the average waiting time per patient image without and with a CADt device being deployed. We study two workflow models with one or multiple radiologists (servers) for a range of AI diagnostic performances, radiologist’s reading rates, and patient image (customer) arrival rates. To evaluate the time-saving performance of a CADt, we use the difference in the mean waiting time between the diseased patient images in the with-CADt scenario and that in the without-CADt scenario as our performance metric. As part of this effort, we have developed and also share a software tool to simulate the radiology workflow around medical image interpretation, to verify theoretical results, and to provide confidence intervals for the performance metric we defined. We show quantitatively that a CADt triage device is more effective in a busy, short-staffed reading setting, which is consistent with our clinical intuition and simulation results. Although this work is motivated by the need for evaluating CADt devices, the evaluation methodology presented in this paper can be applied to assess the time-saving performance of other types of algorithms that prioritize a subset of customers based on binary outputs.

Thompson, Yee Lam Elim (ORCID:0000000196537707)

Scintillation of colloidal nanocrystals

Scintillators are materials that convert ionizing radiation in the form of particles or photons into low-energy photons in the ultraviolet to near-infrared spectral range. Here, this work reviews efforts to use colloidal nanocrystals as scintillator materials. To date, research on colloidal nanocrystals as scintillators has focused on doped phosphor systems, quantum dots and related structures, and perovskite-based nanocrystals. Among various material classes and forms, colloidal semiconductor nanocrystals stand out thanks to their appealing fluorescence properties, yet understanding of their radioluminescence and cathodoluminescence is incomplete. This review discusses fundamental limits and material design challenges toward achieving high brightness, fast speed, and durable scintillator performance with nanocrystal scintillators. First, this review describes the basic principles and efficiency limitations of scintillation, particularly the large influence of multiple exciton generation in many nanocrystal species, as well as performance metrics. Second, methods for measurement are described. Third, we review the results of the main classes of nanocrystal scintillators, including quantum dots and related particles, perovskites, and doped-phosphor particles. Fourth, scintillation imaging is discussed in terms of the relevant performance metrics and results obtained using nanocrystal materials. Finally, we note the strengths and weaknesses of nanocrystal scintillators and discuss potential areas of further development.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH