SEARCH · Search NASA

Results for “metric standardization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

All sources NASA NTRS DOE OSTI

DOE OSTI2022

A Generalized Transformer-Based Pulse Detection Algorithm

Pulse-like signals are ubiquitous in the field of single molecule analysis, e.g., electrical or optical pulses caused by analyte translocations in nanopores. The primary challenge in processing pulse-like signals is to capture the pulses in noisy backgrounds, but current methods are subjectively based on a user-defined threshold for pulse recognition. Here, we propose a generalized machine-learning based method, named pulse detection transformer (PETR), for pulse detection. PETR determines the start and end time points of individual pulses, thereby singling out pulse segments in a time-sequential trace. It is objective without needing to specify any threshold. It provides a generalized interface for downstream algorithms for specific application scenarios. PETR is validated using both simulated and experimental nanopore translocation data. It returns a competitive performance in detecting pulses through assessing them with several standard metrics. Finally, the generalization nature of the PETR output is demonstrated using two representative algorithms for feature extraction.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2021

Deep learning-based segmentation of lithium-ion battery microstructures enhanced by artificially generated electrodes

Accurate 3D representations of lithium-ion battery electrodes, in which the active particles, binder and pore phases are distinguished and labeled, can assist in understanding and ultimately improving battery performance. Here, we demonstrate a methodology for using deep-learning tools to achieve reliable segmentations of volumetric images of electrodes on which standard segmentation approaches fail due to insufficient contrast. We implement the 3D U-Net architecture for segmentation, and, to overcome the limitations of training data obtained experimentally through imaging, we show how synthetic learning data, consisting of realistic artificial electrode structures and their tomographic reconstructions, can be generated and used to enhance network performance. We apply our method to segment x-ray tomographic microscopy images of graphite-silicon composite electrodes and show it is accurate across standard metrics. We then apply it to obtain a statistically meaningful analysis of the microstructural evolution of the carbon-black and binder domain during battery operation.

25 ENERGY STORAGE↗

DOE OSTI2021

Characterizing the acceleration time of laser-driven ion acceleration with data-informed neural networks

Peak ion energy is an important figure-of-merit in short-pulse, laser-driven ion acceleration and is dependent on an associated acceleration time. Standard metrics for these quantities depend on analytical results such as the self-similar fluid model or empirical models based on relatively small experimental and simulation datasets. In this work we attempt to use a data-informed neural network (NN) as a surrogate model for a large ensemble of PIC simulations to investigate an effective acceleration time. We explore the application of a stacked convolutional and recurrent NN architecture for improved regression by incorporating the time dependencies of the data into the training process. Of particular note is how pretraining a network on lower fidelity data, e.g. 1D analytical results, greatly improves the network's ability to learn more complex, higher fidelity data. Finally, the dependency of the acceleration time on various laser and plasma parameters is explored.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2021

Electrical Measurement and Verification of Energy in DC Buildings

Today's selection of DC buildings features a diverse set of electrical topologies and turnkey solutions, and each has specific design trade-offs and optimizations. Designers desperately need standardized metrics and procedures for measurement and verification (M&V) to analyze and compare the advantages of each DC solution to traditional AC building networks. This work develops the Measurement-Informed Modeling (MIM) method, which can be used to determine full-building efficiency and energy savings. The MIM M&V procedure develops a building model, and refines the model with metered data. This work demonstrates the MIM method by measuring the full-building efficiency of two DC buildings operated by the Institute of Building Research in Shenzhen, China. The MIM procedure can ultimately be used to compare and improve the efficiency of various DC topologies.

buildings↗

DOE OSTI2026

Object-Based Evaluation of Dynamical and Statistical Downscaled Precipitation Products over CONUS

High-resolution precipitation data, generated through dynamical downscaling (DD) or statistical downscaling (SD) of global climate model output, provide critical information for regional climate assessment and adaptation planning. Most downscaling development and validation have focused on accurate gridscale precipitation construction and ignored the spatial structure of precipitation across model grids and at the event scale. However, many applications, e.g., hydrologic modeling and the analysis using the downscaled precipitation, require a reasonable representation of the spatial structure of precipitation within watersheds. Therefore, a set of standard metrics to evaluate the representation of the spatial structure of individual storms across diverse downscaled precipitation products is desired. To address this need, we conducted an object-based evaluation of precipitation in decades-long DD and SD products over the contiguous United States (CONUS). Specifically, we evaluate their ability to reproduce various features of precipitation objects in the observations: total volume, precipitation area, peak intensity, and spatial structure. Multiple metrics (bias, Perkins score, and nonparametric statistical tests) are used to quantify model performance. Our evaluation reveals notable variations in performance among individual products across different climate zones and seasons, as well as between extreme and nonextreme events. In general, most DD products exhibit balanced performance across the four precipitation object features, while SD products vary more significantly in their performance across products. Based on this comprehensive evaluation, we provide guidance on choosing downscaled products for specific regions, seasons, and precipitation object features. These findings and recommendations can inform precipitation-relevant modeling and analysis over CONUS, guide future downscaling technique developments, and provide actionable information for climate impact assessment and adaptation.

Downscaling↗

DOE OSTI2026

Object-Based Evaluation of Dynamical and Statistical Downscaled Precipitation Products over CONUS

Environmental sciences↗

DOE OSTI2023

Factors Influencing Building Demand Flexibility

The U.S. Department of Energy’s National Roadmap for Grid-interactive Efficient Buildings (GEB) acknowledged that building demand flexibility (DF) is both an important strategy to decarbonizing the buildings sector and an important resource for meeting the changing needs of the electrical grid such as improving grid reliability. However, understanding the complexity and uncertainties in real building field performance of DF strategies is a large gap hindering stakeholders on both grid and buildings side to make investments on deploying such strategies. The research work in this report intended to advance understanding of the variability and influential factors in building demand flexibility. Adding such knowledge based on lab testing results and measured performance data from real buildings is an important contribution. The report uses standardized metrics and methods to quantify DF performance from field-measured DF datasets of two significant building groups of big-box retail and medium office buildings to present the challenge of building DF variability in multiple dimensions. The report presents findings related to how several key factors influence building demand flexibility from implementing a common, cost-effective DF control strategy (i.e., adjusting zone temperatures). The findings are supported by full-scale lab testing, field data analysis and simulation research. The authors also provided application-oriented recommendations to stakeholders such as building aggregators, utility program design professionals, sophisticated building portfolio owners, and more.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2020

Development of an Optimized Gasoline Surrogate Formulation for PACE Experiments and Simulations

New powertrain solutions are needed to address societal challenges stemming in part from a transportation sector which relies heavily on combustion of conventional hydrocarbon fuels like gasoline. One way to advance new solutions is through predictive simulations. Predictive simulations can potentially limit the extent of experimental validations, reduce time spent in engineering design cycles, unlock new strategies for high efficiency combustion with power density, and minimize tailpipe emissions. However, the simulation tools currently available are either too computationally expensive, inadequate in their accuracy, or a combination of the two. A DOE-funded consortium of national laboratories called the Partnership to Advance Combustion Engines (PACE) seeks to address this gap by rapidly delivering new knowledge and tools which enable market-competitive powertrain solutions for light-duty vehicles. Approaches to modeling combustion in powertrain systems typically incorporate computational fluid dynamics (CFD) simulations with chemical kinetic models. These CFD simulations generally use surrogate fuels featuring a limited number of existing components in a reduced kinetic model to limit computational costs. Such surrogate fuels often sacrifice matching several or more combustion and physical properties of the target gasoline fuel. Validation of surrogate fuels is also often only pursued for a small subset of standard metrics such as research or motor octane number (RON, MON). The purpose of this project is to develop an optimal E10 gasoline surrogate fuel suitable for tasks across PACE to facilitate rapid common analysis and progression toward consortium goals. This project received contributions from tasks led by eight PACE principal investigators. The project funding here reflects all tasks under Pitz, whose tasks also contributed to additional PACE projects. Based on the optimal gasoline surrogate fuel composition, a reduced chemical kinetic model will be shared with PACE researchers, industry, and the broader combustion community.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2024

Marine Energy Commercialization Review: Evaluation of the Transition From Public to Private Capital

The mission of the U.S. Department of Energy's Water Power Technologies Office (WPTO) is to advance marine energy technologies through research, testing, and commercialization. This paper explores the barriers and potential solutions for marine energy commercialization by evaluating publicly available literature, feedback from public and private actors, and historical WPTO actions. A key finding is the absence of standardized metrics to measure marine energy commercialization progress and the lack of targeted success goals. This paper aims to define those metrics, informed by public and private goals and the challenges developers experience, and to further evaluate targets offered by public funders and private capital providers. Recommendations to address barriers in marine energy commercialization include enhancing public-private communication, refining commercialization requirements, leveraging technology transfer programs, and exploring novel funding mechanisms like green bonds and contracts for difference. Addressing these challenges through proposed adjustments could facilitate the transition of marine energy technologies from public funding to sustainable private investment, ultimately advancing their commercialization.

13 HYDRO ENERGY↗

DOE OSTI2025

State Spotlight on Resilience: The Michigan Public Service Commission and Data Informed Accountability

Resilience activities are an emerging area within regulatory utility policy. As resilience frameworks develop, many Public Utility Commissions (PUCs) are looking to initiate resilience activities and have identified enhancing grid reliability as a practical starting point. Reliability describes the grid’s ability to deliver electricity steadily and without interruptions under normal or “blue sky” conditions. Reliability is measured using industry standard metrics such as outage frequency (SAIFI) and outage duration (SAIDI). Resilience is broader, reflecting the grid’s ability to both withstand and recover from disruptions, particularly those caused by extreme events such as severe storms. A reliable grid minimizes routine disruptions; a resilient grid ensures the system can recover quickly when disruptions occur, preventing them from escalating into widespread or prolonged crises.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2025

Artificial Intelligence Benchmarking

AI benchmarking is a method for evaluating the effectiveness of an AI model using a set of standardized metrics, for example, high school-level math exams. These benchmarks and their results will enable ranking various AI models based on their effectiveness in performing a specific task.

Krishnan, Anjay [Fermilab]↗

DOE OSTI2025

Controlling Oxidation of Nb in Oxygen Abundant Environments

Modern particle accelerators depend on Superconducting Radio Frequency (SRF) cavities made from high-purity niobium (Nb) to achieve optimal performance, including high quality factors and strong accelerating gradients. However, when exposed to air, niobium naturally forms a complex oxide layer that can introduce surface imperfections and carbon contamination. This work examines an alternative oxidation strategy under oxygen-rich conditions to better regulate the oxide formation process. The ultimate objective is to improve surface uniformity and cleanliness, thereby reducing defect density and enhancing performance. We used Confocal Microscopy, Scanning Electron Microscopy (SEM), and X-Ray Photoelectron Spectroscopy (XPS) to analyze surface changes. We used standard metrics, like Arithmetic Average Roughness (Ra) and Root Mean Square (Rq). Three oxidation methods were applied: short, extended, and a repeated HF and H₂O₂ oxidation process. Preliminary results show promising reductions in carbon contamination and surface defects.

Romero, Juan [Fermilab]↗

DOE OSTI2021

Large Vessel Activity and Low-Frequency Underwater Sound Benchmarks in United States Waters

Chronic low-frequency noise from commercial shipping is a worldwide threat to marine animals that rely on sound for essential life functions. Although the U.S. National Oceanic and Atmospheric Administration recognizes the potential negative impacts of shipping noise in marine environments, there are currently no standard metrics to monitor and quantify shipping noise in U.S. marine waters. However, one-third octave band acoustic measurements centered at 63 and 125 Hz are used as international (European Union Marine Strategy Framework Directive) indicators for underwater ambient noise levels driven by shipping activity. We apply these metrics to passive acoustic monitoring data collected over 20 months in 2016–2017 at five dispersed sites throughout the U.S. Exclusive Economic Zone: Alaskan Arctic, Hawaii, Gulf of Mexico, Northeast Canyons and Seamounts Marine National Monument (Northwest Atlantic), and Cordell Bank National Marine Sanctuary (Northeast Pacific). To verify the relationship between shipping activity and underwater sound levels, vessel movement data from the Automatic Identification System (AIS) were paired to each passive acoustic monitoring site. Daily average sound levels were consistently near to or higher than 100 dB re 1 μPa in both the 63 and 125 Hz one-third octave bands at sites with high levels of shipping traffic (Gulf of Mexico, Northeast Canyons and Seamounts, and Cordell Bank). Where cargo vessels were less common (the Arctic and Hawaii), daily average sound levels were comparatively lower. Specifically, sound levels were ~20 dB lower year-round in Hawaii and ~10-20 dB lower in the Alaskan Arctic, depending on the season. Although these band-level measurements can only generally facilitate differentiation of sound sources, these results demonstrate that international acoustic indicators of commercial shipping can be applied to data collected in U.S. waters as a unified metric to approximate the influence of shipping as a driver of ambient noise levels, provide critical information to managers and policy makers about the status of marine environments, and to identify places and times for more detailed investigation regarding environmental impacts.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2021

Industrial Energy Assessment Training Effectiveness Evaluation: An Eye-Tracking Study

It is essential to understand the effectiveness of any training program so it can be improved accordingly. Various studies have applied standard metrics for the evaluation of visual behavior to recognize the areas of interest that attract individuals’ attention as there is a high correlation between attentional behavior and where one is focusing on. However, through reviewing the literature, we believe that studies that applied eye-tracking technologies for training purposes are still limited, especially in the industrial energy assessment training field. In this paper, the effectiveness of industrial energy assessment training was quantitatively evaluated by measuring the attentional allocation of trainees using eye-tracking technology. Moreover, this study identifies the areas that require more focus based on evaluating the performance of subjects after receiving the training. Additionally, this research was conducted in a controlled environment to remove the distractions that may be caused by environmental factors to only concentrate on variables that influence the learning behavior of subjects. The experiment results showed that after receiving the training, the subjects’ performance in energy assessment was significantly improved in two areas: production, and recycling and waste management, and the designed training program enhanced the knowledge of participants in identifying energy-saving opportunities to the knowledge level of experienced participants.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2020

The Land Sparing, Water Surface Use Efficiency, and Water Surface Transformation of Floating Photovoltaic Solar Energy Installations

Floating photovoltaic solar energy installations (FPVs) represent a new type of water surface use, potentially sparing land needed for agriculture and conservation. However, standardized metrics for the land sparing and resource use efficiencies of FPVs are absent. These metrics are critical to understanding the environmental and ecological impacts that FPVs may potentially exhibit. Here, we compared techno-hydrological and spatial attributes of four FPVs spanning different climatic regimes. Next, we defined and quantified the land sparing and water surface use efficiency (WSUE) of each FPV. Lastly, we coined and calculated the water surface transformation (WST) using generation data at the world’s first FPV (Far Niente Winery, California). The four FPVs spare 59,555 m2 of land and have a mean land sparing ratio of 2.7:1 m2 compared to ground-mounted PVs. Mean direct and total capacity-based WSUE is 94.5 ± 20.1 SD Wm−2 and 35.2 ± 27.4 SD Wm−2, respectively. Direct and total generation-based WST at Far Niente is 9.3 and 13.4 m2 MWh−1 yr−1, respectively; 2.3 times less area than ground-mounted utility-scale PVs. Our results reveal diverse techno-hydrological and spatial attributes of FPVs, the capacity of FPVs to spare land, and the utility of WSUE and WST metrics.

14 SOLAR ENERGY↗

DOE OSTI2020

Prognosis of Wind Turbine Gearbox Bearing Failures Using SCADA and Modeled Data

Predictive maintenance and condition monitoring systems for wind turbines have seen increased adoption to minimize downtime, reducing operation and maintenance costs. On today’s wind power plants, the integrated supervisory control and data acquisition (SCADA) system provides low- frequency operational data that can be leveraged to quantify a wind turbine’s health. The aim of this study is to utilize machine-learning techniques to predict axial cracking failures in wind turbine gearbox bearings up to 1 month ahead of time. The failures are assumed to have occurred when the investigated bearing was replaced. While current SCADA systems show the overall condition of a wind turbine, often they do not allow for the investigation of specific gearbox bearings’ health. To enrich bearing fault signatures, additional data are computed through physics-based models using gearbox design information. Based on SCADA data, modeled data, and bearing failure log data from an actual wind plant, the performances of different machine-learning models on unseen data are then evaluated using industry-standard metrics such as precision, recall, and F1 score. Results show the overall system performance enhancement in predicting bearing failure when modeled data are included with SCADA data. The reduction in terms of false alarms is about 50%, and improvement in terms of precision and F1 score is about 33% and 12% respectively, based on the best modeling case in this study.

49 EE - Wind and Water Power Program - Wind (EE-4W↗

DOE OSTI2021

First Muon Neutrino on Argon Cross Section Measurements With an Off-Axis Beam

While over ninety years have passed since neutrinos were first predicted in 1930 by Wolfgang Pauli, much about them is still unknown [20]. How many types of neutrinos there are, how precisely neutrinos change flavor, and how neutrinos interact with various types of matter are largely unanswered questions that have implications for fields beyond particle physics, such as cosmology and astrophysics. The final question can be answered partially by differential cross section measurements, two of which constitute the primary result of this thesis. The NeUtrinos at the Main Injector (NuMI) Beam at Fermilab in Batavia, IL provides a source of muon neutrinos and muon antineutrinos to the MicroBooNE experiment, an 85 ton liquid argon time projection chamber (LArTPC). The technology allows for high precision particle tracking and energy reconstruction that can be used to make cross section measurements. Necessary work for making these measurements for which the author of this thesis made an essential contribution is presented in detail in References [21] [22] [11] [23]. The measurement presented in this thesis is made with 2.187e20 Protons on Target (POT), the standard metric for an amount of beam exposure, of data when the beam was in forward horn current mode. Single-differential cross section measurements in terms of muon candidate kinetic energy and direction are made, and their statistical fits with simulation are 5.8 (12 d.o.f.) and 11.4 (10 d.o.f.), respectively. This indicates that the muon kinematics for muon neutrino and muon antineutrino charged-current (CC) events primarily in the energy range [0-3] GeV can be trusted for oscillation experiments, including DUNE, because of the agreement to within the associated systematic and statistical uncertainties between the measurement and the model in every bin of both single-differential cross sections. This result adds to the corresponding result for the Booster Neutrino Beam (BNB) because it covers a completely different energy region than that measurement, a double-differential cross section in terms of muon momentum and direction [14]. This result contributes to reducing the uncertainty in near-far event rate comparisons in long baseline neutrino experiments and also adds to existing knowledge of the neutrino-nucleus interaction by describing the outgoing muon kinematics in interactions of muon neutrinos and muon antineutrinos. This result is the first-ever measurement of differential cross sections of muon neutrinos and muon antineutrinos in liquid argon made with an off-axis beam.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2021

Machine Learning for Gearbox Fault Prediction by Using Both Scada and Modeled Data

This presentation outlines the work in the paper titled "Prognostics of Wind Turbine Gearbox Bearing Failures Using SCADA and Modeled Data" published by the PHM Society and presented at its 2020 annual conference. It is accessible at https://papers.phmsociety.org/index.php/phmconf/article/download/1292/862. The technical work is on machine learning approaches for prognostics for gearbox faults. The methodology combines SCADA time series data and physics domain modeling data, derived from the models developed by the NREL team, as inputs to machine learning models to predict gearbox bearing failures with one month lead time. Based on SCADA data, modeled data, and bearing failure log data from an actual wind plant, the performances of different machine-learning models on unseen data are then evaluated using industry-standard metrics such as precision, recall, and F1 score, and AUC (area under receiver operating characteristic curve). Results show the overall system performance enhancement in predicting bearing failure when modeled data are included with SCADA data. The reduction in terms of false alarms is about 50%, and improvement in terms of precision, and F1 score, and AUC is about 33%, and 12%, and 6% respectively, based on the best modeling case in this study.

49 EE - Wind and Water Power Program - Wind (EE-4W↗