Search NASA⌕ Search

SEARCH · Search NASA

Results for “metric standardization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

A Study of Imbalance Levels Attributed to Photovoltaic Penetration in Distribution Systems

Abstract— The number of renewable sources, namely photovoltaics (PV), continues to grow within distribution systems. How placements impact a system’s performance remains a concern within both the research and the utility communities. Beyond system node voltages and real power losses, this work looks to industry standard imbalance metrics and the changes experienced on these values with varied levels of PV. Specifically, four imbalance metrics are presented and studied for an actual 906-bus distribution system. Multiple loading conditions and photovoltaic placement schemes are explored to compare the changes seen on these metrics across a variety of scenarios experienced by the network.

14 SOLAR ENERGY↗
DOE OSTI2021

Extracting Resilience Metrics From Distribution Utility Data Using Outage and Restore Process Statistics

Resilience curves track the accumulation and restoration of outages during an event on an electric distribution grid. We show that a resilience curve generated from utility data can always be decomposed into an outage process and a restore process and that these processes generally overlap in time. We use many events in real utility data to characterize the statistics of these processes, and derive formulas based on these statistics for resilience metrics such as restore duration, customer hours not served, and outage and restore rates. The formulas express the mean value of these metrics as a function of the number of outages in the event. We also give a formula for the variability of restore duration, which allows us to predict a maximum restore duration with 95% confidence. Overall, we give a simple and general way to decompose resilience curves into outage and restore processes and then show how to use these processes to extract resilience metrics from standard distribution system data.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Hybrid-BPR (Bayesian Personalized Ranking with Feature Embeddings and Explicit Negative Sampling) [SWR-26-039]

Hybrid-BPR is a Python library for Bayesian Personalized Ranking (BPR) with two key capabilities that go beyond standard BPR implementations: 1. User and item feature embeddings - incorporate content-based signals (genres, tags, metadata) alongside collaborative filtering. 2. Implicit negative interactions - use observed non-interactions (e.g. viewed-but-not-clicked) as negative training signal instead of random sampling from the full item space. The software is built for recommender systems research with MLflow experiment tracking, parallel hyperparameter sweeps, and standard ranking metrics.

Sandhu, Rimple [National Laboratory of the Rockies↗
DOE OSTI2024

Production of Carbon Nanomaterials and Sorbents from Domestic U.S. Coal (Final Report)

The main goal of this project was to produce high-value carbon nanomaterials and carbon sorbents from domestic coal resources in a cost-effective manner. Four types of domestic coal samples were processed through a combination of deashing, devolatilization, oxidation, reduction, and activation treatments to produce graphene oxide (GO), reduced graphene oxide (RGO), and activated carbon (AC). The precursors and developed materials were extensively characterized by various methods to investigate the impact of the coal feedstock type on the yield and quality of each product. A commercial graphite-based GO sample was included in the experimental work as the baseline material for comparison with the coal-based materials developed in this work. The performed work also included a technoeconomic analysis and cost estimation for a plant processing 20 tons/day coal, a market evaluation for the graphene materials, and a technology gap analysis. A simple process by concentrated nitric acid oxidation is used to oxidize coal precursors for the production of GO. Fine oxidized coal particles that were separated from larger oxidized coal particles had significantly higher oxygen contents and were identified as coal-based GO samples. Coarse oxidized coal particles were used as precursors for production of AC. Based on the Raman spectroscopy results, coal-based GO samples exhibited G and D bands similar to those of graphite-based GO samples. X-ray photoelectron spectroscopy revealed that coal-based GO samples had surface oxygen contents of ~26-35% that were higher than the oxygen contents of graphite-based GO samples. Larger particles of oxidized coal samples were activated under different conditions to produce high surface area functionalized AC. Prepared materials had surface areas exceeding 1,500 m 2 /g and pore volumes more than 1 cm 3 /g with different pore size distributions. Reduced graphene oxide samples were prepared by thermal reduction of both coal-based and graphite-based GO samples at 170-2800 ºC. Coal-based and graphite-based RGO samples exhibited similar carbon contents, Raman spectra, and XRD profiles. Heat treatment above 1500 ºC shifted RGO to synthetic graphite. Among anthracite, bituminous, subbituminous, and lignite coals tested, anthracite was the best precursor to produce carbon nanomaterials exhibiting properties similar to those of graphite-based materials. Anthracite-based carbon nanomaterials also had the highest production yields. Technoeconomic analysis estimated the production cost of GO and RGO for anthracite-based samples at about 2,600 and 4,200 $/ton, respectively, which is about two orders of magnitude lower than the current estimated price of graphite-based materials. Several gaps to further develop the proposed technology were identified and discussed that include process and equipment optimization, process integration, need for additional bench- and pilot-scale experiments, and other items to reduce the scale up risk. Market analysis reports suggested a compound annual growth rate of 40% for graphene and related materials. Short-term applications include composites, inks, and coatings. However, energy storage applications appear to be the dominant potential long-term applications. Different applications of coal-based GO and RGO need to be explored and clear metrics and standards for each application need to be developed.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2024

The Effect of Luminance Pattern on Nighttime Discomfort Glare Response - CRADA 653 (Abstract)

Light Emitting Diode (LED) adoption is critical for widespread energy savings from commercial outdoor lighting systems. A complaint from the public, concerns glare from LED light fixtures especially those with exposed LED arrays. This human factor study will examine luminance uniformity of the fixture aperture to identify parameters related to this response. The outcome will inform optical design by lighting manufacturers, retaining LED energy efficiency while mitigating glare. The results may also lead to improved industry standard glare metrics for lighting. Pacific Northwest National Laboratory’s (PNNL) Lighting Science and Technology Lab in Portland OR has a purpose-built apparatus with exposed LED arrays that have been used for prior work. It can easily be adapted for use in this experiment. Interchangeable templates will allow changing patterns for the stimulus. Glare ratings from the recruited subjects will be analyzed and reported in a peer-reviewed journal for application by luminaire manufacturers for improved products. The McClung Foundation’s interest is to better understand human perception of lighting, leading to more comfortable and effective visual environments. Members of the Foundation’s Technical Review Committee will be instrumental in reviewing the experimental design, analysis, and the final report. They will also help disseminate information about the results within the lighting community.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

Assessment of Condition Monitoring Methods and Technologies for Inservice Inspection and Testing of Nuclear Power Plant Components

This report was prepared for the U.S. Nuclear Regulatory Commission (NRC) to explore the application of advanced technologies toward meeting the current and future regulatory requirements for maintenance and condition monitoring of structures, systems, and components. The advanced technologies considered in this work are advanced sensors and instrumentation, data analytics, machine learning and artificial intelligence (ML/AI), physics-based models, and digital twins (DT). The interest in the application of advanced technologies for condition monitoring in nuclear power plants continues to grow, and current and future licensees are expected to implement advanced technologies as part of their inservice inspection (ISI) and inservice testing (IST) programs. This report delineates the outcomes of an exploratory investigation into the implementation of advanced condition monitoring technologies to address ISI and IST requirements. A thorough review was conducted of the existing regulatory requirements for ISI and IST, along with an analysis of associated industry practices. Additionally, a state-of-the-art assessment was performed on advanced condition monitoring technologies frequently employed in non-nuclear sectors. This research incorporated two nuclear-specific case studies to illustrate the application of these technologies within the current nuclear fleet. The report provides an exhaustive discussion on the technical challenges, considerations, and opportunities associated with the deployment of advanced condition monitoring technologies. The following are key considerations in the application of advanced technologies for the ISI and IST of nuclear power plant components: • Developing adequate verification and validation procedures to confirm the functional and non-functional requirements, • Developing technical capabilities to conduct real-time asset condition monitoring, • Establishing guidance and protocol for modeling and simulation tools to continuously meet regulatory requirements, • Addressing trustworthiness, explainability, and interpretability of ML/AI methods, • Evaluating maintenance activities to maintain an adequate safety margin and avoid undesirable conditions, • Establishing cybersecure condition monitoring programs associated with a computer-based software system, and • Establishing standardized evaluation metrics for advanced condition monitoring programs. Interest in the use of advanced technologies for condition monitoring in ISI and IST programs continues to grow, and the technology is expected to experience rapid and wide industry adoption in the near future. Adoption of advanced technologies for condition monitoring could have novel and unique impacts on regulatory activities associated with ISI and IST programs. The NRC is continuing to explore the regulatory aspects of advanced technologies as part of ISI and IST programs by pursuing additional research in this technical area.

22 - GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2026

Taming the Wild West: Assessing Impacts-Relevant Climate Data Products (Abbreviated Report)

Impacts-relevant Earth system data refers to observational and ESM data that are downscaled, debiased, validated, and provisioned for use by decision-makers. Impacts-relevant Earth system data is essential for mitigation and adaptation planning across a variety of regions and sectors. A vast number of these data products have emerged in recent years, which has led to confusion among stakeholders and scientists as to the best product to use. With no standard evaluation protocol available for these products, the decision on which product to use was sometimes made because it was pragmatic rather than the best product to use. This project sought to develop foundational capabilities around impacts-relevant data products that would support more informed selection and application of these products. This work has been immensely successful, driving several academic publications and supported the development of a community of practice around impacts-relevant data products. Over the project’s three years we have addressed six tasks: First, the development of standard evaluation metrics for impacts-relevant climate data; second, the development of a novel suite of atmospheric river metrics; third, the development of novel metrics for precipitation feature analysis; fourth, the development of novel metrics for assessing co-variances between temperature and precipitation; fifth, the development of a dashboard for interactive examination of impacts-relevant climate data; and sixth, the establishment of a community of practice around impacts-relevant climate data that will continue beyond the conclusion of this project.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Comparison of Machine Learning-Based Predictive Models of the Nutrient Loads Delivered from the Mississippi/Atchafalaya River Basin to the Gulf of Mexico

Predicting nutrient loads is essential to understanding and managing one of the environmental issues faced by the northern Gulf of Mexico hypoxic zone, which poses a severe threat to the Gulf’s healthy ecosystem and economy. The development of hypoxia in the Gulf of Mexico is strongly associated with the eutrophication process initiated by excessive nutrient loads. Due to the complexities in the excessive nutrient loads to the Gulf of Mexico, it is challenging to understand and predict the underlying temporal variation of nutrient loads. The study was aimed at identifying an optimal predictive machine learning model to capture and predict nonlinear behavior of the nutrient loads delivered from the Mississippi/Atchafalaya River Basin (MARB) to the Gulf of Mexico. For this purpose, monthly nutrient loads (N and P) in tons were collected from US Geological Survey (USGS) monitoring station 07373420 from 1980 to 2020. Machine learning models—including autoregressive integrated moving average (ARIMA), gaussian process regression (GPR), single-layer multilayer perceptron (MLP), and a long short-term memory (LSTM) with the single hidden layer—were developed to predict the monthly nutrient loads, and model performances were evaluated by standard assessment metrics—Root Mean Square Error (RMSE) and Correlation Coefficient (R). The residuals of predictive models were examined by the Durbin–Watson statistic. The results showed that MLP and LSTM persistently achieved better accuracy in predicting monthly TN and TP loads compared to GPR and ARIMA. In addition, GPR models achieved slightly better test RMSE score than ARIMA models while their correlation coefficients are much lower than ARIMA models. Moreover, MLP performed slightly better than LSTM in predicting monthly TP loads while LSTM slightly outperformed for TN loads. Furthermore, it was found that the optimizer and number of inputs didn’t show effects on the LSTM performance while they exhibited impacts on MLP outcomes. This study explores the capability of machine learning models to accurately predict nonlinearly fluctuating nutrient loads delivered to the Gulf of Mexico. Further efforts focus on improving the accuracy of forecasting using hybrid models which combine several machine learning models with superior predictive performance for nutrient fluxes throughout the MARB.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Low-Carbon District Heating: Performance Modeling of Hybrid Solar, Heat Pump, and Thermal Storage Systems for District Thermal Energy in the United States

District heating requires thermal energy in the temperature range of 40 degrees C - 120 degrees C. Typically, the thermal energy input for these systems has largely been met through fossil energy. However, the temperature range is low enough that it presents an opportunity for low-carbon technologies such as solar thermal and electrified thermal generators like heat pumps to decarbonize the heat generation. In this paper, a heat pump model was applied to estimate the performance and economics of a real-world low-carbon district heating substation. This system is comprised of a flat plate solar collector field paired with a mechanical vapor compression heat pump and hot water thermal storage, augmented by gas-fired boilers. Plant data was used to tune the model and estimate the system's benefits in terms of both standard financial metrics (IRR and payback), and environmental metrics, including avoided CO2 emissions. The model is subsequently employed to estimate the technical and economic potential of solar + heat pump + ther-mal storage hybrid systems as retrofits for district heating systems in eight US Markets.

district heating↗
DOE OSTI2026

Enhancing Operational Safety via Agentic Dialogue Hazard Identification Analysis

Operational safety in high-stakes domains such as industrial process control, autonomous, and safety-critical systems demand reliable hazard identification. While large language models (LLMs) have shown promise in automating safety analysis tasks, single-turn, monolithic inference is brittle: it lacks the self-correction, deliberation, and contextual refinement that safety engineers apply iteratively. In this paper, we introduce HAZDIAL, a framework that investigates whether structured agentic dialogue (multi-agent, multi-turn interactions) improves the quality of NLP-based hazard identification over single-pass baselines. We systematically compare two dialogue modalities: adversarial debate and constructive discussion, and propose an genetic algorithm-based agentic interaction optimization. We evaluate all configurations against a curated golden dataset using standard classification metrics (accuracy, precision, recall, F1) and a novel dialogue metrics. This work advances the intersection of dialogue systems, multi-agent reasoning, and AI safety, providing empirical evidence for dialogue-driven hazard analysis.

Das, Sanjay [ORNL] (ORCID:0009000542591915)↗
DOE OSTI2021

Benchmark Testing on the IBM-Q Network

The goal of this project is to evaluate a proposed set of candidate benchmarks being developed by the Standards and Performance Metrics Technical Advisory Group (TAG) of the Quantum Economic Development Consortium (QED-C), of which LANL is a member. The QED-C Standards and Performance Metrics TAG has developed implementations of several benchmark codes with the hope and expectation that these codes will be helpful to QED-C members interested in investigating various quantum computer platforms. The benchmark set will be run on LANL’s access to the IBM-Q system with the intent to evaluate the set for scalability, correct execution, and coverage of the application space. The goal is for the QED-C Standards and Performance Metrics TAC to be able to produce a coherent, consistent, scalable set of benchmarks that will run on multiple quantum computing platforms and will be available to members of QED-C, including LANL.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Equitable Energy Metrics for Integration into Building Performance Standard Tracking Platforms: Preprint

Building Performance Standards (BPS) are being adopted globally and in the United States of America, where 14 different states and jurisdictions have a policy in place and many others are under development (Department of Energy (DOE) 2023). Accurate and equitable data sources are essential to make informed decisions about focusing investment on upgrading buildings to meet jurisdictional goals. There have been multiple new tools developed related to Energy Equity and Environmental Justice (EEEJ) and the resulting datasets need to be integrated into large building port-folios for quick access and better scalability. Integrating EEEJ data in a user-friendly format can help decision makers more quickly assess impacts and analyze the multitude of potentially significant metrics for which there is not yet consensus. In the U.S. and Canada, many BPS ordinances rely primarily on ENERGY STAR Portfolio Manager (ESPM) to capture building characteristics and energy and water consumption data. These datasets can then be imported into city-specific building tracking tools like the Standard Energy Efficiency Data Platform (SEED). Crucially, BPS decision makers require an efficient means of identifying buildings in priority communities to effectively allocate resources and funding. This process must integrate seamlessly with existing jurisdictional toolsets for optimal utility. This paper will demonstrate, for the case of Washington D.C.'s (the District) data, a workflow that provides actionable data for building upgrade investment prioritization in disadvantaged communities.

BPS↗
DOE OSTI2025

An Observational Evaluation of RKW Theory over the U.S. Southern Great Plains

The theory of Rotunno et al. (“RKW” theory) addresses the behavior of squall-line cold pools in vertically sheared flows. It predicts that, within a given thermodynamic environment, a balance between baroclinic vorticity generation by the cold pool and low-level environmental vertical wind shear induces an upright updraft along the gust front that maximizes the initiation of new convective cells. Although this theory has been evaluated numerically, its applicability to observed systems remains unclear and is limited by a lack of critical measurements, including high-frequency thermodynamic and wind profiles across the gust front. Herein, observations from the Atmospheric Radiation Measurement Southern Great Plains (ARM-SGP) observatory near Lamont, Oklahoma, are used to evaluate RKW theory for 10 well-observed squall lines over a 11-yr period. For this evaluation, RKW parameters including cold-pool intensity (c), low-level ambient, line-normal vertical shear (ΔV n ), subcloud and cloud-layer updraft tilts, and multiple measures of system intensity are estimated. Furthermore, the c estimates rely on thermodynamic retrievals from the Atmosphere Emitted Radiance Interferometer (AERI), which are uncertain but verify reasonably well against independent observations. As predicted by the theory, for c/ΔV n ≥ 1, c/ΔV n correlates positively with updraft tilt and negatively with system intensity, but these results are not always statistically significant and are also sensitive to the method by which ΔV n is evaluated. Specifically, ΔV n evaluations that extend above the cold-pool top yield greater consistency with RKW predictions. Also, some measures of intensity correlate more strongly with standard moist instability metrics than with RKW parameters.

Cold pools↗
DOE OSTI2023

LTE-P-19 Comparison Metrics and Terms for Low Temperature Electrolysis

Defines a standard set of definitions, metrics, units, and conventions for low temperature electrolysis (LTE). The goal is to ensure that the literature is consistent from research group to research group, and data is reported in similar formats, such that results can be compared on a similar basis.

Electryolyzer↗
DOE OSTI2023

A systematic literature review on residential demand response with a focus on opportunities for low-income communities

Demand Response improves efficiency and grid stability, reducing peak load and total system costs. It can potentially contribute to other societal aspects, including mitigating climate change and improving air quality, health, stress levels, and comfort. This paper reviewed the literature on residential demand response programs in the United States, through the lens of the five energy justice principles, identifying and categorizing a set of 165 papers from 1960 to 2024. As a result, we observe significant progress in distributive justice, however, mostly focused on increasing participation rather than attending specific needs of historically marginalized communities. Concordantly, recognition and procedural justice dimensions are lagging, while cosmopolitan justice studies are scarce, underscoring a need to improve the measurement of impacts resulting from the implementation of demand response programs. Future research opportunities include the consolidation of standardized definitions and metrics, to better understand burdens and needs of diverse residential users. In terms of policy, collection and transparent access to standardized data is required as a condition to the design of flexible, customizable, transparent, and easy to navigate demand response programs. As a result, a better understanding of and engagement with customers has the potential to increase adoption rates, persistence in the program, and overall impacts for the system, households, and society.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2024

Prioritizing Off-gas Metrics

Off-gas research within the Material Recovery and Waste Form Development (MRWFD) team is dispersed among four national laboratories and multiple universities and small businesses. Ensuring research is conducted consistently and in a manner conducive to direct comparison is a nontrivial task. The team assembled to realign goals and expectations by identifying distinct R&D phases, prioritizing crucial metrics, and outlining standardized tests specifically associated with Kr, Xe, and I capture.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2020

Flux Seasonality Metrics Database: A companion dataset for FLUXNET annual product

This dataset include standardized phenological transition dates, and derived season lengths of active, dormant and transition seasons of ecosystem carbon and energy fluxes, as reported in FLUXNET. Such metrics are unique in that they characterize the seasonal dynamics of these fluxes in their own terms rather than in reference to traditional phenology indicators that mostly relate to vegetation structural characteristics. The Flux Seasonality Metrics Database (FSMD) generated 17 standardized seasonality metrics for 4 different fluxes including gross primary productivity (GPP), ecosystem respiration (RE), latent heat (LE) and sensible heat (H) reported in FLUXNET2015 Dataset for about 200 sites and 1500 site-years of data globally. Each metric is reported as an estimate and a confidence interval, which is a function of data coverage and flux variability. We anticipate that the FSMD will facilitate new model validation exercises, and stimulate new research in global change and Earth science disciplines where land-atmosphere exchange dynamics play a central role.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Assessing thermal resilience of an assisted living facility during heat waves and cold snaps with power outages

Extreme hot and cold weather events are becoming more frequent, intense, and longer due to climate change. When these events occur coincidentally with power outages, the resulting extreme indoor temperatures pose a severe health hazard for occupants. This study conducted a holistic modeling and analysis of an assisted living facility, where senior residents live, to assess its thermal resilience performance under a six-day heat wave in 2015 and a three-day cold snap in 2021 with power outages. Impacts of 13 energy efficiency measures on thermal resilience and backup power capacity of the facility were evaluated. Three thermal resilience metrics: the SET (standard effective temperature) degree-hours, the Heat Index, and the Hours of Safety, were used and calculated from the EnergyPlus simulation models. Furthermore, major findings are: (1) the facility would suffer from extreme temperatures during the cold and hot events without a power supply, not meeting the passive survivability requirements; (2) most passive envelope measures improve thermal resilience for both hot and cold events, but making the building envelope airtight results in conflicting performance between the hot and cold events; (3) natural ventilation is an effective measure to mitigate summer indoor overheating; and (4) the energy efficiency package can reduce backup power capacity by 19% for the three-day cold snap. It is recommended that building technologies and design strategies be evaluated to consider co-benefits of energy use, thermal resilience, and backup power needs through building energy codes or policies for existing and new buildings, which are transitioning for decarbonization and climate resilience.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗