SEARCH · Search NASA

Results for “metric standardization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Defining a Metric to Assess Leachability of Contaminants from Cementitious Waste Forms in Lab Testing Related to Hanford - 20478

This paper reports on the determination of performance metrics for the release of four contaminants (technetium, iodine, nitrate, and chromium) from a theoretical supplemental low-activity waste (LAW) inventory of grout in the Hanford Integrated Disposal Facility (IDF). The performance metric was defined as a retardation factor, R, that can be used to quantify a waste form's ability to retain one contaminant compared with an un-retarded species (e.g., sodium). By setting the target R value at the magnitude required to maintain concentrations of the contaminants below the drinking water standard at the point of compliance for the IDF, a bar for grout leach performance can be established for screening laboratory leach test data. The R can be converted to a corresponding laboratory-observed diffusivity value against which to assess leach test data. The individual performance metrics were determined through an iterative set of simulations using a variable saturation and transport flow model of a grout waste form inventory in the IDF to calculate the resulting concentration-based requirements at the point of compliance. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

DOE OSTI2025

Meeting Global Health Needs via Infectious Disease Forecasting: Development of a Reliable Data-Driven Framework

Infectious diseases (IDs) have a significant detrimental impact on global health. Timely and accurate ID forecasting can result in more informed implementation of control measures and prevention policies. To meet the operational decision-making needs of real-world circumstances, we aimed to build a standardized, reliable, and trustworthy ID forecasting pipeline and visualization dashboard that is generalizable across a wide range of modeling techniques, IDs, and global locations. We forecasted 6 diverse, zoonotic diseases (brucellosis, campylobacteriosis, Middle East respiratory syndrome, Q fever, tick-borne encephalitis, and tularemia) across 4 continents and 8 countries. We included a wide range of statistical, machine learning, and deep learning models (n=9) and trained them on a multitude of features (average n=2326) within the One Health landscape, including demography, landscape, climate, and socioeconomic factors. The pipeline and dashboard were created in consideration of crucial operational metrics—prediction accuracy, computational efficiency, spatiotemporal generalizability, uncertainty quantification, and interpretability—which are essential to strategic data-driven decisions. While no single best model was suitable for all disease, region, and country combinations, our ensemble technique selects the best-performing model for each given scenario to achieve the closest prediction. For new or emerging diseases in a region, the ensemble model can predict how the disease may behave in the new region using a pretrained model from a similar region with a history of that disease. The data visualization dashboard provides a clean interface of important analytical metrics, such as ID temporal patterns, forecasts, prediction uncertainties, and model feature importance across all geographic locations and disease combinations. As the need for real-time, operational ID forecasting capabilities increases, this standardized and automated platform for data collection, analysis, and reporting is a major step forward in enabling evidence-based public health decisions and policies for the prevention and mitigation of future ID outbreaks.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2025

Leveraging Large Language Models for Real-World Data Evidence: A Framework for Automated Treatment Extraction and Data Harmonization

Background: The ability to comprehensively collect treatment information from cancer patient medical records would enable studies to evaluate real-world benefits and risks tied to specific treatments. Currently, it is difficult to system- atically collect high-quality treatment information because it is often stored in unstructured text. Manually extracting and standardizing drug and regimen data is time-intensive. Recent advances in large language models (LLMs) offer a potential solution for automated extraction of structured treatment information from clinical text. Objective: This study systematically evaluates the utility of four LLMs from the Llama family for automated extraction of oncology treatment information from clinical text. This information can guide researchers using cancer registry data to provide insights into cancer care and outcomes beyond clinical trials. Methods: Four instruction-tuned Llama models with varying parameter counts (1B, 3B, 8B, and 70B) were evaluated for their ability to extract treatment information from clinical documents. A unified oncology knowledge base integrating seven major public data sources was developed to standardize and normalize extracted entities—a critical step for harmonizing data from diverse sources. Extracted treatment data were compared against expert-annotated ground truth. Model performance was assessed using accuracy metrics (Precision, Recall, F1-Score) and opera- tional feasibility metrics, including processing speed and structural compliance of the output. Results: A strong positive correlation was observed between model size and extraction accuracy. F1-score improved from 0.609 for the 1B model to 0.710 (3B), 0.807 (8B), and 0.828 (70B). While larger models demonstrated superior accuracy and compliance, they incurred higher computational costs. The modest performance difference between 8B and 70B suggests diminishing returns with increasing model size. Conclusions: LLMs represent a viable technology for automating oncology treatment extraction. The 8B-parameter model emerged as a highly effective option, balancing high accuracy and computational efficiency. Selecting an appropriate LLM for deployment in cancer registries involves a trade-off between desired accuracy and available operational resources. Harmonizing extracted entities with the oncology knowledge base facilitates standardized integration into common data models, enhancing data quality for real-world evidence analyses.

artificial intelligence↗

DOE OSTI2020

On the symmetries of cosmological perturbations

The space of inflationary models is vast, containing wide varieties of mechanisms, symmetries, and spectra of particles. Consequently, the space of observational signatures is similarly complex. Hence, it is natural to look for boundaries of the space of models and their signatures. In this paper, we explore the possible symmetries associated with the primordial cosmological perturbations and their correlators in the asymptotic future. Assuming the observed homogeneity, isotropy and (approximate) scale invariance, we prove three main results. First, correlation functions of scalar metric fluctuations are uniquely characterized by soft theorems and are free from ambiguity under field redefinitions. Second, whatever the particle content and interactions, when the standard soft theorems apply, invariance under de Sitter boosts (linearly realized conformal invariance) is only possible if all connected correlators vanish identically, i.e. if the theory is free. Third, conformal invariance is the largest set of linearly realized (bosonic) symmetries of the correlators of any single scalar, irrespectively of any soft theorems or particle content.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2022

January 2022 Operational Highlights

The Indexing Lab is now complete and includes classified and unclassified computers, safes and work stations. Staff capture metadata and catalog materials, including classified reports, directors’ correspondence and Rocky Flats materials to ensure the holdings are discoverable and retrievable. Access protocols were updated for products related to the LANL Annual Assessment in the Online Vault (OLV) classified repository. The Annual Assessment is a yearly analysis of the weapons systems in the nation’s nuclear stockpile. The Standardization Quality Assessment (SQA) for the Online Vault (OLV) classified repository was completed and contained no findings. Beta testing, or customer validation, began for the metrics database that generates metrics reports and visualizations from NSRC customer projects.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Analysis of Data Fusion Between Waveform Events and Radionuclide Detections Reported in 2021 by the International Data Centre

During this project, we assessed the percentage of events reported by the International Data Centre (IDC) that are candidates for evaluation using data fusion methods. We calculated the percentage of waveform (seismic, hydroacoustic, infrasound, SHI) events that may be associated with radionuclide (RN) detections and vice versa. For this task, data fusion means identifying RN detections that may be associated with SHI events. The task of producing a fused SHI and RN bulletin is included in the IDC operational manual. As of 2022, the production of a fused event bulletin remains incomplete, largely because methods for producing the bulletin are under development. Nonetheless, simple methods for data fusion have been developed and preliminary software tools are available at the IDC to associate SHI events and RN detections. This report is a first look at the percentage of SHI events that may be candidates for fusion with RN detections or bulletins. One year of IDC bulletin data (2021) is considered in this report. It is important to note that there were no known nuclear explosions during this time period. Hence, we expect that events during this time period would generate SHI and RN signals. If many SHI events are candidates for fusion with RN data, greater priority should be placed on establishing screening procedures before and/or during the fusion process. By contrast, if the number of candidate events is diminishingly small, then data fusion is not a driver for further development of event or detection screening at the IDC. LLNL reviewed the events reported in the Standard Event Bulletin (SEB) and determined which events are candidates for fusion with the Reviewed Radionuclide Reports (RRR). Much of the work involves establishing a metric or metrics for determining whether a Reviewed Event Bulletin (REB) event is a candidate for data fusion.

58 GEOSCIENCES↗

DOE OSTI2021

Stable Parallel Training of Wasserstein Conditional Generative Adversarial Neural Networks : *Full/Regular Research Paper submission for the symposium CSCI-ISAI: Artificial Intelligence

We use a stable parallel approach to train Wasserstein Conditional Generative Adversarial Neural Networks (W-CGANs). The parallel training reduces the risk of mode collapse and enhances scalability by using multiple generators that are concurrently trained, each one of them focusing on a single data label. The use of the Wasserstein metric reduces the risk of cycling by stabilizing the training of each generator. We apply the approach on the CIFAR10 and the CIFAR100 datasets, two standard benchmark datasets with images of the same resolution, but different number of classes. Performance is assessed using the inception score, the Fréchet inception distance, and image quality. An improvement in inception score and Fréchet inception distance is shown in comparison to previous results obtained by performing the parallel approach on deep convolutional conditional generative adversarial neural networks (DC-CGANs). Weak scaling is attained on both datasets using up to 100 NVIDIA V100 GPUs on the OLCF supercomputer Summit.

Lupo Pasini, Massimiliano↗

DOE OSTI2026

Data for Autonomous Transportation Awareness: Data Exchange Use Cases, Standards, and Barriers

This report examines the critical data exchanges between automated vehicle (AV) service providers and the cities and municipalities they serve. It assists municipal authorities in navigating the often complex and real-time digital data exchanges needed to support AV mobility services, with emphasis in three areas: (1) critical safety data for broad-area situational awareness of hazards typically associated emergency dispatch or roadway work zones; (2) performance metrics of AV services that inform the quantity, quality, spatial extents, and impact on the roadway network; and (3) regulatory and policy information, particularly dynamic information that governs how AV services interact with the roadway network, with emphasis on curb space. The report reviews existing practices and emerging protocols and standards and identifies key gaps to address moving forward.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2023

Renormalization of the Standard Model Effective Field Theory from geometry

S-matrix elements are invariant under field redefinitions of the Lagrangian. They are determined by geometric quantities such as the curvature of the field-space manifold of scalar and gauge fields. We present a formalism where scalar and gauge fields are treated together, with a metric on the combined space of both types of fields. Scalar and gauge scattering amplitudes are given by the Riemann curvature Rijkl of this combined space, with indices i, j, k, l chosen to be scalar or gauge indices depending on the type of external particle. One-loop divergences can also be computed in terms of geometric invariants of the combined space, which greatly simplifies the computation of renormalization group equations. We apply our formalism to the Standard Model Effective Field Theory (SMEFT), and compute the renormalization group equations for even-parity bosonic operators to mass dimension eight.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2021

Eject, crash, or survive: Using machine learning to predict orbital instability of exoplanetary systems

Astronomers throughout history, including titans like Kepler and Newton, have tackled planetary dynamics and orbital instability. Despite strides taken in research, understanding the evolution of planetary orbits remains an intricate, computationally expensive, and analytically unsolved problem. I apply machine learning classification methods to numerical simulations of planetary systems in order to predict the long-term fate of the planet - whether the planet remains in a stable orbit or not. My method uses the first 41.1 years (≤ 500 orbits) of data from a planet’s simulation to calculate 17 dynamically-motivated metrics; I trained my classifier on these features to predict a planet’s stability after 107 years. At 84.33%, my classifier was comparable in accuracy to pre-existing literature, despite using significantly less computational power than most other methods. In my research, I found that the standard deviation of eccentricity, mass ratios for neighboring planets, and semi-major axis ratio with the outer planet neighbor to be the most predictive features of instability. I propose reasons for the importance of these features, their role in planetary dynamics, as well as possible explanations for why some planets were misclassified. By understanding the important metrics of instability and reasons for misclassification, we can begin to understand more about system architectures, orbital motion and dynamics, and the formation and evolution of the exoplanetary systems. This is applicable in our own Solar System, and with exoplanet discovery missions such as TESS, this research becomes especially relevant in understanding the new exoplanetary systems we discover.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2021

Eject, crash, or survive: Using machine learning to predict orbital instability of exoplanetary systems

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2025

Evaluating the factors influencing accuracy, interpretability, and reproducibility in the use of machine learning classifiers in biology to enable standardization

The complexity and variability of biological data has promoted the increased use of machine learning methods to understand processes and predict outcomes. These same features complicate reliable, reproducible, interpretable, and responsible use of such methods, resulting in questionable relevance of the derived. outcomes. Here we systematically explore challenges associated with applying machine learning to predict and understand biological processes using a well- characterized in vitro experimental system. We evaluated factors that vary while applying machine learning classifers: (1) type of biochemical signature (transcripts vs. proteins), (2) data curation methods (pre- and post-processing), and (3) choice of machine learning classifier. Using accuracy, generalizability, interpretability, and reproducibility as metrics, we found that the above factors significantly mod- ulate outcomes even within a simple model system. Our results caution against the unregulated use of machine learning methods in the biological sciences, and strongly advocate the need for data standards and validation tool-kits for such studies.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2023

2022 Standard Scenarios Report: A U.S. Electricity Sector Outlook

This report documents the eighth edition of the annual Standard Scenarios. It summarizes 70 forward-looking scenarios of the U.S. electricity sector that have been designed to capture a wide range of possible futures. In August 2022, the United States Congress passed the Inflation Reduction Act (IRA), a law aimed at accelerating U.S. decarbonization, clean energy manufacturing, and deployment of new power and end-use technologies. This year’s scenarios include representations of the main electricity-sector provisions from IRA and the potential impact on electricity demand. The Standard Scenarios are simulated using the Regional Energy Deployment System (ReEDS) model, which projects utility-scale electricity sector evolution for the contiguous United States using a system-wide, least-cost approach subject to policy and operational constraints. A subset of the scenarios are simulated in the PLEXOS production cost model to obtain a broader suite of metrics at the hourly resolution, which are made available through the National Renewable Energy Laboratory’s (NREL’s) annual Cambium data sets. The scenarios can be viewed and downloaded from NREL’s Scenario Viewer. Annual results are available for the full suite of scenarios in the Standard Scenarios projects in the viewer, whereas the Cambium projects contain hourly data for a subset of scenarios. The Standard Scenarios includes a scenario called the Mid-case, which has central or median values for core inputs such as technology costs and fuel prices, moderately paced demand growth averaging 1.3% per year, and electricity sector policies as they existed in September 2022 (including IRA). The remaining 69 scenarios are created by varying inputs such as technology and fuel prices, resource availability, demand growth, whether nascent generation technologies are allowed, and by introducing national decarbonization constraints.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2021

Development and Application of Schema Based Occupant-Centric Building Performance Metrics

Occupant behavior can significantly influence the operation and performance of buildings. Many occupant-centric key performance indicators (KPIs) rely on having accurate counts of the number of occupants in a building, which is very different to how occupancy information is currently collected in the majority of buildings today. To address this gap, the authors develop a standardized methodology for the calculation of percent space utilization for buildings, which is formulated with respect to two prevalent operational data schemas: the Brick Schema and Project Haystack. The methodology is scalable across different levels of spatial granularity and irrespective of sensor placement. Moreover, the methods are intended to make use of typical occupancy sensors that capture presence level occupancy and not counts of people. Since occupant-hours is a preferable metric to use in KPI calculations, a method to convert between percent space utilization and occupant-hours using the design occupancy for a space is also developed. The methodology is demonstrated on a small commercial office space in Boulder, Colorado using data collected between June 2018 and February 2019. A multiple linear regression is performed that shows strong evidence for a relationship between building energy consumption and percent space utilization.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2021

International collaboration framework for the calculation of performance loss rates: Data quality, benchmarks, and trends (towards a uniform methodology)

Abstract The IEA PVPS Task 13 group, experts who focus on photovoltaic performance, operation, and reliability from several leading R&D centers, universities, and industrial companies, is developing a framework for the calculation of performance loss rates of a large number of commercial and research photovoltaic (PV) power plants and their related weather data coming across various climatic zones. The general steps to calculate the performance loss rate are (i) input data cleaning and grading; (ii) data filtering; (iii) performance metric selection, corrections, and aggregation; and finally, (iv) application of a statistical modeling method to determine the performance loss rate value. In this study, several high‐quality power and irradiance datasets have been shared, and the participants of the study were asked to calculate the performance loss rate of each individual system using their preferred methodologies. The data are used for benchmarking activities and to define capabilities and uncertainties of all the various methods. The combination of data filtering, metrics (performance ratio or power based), and statistical modeling methods are benchmarked in terms of (i) their deviation from the average value and (ii) their uncertainty, standard error, and confidence intervals. It was observed that careful data filtering is an essential foundation for reliable performance loss rate calculations. Furthermore, the selection of the calculation steps filter/metric/statistical method is highly dependent on one another, and the steps should not be assessed individually.

14 SOLAR ENERGY↗

DOE OSTI2022

Stable parallel training of Wasserstein conditional generative adversarial neural networks

In this work, we propose a stable, parallel approach to train Wasserstein conditional generative adversarial neural networks (W-CGANs) under the constraint of a fixed computational budget. Differently from previous distributed GANs training techniques, our approach avoids inter-process communications, reduces the risk of mode collapse and enhances scalability by using multiple generators, each one of them concurrently trained on a single data label. The use of the Wasserstein metric also reduces the risk of cycling by stabilizing the training of each generator. We illustrate the approach on the CIFAR10, CIFAR100, and ImageNet1k datasets, three standard benchmark image datasets, maintaining the original resolution of the images for each dataset. Performance is assessed in terms of scalability and final accuracy within a limited fixed computational time and computational resources. To measure accuracy, we use the inception score, the Fréchet inception distance, and image quality. An improvement in inception score and Fréchet inception distance is shown in comparison to previous results obtained by performing the parallel approach on deep convolutional conditional generative adversarial neural networks as well as an improvement of image quality of the new images created by the GANs approach. Weak scaling is attained on both datasets using up to 2000 NVIDIA V100 GPUs on the OLCF supercomputer Summit.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2026

A Guide to Nonaqueous Electrochemistry of f-Element Complexes

Electrochemistry is a powerful tool for assessing and understanding the redox chemistry of molecular complexes. Cyclic voltammetry enables the f-element community to study molecules in unusually high or low oxidation states, which potentially pose important broad-scope questions of electronic structure. In the pursuit of boundary-pushing compounds, reactive air- and moisture-sensitive species are often encountered, which can be challenging to characterize, especially when they are chemically incompatible with certain solvents, electrolytes, or electrodes or when their potentials lie outside of common electrochemical windows. Nonaqueous solvents and pseudo reference electrodes complicate many of the standard practices in acquiring high-quality and reproducible electrochemical data. This guide presents a detailed discussion of selecting appropriate cell conditions and referencing and addresses metrics for evaluating electrochemical and chemical reversibility. These methodological approaches have been extended to best practices for the electrochemical analysis of radioactive transuranic complexes.

Electrodes↗

DOE OSTI2021

Making Data-Driven Policy Decisions for the Nation’s First Building Energy Performance Standards

Nearly every major U.S. city has committed itself to ambitious climate action goals – for Washington, DC this means a 50 percent reduction in greenhouse gases by 2032 and carbon neutrality by 2050. In support of these goals, Washington, DC has passed one of the most aggressive and practical climate action bills in the nation—with the Clean Energy DC Omnibus Act, DC became the first city in the U.S. to adopt energy performance standards for existing buildings. DC’s Building Energy Performance Standards (BEPS) require energy efficiency improvements for all commercial and multifamily buildings that do not meet a sector-specific minimum ENERGY STAR score or equivalent metric, with iterative compliance cycles every five years that will accelerate the pace of whole building retrofits. This paper explores this revolutionary policy framework and uses two data analysis projects that DC conducted to evaluate the potential impact of the BEPS and move towards carbon neutrality. First, we analyze the potential energy savings and greenhouse gas reductions, as well as potential cost impacts, from the implementation of a BEPS policy in DC We then examine the role of BEPS in a carbon neutrality strategy, how BEPS savings iterate over time, and what additional existing building improvements will be driven by the gravitational pull of new building codes on median performance. The paper highlights the benefits and limitations of such data-driven approaches to support policy decisions. Finally, we will review ongoing BEPS implementation, including expected policy directions, critical supportive programs, and lessons learned to date.

Bergfeld, Katie↗