SEARCH · Search NASA

Results for “data quality metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

DOE OSTI2023

ET-AL: Entropy-targeted active learning for bias mitigation in materials data

Growing materials data and data-driven informatics drastically promote the discovery and design of materials. While there are significant advancements in data-driven models, the quality of data resources is less studied despite its huge impact on model performance. In this work, we focus on data bias arising from uneven coverage of materials families in existing knowledge. Observing different diversities among crystal systems in common materials databases, we propose an information entropy-based metric for measuring this bias. To mitigate the bias, we develop an entropy-targeted active learning (ET-AL) framework, which guides the acquisition of new data to improve the diversity of underrepresented crystal systems. We demonstrate the capability of ET-AL for bias mitigation and the resulting improvement in downstream machine learning models. This approach is broadly applicable to data-driven materials discovery, including autonomous data acquisition and dataset trimming to reduce bias, as well as data-driven informatics in other scientific domains.

36 MATERIALS SCIENCE↗

DOE OSTI2020

MEP: Mobility Energy Productivity Metric

In response to the need to assess fundamental improvements in mobility as technology provides new modes, methods, and opportunities in urban areas to connect people with goods, services, and employment, a mobility-energy productivity score (MEPS) has been developed. The MEPS fundamentally measures the potential of a multi-modal system to connect a person to a variety of services and activities that define a high-quality of life. The MEPS is measured relative to the convenience and energy needed to provide connectivity. Fundamentally derived from accessibility theory, the MEPS advances practice by using readily available travel time data (either from web-based APIs or outputs from an urban transportation model) combined with established parameters that reflect the energy intensity of various travel modes, and relative frequency of activity engagement. The construction of the MEPS allows for aggregation and disaggregation to the appropriate spatial, modal, and trip purpose resolution, as analysis needs dictate. The MEPS could be used to compare alternative futures related to technology, infrastructure investment, or policy, providing a much needed tool for planners, researchers, and analysts. In other words, the metric measures how efficiently connected a place is.

Hou, Yi↗

DOE OSTI2023

Two decades of fumigation data from the Soybean Free Air Concentration Enrichment facility

Abstract The Soybean Free Air Concentration Enrichment (SoyFACE) facility is the longest running open-air carbon dioxide and ozone enrichment facility in the world. For over two decades, soybean, maize, and other crops have been exposed to the elevated carbon dioxide and ozone concentrations anticipated for late this century. The facility, located in East Central Illinois, USA, exposes crops to different atmospheric concentrations in replicated octagonal ~280 m 2 Free Air Concentration Enrichment (FACE) treatment plots. Each FACE plot is paired with an untreated control (ambient) plot. The experiment provides important ground truth data for predicting future crop productivity. Fumigation data from SoyFACE were collected every four seconds throughout each growing season for over two decades. Here, we organize, quality control, and collate 20 years of data to facilitate trend analysis and crop modeling efforts. This paper provides the rationale for and a description of the SoyFACE experiments, along with a summary of the fumigation data and collation process, weather and ambient data collection procedures, and explanations of air pollution metrics and calculations.

60 APPLIED LIFE SCIENCES↗

DOE OSTI2020

Power Prediction of Airborne Wind Energy Systems Using Multivariate Machine Learning

Kites can be used to harvest wind energy at higher altitudes while using only a fraction of the material required for conventional wind turbines. In this work, we present the kite system of Kyushu University and demonstrate how experimental data can be used to train machine learning regression models. The system is designed for 7 kW traction power and comprises an inflatable wing with suspended kite control unit that is either tethered to a fixed ground anchor or to a towing vehicle to produce a controlled relative flow environment. A measurement unit was attached to the kite for data acquisition. To predict the generated tether force, we collected input–output samples from a set of well-designed experimental runs to act as our labeled training data in a supervised machine learning setting. We then identified a set of key input parameters which were found to be consistent with our sensitivity analysis using Pearson input–output correlation metrics. Finally, we designed and tested the accuracy of a neural network, among other multivariate regression models. The quality metrics of our models show great promise in accurately predicting the tether force for new input/feature combinations and potentially guide new designs for optimal power generation.

17 WIND ENERGY↗

DOE OSTI2023

The DESI Survey Validation: Results from Visual Inspection of the Quasar Survey Spectra

Abstract A key component of the Dark Energy Spectroscopic Instrument (DESI) survey validation (SV) is a detailed visual inspection (VI) of the optical spectroscopic data to quantify key survey metrics. In this paper we present results from VI of the quasar survey using deep coadded SV spectra. We show that the majority (≈70%) of the main-survey targets are spectroscopically confirmed as quasars, with ≈16% galaxies, ≈6% stars, and ≈8% low-quality spectra lacking reliable features. A nonnegligible fraction of the quasars are misidentified by the standard spectroscopic pipeline, but we show that the majority can be recovered using post-pipeline “afterburner” quasar-identification approaches. We combine these “afterburners” with our standard pipeline to create a modified pipeline to increase the overall quasar yield. At the depth of the main DESI survey, both pipelines achieve a good-redshift purity (reliable redshifts measured within 3000 km s −1 ) of ≈99%; however, the modified pipeline recovers ≈94% of the visually inspected quasars, as compared to ≈86% from the standard pipeline. We demonstrate that both pipelines achieve a median redshift precision and accuracy of ≈100 km s −1 and ≈70 km s −1 , respectively. We constructed composite spectra to investigate why some quasars are missed by the standard pipeline and find that they are more host-galaxy dominated (i.e., distant analogs of “Seyfert galaxies”) and/or more dust reddened than the standard-pipeline quasars. We also show example spectra to demonstrate the overall diversity of the DESI quasar sample and provide strong-lensing candidates where two targets contribute to a single spectrum.

79 ASTRONOMY AND ASTROPHYSICS↗

DOE OSTI2026

Reducing Deferrals by Integrating Health Homes with Weatherization

The U.S. Department of Energy’s Weatherization Assistance Program (WAP) improves energy efficiency and household health for low-income families, yet a substantial number of otherwise eligible homes are deferred from due to health and safety concerns in their homes, including mold, moisture damage, or structural deficiencies. These deferred homes are often occupied by marginalized or otherwise vulnerable residents who may be exposed to elevated indoor air pollutant concentration. Integrating Healthy Homes (HH) interventions with weatherization has been proposed as a strategy to reduce deferrals, address environmental justice concerns, and improve health outcomes. However, limited data on the health and economic implications of such integration exist. This study aimed to assess the potential health benefits and savings-to-investment ratio (SIR) associated with integrating Healthy Homes interventions into weatherization programs for homes typically deferred from WAP services. We collected indoor air pollutant data from homes undergoing health home renovations, including fine particulate matter (PM 2.5 ), nitrogen dioxide (NO 2 ), carbon monoxide (CO), and formaldehyde, with sampling times up to one month. Except for fomaldehyde, which was measured using passive UMEx badges, the other metrics were measured using the airQ Pro indoor air quality monitor.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2022

Very-High Dynamic Range, 10,000 Frames/Second Pixel Array Detector for Electron Microscopy

Precision and accuracy of quantitative scanning transmission electron microscopy (STEM) methods such as ptychography, and the mapping of electric, magnetic, and strain fields depend on the dose. Reasonable acquisition time requires high beam current and the ability to quantitatively detect both large and minute changes in signal. A new hybrid pixel array detector (PAD), the second-generation Electron Microscope Pixel Array Detector (EMPAD-G2), addresses this challenge by advancing the technology of a previous generation PAD, the EMPAD. The EMPAD-G2 images continuously at a frame-rates up to 10 kHz with a dynamic range that spans from low-noise detection of single electrons to electron beam currents exceeding 180 pA per pixel, even at electron energies of 300 keV. The EMPAD-G2 enables rapid collection of high-quality STEM data that simultaneously contain full diffraction information from unsaturated bright-field disks to usable Kikuchi bands and higher-order Laue zones. Test results from 80 to 300 keV are presented, as are first experimental results demonstrating ptychographic reconstructions, strain and polarization maps. We introduce a new information metric, the maximum usable imaging speed (MUIS), to identify when a detector becomes electron-starved, saturated or its pixel count is mismatched with the beam current.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Blind Modeling Validation Exercises Using the Horizontal Dry Cask Simulator

The U.S. Department of Energy (DOE) established a need to understand the thermal-hydraulic properties of dry storage systems for commercial spent nuclear fuel (SNF) in response to a shift towards the storage of high-burnup (HBU) fuel (> 45 gigawatt days per metric ton of uranium, or GWd/MTU). This shift raises concerns regarding cladding integrity, which faces increased risk at the higher temperatures within spent fuel assemblies present within HBU fuel compared to low-burnup fuel (≤ 45 GWd/MTU). A dry cask simulator (DCS) was built at Sandia National Laboratories (SNL) in Albuquerque, New Mexico to produce validation-quality data that can be used to test the accuracy of the modeling used to predict cladding temperatures. These temperatures are critical to evaluating cladding integrity throughout the storage cycle of commercial spent nuclear fuel. A model validation exercise was previously carried out for the DCS in a vertical configuration. Lessons learned during the previous validation exercise have been applied to a new, blind study using a horizontal dry cask simulator (HDCS). Three modeling institutions – the Nuclear Regulatory Commission (NRC), Pacific Northwest National Laboratory (PNNL), and Empresa Nacional del Uranio, S.A., S.M.E. (ENUSA) – were granted access to the input parameters from the DCS Handbook, SAND2017-13058R, and results from a limited data set from the horizontal BWR dry cask simulator tests reported in the HDCS update report, SAND2019-11688R. With this information, each institution was tasked to calculate peak cladding temperatures and air mass flow rates for ten HDCS test cases. Axial as well as vertical and horizontal transverse temperature profiles were also calculated. These calculations were done using modeling codes (ANSYS/Fluent, STAR-CCM+, or COBRA-SFS), each with their own unique combination of modeling assumptions and boundary conditions. For this validation study, the ten test cases of the horizontal dry cask simulator were defined by three independent variables – fuel assembly decay heat (0.5 kW, 1 kW, 2.5 W, and 5 kW), internal backfill pressure (100 kPa and 800 kPa), and backfill gas (helium and air). The plots provided in Chapter 3 of this report show the axial, vertical, and horizontal temperature profiles obtained from the dry cask simulator experiments in the horizontal configuration and the corresponding models used to describe the thermal-hydraulic behavior of this system. The tables provided in Chapter 3 illustrate the closeness of fit of the model data to the experiment data through root mean square (RMS) calculations of the error in peak cladding temperatures (PCTs), PCT axial locations, axial temperature profiles, vertical and horizontal temperature profiles at two different axial locations, and air mass flow rates for the ten test cases, normalized by the experimental results. The model results are assigned arbitrary model numbers to retain anonymity. Due to the relatively flat axial temperature profiles, small temperature gradients resulted in large deviations of all models’ PCT axial location from the experimental PCT axial location. When the PCT axial location error is excluded in the calculation of the combined RMS of the normalized errors that considers PCT, the temperature profiles, and the air mass flow rates, the model data fits the experimental data to within 5%. When the vault information is excluded, the model data fits the experimental data to within 2.5%. An error analysis was developed further for one model, using the model and experimental uncertainties in each validation parameter to calculate validation uncertainties. The uncertainties for each parameter were used to define quantifiable validation criteria. For this analysis, the model was considered validated for a given comparison metric if the normalized error in that metric divided by the validation uncertainty was less than or equal to 1. When considering the combined RMS of the normalized errors of all metrics divided by their validation uncertainties, the model was found to have satisfied the criterion for model validation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2026

United States Nuclear Power Reactor Used Nuclear Fuel Database and Applications

The Unified Database (UDB) within STANDARDS serves as the foundational data infrastructure for managing the United States' spent nuclear fuel inventory of 315,111 discharged assemblies totaling 91,036 metric tons of heavy metal. The database organizes this complex inventory through over 200 interconnected tables structured into eight primary attribute categories, supporting integrated analyses across storage, transportation, and disposal domains. Data enters the UDB through the GC-859 Nuclear Fuel Data Survey, which transitioned to web-based collection in 2023, improving data quality through real-time validation. The UDB enables automated generation of input files for nuclear safety analyses, reducing preparation time from weeks to hours while maintaining traceability. Applications include national inventory reporting, Certificate of Compliance assessments, and facility optimization. The three-tier distribution model balances accessibility with security requirements for federal agencies, national laboratories, and research organizations. The UDB provides essential data infrastructure as spent fuel management transitions from site-specific to integrated national campaigns.

Stefanovic, Peter↗

DOE OSTI2025

Montane Conifer, Aspen, Meadow, and Sagebrush Metagenome Resolved Genomes and Traits in East River Watershed, Colorado, USA

Climate change is driving vegetation shifts in mountain watersheds, with unknown impacts on biogeochemical cycles. We hypothesize that these shifts will reshape soil microbiomes and associated biogeochemical processes. As a part of Lawrence Berkeley National Laboratory (LBNL) Watershed Science Focus Area (SFA), we assessed microbiome and microbial functional trait differences between soils under conifer, aspen, forby meadows, and sagebrush across the East River Watershed, CO, controlling for elevation and aspect.Here we present metagenome assembled genomes (MAGs) for the bacterial and archaeal communities from soils 0-20cm in depth across three locations in the watershed—Headwaters, Upper Reaches, and Lower Reaches from August 3-11th 2016. Each location was further subdivided into two blocks, with one block on a west facing aspect, and two on the east aspect of the valley. Within blocks, two samples per vegetation type were taken (one at each depth). This resulted in 66 samples, which were sequenced at JGI and can be found under the Joint Genome Institute (JGI) Genomes Online Database (GOLD) sequencing project Gs0118068. Metagenomes were assembled through an inhouse pipeline (see methods), binned using four autobinners (concoct, maxbin2, metabat2, and vamb) and consolidated using dastool. The consolidated bins from all metagenomes were pooled, filtered by completeness (>75%) and contamination (<25%), and dereplicated at 95% ANI using drep. The dataset includes a zip file of 687 genomes (Vegtype_MAGS.zip), the accession numbers for the underlying metagenomes, a csv file with MAG quality metrics and taxonomy from Genome Taxonomy Database (GTDB) and National Center for Biotechnology Information (NCBI) taxonomic representative genome proteins (EastRiver_Vegtype_drep_genome_info.csv), and a file containing MAG quality metrics and taxonomy (gtdb_drep_bin_taxonomy.csv). The dataset additionally includes a sample metadata file (EastRiver_Vegtype_sample_metadata.csv), a metadata file used to register associated samples with IGSNs (International Generic Sample Numbers) (samples.csv), a Google KML file for the sampled locations (sample_collection_sites.kml), a location metadata file (locations.csv), a file-level metadata file (flmd.csv), and a data dictionary (dd.csv) file.This work was supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Integrating the Mobility Energy Productivity Metric into the CDOT Statewide Model

The Mobility Energy Productivity (MEP) metric measures the quality of mobility at a specific location and can be used to evaluate how changes to transportation systems impact the mobility of that location over time, such as through infrastructure investments. The objective of this study is to demonstrate integration of the MEP metric into CDOT's transportation planning process by leveraging data from their statewide travel demand model. We evaluate the MEP metric in 2015 as well as 2030 baselines and projected impacts in 2030 for two different regions in Colorado under multiple scenarios across multiple modes (driving, walking, biking, and transit). It was found that increasing development (increasing population density, jobs, and opportunities) had a significant impact on MEP, independent of any specific alternatives. For drive mode, there was a trade- off of increasing congestion on the road network and increasing job and opportunity access. Impacts to bike, walk, and transit MEP were also demonstrated in both regions. This report shows how MEP can be used as a tool to support evaluating the impacts of various transportation projects across the state. With projections of significant growth across the state of Colorado, access to the increasing opportunities and jobs will be important to understand through the context of energy efficiency. MEP could support future project evaluation and decision-making by enabling the unique and important dimension of energy- efficient accessibility of a transportation system.

33 ADVANCED PROPULSION SYSTEMS↗

DOE OSTI2025

Comparing the predictive capabilities of subjective crackle metrics using leave-one-out cross validation

Leave-one-out cross validation was used to show the capability to predict crackling sound quality based on the use of the standard deviation of the time-varying sharpness and the skewness of the derivative of the pressure waveform. The predictive output of this method implies that the more sophisticated fits used to describe this data were not overfit, but instead exhibited substantial predictive value.

Swift, Stephen Hales [Sandia National Laboratories↗

DOE OSTI2025

Examination of coal combustion management sites for microbiological and chemical signatures of groundwater impacts

Coal combustion accounts for 40% of the world’s electricity and generates more than a billion tons of coal combustion products (CCP) annually, half of which end up in landfills and impoundments. CCP contain mixtures of chemicals that can be mobile in the environment and impact the quality of surface water and potable groundwater. In this investigation, water samples from 14 coal combustion management sites across 4 physiographic regions in the United States, paired with background and down-gradient groundwater samples, were analyzed for water chemistry and microbiology. The objective was to determine if microbiology data alone, or supported by chemistry data, could reliably differentiate source waters and identify sites where CCP is known or expected to be influencing groundwater. Two percent of the total amplicons showed genus level conservation across CCP management sites, regions, and sample types; corresponding to ubiquitous, facultatively aerobic proteobacterial taxa that are generally recognized for the potential to respire using different terminal electron acceptors. Ordination plots did not reveal significant differences ( p > 0.05) in 16S rRNA gene amplicon diversity by CCP management site, water sample types, or physiographic regions. Contrastingly, chemistry distinguished sample types by standard water quality metrics (total dissolved solids, Ca:SO 4 ratio), alkali earth metals (K, Na, Li), selenium, boron, and fluoride. A focused evaluation of 16S rRNA gene amplicons for a subset of CCP management sites revealed microbiological features and chemical drivers (F, Ca, temperature) that positively identified the single CCP management site confirmed to have groundwater impacted by CCP leachate. At this site, 9 genera (>0.5% relative abundance) were exclusive to CCP porewater and downgradient groundwater. Inferred metabolisms for these taxa indicates potential for N and S biogeochemical transformations and 1-C metabolism that are consistent with a reducing environment, as evidenced by low ORP and depleted SO 4 2− . This research contributes to a growing understanding of conditions where these data types, analyses, and interpretation methods could be applied for distinguishing influence from CCP on the surrounding environment, as well as practical limitations.

01 COAL, LIGNITE, AND PEAT↗

DOE OSTI2024

Score-based diffusion models for generating liquid argon time projection chamber images

For the first time, we show high-fidelity generation of Liquid Argon Time Projection Chamber (LArTPC-like) data using a generative neural network. This demonstrates that methods developed for natural images do transfer to LArTPC-produced images, which, in contrast to natural images, are globally sparse but locally dense. We present the score-based diffusion method employed. We evaluate the fidelity of the generated images using several quality metrics, including modified measures used to evaluate natural images, comparisons between high-dimensional distributions, and comparisons relevant to LArTPC experiments. Published by the American Physical Society 2024

Astronomy & Astrophysics↗

DOE OSTI2022

Integrated Mechanical System Pods (CRADA Final Report)

LBNL provided input to setting the requirements related to indoor air quality and contributed to the development of metrics and test plans to evaluate prototypes of the mechanical pods, which were developed by other members of the project team. The testing of prototypes was conducted by and at Syracuse University, another project partner. LBNL also collaborated with RMI to develop a basic plan for data collection when the pods are deployed for field testing in Phase 2.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2023

Unlocking Autonomous Telescopes through Reinforcement Learning: An Offline Framework and Insights from a Case Study

Optimizing observational astronomy campaigns is becoming a complex and expensive task for next-generation telescopes, where manual planning of observations may tend to reach suboptimal results in terms of optimization.Reinforcement Learning (RL) has been well-demonstrated as a valuable approach for training autonomous systems, and it may provide the basis for self-driving telescopes capable of scanning the sky and optimizing the scheduling for astronomy campaigns.We have developed a framework for the optimization of telescope scheduling using RL techniques, based on a dataset containing data on a discrete set of sky locations that the telescope should visit, and a reward metric. We compared several RL algorithms applied to an offline simulation dataset based at the Stone Edge Observatory, considering a discrete set of sky locations to visit and using “t-effective” as a reward metric, a measure of the quality of the data.Deep Q-Networks (DQNs), belonging to the class of value-based methods, have shown remarkable success in the optimization of astronomical observations in our dataset. In the full environment, the average reward value in each state was found to be 92%±5% of the maximum possible reward, while on the test set it resulted in 87%±9% of the maximum possible reward.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

DOE OSTI2021

The effect of WAAM process parameters on process conditions and production metrics in the fabrication of single-pass multi-layer wall artifacts

The present work seeks to understand the impact of varying dwell time and input deposition power on part quality and overall production time for wire arc additive manufacturing. In this work, multi-layer wall geometries were deposited under different input power conditions without affecting the material deposition rate by setting traverse speed and wire feed speed constant and varying the contact tip-to-workpiece distance and the deposition power settings. Current and voltage data and optical imaging of the deposition zone were captured in situ, and wall geometry was characterized using laser scanning, so to understand the applicability of these methods for determining part height in situ. Furthermore, the present results demonstrate that alternating dwell times with lower input deposition power can result in significantly reduced overall production time and minimal material underbuilding, despite increased deposition geometry width. Furthermore, it is shown that while elimination of process dwell results in severe underbuilding of the deposition, it also yields the highest production rate for a hybrid-finished (e.g., deposited, machined) wall in terms of mm in build direction per minute and the highest buy-to-fly ratio.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Optimising the processing and storage of visibilities using lossy compression

The next-generation radio astronomy instruments are providing a massive increase in sensitivity and coverage, largely through increasing the number of stations in the array and the frequency span sampled. The two primary problems encountered when processing the resultant avalanche of data are the need for abundant storage and the constraints imposed by I/O, as I/O bandwidths drop significantly on cold storage. An example of this is the data deluge expected from the SKA Telescopes of more than 60 PB per day, all to be stored on the buffer filesystem. While compressing the data is an obvious solution, the impacts on the final data products are hard to predict. In this paper, we chose an error-controlled compressor – MGARD – and applied it to simulated SKA-Mid and real pathfinder visibility data, in noise-free and noise-dominated regimes. As the data have an implicit error level in the system temperature, using an error bound in compression provides a natural metric for compression. MGARD ensures the compression incurred errors adhere to the user-prescribed tolerance. To measure the degradation of images reconstructed using the lossy compressed data, we proposed a list of diagnostic measures, exploring the trade-off between these error bounds and the corresponding compression ratios, as well as the impact on science quality derived from the lossy compressed data products through a series of experiments. We studied the global and local impacts on the output images for continuum and spectral line examples. We found relative error bounds of as much as 10%, which provide compression ratios of about 20, have a limited impact on the continuum imaging as the increased noise is less than the image RMS, whereas a 1% error bound (compression ratio of 8) introduces an increase in noise of about an order of magnitude less than the image RMS. For extremely sensitive observations and for very precious data, we would recommend a 0.1% error bound with compression ratios of about 4. These have noise impacts two orders of magnitude less than the image RMS levels. At these levels, the limits are due to instabilities in the deconvolution methods. We compared the results to the alternative compression tool DYSCO, in both the impacts on the images and in the relative flexibility. MGARD provides better compression for similar error bounds and has a host of potentially powerful additional features.

Techniques: interferometric↗