Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

In-Depth Analysis of Subject Functional Performance and Subjective Feedback Data for Evaluating Argos Simulation Quality

Mechanical offloading systems such as the Active Response Gravity Offload System (ARGOS) at NASA Johnson Space Center (JSC) are used to simulate various partial gravity environments. ARGOS offloads pressurized suited subjects through a gimbaling pivot point system attached to a volumetric Portable Life Support System (PLSS). The pivot point can be configured to multiple locations with respect to the human-suit system center of gravity (CG). Previous work has tested and documented the interaction between different pivot point locations and measured CG. Observations indicated that small changes in pivot point location substantially affect the stability and functional performance (simulation quality) of a subject. This led to the development of a standardized gimbal assessment protocol to assess the functional performance of a pressurized suited subject as a function of the pivot point location, using the data obtained from a variety of planetary suit mobility tasks. As a result, an expansive repository of CG-related task metrics was generated from numerous ARGOS spacesuit test events, for different gimbal configurations and different test subjects. Based on the evaluation metrics and observed trends, several pivot point locations were iteratively identified to determine an “appropriate/optimal” configuration. This study thus describes the in-depth analysis of the CG evaluation metrics to better quantify trends and determine if specific factors are strongly associated with appropriate/optimal configurations. Quantitative and qualitative variables relating to subject task performance, subjective feedback, and anthropometry will be evaluated via probabilistic methods. The results from this study are expected to improve our understanding of optimal ARGOS gimbal settings, which will better inform the gimbal configuration identification process and improve simulation quality for extravehicular activity (EVA) training.

Joseph Yao↗
NASA NTRS2017

Kepler Planet Detection Metrics: Per-Target Detection Contours for Data Release 25

A necessary input to planet occurrence calculations is an accurate model for the pipeline completeness (Burke et al., 2015). This document describes the use of the Kepler planet occurrence rate products in order to calculate a per-target detection contour for the measured Data Release 25 (DR25) pipeline performance. A per-target detection contour measures for a given combination of orbital period, Porb, and planet radius, Rp, what fraction of transit signals are recoverable by the Kepler pipeline (Twicken et al., 2016; Jenkins et al., 2017). The steps for calculating a detection contour follow the procedure outlined in Burke et al. (2015), but have been updated to provide improved accuracy enabled by the substantially larger database of transit injection and recovery tests that were performed on the final version (i.e., SOC 9.3) of the Kepler pipeline (Christiansen, 2017; Burke Catanzarite, 2017a). In the following sections, we describe the main inputs to the per-target detection contour and provide a worked example of the python software released with this document (Kepler Planet Occurrence Rate Tools KeplerPORTs)1 that illustrates the generation of a detection contour in practice. As background material for this document and its nomenclature, we recommend the reader be familiar with the previous method of calculating a detection contour (Section 2 of Burke et al.,2015), input parameters relevant for describing the data quantity and quality of Kepler targets (Burke Catanzarite, 2017b), and the extensive new transit injection and recovery tests of the Kepler pipeline (Christiansen et al., 2016; Burke Catanzarite, 2017a; Christiansen, 2017).

Planet Detection Metrics↗
DOE OSTI2025

SCULPT (Supervised Clustering and Uncovering Latent Patterns with Training) v1

SCULPT (Supervised Clustering and Uncovering Latent Patterns with Training) is a comprehensive data visualization and analysis application focused on working with COLTRIMS (COLd Target Recoil Ion Momentum Spectroscopy) data, which is used in atomic and molecular physics experiments. The application offers several powerful features: - Data uploading and processing capabilities for COLTRIMS files - Multiple visualization methods using UMAP (Uniform Manifold Approximation and Projection) for dimensionality reduction - Interactive selection of data points across multiple views - Feature engineering through various methods: - Manual feature selection from calculated physics parameters - Deep autoencoder for dimension reduction - Genetic programming for discovering meaningful features - Mutual information-based feature selection - Multiple clustering approaches (DBSCAN, KMeans, Agglomerative) - Quality metrics for evaluating clustering results - Export capabilities for selections and generated features

Daoud, Hazem [Lawrence Berkeley National Laborator↗
DOE OSTI2025

CQM-Analysis v1.0

This repository contains the data and code necessary to reproduce the primary analysis and figures for the manuscript "Pathways to productivity: mapping the relationship between multimodal transportation infrastructure, commute quality, and economic vitality for the United States workforce". The analysis demonstrates a newly defined commute quality metric (CQM) characterizing the quality, as a monetized consumer surplus, of travel for the purpose of work for every census tract in the continental United States. The analysis additionally demonstrates the correlation of that CQM with key economic vitality indicators. Specifically median household income and unemployment rate.

Spurlock, C Anna [Lawrence Berkeley National Labor↗
DOE OSTI2024

Methods for Incorporating Model Uncertainty into Exoplanet Atmospheric Analysis

A key goal of exoplanet spectroscopy is to measure atmospheric properties, such as abundances of chemical species, in order to connect them to our understanding of atmospheric physics and planet formation. In this new era of high-quality JWST data, it is paramount that these measurement methods are robust. When comparing atmospheric models to observations, multiple candidate models may produce reasonable fits to the data. Typically, conclusions are reached by selecting the best-performing model according to some metric. This ignores model uncertainty in favor of specific model assumptions, potentially leading to measured atmospheric properties that are overconfident and/or incorrect. In this paper, we compare three ensemble methods for addressing model uncertainty by combining posterior distributions from multiple analyses: Bayesian model averaging, a variant of Bayesian model averaging using leave-one-out predictive densities, and stacking of predictive distributions. We demonstrate these methods by fitting the Hubble Space Telescope (HST) + Spitzer transmission spectrum of the hot Jupiter HD 209458b using models with different cloud and haze prescriptions. All of our ensemble methods lead to uncertainties on retrieved parameters that are larger but more realistic and consistent with physical and chemical expectations. Since they have not typically accounted for model uncertainty, uncertainties of retrieved parameters from HST spectra have likely been underreported. We recommend stacking as the most robust model combination method. Our methods can be used to combine results from independent retrieval codes and from different models within one code. They are also widely applicable to other exoplanet analysis processes, such as combining results from different data reductions.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Downscaling atmospheric chemistry simulations with physically consistent deep learning

Abstract. Recent advances in deep convolutional neural network (CNN)-based super resolution can be used to downscale atmospheric chemistry simulations with substantially higher accuracy than conventional downscaling methods. This work both demonstrates the downscaling capabilities of modern CNN-based single image super resolution and video super-resolution schemes and develops modifications to these schemes to ensure they are appropriate for use with physical science data. The CNN-based video super-resolution schemes in particular incur only 39 % to 54 % of the grid-cell-level error of interpolation schemes and generate outputs with extremely realistic small-scale variability based on multiple perceptual quality metrics while performing a large (8×10) increase in resolution in the spatial dimensions. Methods are introduced to strictly enforce physical conservation laws within CNNs, perform large and asymmetric resolution changes between common model grid resolutions, account for non-uniform grid-cell areas, super-resolve lognormally distributed datasets, and leverage additional inputs such as high-resolution climatologies and model state variables. High-resolution chemistry simulations are critical for modeling regional air quality and for understanding future climate, and CNN-based downscaling has the potential to generate these high-resolution simulations and ensembles at a fraction of the computational cost.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2021

Florida Transportation and Infrastructure: Monitoring Water Quality Along Southern Florida Seaports to Assess Impact on Coral Reef Tracts from Harbor Deepening Projects

The U.S. Army Corps of Engineers (USACE) and National Oceanic and Atmospheric Administration (NOAA) National Marine Fisheries Service (NMFS) will be supervising a harbor deepening project in Port Everglades, Florida. The project raises concerns about potential impacts on the nearby Florida reef tract through increased turbidity and sediment from the dredging. To better understand these potential impacts, the NASA DEVELOP team created an interactive Google Earth Engine tool to help establish a historical baseline of water quality parameters and assist monitoring these parameters more frequently than traditional sampling. This Seaport & Harbor Area Resource Quality (SHARQ) tool incorporates remotely sensed data from Sentinel-2 Multispectral Instrument, Landsat 5 Thematic Mapper, Landsat 7 Enhanced Thematic Mapper+, Landsat 8 Operational Land Imager, and Aqua Moderate Resolution Imaging Spectroradiometer. It allows users to view true color images and calculate water quality parameters, like turbidity and chlorophyll-a, for any given study area and time period from 1984 onward. The SHARQ tool also generate time series charts, allowing users to interpret changes in water quality over a given time range. The accuracy of the remotely sensed water quality parameter algorithms was determined using in situ data to calculate percent difference and root mean square error values (RMSE), which ranged from 0.32 to 0.58 error between sites. Using the SHARQ tool’s time series analysis feature, a baseline average turbidity metric of ~6.8 FNUs provides a historical baseline average for turbidity between September 2000 and 2020 and can assist in future decision-making for determining thresholds for turbidity.

Benjamin Rocha↗
NASA NTRSDate not supplied

A Procedure to Quantify Interlaminar Damage in Refractory Composites by In-Situ Micro-X-Ray Computed Tomography

Refractory composites are relevant for hot-structure applications on re-entry vehicles. To develop optimized high-performance hot structures, accurate material property data is required. Material properties that often limit design in two-dimensional (2-D) composites are interlaminar strengths. A better understanding of the failure mechanisms for interlaminar shear (ILS), interlaminar tension (ILT), and curved-beam interlaminar tension (CB-ILT) tests can provide insight on improving the design and fabrication of refractory composites. In-situ tests were performed to capture the progressive failure in American Society for Testing and Materials (ASTM) sized ILS (ASTM D3846), ILT (ASTM D7291), and CB-ILT (ASTM D6415) specimens. Before measuring internal damage of refractory composites specimens, the methodology of the test setup warrants a complete and thorough discussion. Detail on the test procedure, test stand design, micro-x-ray computed tomography (CT) configuration, data processing, and CT system uncertainty is discussed. Through keeping the many parameters of the CT system consistent, the uncertainty of the CT system was minimized, optimizing the quality of measurements. The overall quality of a CT scan can be quantified by three metrics: voxel resolution, minimal voxel resolution feature detection, and directional variability. A better understanding of the progressive failure mechanisms of refractory composites is provided by the results of both the present discussion and the one found in the accompanying paper titled “Analysis of Interlaminar Damage in Refractory Composites by In-Situ Micro-X-Ray Computed Tomography”.

In-situ micro-x-ray CT↗
DOE OSTI2022

Insights into Methodologies and Operational Details of Resource Adequacy Assessment: A Case Study with Application to a Broader Flexibility Framework

Assessing and maintaining resource adequacy (RA) is a core pillar of power systems. However, recent changes in the physical makeup of these systems and the conditions under which these systems must operate have yielded a renewed interest in the methods, metrics, and assumptions that underpin RA assessments. In this paper, we systematically explore a wide range of RA modeling dimensions, including: the objective function and level of operational detail in the underlying model formulation; the quantity (look-ahead) and quality (accuracy) of data that is available for making operational decisions within those models; and the physical configuration of solar photovoltaics (PV) with battery storage hybrid resources. We apply a set of probabilistic RA tools and production cost modeling tools to a realistic test system based loosely on a future Electric Reliability Council of Texas power system dominated by solar PV resources. Under the assumptions of our system and models, we find that multi-stage probabilistic assessments may provide a more robust evaluation of RA by capturing a wider range of operational and system interactions, but this comes at a computational cost of 1-2 orders of magnitude longer run time depending on the specific configuration. In addition, the information on thermal generator availability impacts RA performance by an order of magnitude more than solar resource forecasts, which is driven by the comparatively larger magnitude of thermal outages than solar forecast errors within our test system. Lastly, the flexibility provided by hybrid and other resources can help reduce system load-shedding event frequencies and enable the system to be more robust to inaccurate forecast information, and alternative hybrid inverter sizes can impact RA levels by 1-2 orders of magnitude. Our results point to the importance of a broader flexibility framework to describe the interaction between (1) flexibility "supply" from both physical resource capabilities and operational constraints considered in the modeling, and (2) flexibility "demand" from forecast errors, thermal generator outages, and other sources of uncertainty, as well as their RA impacts. Results are likely sensitive to the system buildout explored; future work could consider additional system configurations and conditions.

ENERGY PLANNING, POLICY, AND ECONOMY,POWER TRANSMI↗
DOE OSTI2021

A Statistical Evaluation of Combining Human Productivity Metrics in the Indoor Environment

The potential of improving human productivity by providing healthy indoor environments has been a consistent interest in the building field for decades. This research field's long-standing challenge is to measure human productivity given the complex nature of office work. Previous studies have diversified productivity metrics, allowing greater flexibility in collecting human data; however, this diversity complicates the ability to combine productivity metrics from disparate studies within a meta-analysis. This study aims to categorize existing productivity metrics and statistically assess which categories show similar behavior when used to measure the impacts of indoor environmental quality. The 106 productivity metrics compiled were grouped into six productivity metric categories: neurobehavioral speed, accuracy, neurobehavioral response time, call handling time, self-reported productivity, and performance score. Then, this study set neurobehavioral speed as the baseline category given its fitness to the efficiency-based definition of productivity (i.e., output versus input) and conducted three statistical analyses with the other categories to evaluate their similarity. As results, the categories of neurobehavioral response time, self-reported productivity, and call handling time were found to have statistical similarity with neurobehavioral speed. This study contributes to creating a constructive research environment for future meta-analyses to understand which human productivity metrics can be combined with each other.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2020

Investigating Scientific Data Change with User Research Methods

Scientific datasets are continually expanding and changing due to fluctuations with instruments, quality assessment and quality control processes, and modifications to software pipelines. Datasets include minimal information about these changes or their effects requiring scientists manually assess modifications through a number of labor intensive and ad-hoc steps. The Deduce project is investigating data change to develop metrics, methods, and tools that will help scientists systematically identify and make decisions around data changes. Currently, there is a lack of understanding, and common practices, for identifying and evaluating changes in datasets since systematically measuring and managing data change is under explored in scientific work. We are conducting user research to address this need by exploring scientist's conceptualizations, behaviors, needs, and motivations when dealing with changing datasets. Our user research utilizes multiple methods to produce foundational, generative insights and evaluate research products produced by our team. In this paper, we detail our user research process and outline our findings about data change that emerge from our studies. Our work illustrates how scientific software teams can push beyond just usability testing user interfaces or tools to better probe the underlying ideas they are developing solutions to address.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗
NASA NTRS1998

Objective Situation Awareness Measurement Based on Performance Self-Evaluation

The research was conducted in support of the NASA Safe All-Weather Flight Operations for Rotorcraft (SAFOR) program. The purpose of the work was to investigate the utility of two measurement tools developed by the British Defense Evaluation Research Agency. These tools were a subjective workload assessment scale, the DRA Workload Scale and a situation awareness measurement tool. The situation awareness tool uses a comparison of the crew's self-evaluation of performance against actual performance in order to determine what information the crew attended to during the performance. These two measurement tools were evaluated in the context of a test of innovative approach to alerting the crew by way of a helmet mounted display. The situation assessment data are reported here. The performance self-evaluation metric of situation awareness was found to be highly effective. It was used to evaluate situation awareness on a tank reconnaissance task, a tactical navigation task, and a stylized task used to evaluated handling qualities. Using the self-evaluation metric, it was possible to evaluate situation awareness, without exact knowledge the relevant information in some cases and to identify information to which the crew attended or failed to attend in others.

DeMaio, Joe↗
DOE OSTI2024

Characterization of ultrafast-laser ablation of micro-structures in Li-ion battery anode and cathode materials: Morphology, rate, and efficiency

Characterization of the rate and quality of ultrafast-laser ablation of Li-ion battery (LIB) electrode materials is presented for a collection of common and next-generation electrodes. Laser ablated micro-structures on the surface of LIB electrodes have been shown to provide dramatic enhancement of high-rate capability and electrode wetting. However, industrial adoption is hampered by a lack of data enabling informed choice of laser parameters and predicting process throughput. Here this work bridges this gap by providing characterization of the ablation process at more laser parameters (laser fluence and number of pulses used) than are currently available in the literature. Further, we expand on previous graphite and lithium iron phosphate (LFP) ablation work by extending ablation characterization to new LIB materials, providing high data resolution and adopting new characterization metrics which are relevant for industrial application of this technology. Ablated pores are characterized by their ablated depth, volume, and how the depth and volume ablation rate changes as a function of pore depth. Finally, we provide a detailed characterization of the morphology of laser ablated micro-structures which informs how material and laser parameters affect the quality of laser-processed electrodes.

25 ENERGY STORAGE↗
NASA NTRSDate not supplied

Fusing GeoNEX and VIIRS Surface BRDF Retrievals: Exploring a GEO-LEO Synergy

The Bidirectional Reflectance Distribution Function or BRDF, which describes the dependency of surface reflectance on the illumination-view geometries, are the foundation of many high-level satellite products for terrestrial and aquatic system monitoring. The latest geostationary sensors like GOES ABI provide high frequent (~10 minutes) observations of the Earth surface that feature continuously changing sun angles, allowing us to retrieve surface BRDF with dedicated atmospheric correction algorithms like MAIAC (Multi-Angle Implementation of Atmospheric Correction). For mid-latitude locations, because geostationary satellites have fixed view angles in the back-scattering directions, the angular sampling of surface BRDF by GEO sensors is not comprehensive. This study explores a GEO-LEO synergy to address this issue. We first extract concurrent GeoNEX and VIIRS BRDF data with the best quality (cloud-free and low aerosol loading) at chosen AERONET sites. We then compare the magnitude and the shape factors of the two set of BRDF parameters as well as their variations through the season. We calculate the “distances” between the GeoNEX and VIIRS BRDF by using them to cross-predict the top-of-atmosphere reflectance measured by their counterpart and evaluating the corresponding prediction errors. This metric allows us to derive a set of optimized BRDF parameters that minimize such distances or prediction errors, which are considered as the fused BRDF result. We validate the algorithm with reserved AERONET data and then apply it to generate the GEO-LEO BRDF synergy over CONUS. We expect the fused BRDF to have reduced uncertainties as compared to the source GeoNEX or VIIRS data and may find broadly application in deriving other high-level satellite products.

Geostationary satellite↗
NASA NTRS2023

Potomac River Basin Water Resources: Assessing Water Quality and Quantity in the National Capital Region Using NASA Earth Observations

The Potomac River Basin (PRB) is responsible for providing drinking water to over 5 million residents and plays a significant role in the health of the Chesapeake Bay. Therefore, it is important to understand the relationship between water quality, landcover, and the hydrological cycle within the PRB. The National Park Service (NPS) has monitored 37 streams within the National Park Units in Maryland, Virginia, West Virginia and Washington, D.C. This project aimed to help the NPS better understand trends in water quality to supplement their ability to monitor changes in the National Capital Region Network (NCRN). Google Earth Engine, ArcGIS Pro, R, and Python were used for data retrieval, visualization, and analysis. Earth observations included Landsat 5 TM and Landsat 8 OLI/TIRS imagery. Ancillary data included the USDA Cropland Data Layer, Climate Hazards Group InfraRed Precipitation with Station Data (CHIRPS), and soil moisture data from the Famine Early Warning Systems Network (FEWS NET) Land Data Assimilation System (FLDAS). We compared Land use/land cover (LULC), Normalized Difference Vegetation Index (NDVI), precipitation and soil moisture data to water quality data provided by the NPS at a watershed level. LULC change maps were also generated for the PRB between 2008 and 2022. We found significant correlations between precipitation, soil moisture, NDVI, and water quality. Correlations were found between certain land use types and water quality metrics, but findings varied greatly between watersheds. These insights emphasize the imperative of strategic watershed management in preserving the integrity of key aquatic systems.

Landsat↗
NASA NTRS2004

Architecture and Functionality of the Advanced Life Support On-Line Project Information System (OPIS)

An ongoing effort is underway at NASA Amcs Research Center (ARC) tu develop an On-line Project Information System (OPIS) for the Advanced Life Support (ALS) Program. The objective of this three-year project is to develop, test, revise and deploy OPIS to enhance the quality of decision-making metrics and attainment of Program goals through improved knowledge sharing. OPIS will centrally locate detailed project information solicited from investigators on an annual basis and make it readily accessible by the ALS Community via a web-accessible interface. The data will be stored in an object-oriented relational database (created in MySQL(Trademark) located on a secure server at NASA ARC. OPE will simultaneously serve several functions, including being an R&TD status information hub that can potentially serve as the primary annual reporting mechanism. Using OPIS, ALS managers and element leads will be able to carry out informed research and technology development investment decisions, and allow analysts to perform accurate systems evaluations. Additionally, the range and specificity of information solicited will serve to educate technology developers of programmatic needs. OPIS will collect comprehensive information from all ALS projects as well as highly detailed information specific to technology development in each ALS area (Waste, Water, Air, Biomass, Food, Thermal, and Control). Because the scope of needed information can vary dramatically between areas, element-specific technology information is being compiled with the aid of multiple specialized working groups. This paper presents the current development status in terms of the architecture and functionality of OPIS. Possible implementation approaches for OPIS are also discussed.

Hogan, John A.↗
NASA NTRS2004

Architecture and Functionality of the Advanced Life Support On-Line Project Information System

An ongoing effort is underway at NASA Ames Research Center (ARC) to develop an On-line Project Information System (OPIS) for the Advanced Life Support (ALS) Program. The objective of this three-year project is to develop, test, revise and deploy OPIS to enhance the quality of decision-making metrics and attainment of Program goals through improved knowledge sharing. OPIS will centrally locate detailed project information solicited from investigators on an annual basis and make it readily accessible by the ALS Community via a Web-accessible interface. The data will be stored in an object-oriented relational database (created in MySQL) located on a secure server at NASA ARC. OPE will simultaneously serve several functions, including being an research and technology development (R&TD) status information hub that can potentially serve as the primary annual reporting mechanism for ALS-funded projects. Using OPIS, ALS managers and element leads will be able to carry out informed R&TD investment decisions, and allow analysts to perform accurate systems evaluations. Additionally, the range and specificity of information solicited will serve to educate technology developers of programmatic needs. OPIS will collect comprehensive information from all ALS projects as well as highly detailed information specific to technology development in each ALS area (Waste, Water, Air, Biomass, Food, Thermal, Controls and Systems Analysis). Because the scope of needed information can vary dramatically between areas, element-specific technology information is being compiled with the aid of multiple specialized working groups. This paper presents the current development status in terms of the architecture and functionality of OPIS. Possible implementation approaches for OPIS are also discussed.

Hogan, John A.↗