Search NASA⌕ Search

SEARCH · Search NASA

Results for “metric standardization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
NASA NTRS2006

Reconfigurable Protocol Sensing in an End-to-End Demonstration

In this work, we present sensing performance using an architecture for a reconfigurable protocol chip for spacebased applications. Toward utilizing the IP packet architecture, utilizing data link layer framing structures for multiplexed data on a channel are the targeted application considered for demonstration purposes. Specifically, we examine three common framing standards and present the sensing performance of these standards and their relative de-correlation metrics. Some analysis is performed to investigate the impact of lossy links. Finally, we present results on a demonstration platform that integrated reconfigurable sensing technology into the Ground Station Interface Device (GRID) for End-to-End IP demonstrations in space.

space based applications↗
NASA NTRSDate not supplied

Influence of Thermophysical Property Variability on Thermal Predictions of Ti-6Al-4V

The additive manufacturing (AM) industry has experienced rapid growth in recent decades as industrial interest in the process has grown. Because of this, there are many groups interested in simulations of the AM process. However, the influence of thermophysical property variability on the melt pool geometry during processing of various AM alloys is unclear. The goal of my work at NASA Langley Research Center (LaRC) was to characterize this influence on Ti-6Al-4V during AM processing alongside developing a tool to enable equivalent studies on other AM materials. To facilitate this process, a database tool was developed to contain and organize thermophysical data previously reported by primary sources. The specific thermophysical properties of interest for this study were density, specific heat capacity, and conductivity. Thermal diffusivity was calculated using the other three properties. This data was then fit with a Gaussian distribution and then randomly sampled from using Monte Carlo random value sampling. Using the Rosenthal equation, this sample data was used to simulate the temperature field during additive manufacturing and extract the melt pool geometry. Specifically, the melt pool’s length, width, and depth. This process was repeated an arbitrary number of times, with the default being 1000. Once this information was obtained, histograms were made showing the distributions of the sizes of the melt pool’s length, width, and depth. Representative statistical metrics of the distributions were calculated (mean, standard deviation, and coefficient of variance). This work found that at the simulated processing values, the melt pool’s width and depth had a 5.7% variation while the length had a 3.2% variation. Additionally, a tool was constructed to graph a thermal color map representation of the melt pool for specific, arbitrary values of density, specific heat, and conductivity. This tool allowed for more efficient plotting of individual queries of the thermophysical properties. The results that were observed in the research were that values reported in literature vary and this variance can have a significant impact on the simulation. Predictions of the melt pool’s dimensions show that length has a standard deviation of approximately 6 μm, width has a standard deviation of approximately 5 μm, and depth can vary by approximately 3 μm. Considering the mean sizes of length, width, and depth are 185 μm, 88 μm, and 44 μm respectively, such a deviation is significant. This shows that depth, for example, could be more than 10% larger or smaller than expected. This demonstrates that variability in the reported thermophysical properties are not negligible and should be expected to have an influence on the results of the laser powder bed fusion additive manufacturing process. When simulating this process in the future, measures should be taken to account for this discrepancy and the uncertainty involved

Justin Martin↗
NASA NTRSDate not supplied

Human Thermal Assessment of Traverse and Geology Task Iterations During Simulated Lunar Extravehicular Activity

Spacewalks or extravehicular activities (EVA) in microgravity are mentally and physically demanding. Current microgravity EVAs are predominantly focused on upper body tasks on engineered surfaces; however, the introduction of gravity means that crew members during future lunar EVAs will be required to perform tasks that generate full body workloads such as navigating natural lunar terrain while conducting geological sampling. To date, only 12 people have walked on the surface of the Moon resulting in limited knowledge of suited thermal regulation under lunar-relevant physical workloads. To address this gap, a study is underway to focus on spacesuit operations with simulated lunar EVA workloads. This study presents methodology for collecting standard thermal measures during suit testing. In this pilot study, two suited subjects underwent simulated lunar EVAs using the NASA Active Response Gravity Offload System (ARGOS) to simulate the effects of partial gravity. Each lunar EVA, lasting three to five hours, included various metabolically demanding EVA tasks. Subjects donned the NASA Mark III (MK III) space suit and were offloaded to 1/6th G (lunar gravity). A subset task circuit from one of these simulations replicated an EVA traverse to a lunar crater, taking a geological sample, and returning to base. The suited subject walked one 1500 m (0% grade) and three 500 m traverses at three different grades (10, 20, 30%). Between each traverse, subjects performed geology sampling tasks (0 and 10% grade). Thermal measurements included core and skin temperature, liquid cooling garment (LCG) inlet and outlet temperature, and spacesuit gas inlet and outlet temperature and humidity. Compared to baseline core temperature (S1 = 37.07±0.32 °C, S2 = 37.27±0.01 °C) and mean skin temperature (S1 = 32.38±0.34 °C, S2 = 33.62±0.03 °C), after a 1500 m traverse, each suited subject showed an increased core temperature (S1 = 37.23±0.12 °C, S2 = 37.41±0.11°C) and decreased mean skin temperature (S1 = 32.16±0.17 °C, S2 = 31.53±1.15 °C) at a delta LCG temperature (S1 = 1.86±0.24 °C, S2 = 2.20±0.76 °C) and delta suit humidity (S1 = 9.66±1.49 %, S2 = 11.50±1.58 %). Core temperature continued to increase from compounding traverse and geology tasks (S1 = 38.04±0.03 °C, S2 = 38.1±0.02 °C) accompanied by an increase in delta LCG temperature (S1 = 2.24±0.13 °C, S2 = 2.67±0.12 °C) and delta suit humidity (S1 = 28±2.42 %, S2 = 31±2.13 %). Conversely, as the circuit progressed, mean skin temperature continued to decrease due to sustained LCG heat rejection (S1 = 30.08±0.15 °C, S2 = 30.28±0.07 °C). During the simulated EVA circuit core temperature increased to elevated values and remained elevated as heat was retained while mean skin temperature decreased due to peripheral heat offloaded to the LCG. The thermal measures collected during this study provided critical heat loading dynamics during lunar EVA tasks. Including core and skin temperatures along with suited thermal measures provides a standard data collection scheme for human thermal metrics during EVA task management. Data collected in this configuration can be used to build future lunar EVA task circuits and human thermal predictions.

Bradley Hoffmann↗
NASA NTRS2022

Optimal Estimation Framework for Ocean Color Atmospheric Correction and Pixel-level Uncertainty Quantification

Ocean color remote sensing requires compensation for atmospheric scattering and absorption (aerosol, Rayleigh, and trace gases), referred to as atmospheric correction (AC). AC allows inference of parameters such as spectrally resolved remote sensing reflectance ( R rs )(λ) ; sr 1 ) at the ocean surface from the top-of-atmosphere reflectance. Often, the uncertainty of this process is not fully explored. Bayesian inference techniques provide a simultaneous AC and uncertainty assessment via a full posterior distribution of the relevant variables, given the prior distribution of those variables and the radiative transfer (RT) likelihood function. Given uncertainties in the algorithm inputs, the Bayesian framework enables better constraints on the AC process by using the complete spectral information compared to traditional approaches that use only a subset of bands for AC. This paper investigates a Bayesian inference research method (Optimal Estimation, OE) for ocean color AC by simultaneously retrieving atmospheric and ocean properties using all visible and near-infrared spectral bands. The OE algorithm analytically approximates the posterior distribution of parameters based on normality assumptions and provides a potentially viable operational algorithm with a reduced computational expense. We developed a Neural Network (NN) RT forward model look-up-table-based emulator to increase algorithm efficiency further and thus speed up the likelihood computations. We then applied the OE algorithm to synthetic data and observations from the MODerate resolution Imaging Spectroradiometer (MODIS) on NASA’s Aqua spacecraft. We compared the R rs )(λ) retrieval and its uncertainty estimates from the OE method with in-situ validation data from the SeaWiFS Bio-optical Archive and Storage System (SeaBASS) and Aerosol Robotic Network Ocean Color (AERONET-OC) datasets. The OE algorithm improved R rs )(λ) estimates relative to the NASA standard operational algorithm by improving all statistical metrics at 443, 555, and 667 nm. Unphysical negative R rs )(λ) , which often appear in complex water conditions, was reduced by a factor of 3. The OE-derived pixel-level R rs )(λ) uncertainty estimates were also assessed relative to in-situ data and were shown to have skill.

Atmospheric correction↗
DOE OSTI2025

Livewire: Automatic Annotations

Diogenes processes datasets to provide data quality metrics for the Livewire platform and creates standardized data dictionaries from data annotations. Diogenes needs data annotations that clearly outline thenformat and organization of the data. It also relies on the type, class, and unit of each data piece for comprehensive analysis, which it cannot determine independently. The Annotation Tool significantly reduces the time needed to create annotations for Diogenes by generating data annotations with the correct formatting and content. It also employs machine learning and hard-coded models to automatically annotate data class, quality type, and data units.

33 - ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2021

Regulatory Implications of Embedded Grid Energy Storage

Electricity is unique among commodities in that its supply chain was developed without a storage component. Every other resource commodity has the ability to store excess quantities built into its supply chain – in the form of granaries, warehouses, reservoirs, etc. This embedded storage creates a buffer for mismatches between supply and demand, stabilizing prices and protecting customers. Recent technological advances in cost-competitive energy storage technologies that are scalable and flexible have made the concept of embedded electrical storage feasible, but several regulatory questions remain. This paper summarizes energy regulatory structures in the U.S. and the implications that they would have for embedded storage on the electric grid. Regulatory challenges for embedded storage include the lack of underlying standards, inclusion in planning processes, ownership models, compensation, and metrics. Two possible pathways forward are explored: an incremental one including regulatory guidance regarding the evaluation of embedded storage in existing planning processes, and a complex one involving the revision of existing reliability standards or the development of a new standard specific to embedded storage.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Assessing the sensitivity and repeatability of permanganate oxidizable carbon as a soil health metric: An interlab comparison across soils

Soil organic matter is central to the soil health framework. Therefore, reliable indicators of Soil organic matter is central to the soil health framework. Therefore, reliable indicators of changes in soil organic matter are essential to inform land management decisions. Permanganate oxidizable carbon (PDXC), an emerging soil health indicator, has shown promise for being sensitive to soil management. However, strict standardization is required for widespread implementation in research and commercial contexts. Here, we used 36 soils-three from each of the 12 USDA soil orders-to determine the effects of sieve size and soil mass of analysis on PDXC results. Using replicated measurements across 12 labs in the US and the EU (n = 7951 samples), we quantified the relative importance of 1) variation between labs, 2) variation within labs, 3) effect soil mass, and 4) effect of soil sieve size on the repeatability of PDXC. We found a wide range of overall variability in PDXC values across labs (0.03 to 171.8%; mean = 13.4%), and much of this variability was attributable to within-lab variation (median = 6.5%) independently of soil mass or sieve size. Greater soil mass (2.5 g) decreased absolute PDXC values by a mean of 177 mg kg -1 soil and decreased analytical variability by 6.5%. For soils with organic carbon (SOC) >10%, greater soil mass (2.5 g) resulted in more frequent PDXC values above the limit of detection whereas the lower soil mass (0.75 g) resulted in PDXC values below the limit of detection for SOC contents <5%. A finer sieve size increased absolute values of PDXC by 124 mg kg -1 while decreasing the analytical variability by 1.8%. In general, soils with greater SOC contents had lower analytical variability. These results point to potential standardizations of the PDXC protocol that can decrease the variability of the metric. We recommend that the PDXC protocol be standardized to use 2.5 g for soils <10% SOC. Sieve size was a relatively small contributor to analytical variability and therefore we recommend that this decision be tailored to the study purpose. Tradeoffs associated with these standardizations can be mitigated, ultimately providing guidance on how to standardize PDXC for routine analysis.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

ComStock Measure Documentation: Heat Pump Rooftop Units with Standard Performance

This documentation focuses on a single end-use savings shape measure - heat pump rooftop units (HP-RTUs) with standard efficiencies that are prevalent in the current market. Today, these products are claimed as standard efficiency by the manufacturers and are most commonly installed. This document will primarily discuss the additional changes of performance and configuration of the standard efficiency HP-RTUs while a comprehensive overview of the fundamental modeling methodology and background of the HP-RTU measure, including applicability, sizing scheme, and other key assumptions can be found in the original documentation: Heat Pump RTU. The definition of "standard efficiency" can be a bit vague when considering detailed specifics other than efficiency metrics of a heat pump. Thus, we have focused on reflecting products where manufacturers claim as standard efficiency and products that are not top-of-the-line in their model lineup. Based on gathering information from eight products from four major manufacturers, there are some common (or relatively prevalent) characteristics and we have defined standard efficiency product as follows: direct drive outdoor unit fan, two stages of heat pump cooling, single stage heat pump heating (i.e., all compressors running at the same time), heat pump minimum lockout temperature of 0°F (-17.8°C), backup electric resistance heating, backup heating runs at the same time as heat pump heating , heat pump heating locking out below minimum operating temperature, IEER in between 11-13, and HSPF in between 8-8.9. There are cases where some of these products have other variations: a variable frequency drive fan, dual fuel (i.e., gas backup heating) option, three or more cooling stages, two stages of heat pump heating, no backup heating as default , etc. However, this work tried to reflect the most common and prevalent options for a standard efficiency product.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRSDate not supplied

WGISS CWIC Report: CWIC Evolution

The purpose of the Committee on Earth Observing Satellites (CEOS) Working Group on Information Systems and Services (WGISS) Integrated Catalog (CWIC) is to provide a consistent search interface to help users find and access satellite data made available by CWIC data partners through the use of the WGISS-supported standards. This presentation will cover the current status of CWIC, CWIC Data partners, CWIC Metrics, and the CWIC evolution/transition activities.

metadata↗
NASA NTRS2010

Optimization of Regression Models of Experimental Data Using Confirmation Points

A new search metric is discussed that may be used to better assess the predictive capability of different math term combinations during the optimization of a regression model of experimental data. The new search metric can be determined for each tested math term combination if the given experimental data set is split into two subsets. The first subset consists of data points that are only used to determine the coefficients of the regression model. The second subset consists of confirmation points that are exclusively used to test the regression model. The new search metric value is assigned after comparing two values that describe the quality of the fit of each subset. The first value is the standard deviation of the PRESS residuals of the data points. The second value is the standard deviation of the response residuals of the confirmation points. The greater of the two values is used as the new search metric value. This choice guarantees that both standard deviations are always less or equal to the value that is used during the optimization. Experimental data from the calibration of a wind tunnel strain-gage balance is used to illustrate the application of the new search metric. The new search metric ultimately generates an optimized regression model that was already tested at regression model independent confirmation points before it is ever used to predict an unknown response from a set of regressors.

Ulbrich, N.↗
NASA NTRSDate not supplied

Uncertainty Estimates for Sonic-Boom Pressure Signatures and Loudness Carpets

A non-intrusive uncertainty quantification method is applied to computational analysis of supersonic, low-boom aircraft. The mean and standard deviation statistics of the pressure waveforms and loudness metrics are evaluated through use of numerical quadrature. The probability density function (p.d.f.) of these outputs is evaluated via kernel density estimation. The simulations use an inviscid, embedded-boundary Cartesian-mesh flow solver in the nearfield combined with an augmented Burgers’ equation solver for propagation in the farfield. The results show that the p.d.f. of the waveform is bimodal at shocks, which makes the mean and standard deviation statistics inappropriate. Despite this limitation, we show that the moment statistics can provide effective assessment of discrepancies when comparing with experimental data. This is demonstrated by presenting uncertainty analysis of a wind-tunnel test and showing that we significantly improve the predictions when we include the test uncertainties in the simulation. Normal distributions are obtained for the ground signature and loudness metrics, which is primarily due to the careful shaping of the low-boom waveform. Separation of variables and error control are used to reduce computational cost. We demonstrate that this is an efficient approach in the sense of balancing numerical errors in the statistics quadrature with discretization errors in the solvers.

ARMD↗
NASA NTRS2010

Metrics for Offline Evaluation of Prognostic Performance

Prognostic performance evaluation has gained significant attention in the past few years. Currently, prognostics concepts lack standard definitions and suffer from ambiguous and inconsistent interpretations. This lack of standards is in part due to the varied end-user requirements for different applications, time scales, available information, domain dynamics, etc. to name a few. The research community has used a variety of metrics largely based on convenience and their respective requirements. Very little attention has been focused on establishing a standardized approach to compare different efforts. This paper presents several new evaluation metrics tailored for prognostics that were recently introduced and were shown to effectively evaluate various algorithms as compared to other conventional metrics. Specifically, this paper presents a detailed discussion on how these metrics should be interpreted and used. These metrics have the capability of incorporating probabilistic uncertainty estimates from prognostic algorithms. In addition to quantitative assessment they also offer a comprehensive visual perspective that can be used in designing the prognostic system. Several methods are suggested to customize these metrics for different applications. Guidelines are provided to help choose one method over another based on distribution characteristics. Various issues faced by prognostics and its performance evaluation are discussed followed by a formal notational framework to help standardize subsequent developments.

Saxena, Abhinav↗
NASA NTRS2006

The Effects of Development Team Skill on Software Product Quality

This paper provides an analysis of the effect of the skill/experience of the software development team on the quality of the final software product. A method for the assessment of software development team skill and experience is proposed, and was derived from a workforce management tool currently in use by the National Aeronautics and Space Administration. Using data from 26 smallscale software development projects, the team skill measures are correlated to 5 software product quality metrics from the ISO/IEC 9126 Software Engineering Product Quality standard. in the analysis of the results, development team skill is found to be a significant factor in the adequacy of the design and implementation. In addition, the results imply that inexperienced software developers are tasked with responsibilities ill-suited to their skill level, and thus have a significant adverse effect on the quality of the software product. Keywords: software quality, development skill, software metrics

Beaver, Justin M.↗
DOE OSTI2023

Comparing simulated demand flexibility against actual performance in commercial office buildings

Commercial building energy benchmarking has been used as a mechanism to evaluate energy use of a single building over time, relative to other similar buildings, or to simulations of a reference building conforming to various energy standards. Lack of empirical demand flexibility data and consistent flexibility metrics has limited the ability to compare demand flexibility performance with estimated demand flexibility in buildings. In this study, we collected demand response performance data for a total of 831 demand response events from 192 sites as a first step to build such a building demand flexibility dataset, and propose a standard core data schema to consolidate field data from different sources. We also performed parametric simulations of a control strategy called “global temperature adjustment” using commercial office prototype building models. We then compared the simulated demand flexibility performance against the actual data for offices with global temperature adjustment strategy implemented. During demand response events with an average outside air temperature of 34 °C (range 23 °C–42 °C), the measured demand decrease intensity of the demand flexibility metrics were 6.1 watts per square meter (W/m 2 ), 10.0 W/m 2 , 11.1 W/m 2 , 7.1 W/m 2 , and 4.7 W/m 2 for small, small–medium, medium, medium–large, and large office buildings, respectively. Compared to the measured data in medium- and large-size buildings, the simulated demand decrease intensity was 0.7 W/m 2 (17%) lower on average. The discrepancy between simulated and measured peak demand intensities fell within one standard deviation of the mean measured data. Here, the comparison results validate the credibility of simulations in capturing real building data for assessing the technical potential of building demand flexibility.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

Global wave energy resource classification system for regional energy planning and project development

Efforts to streamline and codify wave energy resource characterization and assessment for regional energy planning and wave energy converter (WEC) project development have motivated the recent development of resource classification systems. Given the unique interplay between WEC absorption and resource attributes, viz, available wave power frequency, directionality, and seasonality, various consensus resource classification metrics have been introduced. However, the main international standards body for the wave energy industry has not reached consensus on a wave energy resource classification system designed with clear goals to facilitate resource assessment, regional energy planning, project site selection, project feasibility studies, and selection of WEC concepts or archetypes that are most suitable for a given wave energy climate. In this work, a primary consideration of wave energy generation is the available energy that can be captured by WECs with different resonant frequency and directional bandwidths. Therefore, the proposed classification system considers combinations of three different wave power classifications: the total wave power, the frequency-constrained wave power, and the frequency-directionally constrained wave power. The dominant wave period bands containing the most wave power are sub-classification parameters that provide useful information for designing frequency and directionally constrained WECs. The bulk of the global wave energy resource is divided into just 22 resource classes representing distinct wave energy climates that could serve as a common language and reference framework for wave energy resource assessment if codified within international standards.

16 TIDAL AND WAVE POWER↗
DOE OSTI2022

Feasibility of Vascular Parameter Estimation for Assessing Hypertensive Pregnancy Disorders

Abstract Hypertensive pregnancy disorders (HPDs), such as pre-eclampsia, are leading sources of both maternal and fetal morbidity in pregnancy. Noninvasive imaging, such as ultrasound (US) and magnetic resonance imaging (MRI), is an important tool for predicting and monitoring these high risk pregnancies. While imaging can measure hemodynamic parameters, such as uterine artery pulsatility and resistivity indices (PI and RI), the interpretation of such metrics for disease assessment relies on ad hoc standards, which provide limited insight to the physical mechanisms underlying the emergence of hypertensive pregnancy disorders. To provide meaningful interpretation of measured hemodynamic data in patients, advances in computational fluid dynamics can be brought to bear. In this work, we develop a patient-specific computational framework that combines Bayesian inference with a reduced-order fluid dynamics model to infer parameters, such as vascular resistance, compliance, and vessel cross-sectional area, known to be related to the development of hypertension. The proposed framework enables the prediction of hemodynamic quantities of interest, such as pressure and velocity, directly from sparse and noisy MRI measurements. We illustrate the effectiveness of this approach in two systemic arterial network geometries: an aorta with branching carotid artery and a maternal pelvic arterial network. For both cases, the model can reconstruct the provided measurements and infer parameters of interest. In the case of the maternal pelvic arteries, the model can make a distinction between the pregnancies destined to develop hypertension and those that remain normotensive, expressed through the value range of the predicted absolute pressure.

Biophysics↗
NASA NTRS2010

Propulsion Diagnostic Method Evaluation Strategy (ProDiMES) User's Guide

This report is a User's Guide for the Propulsion Diagnostic Method Evaluation Strategy (ProDiMES). ProDiMES is a standard benchmarking problem and a set of evaluation metrics to enable the comparison of candidate aircraft engine gas path diagnostic methods. This Matlab (The Mathworks, Inc.) based software tool enables users to independently develop and evaluate diagnostic methods. Additionally, a set of blind test case data is also distributed as part of the software. This will enable the side-by-side comparison of diagnostic approaches developed by multiple users. The Users Guide describes the various components of ProDiMES, and provides instructions for the installation and operation of the tool.

Simon, Donald L.↗
NASA NTRS2014

Assessment of Satellite Ocean Colour Radiometry and Derived Geophysical Products

Standardization of methods to assess and assign quality metrics to satellite ocean color radiometry and derived geophysical products has become paramount with the inclusion of the marine reflectance and chlorophyll-a concentration (Chla) as essential climate variables (ECV; [1]) and the recognition that optical remote sensing of the oceans can only contribute to climate research if and when a continuous succession of satellite missions can be shown to collectively provide a consistent, long-term record with known uncertainties. In 20 years, the community has made significant advancements toward that objective, but providing a complete uncertainty budget for all products and for all conditions remains a daunting task. In the retrieval of marine water-leaving radiance from observed top-of-atmosphere radiance, the sources of uncertainties include those associated with propagation of sensor noise and radiometric calibration and characterization errors, as well as a multitude of uncertainties associated with the modeling and removal of effects from the atmosphere and sea surface. This chapter describes some common approaches used to assess quality and consistency of ocean color satellite products and reviews the current status of uncertainty quantification in the field. Its focus is on the primary ocean color product, the spectrum of marine reflectance Rrs, but uncertainties in some derived products such as the Chla or inherent optical properties (IOPs) will also be considered.

Ocean↗