Search NASA⌕ Search

SEARCH · Search NASA

Results for “metric standardization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS2006

Protocol Sensing Across Multiple Space Missions

In this work, we present sensing performance using an architecture for a reconfigurable protocol chip for spacebased applications. Toward utilizing the IP packet architecture, utilizing data link layer framing structures for multiplexed data on a channel are the targeted application considered for demonstration purposes. Specifically, we examine three common framing standards and present the sensing performance of these standards and their relative de-correlation metrics. Some analysis is performed to investigate the impact of lossy links and on the number of packets required to perform a decision with some probability. Finally, we present results on a demonstration platform that integrated reconfigurable sensing technology into the Ground Station Interface Device (GRID) for End-to-End IP demonstrations in space.

Ground Station Interface Device (GRID)↗
NASA NTRS2006

Reconfigurable Protocol Sensing in an End-to-End Demonstration

In this work, we present sensing performance using an architecture for a reconfigurable protocol chip for spacebased applications. Toward utilizing the IP packet architecture, utilizing data link layer framing structures for multiplexed data on a channel are the targeted application considered for demonstration purposes. Specifically, we examine three common framing standards and present the sensing performance of these standards and their relative de-correlation metrics. Some analysis is performed to investigate the impact of lossy links. Finally, we present results on a demonstration platform that integrated reconfigurable sensing technology into the Ground Station Interface Device (GRID) for End-to-End IP demonstrations in space.

space based applications↗
NASA NTRSDate not supplied

Influence of Thermophysical Property Variability on Thermal Predictions of Ti-6Al-4V

The additive manufacturing (AM) industry has experienced rapid growth in recent decades as industrial interest in the process has grown. Because of this, there are many groups interested in simulations of the AM process. However, the influence of thermophysical property variability on the melt pool geometry during processing of various AM alloys is unclear. The goal of my work at NASA Langley Research Center (LaRC) was to characterize this influence on Ti-6Al-4V during AM processing alongside developing a tool to enable equivalent studies on other AM materials. To facilitate this process, a database tool was developed to contain and organize thermophysical data previously reported by primary sources. The specific thermophysical properties of interest for this study were density, specific heat capacity, and conductivity. Thermal diffusivity was calculated using the other three properties. This data was then fit with a Gaussian distribution and then randomly sampled from using Monte Carlo random value sampling. Using the Rosenthal equation, this sample data was used to simulate the temperature field during additive manufacturing and extract the melt pool geometry. Specifically, the melt pool’s length, width, and depth. This process was repeated an arbitrary number of times, with the default being 1000. Once this information was obtained, histograms were made showing the distributions of the sizes of the melt pool’s length, width, and depth. Representative statistical metrics of the distributions were calculated (mean, standard deviation, and coefficient of variance). This work found that at the simulated processing values, the melt pool’s width and depth had a 5.7% variation while the length had a 3.2% variation. Additionally, a tool was constructed to graph a thermal color map representation of the melt pool for specific, arbitrary values of density, specific heat, and conductivity. This tool allowed for more efficient plotting of individual queries of the thermophysical properties. The results that were observed in the research were that values reported in literature vary and this variance can have a significant impact on the simulation. Predictions of the melt pool’s dimensions show that length has a standard deviation of approximately 6 μm, width has a standard deviation of approximately 5 μm, and depth can vary by approximately 3 μm. Considering the mean sizes of length, width, and depth are 185 μm, 88 μm, and 44 μm respectively, such a deviation is significant. This shows that depth, for example, could be more than 10% larger or smaller than expected. This demonstrates that variability in the reported thermophysical properties are not negligible and should be expected to have an influence on the results of the laser powder bed fusion additive manufacturing process. When simulating this process in the future, measures should be taken to account for this discrepancy and the uncertainty involved

Justin Martin↗
NASA NTRSDate not supplied

Human Thermal Assessment of Traverse and Geology Task Iterations During Simulated Lunar Extravehicular Activity

Spacewalks or extravehicular activities (EVA) in microgravity are mentally and physically demanding. Current microgravity EVAs are predominantly focused on upper body tasks on engineered surfaces; however, the introduction of gravity means that crew members during future lunar EVAs will be required to perform tasks that generate full body workloads such as navigating natural lunar terrain while conducting geological sampling. To date, only 12 people have walked on the surface of the Moon resulting in limited knowledge of suited thermal regulation under lunar-relevant physical workloads. To address this gap, a study is underway to focus on spacesuit operations with simulated lunar EVA workloads. This study presents methodology for collecting standard thermal measures during suit testing. In this pilot study, two suited subjects underwent simulated lunar EVAs using the NASA Active Response Gravity Offload System (ARGOS) to simulate the effects of partial gravity. Each lunar EVA, lasting three to five hours, included various metabolically demanding EVA tasks. Subjects donned the NASA Mark III (MK III) space suit and were offloaded to 1/6th G (lunar gravity). A subset task circuit from one of these simulations replicated an EVA traverse to a lunar crater, taking a geological sample, and returning to base. The suited subject walked one 1500 m (0% grade) and three 500 m traverses at three different grades (10, 20, 30%). Between each traverse, subjects performed geology sampling tasks (0 and 10% grade). Thermal measurements included core and skin temperature, liquid cooling garment (LCG) inlet and outlet temperature, and spacesuit gas inlet and outlet temperature and humidity. Compared to baseline core temperature (S1 = 37.07±0.32 °C, S2 = 37.27±0.01 °C) and mean skin temperature (S1 = 32.38±0.34 °C, S2 = 33.62±0.03 °C), after a 1500 m traverse, each suited subject showed an increased core temperature (S1 = 37.23±0.12 °C, S2 = 37.41±0.11°C) and decreased mean skin temperature (S1 = 32.16±0.17 °C, S2 = 31.53±1.15 °C) at a delta LCG temperature (S1 = 1.86±0.24 °C, S2 = 2.20±0.76 °C) and delta suit humidity (S1 = 9.66±1.49 %, S2 = 11.50±1.58 %). Core temperature continued to increase from compounding traverse and geology tasks (S1 = 38.04±0.03 °C, S2 = 38.1±0.02 °C) accompanied by an increase in delta LCG temperature (S1 = 2.24±0.13 °C, S2 = 2.67±0.12 °C) and delta suit humidity (S1 = 28±2.42 %, S2 = 31±2.13 %). Conversely, as the circuit progressed, mean skin temperature continued to decrease due to sustained LCG heat rejection (S1 = 30.08±0.15 °C, S2 = 30.28±0.07 °C). During the simulated EVA circuit core temperature increased to elevated values and remained elevated as heat was retained while mean skin temperature decreased due to peripheral heat offloaded to the LCG. The thermal measures collected during this study provided critical heat loading dynamics during lunar EVA tasks. Including core and skin temperatures along with suited thermal measures provides a standard data collection scheme for human thermal metrics during EVA task management. Data collected in this configuration can be used to build future lunar EVA task circuits and human thermal predictions.

Bradley Hoffmann↗
NASA NTRS2022

Optimal Estimation Framework for Ocean Color Atmospheric Correction and Pixel-level Uncertainty Quantification

Ocean color remote sensing requires compensation for atmospheric scattering and absorption (aerosol, Rayleigh, and trace gases), referred to as atmospheric correction (AC). AC allows inference of parameters such as spectrally resolved remote sensing reflectance ( R rs )(λ) ; sr 1 ) at the ocean surface from the top-of-atmosphere reflectance. Often, the uncertainty of this process is not fully explored. Bayesian inference techniques provide a simultaneous AC and uncertainty assessment via a full posterior distribution of the relevant variables, given the prior distribution of those variables and the radiative transfer (RT) likelihood function. Given uncertainties in the algorithm inputs, the Bayesian framework enables better constraints on the AC process by using the complete spectral information compared to traditional approaches that use only a subset of bands for AC. This paper investigates a Bayesian inference research method (Optimal Estimation, OE) for ocean color AC by simultaneously retrieving atmospheric and ocean properties using all visible and near-infrared spectral bands. The OE algorithm analytically approximates the posterior distribution of parameters based on normality assumptions and provides a potentially viable operational algorithm with a reduced computational expense. We developed a Neural Network (NN) RT forward model look-up-table-based emulator to increase algorithm efficiency further and thus speed up the likelihood computations. We then applied the OE algorithm to synthetic data and observations from the MODerate resolution Imaging Spectroradiometer (MODIS) on NASA’s Aqua spacecraft. We compared the R rs )(λ) retrieval and its uncertainty estimates from the OE method with in-situ validation data from the SeaWiFS Bio-optical Archive and Storage System (SeaBASS) and Aerosol Robotic Network Ocean Color (AERONET-OC) datasets. The OE algorithm improved R rs )(λ) estimates relative to the NASA standard operational algorithm by improving all statistical metrics at 443, 555, and 667 nm. Unphysical negative R rs )(λ) , which often appear in complex water conditions, was reduced by a factor of 3. The OE-derived pixel-level R rs )(λ) uncertainty estimates were also assessed relative to in-situ data and were shown to have skill.

Atmospheric correction↗
NASA NTRSDate not supplied

WGISS CWIC Report: CWIC Evolution

The purpose of the Committee on Earth Observing Satellites (CEOS) Working Group on Information Systems and Services (WGISS) Integrated Catalog (CWIC) is to provide a consistent search interface to help users find and access satellite data made available by CWIC data partners through the use of the WGISS-supported standards. This presentation will cover the current status of CWIC, CWIC Data partners, CWIC Metrics, and the CWIC evolution/transition activities.

metadata↗
NASA NTRS2010

Optimization of Regression Models of Experimental Data Using Confirmation Points

A new search metric is discussed that may be used to better assess the predictive capability of different math term combinations during the optimization of a regression model of experimental data. The new search metric can be determined for each tested math term combination if the given experimental data set is split into two subsets. The first subset consists of data points that are only used to determine the coefficients of the regression model. The second subset consists of confirmation points that are exclusively used to test the regression model. The new search metric value is assigned after comparing two values that describe the quality of the fit of each subset. The first value is the standard deviation of the PRESS residuals of the data points. The second value is the standard deviation of the response residuals of the confirmation points. The greater of the two values is used as the new search metric value. This choice guarantees that both standard deviations are always less or equal to the value that is used during the optimization. Experimental data from the calibration of a wind tunnel strain-gage balance is used to illustrate the application of the new search metric. The new search metric ultimately generates an optimized regression model that was already tested at regression model independent confirmation points before it is ever used to predict an unknown response from a set of regressors.

Ulbrich, N.↗
NASA NTRSDate not supplied

Uncertainty Estimates for Sonic-Boom Pressure Signatures and Loudness Carpets

A non-intrusive uncertainty quantification method is applied to computational analysis of supersonic, low-boom aircraft. The mean and standard deviation statistics of the pressure waveforms and loudness metrics are evaluated through use of numerical quadrature. The probability density function (p.d.f.) of these outputs is evaluated via kernel density estimation. The simulations use an inviscid, embedded-boundary Cartesian-mesh flow solver in the nearfield combined with an augmented Burgers’ equation solver for propagation in the farfield. The results show that the p.d.f. of the waveform is bimodal at shocks, which makes the mean and standard deviation statistics inappropriate. Despite this limitation, we show that the moment statistics can provide effective assessment of discrepancies when comparing with experimental data. This is demonstrated by presenting uncertainty analysis of a wind-tunnel test and showing that we significantly improve the predictions when we include the test uncertainties in the simulation. Normal distributions are obtained for the ground signature and loudness metrics, which is primarily due to the careful shaping of the low-boom waveform. Separation of variables and error control are used to reduce computational cost. We demonstrate that this is an efficient approach in the sense of balancing numerical errors in the statistics quadrature with discretization errors in the solvers.

ARMD↗
NASA NTRS2010

Metrics for Offline Evaluation of Prognostic Performance

Prognostic performance evaluation has gained significant attention in the past few years. Currently, prognostics concepts lack standard definitions and suffer from ambiguous and inconsistent interpretations. This lack of standards is in part due to the varied end-user requirements for different applications, time scales, available information, domain dynamics, etc. to name a few. The research community has used a variety of metrics largely based on convenience and their respective requirements. Very little attention has been focused on establishing a standardized approach to compare different efforts. This paper presents several new evaluation metrics tailored for prognostics that were recently introduced and were shown to effectively evaluate various algorithms as compared to other conventional metrics. Specifically, this paper presents a detailed discussion on how these metrics should be interpreted and used. These metrics have the capability of incorporating probabilistic uncertainty estimates from prognostic algorithms. In addition to quantitative assessment they also offer a comprehensive visual perspective that can be used in designing the prognostic system. Several methods are suggested to customize these metrics for different applications. Guidelines are provided to help choose one method over another based on distribution characteristics. Various issues faced by prognostics and its performance evaluation are discussed followed by a formal notational framework to help standardize subsequent developments.

Saxena, Abhinav↗
NASA NTRS2006

The Effects of Development Team Skill on Software Product Quality

This paper provides an analysis of the effect of the skill/experience of the software development team on the quality of the final software product. A method for the assessment of software development team skill and experience is proposed, and was derived from a workforce management tool currently in use by the National Aeronautics and Space Administration. Using data from 26 smallscale software development projects, the team skill measures are correlated to 5 software product quality metrics from the ISO/IEC 9126 Software Engineering Product Quality standard. in the analysis of the results, development team skill is found to be a significant factor in the adequacy of the design and implementation. In addition, the results imply that inexperienced software developers are tasked with responsibilities ill-suited to their skill level, and thus have a significant adverse effect on the quality of the software product. Keywords: software quality, development skill, software metrics

Beaver, Justin M.↗
NASA NTRS2010

Propulsion Diagnostic Method Evaluation Strategy (ProDiMES) User's Guide

This report is a User's Guide for the Propulsion Diagnostic Method Evaluation Strategy (ProDiMES). ProDiMES is a standard benchmarking problem and a set of evaluation metrics to enable the comparison of candidate aircraft engine gas path diagnostic methods. This Matlab (The Mathworks, Inc.) based software tool enables users to independently develop and evaluate diagnostic methods. Additionally, a set of blind test case data is also distributed as part of the software. This will enable the side-by-side comparison of diagnostic approaches developed by multiple users. The Users Guide describes the various components of ProDiMES, and provides instructions for the installation and operation of the tool.

Simon, Donald L.↗
NASA NTRS2014

Assessment of Satellite Ocean Colour Radiometry and Derived Geophysical Products

Standardization of methods to assess and assign quality metrics to satellite ocean color radiometry and derived geophysical products has become paramount with the inclusion of the marine reflectance and chlorophyll-a concentration (Chla) as essential climate variables (ECV; [1]) and the recognition that optical remote sensing of the oceans can only contribute to climate research if and when a continuous succession of satellite missions can be shown to collectively provide a consistent, long-term record with known uncertainties. In 20 years, the community has made significant advancements toward that objective, but providing a complete uncertainty budget for all products and for all conditions remains a daunting task. In the retrieval of marine water-leaving radiance from observed top-of-atmosphere radiance, the sources of uncertainties include those associated with propagation of sensor noise and radiometric calibration and characterization errors, as well as a multitude of uncertainties associated with the modeling and removal of effects from the atmosphere and sea surface. This chapter describes some common approaches used to assess quality and consistency of ocean color satellite products and reviews the current status of uncertainty quantification in the field. Its focus is on the primary ocean color product, the spectrum of marine reflectance Rrs, but uncertainties in some derived products such as the Chla or inherent optical properties (IOPs) will also be considered.

Ocean↗
NASA NTRSDate not supplied

Augmented fidelity as an alternative to the average fidelity

We provide description of different techniques to assess performance of quantum gates. In particular we focus on newly introduced metric called augmented fidelity, which provides extension to standard average fidelity by taking the average over von Mises-Fisher and polar cap distributions. We show the differences between standard average and augmented fidelities.

quantum computing↗
NASA NTRS2022

Quantifying Cybersecurity Risk for NASA Missions

An end-to-end cyber risk assessment process is presented that is based on the combination of guidelines from the National Institute of Standards & Technology (NIST), the standard 5x5 risk matrix, and quantitative methods for generating loss exceedance curves. The NIST guidelines provide a framework for cyber risk assessment, and the standard 5x5 matrix is widely used across the industry for the representation of risk across multiple disciplines. Loss exceedance curves are a means of quantitatively assessing the loss that occurs due to a given risk profile. Combining these different techniques enables us to follow the guidelines, adhere to standard 5x5 risk management practices and develop quantitative metrics simultaneously. Our quantification process is based on the consideration of the NASA and JPL Cost Risk assessment modeling techniques as we define the cost associated with the cybersecurity risk profile of a mission as a function of the mission cost.

Miller, Robert L.↗
NASA NTRSDate not supplied

EVM and Schedule Management

The objective of EVMS surveillance is to ensure that the management control processes that support the performance measurement baseline (PMB) are in place, compliant with the EVMS guidelines, are routinely being used, and provide timely and reliable data. The PMB is a triple constraint where the constraints are schedule, budget and scope. For Surveillance, NASA uses the DCMA EVM Compliance Metrics (DECM) Tests that are aligned with the EIA-748 EVM Standard. Guidelines 6 is Scheduling Work, and DECM has 23 Tests for evaluating if the IMS supports project goals in its planning, statusing and forecasting. This session will focus on the Test Metric that analyzes forecast start/finish dates riding the status date of the IMS for two or more consecutive months as an example of how surveillance works in concert with IMS health checks. It will cover how to run the test to recognize trends and how this test helps ensure that the forecast is credible in support of critical path analysis.

EVM↗
NASA NTRSDate not supplied

Summary of Propagation Cases of the Third AIAA Sonic Boom Prediction Workshop

A summary is provided for the propagation portion of the Third AIAA Sonic Boom Prediction Workshop held January 5, 2020 in conjunction with the AIAA SciTech 2020 conference. Near-field pressure waveforms for two cases were supplied at multiple azimuthal angles. Ground signatures across the breadth of the sonic boom primary carpet and their corresponding loudness metrics were requested. Each case had some required, as well as some optional, runs. The required cases included atmospheric profiles with measured data including winds. Optional cases included a level-acceleration sonic boom focusing case as well as prediction under standard atmospheric conditions. Participants provided ground signatures along with several loudness metrics using their best sonic boom prediction practices. All the participants' submissions are compared and discussed for each case. Noise or loudness measures are calculated and detailed comparisons and statistical analyses are performed and presented. Compared to previous workshops, the selected cases in the current workshop have much lower boom loudness levels. As was observed in the past workshops, the variation in the loudness measures and spread between participants' submissions increased as the computation proceeded from under-track locations towards the lateral cut-off. Lessons learned during this workshop are discussed and recommendations are made for potential improvements and possible subsequent workshops as we collectively attempt to refine our analysis methods.

SBPW3↗
NASA NTRS2016

National Unmanned Aerial System Standardized Performance Testing and Rating (NUSTAR)

The overall objective of the NUSTAR Capability is to offer standardized tests and scenario conditions to assess performance of the UAS. The following are goals of the NU-STAR: 1. Create a prototype standardized tests and scenarios that vehicles can be tested against. 2. Identify key performance parameters of all UAS and their standardized measurement strategy. 3. Develop standardized performance reporting method (e.g., consumer report style) to assist prospective buyers. 4. Identify key performance metrics that could be used by judged towards overall safety of the UAS and operations. 5. If vehicle certification standard is made by a regulatory agency, the performance of individual UAS could be compared against the minimum requirement (e.g., sense and avoid detection time, stopping distance, kinetic energy, etc.).

Testing↗
NASA NTRS2013

NASA Tech Briefs, Februrary 2013

Topics covered include: Measurements of Ultra-Stable Oscillator (USO) Allan Deviations in Space; Gaseous Nitrogen Orifice Mass Flow Calculator; Validation of Proposed Metrics for Two-Body Abrasion Scratch Test Analysis Standards; Rover Low Gain Antenna Qualification for Deep Space Thermal Environments; Automated, Ultra-Sterile Solid Sample Handling and Analysis on a Chip; Measuring and Estimating Normalized Contrast in Infrared Flash Thermography; Spectrally and Radiometrically Stable, Wideband, Onboard Calibration Source; High-Reliability Waveguide Vacuum/Pressure Window; Methods of Fabricating Scintillators With Radioisotopes for Beta Battery Applications; Magnetic Shield for Adiabatic Demagnetization Refrigerators (ADR); CMOS-Compatible SOI MESFETS for Radiation-Hardened DC-to-DC Converters; Silicon Heat Pipe Array; Adaptive Phase Delay Generator; High-Temperature, Lightweight, Self-Healing Ceramic Composites for Aircraft Engine Applications; Treatment to Control Adhesion of Silicone-Based Elastomers; High-Temperature Adhesives for Thermally Stable Aero-Assist Technologies; Rockballer Sample Acquisition Tool; Rock Gripper for Sampling, Mobility, Anchoring, and Manipulation; Advanced Magnetic Materials Methods and Numerical Models for Fluidization in Microgravity and Hypogravity; Data Transfer for Multiple Sensor Networks Over a Broad Temperature Range; Using Combustion Synthesis to Reinforce Berms and Other Regolith Structures; Visible-Infrared Hyperspectral Image Projector; Three-Axis Attitude Estimation With a High-Bandwidth Angular Rate Sensor Change_Detection.m; AGATE: Adversarial Game Analysis for Tactical Evaluation; Ionospheric Simulation System for Satellite Observations and Global Assimilative; Modeling Experiments (ISOGAME); An Extensible, User- Modifiable Framework for Planning Activities; Mission Operations Center (MOC) - Precipitation Processing System (PPS) Interface Software System (MPISS); Automated 3D Damaged Cavity Model Builder for Lower Surface Acreage Tile on Orbiter; Mixed Linear/Square-Root Encoded Single-Slope Ramp Provides Low-Noise ADC with High Linearity for Focal Plane Arrays; RUSHMAPS: Real-Time Uploadable Spherical Harmonic Moment Analysis for Particle Spectrometers; Powered Descent Guidance with General Thrust-Pointing Constraints; X-Ray Detection and Processing Models for Spacecraft Navigation and Timing; and Extreme Ionizing-Radiation-Resistant Bacterium

Source record↗