Results for “uncertainty reduction”

NASA NTRSDate not supplied

Uncertainty Reduction With Multi-Model Monte Carlo for Crystal Plasticity Simulations of Additively Manufactured Metals

In this work, multi-model Monte Carlo estimators are developed to reduce uncertainty in quantities of interest (QoIs) extracted from crystal plasticity simulations of additively manufactured (AM) metals. A significant concern in AM parts is uncertainty in mechanical properties caused in part by complex microstructures that arise from the AM process. Quantifying uncertainty in microstructure-sensitive behavior using experiments alone is costly, especially when mechanical allowables must be established. Quantitative relationships among microstructure, micromechanical metrics like slip accumulation, crack initiation, and failure are also difficult to capture with limited experiments. Crystal plasticity material models instead enable computational prediction of micromechanical stress and strain fields given a discretized microstructure. However, high-fidelity finely discretized crystal plasticity simulations are computationally expensive, while lower-fidelity models are less accurate and generally biased, making uncertainty quantification and reduction computationally difficult as well. Multi-model Monte Carlo methods leverage correlations between high- and low-fidelity models to produce unbiased estimators for QoIs with reduced uncertainty relative to standard Monte Carlo. Crystal plasticity QoIs considered in this work include yield strength and the mean and extreme values of micromechanical fields that are relevant to crack initiation. Multi-model Monte Carlo estimators are developed for each individual QoI and several groups of QoIs. The results of this work establish relationships among model correlations, sample allocation, and uncertainty reduction for different combinations of QoIs and demonstrate a trend of less uncertainty reduction as QoIs become more sensitive to local microstructure. Limitations from using pilot samples to estimate model covariances and train low-fidelity models are also addressed. The uncertainty reduction achieved by multi-model Monte Carlo is an important step toward using computational mechanics models to predict microstructure-sensitive crack initiation and failure in AM parts.

uncertainty quantification↗

NASA NTRSDate not supplied

More Data Needed for Failure Rate Estimation, Validation, and Uncertainty Reduction

Current Environmental Control and Life Support System (ECLSS) development and test activities are not generating data fast enough to provide statistically-supportable precise Orbital Replacement Unit (ORU) failure rate estimates for future missions. Accurate and precise failure rate estimates are critical for missions beyond Low Earth Orbit (LEO) because current risk mitigation approaches – namely regular resupply and rapid abort capabilities – will not be available. Safe operations will depend on mission planners’ ability to accurately forecast spares demand and efficiently provide the necessary resources. However, even after more than a decade of operations on board the International Space Station (ISS), a significant amount of uncertainty remains in failure rate estimates. Uncertain or inaccurate failure rates result in increased risk and spares mass for future missions. A Bayesian failure rate estimation approach, such as the one currently implemented by the ISS Program, can help reduce uncertainty by incorporating engineering judgement into failure rate estimates. However, experience on the ISS and with other complex systems shows that these prior failure rate estimates are often inaccurate. In addition, prior failure rate estimates are typically point values; some level of uncertainty must be added to convert these into probability distributions for Bayesian updating, and there are several potential methods for doing so. Due to the low rate of data collection, these subjective (and often inaccurate) prior estimates currently have a strong influence on the end result. This paper examines the challenges associated with failure rate estimation, validation, and uncertainty reduction in the context of ECLSS development for beyond-LEO missions. A variety of techniques for generating and updating Bayesian priors are discussed and evaluated using both real-world and simulated data. Potential solutions for improving failure rate estimation, including testing additional units, are analyzed and discussed, and a set of recommendations are provided for next-generation system development activities.

Supportability↗

NASA NTRSDate not supplied

More Data Needed for Failure Rate Estimation, Validation, and Uncertainty Reduction

The currently planned schedule for advanced Environmental Control and Life Support System (ECLSS) development and test activities to support human exploration missions is unlikely to generate sufficient data to enable statistically-supportable, precise Orbital Replacement Unit (ORU) failure rate estimates to meet existing crew safety expectations. Accurate and precise failure rate estimates are critical for missions beyond Low Earth Orbit (LEO) because current risk mitigation approaches –namely regular resupply and rapid abort capabilities –will not be available. Safe operations will depend on mission planners’ ability to accurately forecast spares demand and efficiently provide the necessary resources. However, even after more than a decade of International Space Station (ISS) ECLSS operations, a significant amount of uncertainty remains in failure rate estimates. Uncertain or inaccurate failure rates result in increased risk and spares mass. A Bayesian estimation approach, such as the one currently implemented by the ISS Program, can reduce uncertainty by incorporating engineering judgement into failure rate estimates. However, experience on the ISS and with other complex systems shows that these prior failure rate estimates are often inaccurate. In addition, prior estimates are typically point values; some level of uncertainty must be added to convert these into probability distributions for Bayesian updating, and there are several potential methods for doing so. Due to the low rate of data collection, any inaccuracy in theseprior estimates currently hasa strong influence on the end result. This paper examines the challenges associated with failure rate estimation, validation, and uncertainty reduction in the context of ECLSS development for beyond-LEO missions. A variety of techniques for generating and updating Bayesian priors are discussed and evaluated using both real-world and simulated data. Potential solutions for improving failure rate estimation, including testing additional units, are analyzed and discussed, and a set of recommendations are provided for next-generation system development activities.

Reliability↗

NASA NTRSDate not supplied

More Data Needed for Failure Rate Estimation, Validation, and Uncertainty Reduction

The currently planned schedule for advanced Environmental Control and Life Support System (ECLSS) development and test activities to support human exploration missions is unlikely to generate sufficient data to enable statistically-supportable, precise Orbital Replacement Unit (ORU) failure rate estimates to meet existing crew safety expectations. Accurate and precise failure rate estimates are critical for missions beyond Low Earth Orbit (LEO) because current risk mitigation approaches –namely regular resupply and rapid abort capabilities –will not be available. Safe operations will depend on mission planners’ ability to accurately forecast spares demand and efficiently provide the necessary resources. However, even after more than a decade of International Space Station (ISS) ECLSS operations, a significant amount of uncertainty remains in failure rate estimates. Uncertain or inaccurate failure rates result in increased risk and spares mass. A Bayesian estimation approach, such as the one currently implemented by the ISS Program, can reduce uncertainty by incorporating engineering judgement into failure rate estimates. However, experience on the ISS and with other complex systems shows that these prior failure rate estimates are often inaccurate. In addition, prior estimates are typically point values; some level of uncertainty must be added to convert these into probability distributions for Bayesian updating, and there are several potential methods for doing so. Due to the low rate of data collection, any inaccuracy in theseprior estimates currently hasa strong influence on the end result. This paper examines the challenges associated with failure rate estimation, validation, and uncertainty reduction in the context of ECLSS development for beyond-LEO missions. A variety of techniques for generating and updating Bayesian priors are discussed and evaluated using both real-world and simulated data. Potential solutions for improving failure rate estimation, including testing additional units, are analyzed and discussed, and a set of recommendations are provided for next-generation system development activities.

Reliability↗

NASA NTRS2016

Uncertainty Reduction using Bayesian Inference and Sensitivity Analysis: A Sequential Approach to the NASA Langley Uncertainty Quantification Challenge

This paper presents a computational framework for uncertainty characterization and propagation, and sensitivity analysis under the presence of aleatory and epistemic un- certainty, and develops a rigorous methodology for efficient refinement of epistemic un- certainty by identifying important epistemic variables that significantly affect the overall performance of an engineering system. The proposed methodology is illustrated using the NASA Langley Uncertainty Quantification Challenge (NASA-LUQC) problem that deals with uncertainty analysis of a generic transport model (GTM). First, Bayesian inference is used to infer subsystem-level epistemic quantities using the subsystem-level model and corresponding data. Second, tools of variance-based global sensitivity analysis are used to identify four important epistemic variables (this limitation specified in the NASA-LUQC is reflective of practical engineering situations where not all epistemic variables can be refined due to time/budget constraints) that significantly affect system-level performance. The most significant contribution of this paper is the development of the sequential refine- ment methodology, where epistemic variables for refinement are not identified all-at-once. Instead, only one variable is first identified, and then, Bayesian inference and global sensi- tivity calculations are repeated to identify the next important variable. This procedure is continued until all 4 variables are identified and the refinement in the system-level perfor- mance is computed. The advantages of the proposed sequential refinement methodology over the all-at-once uncertainty refinement approach are explained, and then applied to the NASA Langley Uncertainty Quantification Challenge problem.

Uncertainty↗

NASA NTRSDate not supplied

Results of the NASA Prediction Uncertainty Reduction Tech Challenge

In January 2021 the Advanced Air Vehicles Program approved a new Tech Challenge (TC) to be run out of the Commercial Supersonic Technology (CST) Project. The objective of the TC was to bring uncertainties in the empirical noise modeling for civilian supersonic aircraft into the same range as that of conventional aircraft. The TC goal statement was to “Produce data and demonstrate tools that reduce the uncertainty in predicting Landing & Takeoff Noise levels of supersonic-relevant designs by 5 EPNdB and are ready for use in studies to inform FAA rule-making.” To make the required improvements in noise prediction methods for supersonic aircraft, NASA decided to validate and use high-fidelity numerical simulations to acquire the needed noise data on supersonic propulsion configurations. High-fidelity component designs were developed, such as a two-stage propulsor behind a supersonic inlet designed by General Electric Aviation and variable area exhaust systems using input from recent contracts with GE and Rolls Royce. A noise database was generated as a function of geometric and flow parameters, providing corrections to the empirical noise models and added new input variables to describe the complexities created by the supersonic-specific design features. Statistically, the new models were able to predict the acoustic impact of supersonic-specific features, the reduction in uncertainty being reduced from the baseline 7.8 EPNdB at the beginning of the TC to 2.0 EPNdB at the end.

noise prediction↗

NASA NTRSDate not supplied

Update on Prediction Uncertainty Reduction (PUR) Tech Challenge

NASA has taken on a Technical Challenge to reduce the uncertainty in prediction of noise from near-term commercial supersonic aircraft. To date, an assessment has been done to baseline this effort, quantifying how much more uncertainty exists when the system-level prediction methods are applied to supersonic aircraft as compared to conventional aircraft. And an assessment has been made for the uncertainty in the physics-based simulations for jets. These will be briefly demonstrated.

supersonic↗

NASA NTRS2002

Space Radiation Cancer Risk Projections for Exploration Missions: Uncertainty Reduction and Mitigation

In this paper we discuss expected lifetime excess cancer risks for astronauts returning from exploration class missions. For the first time we make a quantitative assessment of uncertainties in cancer risk projections for space radiation exposures. Late effects from the high charge and energy (HZE) ions present in the galactic cosmic rays including cancer and the poorly understood risks to the central nervous system constitute the major risks. Methods used to project risk in low Earth orbit are seen as highly uncertain for projecting risks on exploration missions because of the limited radiobiology data available for estimating HZE ion risks. Cancer risk projections are described as a product of many biological and physical factors, each of which has a differential range of uncertainty due to lack of data and knowledge. Monte-Carlo sampling from subjective error distributions represents the lack of knowledge in each factor to quantify risk projection overall uncertainty. Cancer risk analysis is applied to several exploration mission scenarios. At solar minimum, the number of days in space where career risk of less than the limiting 3% excess cancer mortality can be assured at a 95% confidence level is found to be only of the order of 100 days.

Cucinotta, Francis↗

NASA NTRSDate not supplied

Acoustic Liner Drag: Measurement Uncertainty Reduction and Application to Novel Perforate Geometries

In addition to developing acoustic liner concepts and characterizing their performance, the NASA Langley Liner Physics Team has investigated issues related to liner drag. A method to quantify relative drag of liner configurations was developed and employed to understand the effects of various liner features. It was observed that perforate shape could have a marked effect on the measured liner drag and led to the discovery of a low-drag geometry that cut the drag penalty between a perforate and a smooth wall by approximately 50%. Investigations of novel perforates to further reduce drag were stymied by measurement uncertainty that prevented further resolution of drag differences between configurations. The current study details efforts to understand the causes of this uncertainty and describe changes made to testing methods to reduce it. Previously evaluated perforates were retested with these improvements in the NASA Langley Grazing Flow Impedance Tube to determine their relative drag at a flow speed of Mach 0.5 without acoustic excitation. Their performance was compared to the previously identified low-drag geometry to see if further drag reductions could be realized.

drag↗

NASA NTRSDate not supplied

Acoustic Liner Drag: Measurement Uncertainty Reduction and Application to Novel Perforate Geometries

In addition to developing acoustic liner concepts and characterizing their performance, the NASA Langley Liner Physics Team has investigated issues related to liner drag. A method to quantify relative drag of liner configurations was developed and employed to understand the effects of various liner features. It was observed that perforate shape could have a marked effect on the measured liner drag and led to the discovery of a low-drag geometry that cut the drag penalty between a perforate and a smooth wall by approximately 50%. Investigations of novel perforates to further reduce drag were stymied by measurement uncertainty that prevented further resolution of drag differences between configurations. The current study details efforts to understand the causes of this uncertainty and describe changes made to testing methods to reduce it. Previously evaluated perforates were retested with these improvements in the NASA Langley Grazing Flow Impedance Tube to determine their relative drag at a flow speed of Mach 0.5 without acoustic excitation. Their performance was compared to the previously identified low-drag geometry to see if further drag reductions could be realized.

drag↗

NASA NTRSDate not supplied

Commercial Supersonic Technology Project - Airport Noise: Prediction Uncertainty Reduction (PUR) Tech Challenge

Explore the source record for details and available documents.

Jet noise, prediction, supersonic↗

NASA NTRSDate not supplied

Reduction of Aircraft Noise Uncertainty for a Notional Supersonic Business Jet

NASA supported a study by the International Civil Aviation Organization on the environmental impact of adding supersonic aircraft to the existing global fleet by designing a notional 55-tonne supersonic business jet. The aircraft is referred to as the Supersonic Technology Concept Aeroplane (STCA) and has been used in a multitude of studies over the past few years. One of the many studies on this aircraft was the noise produced by the STCA during landing and take-off (LTO) operations. The LTO noise for the STCA was assessed using contemporary noise prediction tools that have been primarily developed for and utilized by subsonic aircraft, resulting in a high level of uncertainty for the STCA noise predictions. NASA has recently been conducting research and developing tools to reduce the uncertainty for airport noise predictions of supersonic aircraft. The initial focus of the uncertainty reduction was on the jet and inlet-radiated fan noise produced by supersonic engine systems since these sources are dominant during take-off and landing operations for supersonic jets. The results of these efforts are discussed and applied to the STCA model to update the airport noise predictions and associated uncertainty metrics. It is shown that by using new noise source prediction models, the overall system-level cumulative noise uncertainty of the study vehicle is reduced from a standard deviation of 7.8 EPNdB to 2.0 EPNdB.

uncertainty↗

NASA NTRS2010

Ocean and Atmospheric Profiling Lidar Observations and Its Link to Ocean Carbon Cycle

This study introduces space-based ocean and atmospheric profiling lidar for improving modeling and understanding of ocean carbon cycle. Unique measurements from space-based profiling lidars include (1) the global ocean surface mean square slope measurements for improving air-sea turbulence exchange estimates; (2) the backscatter and beam attenuation measurements for improving the global estimate of partial pressure of CO2 of the ocean with the reduction of uncertainties in primary productivity estimates. Global statistics of CALIOP integrated ocean subsurface backscatter measurements of coastal waters will be presented. The study will also assess the impact of CALIOP on the uncertainty reduction of primary productivity and the improvement of CO2 partial pressure estimates. Ocean surface roughness statistics, its applications in air-sea interaction and its comparisons with other measurements will also be presented

Hu, Yongxiang↗

NASA NTRS2014

Carbon Monitoring System Flux Estimation and Attribution: Impact of ACOS-GOSAT X(CO2) Sampling on the Inference of Terrestrial Biospheric Sources and Sinks

Using an Observing System Simulation Experiment (OSSE), we investigate the impact of JAXA Greenhouse gases Observing SATellite 'IBUKI' (GOSAT) sampling on the estimation of terrestrial biospheric flux with the NASA Carbon Monitoring System Flux (CMS-Flux) estimation and attribution strategy. The simulated observations in the OSSE use the actual column carbon dioxide (X(CO2)) b2.9 retrieval sensitivity and quality control for the year 2010 processed through the Atmospheric CO2 Observations from Space algorithm. CMS-Flux is a variational inversion system that uses the GEOS-Chem forward and adjoint model forced by a suite of observationally constrained fluxes from ocean, land and anthropogenic models. We investigate the impact of GOSAT sampling on flux estimation in two aspects: 1) random error uncertainty reduction and 2) the global and regional bias in posterior flux resulted from the spatiotemporally biased GOSAT sampling. Based on Monte Carlo calculations, we find that global average flux uncertainty reduction ranges from 25% in September to 60% in July. When aggregated to the 11 land regions designated by the phase 3 of the Atmospheric Tracer Transport Model Intercomparison Project, the annual mean uncertainty reduction ranges from 10% over North American boreal to 38% over South American temperate, which is driven by observational coverage and the magnitude of prior flux uncertainty. The uncertainty reduction over the South American tropical region is 30%, even with sparse observation coverage. We show that this reduction results from the large prior flux uncertainty and the impact of non-local observations. Given the assumed prior error statistics, the degree of freedom for signal is approx.1132 for 1-yr of the 74 055 GOSAT X(CO2) observations, which indicates that GOSAT provides approx.1132 independent pieces of information about surface fluxes. We quantify the impact of GOSAT's spatiotemporally sampling on the posterior flux, and find that a 0.7 gigatons of carbon bias in the global annual posterior flux resulted from the seasonally and diurnally biased sampling when using a diagonal prior flux error covariance.

biased sampling↗

NASA NTRS2014

A Regional CO2 Observing System Simulation Experiment for the ASCENDS Satellite Mission

Top-down estimates of the spatiotemporal variations in emissions and uptake of CO2 will benefit from the increasing measurement density brought by recent and future additions to the suite of in situ and remote CO2 measurement platforms. In particular, the planned NASA Active Sensing of CO2 Emissions over Nights, Days, and Seasons (ASCENDS) satellite mission will provide greater coverage in cloudy regions, at high latitudes, and at night than passive satellite systems, as well as high precision and accuracy. In a novel approach to quantifying the ability of satellite column measurements to constrain CO2 fluxes, we use a portable library of footprints (surface influence functions) generated by the WRF-STILT Lagrangian transport model in a regional Bayesian synthesis inversion. The regional Lagrangian framework is well suited to make use of ASCENDS observations to constrain fluxes at high resolution, in this case at 1 degree latitude x 1 degree longitude and weekly for North America. We consider random measurement errors only, modeled as a function of mission and instrument design specifications along with realistic atmospheric and surface conditions. We find that the ASCENDS observations could potentially reduce flux uncertainties substantially at biome and finer scales. At the 1 degree x 1 degree, weekly scale, the largest uncertainty reductions, on the order of 50 percent, occur where and when there is good coverage by observations with low measurement errors and the a priori uncertainties are large. Uncertainty reductions are smaller for a 1.57 micron candidate wavelength than for a 2.05 micron wavelength, and are smaller for the higher of the two measurement error levels that we consider (1.0 ppm vs. 0.5 ppm clear-sky error at Railroad Valley, Nevada). Uncertainty reductions at the annual, biome scale range from 40 percent to 75 percent across our four instrument design cases, and from 65 percent to 85 percent for the continent as a whole. Our uncertainty reductions at various scales are substantially smaller than those from a global ASCENDS inversion on a coarser grid, demonstrating how quantitative results can depend on inversion methodology. The a posteriori flux uncertainties we obtain, ranging from 0.01 to 0.06 Pg C yr-1 across the biomes, would meet requirements for improved understanding of long-term carbon sinks suggested by a previous study.

remote sensing↗

NASA NTRS1994

A new algorithm for five-hole probe calibration, data reduction, and uncertainty analysis

A new algorithm for five-hole probe calibration and data reduction using a non-nulling method is developed. The significant features of the algorithm are: (1) two components of the unit vector in the flow direction replace pitch and yaw angles as flow direction variables; and (2) symmetry rules are developed that greatly simplify Taylor's series representations of the calibration data. In data reduction, four pressure coefficients allow total pressure, static pressure, and flow direction to be calculated directly. The new algorithm's simplicity permits an analytical treatment of the propagation of uncertainty in five-hole probe measurement. The objectives of the uncertainty analysis are to quantify uncertainty of five-hole results (e.g., total pressure, static pressure, and flow direction) and determine the dependence of the result uncertainty on the uncertainty of all underlying experimental and calibration measurands. This study outlines a general procedure that other researchers may use to determine five-hole probe result uncertainty and provides guidance to improve measurement technique. The new algorithm is applied to calibrate and reduce data from a rake of five-hole probes. Here, ten individual probes are mounted on a single probe shaft and used simultaneously. Use of this probe is made practical by the simplicity afforded by this algorithm.

Reichert, Bruce A.↗

NASA NTRS2003

Aeroservoelastic Model Validation and Test Data Analysis of the F/A-18 Active Aeroelastic Wing

Model validation and flight test data analysis require careful consideration of the effects of uncertainty, noise, and nonlinearity. Uncertainty prevails in the data analysis techniques and results in a composite model uncertainty from unmodeled dynamics, assumptions and mechanics of the estimation procedures, noise, and nonlinearity. A fundamental requirement for reliable and robust model development is an attempt to account for each of these sources of error, in particular, for model validation, robust stability prediction, and flight control system development. This paper is concerned with data processing procedures for uncertainty reduction in model validation for stability estimation and nonlinear identification. F/A-18 Active Aeroelastic Wing (AAW) aircraft data is used to demonstrate signal representation effects on uncertain model development, stability estimation, and nonlinear identification. Data is decomposed using adaptive orthonormal best-basis and wavelet-basis signal decompositions for signal denoising into linear and nonlinear identification algorithms. Nonlinear identification from a wavelet-based Volterra kernel procedure is used to extract nonlinear dynamics from aeroelastic responses, and to assist model development and uncertainty reduction for model validation and stability prediction by removing a class of nonlinearity from the uncertainty.

Brenner, Martin J.↗

NASA NTRS2016

Reducing Multisensor Satellite Monthly Mean Aerosol Optical Depth Uncertainty: 1. Objective Assessment of Current AERONET Locations

Various space-based sensors have been designed and corresponding algorithms developed to retrieve aerosol optical depth (AOD), the very basic aerosol optical property, yet considerable disagreement still exists across these different satellite data sets. Surface-based observations aim to provide ground truth for validating satellite data; hence, their deployment locations should preferably contain as much spatial information as possible, i.e., high spatial representativeness. Using a novel Ensemble Kalman Filter (EnKF)- based approach, we objectively evaluate the spatial representativeness of current Aerosol Robotic Network (AERONET) sites. Multisensor monthly mean AOD data sets from Moderate Resolution Imaging Spectroradiometer, Multiangle Imaging Spectroradiometer, Sea-viewing Wide Field-of-view Sensor, Ozone Monitoring Instrument, and Polarization and Anisotropy of Reflectances for Atmospheric Sciences coupled with Observations from a Lidar are combined into a 605-member ensemble, and AERONET data are considered as the observations to be assimilated into this ensemble using the EnKF. The assessment is made by comparing the analysis error variance (that has been constrained by ground-based measurements), with the background error variance (based on satellite data alone). Results show that the total uncertainty is reduced by approximately 27% on average and could reach above 50% over certain places. The uncertainty reduction pattern also has distinct seasonal patterns, corresponding to the spatial distribution of seasonally varying aerosol types, such as dust in the spring for Northern Hemisphere and biomass burning in the fall for Southern Hemisphere. Dust and biomass burning sites have the highest spatial representativeness, rural and oceanic sites can also represent moderate spatial information, whereas the representativeness of urban sites is relatively localized. A spatial score ranging from 1 to 3 is assigned to each AERONET site based on the uncertainty reduction, indicating its representativeness level.

aerosol optical depth↗