Search NASA⌕ Search

SEARCH · Search NASA

Results for “uncertainty reduction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

CO 2 plume evolution in a depleted natural gas reservoir: Modeling of conformance uncertainty reduction over time

Uncertainty in the long-term fate of CO 2 injected for geologic carbon sequestration (GCS) is a significant barrier to the adoption of GCS as a greenhouse-gas emission-mitigation for industry and regulatory agencies alike. Here, we present a modeling study that demonstrates that the uncertainty in forecasts of GCS site performance decreases over time as monitoring data are used to update operational models. We consider a case study of GCS in a depleted natural gas reservoir, with CO 2 injection occurring over 20 years, with a 50-year post-injection site care period. We constructed a detailed model to generate the actual model output, which is considered synthetic observation data. A series of simpler operational models based on limited data and assumptions about how an operator would model such a site are then run and compared against actual model output at specific monitoring points after one year, two years, etc. The operational model is updated and improved using the synthetic observation data from the actual model at the same time intervals. Model parameter values and model features needed to be updated over time to improve matches to the actual model. These kinds of model adjustments would be a normal part of reservoir engineering and site management at GCS sites. Uncertainty in two key measures related to site performance decreases with time: extent of the CO 2 plume up-dip migration, and radial extent of the pressure pulse. This conclusion should help allay the concerns of industry and regulators about uncertainty in long-term fate of CO 2 at GCS sites.

54 ENVIRONMENTAL SCIENCES↗

Report on INL Activities for Uncertainty Reduction Analysis of FY11

This report presents the status of activities performed at INL under the ARC Work Package on "Uncertainty Reduction Analyses" that has a main goal the reduction of uncertainties associated with nuclear data on neutronic integral parameters of interest for the design of advanced fast reactors under consideration by the ARC program. First, an analysis of experiments was carried out. For both JOYO (the first Japanese fast reactor) and ZPPR-9 (a large size zero power plutonium fueled experiment performed at ANL-W in Idaho) the performance of ENDF/B-VII.0 is quite satisfying except for the sodium void configurations of ZPPR-9, but for which one has to take into account the approximation of the modeling. In fact, when one uses a more detailed model (calculations performed at ANL in a companion WP) more reasonable results are obtained. A large effort was devoted to the analysis of the irradiation experiments, PROFIL-1 and -2 and TRAPU, performed at the French fast reactor PHENIX. For these experiments a pre-release of the ENDF/B-VII.1 cross section files was also used, in order to provide validation feedback to the CSWEG nuclear data evaluation community. In the PROFIL experiments improvements can be observed for the ENDF/B-VII.1 capture data in 238 Pu, 241 Am, 244 Cm, 97 Mo, 151 Sm, 153 Eu, and for 240 Pu(n,2n). On the other hand, 240,242 Pu, 95 Mo, 133 Cs and 145 Nd capture C/E results are worse. For the major actinides 235 U and especially 239 Pu capture C/E's are underestimated. For fission products, 105,106 Pd, 143,144 Nd and 147,149 Sm are significantly underestimated, while 101 Ru and 151 Sm are overestimated. Other C/E deviations from unity are within the combined experimental and calculated statistical uncertainty. From the TRAPU analysis, the major improvement is in the predicted 243 Cm build-up, presumably due to an improved 242 Cm capture evaluation. The COSMO experiment was also analyzed in order to provide useful feedback on fission cross sections. It was found out that ENDF/B-VII.1 238,240 Pu fission cross sections have improved with respect to VII.0 files while 242 Pu's fission cross section has not.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Report on INL Activities for Uncertainty Reduction Analysis of FY12

The work scope of this project related to the Work Packages of “Uncertainty Reduction Analyses” with the goal of reducing nuclear data uncertainties is to produce a set of improved nuclear data to be used both for a wide range of validated advanced fast reactor design calculations, and for providing guidelines for further improvements of the ENDF/B files (i.e. ENDF/B-VII, and future releases). Recent extensive sensitivity/uncertainty studies, performed within an international OECD-NEA initiative, have quantified for the first time the impact of current nuclear data uncertainties on design parameters of the major FCR&D and GEN-IV systems, and in particular on Na-cooled fast reactors with different fuels (oxide or metal), fuel composition (e.g. different Pu/TRU ratios) and different conversion ratios.

99 GENERAL AND MISCELLANEOUS↗

Uncertainty Reduction With Multi-Model Monte Carlo for Crystal Plasticity Simulations of Additively Manufactured Metals

In this work, multi-model Monte Carlo estimators are developed to reduce uncertainty in quantities of interest (QoIs) extracted from crystal plasticity simulations of additively manufactured (AM) metals. A significant concern in AM parts is uncertainty in mechanical properties caused in part by complex microstructures that arise from the AM process. Quantifying uncertainty in microstructure-sensitive behavior using experiments alone is costly, especially when mechanical allowables must be established. Quantitative relationships among microstructure, micromechanical metrics like slip accumulation, crack initiation, and failure are also difficult to capture with limited experiments. Crystal plasticity material models instead enable computational prediction of micromechanical stress and strain fields given a discretized microstructure. However, high-fidelity finely discretized crystal plasticity simulations are computationally expensive, while lower-fidelity models are less accurate and generally biased, making uncertainty quantification and reduction computationally difficult as well. Multi-model Monte Carlo methods leverage correlations between high- and low-fidelity models to produce unbiased estimators for QoIs with reduced uncertainty relative to standard Monte Carlo. Crystal plasticity QoIs considered in this work include yield strength and the mean and extreme values of micromechanical fields that are relevant to crack initiation. Multi-model Monte Carlo estimators are developed for each individual QoI and several groups of QoIs. The results of this work establish relationships among model correlations, sample allocation, and uncertainty reduction for different combinations of QoIs and demonstrate a trend of less uncertainty reduction as QoIs become more sensitive to local microstructure. Limitations from using pilot samples to estimate model covariances and train low-fidelity models are also addressed. The uncertainty reduction achieved by multi-model Monte Carlo is an important step toward using computational mechanics models to predict microstructure-sensitive crack initiation and failure in AM parts.

uncertainty quantification↗

Carbon Dioxide Plume Evolution Following Injection into a Depleted Natural Gas Reservoir: Modeling of Conformance Uncertainty Reduction Over Time

The uncertainty in the long-term fate of CO 2 injected for geologic carbon sequestration (GCS) is a significant barrier to the adoption of GCS as a greenhouse gas emission mitigation approach for industry and regulatory agencies alike. Here we present a modeling study that demonstrates that the uncertainty in forecasts of GCS site performance decreases over time as monitoring data are used to inform and update operational models. The approach we take is to consider a case study consisting of a depleted natural gas reservoir that is used for GCS with CO 2 injection occurring over 20 years, with a 50-year post-injection site care (PISC) period. We constructed a detailed model of the system and ran this model out to 200 years to generate the actual site data. A series of simpler operational models based on limited data and assumptions about how an actual operator would model such a site are then run and compared against the actual model output at various specific monitoring points after one year, two years, etc. The operational model is then updated and improved using the observations (synthetic data from the actual model) at the same time intervals. We found that both model parameter values and model features needed to be added over time to improve matches to the actual system. These kinds of model adjustments are expected to be a normal part of reservoir engineering and site management at GCS sites. We found that the uncertainty in two key measures related to site performance at various locations decreases with time. This overall conclusion should help allay the concerns of industry and regulators about the uncertainty in GCS operations.

03 NATURAL GAS↗

More Data Needed for Failure Rate Estimation, Validation, and Uncertainty Reduction

Current Environmental Control and Life Support System (ECLSS) development and test activities are not generating data fast enough to provide statistically-supportable precise Orbital Replacement Unit (ORU) failure rate estimates for future missions. Accurate and precise failure rate estimates are critical for missions beyond Low Earth Orbit (LEO) because current risk mitigation approaches – namely regular resupply and rapid abort capabilities – will not be available. Safe operations will depend on mission planners’ ability to accurately forecast spares demand and efficiently provide the necessary resources. However, even after more than a decade of operations on board the International Space Station (ISS), a significant amount of uncertainty remains in failure rate estimates. Uncertain or inaccurate failure rates result in increased risk and spares mass for future missions. A Bayesian failure rate estimation approach, such as the one currently implemented by the ISS Program, can help reduce uncertainty by incorporating engineering judgement into failure rate estimates. However, experience on the ISS and with other complex systems shows that these prior failure rate estimates are often inaccurate. In addition, prior failure rate estimates are typically point values; some level of uncertainty must be added to convert these into probability distributions for Bayesian updating, and there are several potential methods for doing so. Due to the low rate of data collection, these subjective (and often inaccurate) prior estimates currently have a strong influence on the end result. This paper examines the challenges associated with failure rate estimation, validation, and uncertainty reduction in the context of ECLSS development for beyond-LEO missions. A variety of techniques for generating and updating Bayesian priors are discussed and evaluated using both real-world and simulated data. Potential solutions for improving failure rate estimation, including testing additional units, are analyzed and discussed, and a set of recommendations are provided for next-generation system development activities.

Supportability↗

An investigation on machine learning predictive accuracy improvement and uncertainty reduction using VAE-based data augmentation

The confluence of ultrafast computers with large memory, rapid progress in Machine Learning (ML) algorithms, and the availability of large datasets place multiple engineering fields at the threshold of dramatic progress. However, a unique challenge in nuclear engineering is data scarcity because experimentation on nuclear systems is usually more expensive and time-consuming than most other disciplines. One potential way to resolve the data scarcity issue is deep generative learning, which uses certain ML models to learn the underlying distribution of existing data and generate synthetic samples that resemble the real data. In this way, one can significantly expand the dataset to train more accurate predictive ML models. In this study, our objective is to evaluate the effectiveness of data augmentation using variational autoencoder (VAE)-based deep generative models. We investigated whether the data augmentation leads to improved accuracy in the predictions of a deep neural network (DNN) model trained using the augmented data. Additionally, the DNN prediction uncertainties are quantified using Bayesian Neural Networks (BNN) and conformal prediction (CP) to assess the impact on predictive uncertainty reduction. To test the proposed methodology, we used TRACE simulations of steady-state void fraction data based on the NUPEC Boiling Water Reactor Full-size Fine-mesh Bundle Test (BFBT) benchmark. Here, we found that augmenting the training dataset using VAEs has improved the DNN model’s predictive accuracy, improved the prediction confidence intervals, and reduced the prediction uncertainties.

Bayesian neural network↗

More Data Needed for Failure Rate Estimation, Validation, and Uncertainty Reduction

The currently planned schedule for advanced Environmental Control and Life Support System (ECLSS) development and test activities to support human exploration missions is unlikely to generate sufficient data to enable statistically-supportable, precise Orbital Replacement Unit (ORU) failure rate estimates to meet existing crew safety expectations. Accurate and precise failure rate estimates are critical for missions beyond Low Earth Orbit (LEO) because current risk mitigation approaches –namely regular resupply and rapid abort capabilities –will not be available. Safe operations will depend on mission planners’ ability to accurately forecast spares demand and efficiently provide the necessary resources. However, even after more than a decade of International Space Station (ISS) ECLSS operations, a significant amount of uncertainty remains in failure rate estimates. Uncertain or inaccurate failure rates result in increased risk and spares mass. A Bayesian estimation approach, such as the one currently implemented by the ISS Program, can reduce uncertainty by incorporating engineering judgement into failure rate estimates. However, experience on the ISS and with other complex systems shows that these prior failure rate estimates are often inaccurate. In addition, prior estimates are typically point values; some level of uncertainty must be added to convert these into probability distributions for Bayesian updating, and there are several potential methods for doing so. Due to the low rate of data collection, any inaccuracy in theseprior estimates currently hasa strong influence on the end result. This paper examines the challenges associated with failure rate estimation, validation, and uncertainty reduction in the context of ECLSS development for beyond-LEO missions. A variety of techniques for generating and updating Bayesian priors are discussed and evaluated using both real-world and simulated data. Potential solutions for improving failure rate estimation, including testing additional units, are analyzed and discussed, and a set of recommendations are provided for next-generation system development activities.

Reliability↗

More Data Needed for Failure Rate Estimation, Validation, and Uncertainty Reduction

The currently planned schedule for advanced Environmental Control and Life Support System (ECLSS) development and test activities to support human exploration missions is unlikely to generate sufficient data to enable statistically-supportable, precise Orbital Replacement Unit (ORU) failure rate estimates to meet existing crew safety expectations. Accurate and precise failure rate estimates are critical for missions beyond Low Earth Orbit (LEO) because current risk mitigation approaches –namely regular resupply and rapid abort capabilities –will not be available. Safe operations will depend on mission planners’ ability to accurately forecast spares demand and efficiently provide the necessary resources. However, even after more than a decade of International Space Station (ISS) ECLSS operations, a significant amount of uncertainty remains in failure rate estimates. Uncertain or inaccurate failure rates result in increased risk and spares mass. A Bayesian estimation approach, such as the one currently implemented by the ISS Program, can reduce uncertainty by incorporating engineering judgement into failure rate estimates. However, experience on the ISS and with other complex systems shows that these prior failure rate estimates are often inaccurate. In addition, prior estimates are typically point values; some level of uncertainty must be added to convert these into probability distributions for Bayesian updating, and there are several potential methods for doing so. Due to the low rate of data collection, any inaccuracy in theseprior estimates currently hasa strong influence on the end result. This paper examines the challenges associated with failure rate estimation, validation, and uncertainty reduction in the context of ECLSS development for beyond-LEO missions. A variety of techniques for generating and updating Bayesian priors are discussed and evaluated using both real-world and simulated data. Potential solutions for improving failure rate estimation, including testing additional units, are analyzed and discussed, and a set of recommendations are provided for next-generation system development activities.

Reliability↗

Uncertainty Reduction using Bayesian Inference and Sensitivity Analysis: A Sequential Approach to the NASA Langley Uncertainty Quantification Challenge

This paper presents a computational framework for uncertainty characterization and propagation, and sensitivity analysis under the presence of aleatory and epistemic un- certainty, and develops a rigorous methodology for efficient refinement of epistemic un- certainty by identifying important epistemic variables that significantly affect the overall performance of an engineering system. The proposed methodology is illustrated using the NASA Langley Uncertainty Quantification Challenge (NASA-LUQC) problem that deals with uncertainty analysis of a generic transport model (GTM). First, Bayesian inference is used to infer subsystem-level epistemic quantities using the subsystem-level model and corresponding data. Second, tools of variance-based global sensitivity analysis are used to identify four important epistemic variables (this limitation specified in the NASA-LUQC is reflective of practical engineering situations where not all epistemic variables can be refined due to time/budget constraints) that significantly affect system-level performance. The most significant contribution of this paper is the development of the sequential refine- ment methodology, where epistemic variables for refinement are not identified all-at-once. Instead, only one variable is first identified, and then, Bayesian inference and global sensi- tivity calculations are repeated to identify the next important variable. This procedure is continued until all 4 variables are identified and the refinement in the system-level perfor- mance is computed. The advantages of the proposed sequential refinement methodology over the all-at-once uncertainty refinement approach are explained, and then applied to the NASA Langley Uncertainty Quantification Challenge problem.

Uncertainty↗

Results of the NASA Prediction Uncertainty Reduction Tech Challenge

In January 2021 the Advanced Air Vehicles Program approved a new Tech Challenge (TC) to be run out of the Commercial Supersonic Technology (CST) Project. The objective of the TC was to bring uncertainties in the empirical noise modeling for civilian supersonic aircraft into the same range as that of conventional aircraft. The TC goal statement was to “Produce data and demonstrate tools that reduce the uncertainty in predicting Landing & Takeoff Noise levels of supersonic-relevant designs by 5 EPNdB and are ready for use in studies to inform FAA rule-making.” To make the required improvements in noise prediction methods for supersonic aircraft, NASA decided to validate and use high-fidelity numerical simulations to acquire the needed noise data on supersonic propulsion configurations. High-fidelity component designs were developed, such as a two-stage propulsor behind a supersonic inlet designed by General Electric Aviation and variable area exhaust systems using input from recent contracts with GE and Rolls Royce. A noise database was generated as a function of geometric and flow parameters, providing corrections to the empirical noise models and added new input variables to describe the complexities created by the supersonic-specific design features. Statistically, the new models were able to predict the acoustic impact of supersonic-specific features, the reduction in uncertainty being reduced from the baseline 7.8 EPNdB at the beginning of the TC to 2.0 EPNdB at the end.

noise prediction↗

Uncertainty Reduction in Power Generation Forecast Using Coupled Wavelet-ARIMA

In this paper, we introduce a new approach without implying normal distributions and stationarity of power generation forecast errors. In addition, it is desired to more accurately quantify the forecast uncertainty by reducing prediction intervals of forecasts. We use automatically coupled wavelet transform and autoregressive integrated moving-average (ARIMA) forecasting to reflect multi-scale variability of forecast errors. The proposed analysis reveals slow-changing “quasi-deterministic” components of forecast errors. This helps improve forecasts produced by other means, e.g., using weather-based models, and reduce forecast errors prediction intervals.

Power system planning, uncertainty reduction, fore↗

Update on Prediction Uncertainty Reduction (PUR) Tech Challenge

NASA has taken on a Technical Challenge to reduce the uncertainty in prediction of noise from near-term commercial supersonic aircraft. To date, an assessment has been done to baseline this effort, quantifying how much more uncertainty exists when the system-level prediction methods are applied to supersonic aircraft as compared to conventional aircraft. And an assessment has been made for the uncertainty in the physics-based simulations for jets. These will be briefly demonstrated.

supersonic↗

Iron X-ray Transmission at Temperature Near 150 eV Using the National Ignition Facility: First Measurements and Paths to Uncertainty Reduction

Discrepancies exist between theoretical and experimental opacity data for iron, at temperatures 180–195 eV and electron densities near 3 × 1022/cm3, relevant to the solar radiative-convective boundary. Another discrepancy, between theory and helioseismic measurements of the boundary’s location, would be ameliorated if the experimental opacity is correct. To address these issues, this paper details the first results from new experiments under development at the National Ignition Facility (NIF), using a different method to replicate the prior experimental conditions. In the NIF experiments, 64 laser beams indirectly heat a plastic-tamped rectangular iron-magnesium sample inside a gold cavity. Another 64 beams implode a spherical plastic shell to produce a continuum X-ray flash which backlights the hot sample. An X-ray spectrometer records the transmitted X-rays, the unattenuated X-rays passing around the sample, and the sample’s self-emission. From these data, X-ray transmission spectra are inferred, showing Mg K-shell and Fe L-shell X-ray transitions from plasma at a temperature of ~150 eV and electron density of ~8 × 1021/cm3. These conditions are similar to prior Z measurements which agree better with theory. The NIF transmission data show statistical uncertainties of 2–10%, but various systematic uncertainties must be addressed before pursuing quantitative comparisons. The paths to reduction of the largest uncertainties are discussed. Once the uncertainty is reduced, future NIF experiments will probe higher temperatures (170–200 eV) to address the ongoing disagreement between theory and Z data.

36 MATERIALS SCIENCE↗

Practical uncertainty reduction and quantification in shock physics measurements

We report the development of a simple error analysis sampling method for identifying intersections and inflection points to reduce total uncertainty in experimental data. This technique was used to reduce uncertainties in sound speed measurements by 80% over conventional methods. Here, we focused on its impact on a previously published set of Mo sound speed data and possible implications for phase transition and geophysical studies. However, this technique's application can be extended to a wide range of experimental data.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Status of the Measurement of Proton Scattering on Carbon Nuclei in EMPHATIC for Neutrino Flux Uncertainty Reduction

In long-baseline neutrino oscillation experiments, Monte Carlo (MC) simulations based on hadron interactions and decays are used to predict the neutrino flux. The 10%-level systematic uncertainty of the predicted neutrino fluxes from these simulations is dominated by uncertainties in hadron interaction cross sections due to limited hadron scattering data. EMPHATIC aims to reduce the neutrino flux uncertainty by providing additional data. Using a table-top-sized spectrometer located at the Fermilab Test Beam Facility (FTBF), its physics program includes precise measurements of hadron scattering and production cross sections at various beam momenta and target species that are relevant for GeV-scale neutrino production. Using simulation, we have developed a simple single-track reconstruction algorithm that has a momentum resolution of 3-4\%. We will demonstrate the progress in developing one of EMPHATIC’s first track reconstruction algorithms – an important step in making a new single-track forward scattering measurement (p + C $\rightarrow$ p + C at several beam momenta) using Phase 1 data collected between 2022 and 2023.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Space Radiation Cancer Risk Projections for Exploration Missions: Uncertainty Reduction and Mitigation

In this paper we discuss expected lifetime excess cancer risks for astronauts returning from exploration class missions. For the first time we make a quantitative assessment of uncertainties in cancer risk projections for space radiation exposures. Late effects from the high charge and energy (HZE) ions present in the galactic cosmic rays including cancer and the poorly understood risks to the central nervous system constitute the major risks. Methods used to project risk in low Earth orbit are seen as highly uncertain for projecting risks on exploration missions because of the limited radiobiology data available for estimating HZE ion risks. Cancer risk projections are described as a product of many biological and physical factors, each of which has a differential range of uncertainty due to lack of data and knowledge. Monte-Carlo sampling from subjective error distributions represents the lack of knowledge in each factor to quantify risk projection overall uncertainty. Cancer risk analysis is applied to several exploration mission scenarios. At solar minimum, the number of days in space where career risk of less than the limiting 3% excess cancer mortality can be assured at a 95% confidence level is found to be only of the order of 100 days.

Cucinotta, Francis↗

Acoustic Liner Drag: Measurement Uncertainty Reduction and Application to Novel Perforate Geometries

In addition to developing acoustic liner concepts and characterizing their performance, the NASA Langley Liner Physics Team has investigated issues related to liner drag. A method to quantify relative drag of liner configurations was developed and employed to understand the effects of various liner features. It was observed that perforate shape could have a marked effect on the measured liner drag and led to the discovery of a low-drag geometry that cut the drag penalty between a perforate and a smooth wall by approximately 50%. Investigations of novel perforates to further reduce drag were stymied by measurement uncertainty that prevented further resolution of drag differences between configurations. The current study details efforts to understand the causes of this uncertainty and describe changes made to testing methods to reduce it. Previously evaluated perforates were retested with these improvements in the NASA Langley Grazing Flow Impedance Tube to determine their relative drag at a flow speed of Mach 0.5 without acoustic excitation. Their performance was compared to the previously identified low-drag geometry to see if further drag reductions could be realized.

drag↗