Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99

Measurement of the W-boson mass and width with the ATLAS detector using proton–proton collisions at $\sqrt{s}=7$ TeV

Proton-proton collision data recorded by the ATLAS detector in 2011, at a centre-of-mass energy of 7 TeV, have been used for an improved determination of the W-boson mass and a first measurement of the W-boson width at the LHC. Recent fits to the proton parton distribution functions are incorporated in the measurement procedure and an improved statistical method is used to increase the measurement precision. The measurement of the W-boson mass yields a value of m w = 80,366.5 ± 9.8 (stat.) ± 12.5 (syst.) MeV = 80,366.5 ± 15.9 MeV, and the width is measured as Γ w = 2202 ± 32 (stat.) ± 34 (syst.) MeV = 2202 ± 47 MeV. The first uncertainty components are statistical and the second correspond to the experimental and physics-modelling systematic uncertainties. Both results are consistent with the expectation from fits to electroweak precision data. The present measurement of m w is compatible with and supersedes the previous measurement performed using the same data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

KGML-ag: a modeling framework of knowledge-guided machine learning to simulate agroecosystems: a case study of estimating N<sub>2</sub>O emission using data from mesocosm experiments

Abstract. Agricultural nitrous oxide (N2O) emission accounts for a non-trivial fraction of global greenhouse gas (GHG) budget. To date, estimating N2O fluxes from cropland remains a challenging task because the related microbial processes (e.g., nitrification and denitrification) are controlled by complex interactions among climate, soil, plant and human activities. Existing approaches such as process-based (PB) models have well-known limitations due to insufficient representations of the processes or uncertainties of model parameters, and due to leverage recent advances in machine learning (ML) a new method is needed to unlock the “black box” to overcome its limitations such as low interpretability, out-of-sample failure and massive data demand. In this study, we developed a first-of-its-kind knowledge-guided machine learning model for agroecosystems (KGML-ag) by incorporating biogeophysical and chemical domain knowledge from an advanced PB model, ecosys, and tested it by comparing simulating daily N2O fluxes with real observed data from mesocosm experiments. The gated recurrent unit (GRU) was used as the basis to build the model structure. To optimize the model performance, we have investigated a range of ideas, including (1) using initial values of intermediate variables (IMVs) instead of time series as model input to reduce data demand; (2) building hierarchical structures to explicitly estimate IMVs for further N2O prediction; (3) using multi-task learning to balance the simultaneous training on multiple variables; and (4) pre-training with millions of synthetic data generated from ecosys and fine-tuning with mesocosm observations. Six other pure ML models were developed using the same mesocosm data to serve as the benchmark for the KGML-ag model. Results show that KGML-ag did an excellent job in reproducing the mesocosm N2O fluxes (overall r2=0.81, and RMSE=3.6 mgNm-2d-1 from cross validation). Importantly, KGML-ag always outperforms the PB model and ML models in predicting N2O fluxes, especially for complex temporal dynamics and emission peaks. Besides, KGML-ag goes beyond the pure ML models by providing more interpretable predictions as well as pinpointing desired new knowledge and data to further empower the current KGML-ag. We believe the KGML-ag development in this study will stimulate a new body of research on interpretable ML for biogeochemistry and other related geoscience processes.

54 ENVIRONMENTAL SCIENCES↗

Inference of precipitation through thermal infrared measurements of soil moisture

The physics of microwave radiative transfer is well understood so that causal models can be assembled which relate the observed brightness temperatures to assumed distributions of hydrometeors (both liquid and ice), non-precipitating clouds, water vapor oxygen, and surface conditions. Present models assume a Marshall Palmer size distribution of liquid hydrometers from the surface to the freezing level (near the 0 C isotherm) and a variable thickness of frozen hydrometeors above that with various reasonable distribution of the other relevant constituents. The validity of such models is discussed. All uncertainties in the rain rate retrieval algorithms can be expressed in terms of specific model uncertainties which can be addressed through appropriate measurements. Those factors which must be known to achieve umambiguous results can be identified so that rainfall measuring algorithms can be developed and improved. The emissivity of the underlying surface significantly affects the contrast that may be measured between areas covered by rain and those which are dry. Sensing strategies for measuring rain over the ocean and rain over land are reviewed.

Wetzel, P. J.↗

Reliability and performance evaluation of systems containing embedded rule-based expert systems

A method for evaluating the reliability of real-time systems containing embedded rule-based expert systems is proposed and investigated. It is a three stage technique that addresses the impact of knowledge-base uncertainties on the performance of expert systems. In the first stage, a Markov reliability model of the system is developed which identifies the key performance parameters of the expert system. In the second stage, the evaluation method is used to determine the values of the expert system's key performance parameters. The performance parameters can be evaluated directly by using a probabilistic model of uncertainties in the knowledge-base or by using sensitivity analyses. In the third and final state, the performance parameters of the expert system are combined with performance parameters for other system components and subsystems to evaluate the reliability and performance of the complete system. The evaluation method is demonstrated in the context of a simple expert system used to supervise the performances of an FDI algorithm associated with an aircraft longitudinal flight-control system.

Beaton, Robert M.↗

Towards a methodology for robust parameter identification

Consideration is given to the problem of estimating, from experimental data, real parameters for a model with uncertainty in the form of both additive noise and norm-bounded perturbations. Such models frequently arise in robust control theory, and a framework is introduced for the consideration of experimental data in robust control analysis problems. If the analysis tools applied include robust stability tests for real parameter variations (real mu), the framework can be used to address the problem of robust parameter identification. While the techniques discussed can quickly become computationally overwhelming when applied to physical systems and real data, the approach introduces a novel way of looking at the identification problem and may be helpful in arriving at a more tractable methodology.

Smith, Roy S.↗

Uncertainty Representation and Interpretation in Model-Based Prognostics Algorithms Based on Kalman Filter Estimation

This article discusses several aspects of uncertainty representation and management for model-based prognostics methodologies based on our experience with Kalman Filters when applied to prognostics for electronics components. In particular, it explores the implications of modeling remaining useful life prediction as a stochastic process, and how it relates to uncertainty representation, management and the role of prognostics in decision-making. A distinction between the interpretations of estimated remaining useful life probability density function is explained and a cautionary argument is provided against mixing interpretations for two while considering prognostics in making critical decisions.

Galvan, Jose Ramon↗

Numerical Continuation Methods for Intrusive Uncertainty Quantification Studies

Rigorous modeling of engineering systems relies on efficient propagation of uncertainty from input parameters to model outputs. In recent years, there has been substantial development of probabilistic polynomial chaos (PC) Uncertainty Quantification (UQ) methods, enabling studies in expensive computational models. One approach, termed ”intrusive”, involving reformulation of the governing equations, has been found to have superior computational performance compared to non-intrusive sampling-based methods in relevant large-scale problems, particularly in the context of emerging architectures. However, the utility of intrusive methods has been severely limited due to detrimental numerical instabilities associated with strong nonlinear physics. Previous methods for stabilizing these constructions tend to add unacceptably high computational costs, particularly in problems with many uncertain parameters. In order to address these challenges, we propose to adapt and improve numerical continuation methods for the robust time integration of intrusive PC system dynamics. We propose adaptive methods, starting with a small uncertainty for which the model has stable behavior and gradually moving to larger uncertainty where the instabilities are rampant, in a manner that provides a suitable solution.

97 MATHEMATICS AND COMPUTING↗

Uncertainty Quantification of Extratropical Forest Biomass in CMIP5 Models over the Northern Hemisphere

Abstract Simplified representations of processes influencing forest biomass in Earth system models (ESMs) contribute to large uncertainty in projections. We evaluate forest biomass from eight ESMs outputs archived in the Coupled Model Intercomparison Project Phase 5 (CMIP5) using the biomass data synthesized from radar remote sensing and ground-based observations across northern extratropical latitudes. ESMs exhibit large biases in the forest distribution, forest fraction, and mass of carbon pools that contribute to uncertainty in forest total biomass (biases range from −20 Pg C to 135 Pg C). Forest total biomass is primarily positively correlated with precipitation variations, with surface temperature becoming equally important at higher latitudes, in both simulations and observations. Relatively small differences in forest biomass between the pre-industrial period and the contemporary period indicate uncertainties in forest biomass were introduced in the pre-industrial model equilibration (spin-up), suggesting parametric or structural model differences are a larger source of uncertainty than differences in transient responses. Our findings emphasize the importance of improved (1) models of carbon allocation to biomass compartments, (2) distribution of vegetation types in models, and (3) reproduction of pre-industrial vegetation conditions, in order to reduce the uncertainty in forest biomass simulated by ESMs.

54 ENVIRONMENTAL SCIENCES↗

Modelling detector-specific reconstruction uncertainties in LAr-TPC

The Short-Baseline Neutrino (SBN) program features three Liquid Argon Time Projection Chamber (LAr-TPC) detectors positioned along the Booster Neutrino Beam (BNB) axis: the Short Baseline Neutrino Near Detector, MicroBooNE, and the ICARUS T600. As the largest operational LAr-TPC, ICARUS T600 serves as the far detector, located 600 m from the BNB target. While its primary goal is to record neutrino events, it also detects other ionizing events, including cosmic rays. This work focuses on analyzing and modeling detector-specific reconstruction uncertainties in LAr-TPC. These inefficiencies, identified during the Pattern Recognition phase handled by the PANDORA algorithm, impact subsequent Particle Fits and Offline Analysis. Specifically, inaccuracies in track reconstruction can lead to significant physical consequences, such as erroneous particle energy estimates and poor Particle Identification (PID), reducing the efficiency of neutrino event characterization. A key issue addressed is split tracks, caused by missing hits or incomplete track stitching by PANDORA. The aim of this internship is to characterize, model, and quantify the impact of split tracks on track reconstruction.

43 PARTICLE ACCELERATORS↗

Improved information criteria for Bayesian model averaging in lattice field theory

Bayesian model averaging is a practical method for dealing with uncertainty due to model specification. Use of this technique requires the estimation of model probability weights. Here, we revisit the derivation of estimators for these model weights. Use of the Kullback-Leibler divergence as a starting point leads naturally to a number of alternative information criteria suitable for Bayesian model weight estimation. We explore three such criteria, known to the statistics literature before, in detail: a Bayesian analog of the Akaike information criterion which we call the BAIC, the Bayesian predictive information criterion, and the posterior predictive information criterion (PPIC). We compare the use of these information criteria in numerical analysis problems common in lattice field theory calculations. We find that the PPIC has the most appealing theoretical properties and can give the best performance in terms of model-averaging uncertainty, particularly in the presence of noisy data, while the BAIC is a simple and reliable alternative.

97 MATHEMATICS AND COMPUTING↗

Modelling System Processes to Support Uncertainty Analysis and Robustness Evaluation

In the use of advanced systems control techniques in the development of a dynamic system, results from effective mathematical modelling is required. Historically, in some cases the use of a model which only reflects the "expected" or "nominal" important -information about the system's internal processes has resulted in acceptable system performance, but it should be recognized that for those cases success was due to a combination of the remarkable inherent potential of feedback control for robustness and fortuitously wide margins between system performance requirements and system performance capability. In the cases of a CELSS development, no such fortuitous combinations should be expected, and it should be expected that the uncertainty in the information on the system's processes will have to be taken into account in order to generate a performance robust design. In this paper, we develop one perspective of the issue of providing robustness as mathematical modelling impacts it, and present some examples of model formats which serve the needed purpose.

Blackwell, Charles↗

Rapid high-fidelity aerothermal responses with quantified uncertainties via reduced-order modeling

This project will enable high-fidelity aerothermal simulations of hypersonic vehicles to be employed (1) to generate large databases with quantified uncertainties and (2) for rapid interactive simulation. The databases will increase the volume/quality of A4H data; rapid interactive simulation can enable arbitrary conditions/designs to be simulated on demand. We will achieve this by applying reduced-order-modeling techniques to aerothermal simulations.

42 ENGINEERING↗

Updating and Refining BISON TRISO Assessment

Several advanced reactor concepts consider tristructural isotropic (TRISO) fuel in their designs. To support the advanced reactor industry, the Nuclear Energy Advanced Modeling and Simulation (NEAMS) program within the U.S. Department of Energy (DOE) is developing modeling and simulation capabilities within the BISON fuel performance code. Assessment of these capabilities against available experi- mental data, such as the Advanced Gas Reactor (AGR) program, is essential in instilling confidence in the code predictions. Associated uncertainties in model inadequacy, experimental measurements, and manufacturing are also of importance. This report discusses the updating and standardization of the existing assessment suite in BISON for TRISO fuel performance analysis. The cases considered the AGR-1, AGR-2, and AGR-3/4 experimental programs. The report also includes a preliminary investigation into the sources of model inadequacy associated with silver (Ag) release fractions using the AGR-2 Compact 2-1-2 as a case study. The results indicate that uncertainties in the operating temperatures supplied to the model and the form of those temperature conditions (spatially averaged versus spatially resolved) both affect Ag release predictions. This suggests that previously observed model inadequacy can be attributed to both physical models and the operating conditions supplied to them. These findings will be leveraged to guide development of assessment cases for additional experiments and refinement of physical models for behaviors that potentially influence Ag release, such as palladium penetration.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Leveraging machine learning to improve understanding and predictability of weather/climate extremes and the resilience of human systems

Focal Area(s): Developing hybrid models for predicting weather/climate extremes at the intersection of the urban environment (focal area #2). Science Challenge: Limited by many sources of uncertainty, numerical models are unable to accurately simulate weather and climate processes and this problem is particularly acute for modeling extreme events, including hurricanes. Moreover, computational limits within these numerical models bound our ability to develop large ensembles to explore this uncertainty and the implications relative to characterization of risk and resilience within the human systems that are impacted by changes in extremes.

54 ENVIRONMENTAL SCIENCES↗

Uncertainty quantification of material parameters in modeling coupled metal and high explosive experiments

Experiments involving the coupling of metal and high explosives (HE) are of notable defense-related interest, and we seek to refine the uncertainty quantification associated with models of such experiments. In particular, our focus is on how uncertainty related to the metal constitutive model challenges our ability to infer high explosive model parameters when analyzing focused science experiments. We consider three focused experiments involving an HE accelerating metal: small plate tests with tantalum/LX-14 and tantalum/LX-17 pairings as well as a tantalum/LX-17 cylinder test. For all three models, we perform sensitivity analysis to ascertain the influence of metal strength on the coupled experimental response. Moreover, we calibrate each model in a Bayesian setting and study the quantification of metal strength on the inference of the HE parameters. Based on our results, we offer guidance for future metal/HE experiments.

36 MATERIALS SCIENCE↗

Soil enzymes as indicators of soil function: A step toward greater realism in microbial ecological modeling

Soil carbon (C) and nitrogen (N) cycles and their complex responses to environmental changes have received increasing attention. However, large uncertainties in model predictions remain, partially due to the lack of explicit representation and parameterization of microbial processes. One great challenge is to effectively integrate rich microbial functional traits into ecosystem modeling for better predictions. Here, using soil enzymes as indicators of soil function, we developed a competitive dynamic enzyme allocation scheme and detailed enzyme-mediated soil inorganic N processes in the Microbial-ENzyme Decomposition (MEND) model. We conducted a rigorous calibration and validation of MEND with diverse soil C-N fluxes, microbial C:N ratios, and functional gene abundances from a 12-year CO 2 × N grassland experiment (BioCON) in Minnesota, USA. In addition to accurately simulating soil CO 2 fluxes and multiple N variables, the model correctly predicted microbial C:N ratios and their negative response to enriched N supply. Model validation further showed that, compared to the changes in simulated enzyme concentrations and decomposition rates, the changes in simulated activities of eight C-N-associated enzymes were better explained by the measured gene abundances in responses to elevated atmospheric CO 2 concentration. In conclusion, our results demonstrated that using enzymes as indicators of soil function and validating model predictions with functional gene abundances in ecosystem modeling can provide a basis for testing hypotheses about microbially mediated biogeochemical processes in response to environmental changes. Further development and applications of the modeling framework presented here will enable microbial ecologists to address ecosystem-level questions beyond empirical observations, toward more predictive understanding, an ultimate goal of microbial ecology.

59 BASIC BIOLOGICAL SCIENCES↗

Validation of FSP Reactor Design with Sensitivity Studies of Beryllium-Reflected Critical Assemblies

The baseline design for space nuclear power is a fission surface power (FSP) system: sodium-potassium (NaK) cooled, fast spectrum reactor with highly-enriched-uranium (HEU)-O 2 fuel, stainless steel (SS) cladding, and beryllium reflectors with B4C control drums. Previous studies were performed to evaluate modeling capabilities and quantify uncertainties and biases associated with analysis methods and nuclear data. Comparison of Zero Power Plutonium Reactor (ZPPR)-20 benchmark experiments with the FSP design indicated that further reduction of the total design model uncertainty requires the reduction in uncertainties pertaining to beryllium and uranium cross-section data. Further comparison with three beryllium-reflected HEU-metal benchmark experiments performed at the Oak Ridge Critical Experiments Facility (ORCEF) concluded the requirement that experimental validation data have similar cross section sensitivities to those found in the FSP design. A series of critical experiments was performed at ORCEF in the 1960s to support the Medium Power Reactor Experiment (MPRE) space reactor design. The small, compact critical assembly (SCCA) experiments were graphite- or beryllium-reflected assemblies of SS-clad, HEU-O 2 fuel on a vertical lift machine. All five configurations were evaluated as benchmarks. Two of the five configurations were beryllium reflected, and further evaluated using the sensitivity and uncertainty analysis capabilities of SCALE 6.1. Validation of the example FSP design model was successful in reducing the primary uncertainty constituent, the Be(n,n) reaction, from 0.28 %$\delta$k/k to 0.0004 %$\delta$k/k. Further assessment of additional reactor physics measurements performed on the SCCA experiments may serve to further validate FSP design and operation.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

From Exploration Flight Test-1 to Artemis II--A NASA Langley's Orion Aerosciences Overview

The Orion Aerosciences program at NASA Langley has played a central role in advancing the aerodynamic and aeroheating prediction capabilities required for the Orion crew vehicle’s return from deep space. This presentation provides a technical overview of aerosciences contributions spanning Exploration Flight Test-1 (EFT-1), Artemis I, and the ongoing post-flight analysis of Artemis II. EFT-1 provided the first high-energy entry dataset for Orion, enabling critical validation of aerodynamic force and moment predictions, static and dynamic stability characteristics, and aeroheating environments at relevant flight Mach and Reynolds numbers. Flight-derived pressure data were used to refine the Flush Air Data System (FADS) methodology for atmospheric density reconstruction and to improve Best Estimated Trajectory (BET) solutions. The EFT-1 data also offered key insights into heat shield performance, including char layer recession, in-depth thermal response, and material retention behavior under flight conditions, informing updates to both thermal response models and uncertainty quantification practices. Building on EFT-1, Artemis I extended the database to true lunar-return conditions. Observations of heat shield performance, including localized char loss, bondline response, and recession variability, provided an unprecedented opportunity to reassess Thermal Protection System (TPS) and aeroheating modeling assumptions. Aerodynamic reconstruction efforts incorporated improved FADS calibration, enhanced atmospheric modeling, and refined force and moment databases to reduce trajectory and load uncertainties. Aeroheating comparisons between pre-flight predictions and flight data enabled targeted model updates, particularly in transitional flow environments and wake heating regions. For Artemis II, these lessons were systematically incorporated into the pre-flight prediction process. Updates included refined aerodynamic databases anchored to flight-validated corrections, improved density estimation and BET methodologies using enhanced database interpolation algorithm and FADS modeling, and revised aeroheating design environments informed by Artemis I material response observations. By the time of the workshop, Artemis II post-flight analysis will be underway, and preliminary findings will be presented where available, including early comparisons of aerodynamic reconstruction, atmospheric density estimation, and thermal protection system performance relative to updated predictions. Collectively, this body of work is a testament to the dedicated and multidisciplinary team whose sustained efforts have contributed to the program’s success and to the progressive maturation of Orion aerosciences modeling through numerical modeling, ground and flight data assimilation. The integrated advancement of aerodynamics, trajectory reconstruction, FADS-based density estimation, and aeroheating analysis has reduced predictive uncertainty and strengthened confidence for future crewed lunar and deep-space missions.

Orion↗