Search NASASearch

SEARCH · Search NASA

Results for “parameter uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Parameter uncertainties for imperfect surrogate models in the low-noise regime

Abstract Bayesian regression determines model parameters by minimizing the expected loss, an upper bound to the true generalization error. However, this loss ignores model form error, or misspecification, meaning parameter uncertainties are significantly underestimated and vanish in the large data limit. As misspecification is the main source of uncertainty for surrogate models of low-noise calculations, such as those arising in atomistic simulation, predictive uncertainties are systematically underestimated. We analyze the true generalization error of misspecified, near-deterministic surrogate models, a regime of broad relevance in science and engineering. We show that posterior parameter distributions must cover every training point to avoid a divergence in the generalization error and design a compatible ansatz which incurs minimal overhead for linear models. The approach is demonstrated on model problems before application to thousand-dimensional datasets in atomistic machine learning. Our efficient misspecification-aware scheme gives accurate prediction and bounding of test errors in terms of parameter uncertainties, allowing this important source of uncertainty to be incorporated in multi-scale computational workflows.

Swinburne, Thomas D. (ORCID:0000000232554257)

Identifying high-impact and high-uncertainty parameters in MiniFuel model predictions

The MiniFuel irradiation platform at Oak Ridge National Laboratory's High Flux Isotope Reactor (HFIR) is a flexible, high-throughput separate effects test capability. Finite element thermal models are relied upon to design MiniFuel experiments and to achieve experimental objectives. Recent reports show good agreement in the model prediction of target fuel temperatures, but as the capability of the experiments is extended to higher temperatures, the uncertainty in the model predictions must be quantified. To that end, high-impact, high-uncertainty parameters that contribute the most uncertainty to the model are identified. The uncertainty quantification was accomplished through a series of screening and sensitivity analyses. The first analysis utilizes the method of Morris to perform a computationally efficient preliminary screening that considers uncertainty in a large number of the model inputs. The most important parameters identified in the Morris screening study were then considered in a Sobol sensitivity analysis that more robustly ranks and quantifies the uncertainty associated with each parameter. From these analyses, it was determined that thermal contact conductance between components is the parameter that contributes the highest uncertainty. The estimated uncertainty of the MiniFuel model fuel temperature predictions is ±80 °C in the removable beryllium and ±40 °C in the vertical experiment facilities. In conclusion, the framework established by the series of sensitivity analyses presented herein could easily be adapted to fit the needs of accelerated fuel qualification processes.

Fuel, Irradiation

Characterizing How Meteorological Forcing Selection and Parameter Uncertainty Influence Community Land Model Version 5 Hydrological Applications in the United States

Despite the increasing use of large-scale Land Surface Models (LSMs) in predicting hydrological responses in extreme conditions, there's a critical gap in understanding the uncertainties in these predictions. This study addresses this gap through a detailed diagnostic evaluation of the uncertainties arising from meteorological forcing selection and model parametrization in hydrological simulations of the Community Land Model version 5 (CLM5). CLM5 is configured at a spatial scale of about 12-km to simulate runoff processes for 464 headwater watersheds, selected from the Catchment Attributes for Large-Sample Studies (CAMELS) dataset to be representative of physiographic and climatic gradients across the conterminous United States. For each watershed, CLM5 is driven by five commonly used gridded forcing datasets in combination with a large ensemble (> 1200) of key CLM5 hydrologic parameters. Our results suggest that uncertainty in CLM5 runoff simulations resulting from both forcing and parametric sources is markedly higher in arid regions, e.g., Great Plains and Midwest regions. Uncertainty in low flow is dominated by parametric uncertainty, while the selection of meteorological forcing contributes more dominantly to high flow and seasonal flows during fall and spring. Our analysis also demonstrates that the selection of forcing datasets and the metrics used to calibrate CLM5 significantly impact the model’s predictive accuracy in extreme event severity for both floods and droughts. Overall, the results from this study highlight the need to understand and account for forcing and parametric uncertainties in CLM5 simulations, particularly for hazard and risk assessments addressing hydrologic extremes.

54 ENVIRONMENTAL SCIENCES

Sequential spectral line analysis for accurate density and temperature diagnosis of laboratory opacity measurements

The accuracy of iron opacity calculated in stellar interiors has been questioned since the discovery of the “solar problem” and the discrepancies between the measured and modeled iron opacity reported in 2015. Experimental opacity benchmarks require accurate temperature and density measurements, which were inferred by analyzing tracer magnesium spectra in those experiments. Could the observed discrepancy be explained by insufficient accuracy in the inferred temperature, density, and their uncertainties? Previous analyses may have yielded biased results due to three limitations: (1) simultaneous multi-line fitting, (2) approximations in line-shape models, and (3) exclusion of certain spectral lines due to insufficient background characterization. Notably, the first issue is a common concern for many inversion methods, including Bayesian inferences. We present a refined analysis method that overcomes these limitations, applied to three categories of iron opacity experiments (Anchor 1, 2, and 3). In particular, the sequential fitting method yields unbiased results with more realistic uncertainties by accounting for line inconsistencies in the parameter uncertainties. The average electron temperature and density values are 162 ± 6 eV and (7.0 ± 1.9) × 10 21 cm −3 for six Anchor 1 experiments, 189 ± 7 eV and (3.4 ± 0.3) × 10 22 cm −3 for 21 Anchor 2 experiments, and 201 ± 6 eV and (4.8 ± 1.1) × 10 22 cm −3 for nine Anchor 3 experiments. These results show ∼4% temperature and ∼20% density reproducibility over a decade, which also aligns with the inferred parameter uncertainties. In conclusion, the resulting temperature and density uncertainties lead to a quasi-continuum iron opacity variation of ±4%–7% for wavelengths below 9.5 Å, which is insufficient to explain the significant model-data discrepancies reported in 2015.

Absorption spectroscopy

Uncertainty quantification for competing failure mechanisms in unidirectionally reinforced carbon–carbon composites

Microstructure-informed finite element models play a key role in the carbon–carbon composite design process. Variability in manufacturing process parameters and experimental limitations introduce model parameter uncertainty. This study quantifies the effect of model parameter uncertainty on transverse tensile fracture behavior and proposes a methodology to predict the failure mode based on competing microscale damage mechanisms. Finite element simulations incorporate fiber–matrix interface debonding with cohesive zones and matrix damage with a smeared crack band approach in a unidirectional carbon–carbon composite. Results from a variance-based global sensitivity analysis identifies interfacial and matrix damage parameters as the primary source of variability in fracture behavior. Sobol’ indices indicate that matrix and cohesive zone strengths contribute 94% of the variance in the effective ultimate stress. A local analysis elucidates the relationship between these constituent strength parameters and failure mode by estimating the probability of cohesive, matrix, and mixed-mode dominated failure. Based on the results for 4000 simulations, 93% exhibit mixed-mode or interfacial dominated failure, which underscores the crucial role of fiber–matrix interface debonding in the transverse tensile failure of carbon–carbon composites. These uncertainty quantification results facilitate more efficient model calibration and provide a framework for microstructure-informed failure predictions in the face of manufacturing-induced uncertainty.

36 MATERIALS SCIENCE

Extended State Observer-Based Robust Model Predictive Velocity Control for Permanent Magnet Synchronous Motor

This article proposes an extended state observer based robust model predictive velocity control to decrease system prediction error under parameter uncertainties for permanent magnet synchronous motor (PMSM). We develop a new PMSM model that consists of velocity and acceleration to lump the system information and an external disturbance into a disturbance. The extended state observer (ESO) is designed to estimate the velocity, acceleration, and disturbance. By estimating the state variables and disturbance using the ESO, the model predictive control (MPC) finds the optimal control input by predicting future system behavior. Additionally, the direct current controller is designed so that the direct current converges to zero. Because the proposed method is not designed based on the cascade structure from the viewpoint of velocity control, the optimization control for the velocity and currents can be defined. Thus, the proposed method is robust against external disturbances and parameter uncertainties owing to feedback linearization, state feedback, and ESO-based MPC using the acceleration PMSM model. The proposed control algorithm was experimentally verified and it showed improved velocity tracking performance compared with ESO-based MPC using the conventional PMSM model.

42 ENGINEERING

Combined Meteorological and Hydrologic Uncertainties Shape Projections of Future Soil Moisture in the Eastern United States

Physical hazards pose risks to many critical systems. Designing adaptive measures to mitigate these risks is challenging due to large uncertainties in modeling future hazards and the associated sectoral responses. Here, we help address this challenge in a hydrologic context by examining the combined role of meteorological forcing and hydrologic parameter uncertainties in shaping projections of future soil moisture. By encoding a simple conceptual water balance model in a differentiable programming framework, we facilitate fast runtimes and an efficient calibration, enabling an improved uncertainty analysis. We characterize uncertainty in model parameters by calibrating against different target data sets and by using several loss functions. We then convolve the resulting parameter ensemble with a set of Earth system model projections to produce a large ensemble (2,340 members) of daily soil moisture simulations. Focusing on the eastern United States, we find that most ensemble members project a drying of soils across the region, although some simulate wetter conditions throughout this century. Our ensemble shows an increase in the frequency and intensity of dry extremes while there is less agreement for wet extremes. We conduct sensitivity analyses on several soil moisture signatures to measure the relative influence of meteorological and hydrologic uncertainties across space and time. Both meteorological and hydrologic factors contribute consistently to uncertainty surrounding long-term trends, while changes to both wet and dry soil extremes are typically more sensitive to hydrologic parameter uncertainty. Our results underscore the need to account for varied sources of uncertainty when developing long-term hydrometeorological projections.

Lafferty, David C. [University of Illinois Urbana‐

Robust calibration of non-perturbative models with history matching

We apply, for the first time, Bayes Linear Emulation and History Matching to the calibration of non-perturbative models in Monte Carlo event generators. In contrast to the usual approach of "Monte Carlo tuning", History Matching does not result in best-fit plus ellipsoidal parameter uncertainty estimates but instead identifies all parameter space regions that are consistent with data. This approach leads to a systematic and robust quantification of parametric uncertainties in the models, especially in those challenging cases where different, possibly disjoint, regions of parameter space deliver similar results, which are usually not properly treated with current methodology. We highlight the power of this method with the hadronisation models available through Sherpa : the built-in cluster fragmentation Ahadic and string fragmentation through an interface to Pythia .

Iskauskas, Andrew [Durham U. (main)] (ORCID:000000

Aircraft in-situ measurements from SOCRATES constrain the anthropogenic perturbations of cloud droplet number

Aerosol-cloud interactions (ACI) in warm clouds alter reflected shortwave radiation by influencing cloud microphysical and macrophysical properties. The variable of state controlling ACI is the cloud droplet number concentration (N d ). Here, we examine the perturbations in N d due to anthropogenic aerosols (ΔN d, PD-PI ) using a perturbed parameter ensemble (PPE) hosted in the sixth Community Atmosphere Model (CAM6). Surrogate models are created for the CAM6 PPE outputs and are used to generate 1 million model variants of CAM6 by sampling 45 sources of parameter uncertainty. The range of uncertain physical parameters related to ACI are constrained with observations of aerosol and cloud properties from SOCRATES. The likely range of uncertain parameters and the associated range of ΔN d, PD-PI are more strongly constrained with observations of N d relative to observations of cloud condensation nuclei. We conduct sensitivity tests of how constraints on ΔN d, PD-PI are affected by systematic uncertainties in observations and our limitations in our surrogate models created for CAM6 PPE outputs. Based on this, we provide guidance on the impact of reducing systematic uncertainty in airborne microphysical observations and in surrogate models.

Song, Ci [Univ. of Wyoming, Laramie, WY (United St

Unpacking model inadequacy: The quantification of silver release from TRISO fuel by considering empirical and mechanistic approaches

Increasing adoption of the proposed tristructural isotropic (TRISO) particle fuel for both advanced and existing reactors makes it critical to assess and address any uncertainties and inadequacies of TRISO fission product release models. Model inadequacy stems from simplifications made to the computational model when compared to the experiments. The modeling and simulation efforts conducted using the BISON fuel performance code, along with the experimental campaigns carried out under the Advanced Gas Reactor Fuel Development and Qualification Program, afford a unique opportunity to conduct a rigorous modeling inadequacy assessment within the Bayesian uncertainty quantification (UQ) framework. Here, this study compares the standard Bayesian framework against the Kennedy-O'Hagan (KOH) framework, which explicitly represents modeling inadequacy, in regard to UQ for TRISO silver release models. For this purpose, both the traditional Arrhenius equation fitted to experimental data and the more advanced lower-length-scale (LLS)-informed model, which considers microstructure information, are independently considered. Applying the inverse UQ process on the AGR-2 and -3/4 datasets revealed modeling inadequacy to be the most dominant source of uncertainty. Experimental noise uncertainty is also significant; however, model parameter uncertainty can be considered negligible. Interestingly, both the Arrhenius equation and the LLS-informed model demonstrated similar levels of modeling inadequacy. For the forward predictive UQ, the KOH framework improved both the accuracy and quality of quantified uncertainties in comparison to the standard Bayesian framework. This is true for both the Arrhenius equation and the LLS-informed model. In comparing these modeling approaches, both demonstrated similar performance at the engineering scale, while the LLS-informed model expectedly outperformed the Arrhenius equation at the mesoscale. These conclusions highlight the importance of explicitly accounting for modeling inadequacy in the UQ process, and reinforce the need for continuous refinement of physics-based models in order to address the modeling inadequacy.

Advanced reactors

Uncertainty Analysis of Inhalation Dose Coefficients for Nuclear Incident Response

This study addressed the need to characterize variability in inhalation dose coefficients due to uncertainties in respiratory tract deposition, systemic biokinetics, and physiological parameters. A Python-based implementation of the International Commission on Radiological Protection Publication 66 Human Respiratory Tract Model was developed called the Radiological Exposure Dose Calculator (REDCAL) to propagate parameter uncertainty.

61 RADIATION PROTECTION AND DOSIMETRY

Understanding Model Inadequacy in TRISO Nuclear Fuel Fission Products Release Models: Empirical and Mechanistic Approaches

The increasing use of tristructural isotropic (TRISO) particle fuel in both advanced and existing reactors necessitates a thorough evaluation of uncertainties and shortcomings in TRISO fission product release models. These inadequacies arise from the simplifications made in computational models compared to experimental data. Utilizing the BISON fuel performance code and experimental data from the Advanced Gas Reactor (AGR) program provides a unique chance to rigorously assess these inadequacies within a Bayesian uncertainty quantification (UQ) framework. This study contrasts the standard Bayesian framework with the Kennedy-O'Hagan (KOH) framework, which explicitly accounts for modeling inadequacies, in the context of UQ for TRISO silver release models. It examines both the traditional Arrhenius equation and a more advanced lower-length-scale (LLS)-informed model that incorporates microstructure information. The inverse UQ process applied to AGR-2 and AGR-3/4 datasets identified modeling inadequacy as the primary source of uncertainty, with experimental noise also being significant, while model parameter uncertainty was minimal. Both the Arrhenius and LLS-informed models showed similar levels of modeling inadequacy. For forward predictive UQ using the AGR-1 dataset, the KOH framework enhanced the accuracy and quality of quantified uncertainties by approximately 30% and 40%, respectively, compared to the standard Bayesian framework. This improvement was observed for both the Arrhenius and LLS-informed models. At the engineering scale, both models performed similarly, but the LLS-informed model outperformed the Arrhenius equation at the mesoscale. These findings underscore the importance of explicitly considering modeling inadequacy in the UQ process and highlight the need for ongoing refinement of physics-based models to address these shortcomings.

11 - NUCLEAR FUEL CYCLE AND FUEL MATERIALS

Uncertainty Quantification and Sensitivity Analysis of Nuclear Construction Cost Reduction Pathways

High construction costs have plagued recent nuclear projects and they hamper the widespread deployment of nuclear technology. The Nuclear Cost Reduction Tool is a plant economic framework that quantifies the impact that various plant design and construction attributes have on construction costs and cost overruns and shows the positive effects of learning over a series of deployments. However, a downside of the current model is that all model outputs and capabilities are deterministic. To provide a more comprehensive view, this study evaluated the impact of model parameter uncertainty through a sensitivity analysis applied to 18 model parameters. This approach quantified the impact of model uncertainty on the output variables of Net Overnight Capital Cost (Net OCC), Construction Duration (CD), and Levelized Cost of Electricity (LCOE). Monte Carlo analysis revealed uncertainty distributions for these variables, showing that absolute uncertainty decreases over a series of deployments. A local sensitivity analysis showed that even small parameter perturbations (5%) can have a significant impact on project execution, highlighting areas that could reduce costs by billions across an order book of plants. The results of this study have improved the understanding of the model and identified the most impactful model parameters and construction attributes.

Levelized Cost of Electricity

Uncertainty quantification for misspecified machine learned interatomic potentials

The use of high-dimensional regression techniques from machine learning has significantly improved the quantitative accuracy of interatomic potentials. Atomic simulations can now plausibly target quantitative predictions in a variety of settings, which has brought renewed interest in robust means to quantify uncertainties. In many practical settings where model complexity is constrained (e.g., due to performance considerations), misspecification — the inability of any one choice of model parameters to exactly match all training data — is a key contributor to errors that is often disregarded. Here, we employ a recent misspecification-aware regression technique to quantify parameter uncertainties, which is then propagated to a broad range of phase and defect properties in tungsten. The propagation is performed through both brute-force resampling and implicit Taylor expansion. The propagated misspecification uncertainties robustly quantify and bound errors on a broad range of material properties. We demonstrate application to recent foundational machine learning interatomic potentials, accurately predicting and bounding errors in MACE-MPA-0 energy predictions across the diverse materials project database.

36 MATERIALS SCIENCE

Sensitivity analysis of thermal contact conductance modeling to inform MiniFuel irradiation capsule designs

The MiniFuel irradiation platform has been developed by Oak Ridge National Laboratory as a flexible, high-throughput separate effects testing capability within the High Flux Isotope Reactor (HFIR). Finite element thermal models are relied upon to design MiniFuel experiments to achieve a specific time-averaged irradiation temperature for experimental objectives. A previous study identified that uncertainty in the component heat generation rates and thermal contact conductance (TCC) model are the most significant contributors to predicted fuel temperature variance. To address both sources of uncertainty, this work performs sensitivity analysis on the TCC model to identify high-impact, high-uncertainty parameters that contribute to fuel temperature variance. The TCC model is analyzed in increasing detail, first using a standalone Python code, then again after coupling Python to the BISON fuel performance code. Furthermore, the parameters with the largest contributions to fuel temperature variance which can be reduced through design changes are identified as the initial subcapsule gas pressure, contact pressure between the fuel and dish, and the effective surface roughness of the interface. A set of design recommendations for future capsule designs has been established and applied to reduce the previously quantified average fuel temperature uncertainty ranges of ± 40 °C in the HFIR vertical experiment facilities (VXF) and ± 80 °C in the removable beryllium (RB) reflector to approximately ± 32 °C and ± 53 °C, respectively. This equates to a 21 % and 33 % reduction in the uncertainty range of the average fuel temperature for VXF and RB, respectively.

BISON

HFIR Steady State Heat Transfer Code (HSSHTC) Statistical Uncertainty Analysis

HSSHTC, the safety basis steady state TH code for HFIR, uses a highly conservative approach in which all input and calculation uncertainties are resolved simultaneously at their most limiting setting. This results in excessive conservatism which does not account for the high unlikelihood of such simultaneous worst-case conditions. The present study explores an alternative approach, BEPU, in which reasonable working assumptions for the probability distribution of each input uncertainty are used to determine a relationship between burnout power margin and core fuel failure probability. This was performed under a philosophy of perturbing uncertainty parameters already defined within the HSSHTC methodology while preserving the HSSHTC calculation approach and solution methodology itself. Based on the assumptions employed in this study, the BEPU approach resulted in a 0.29 increase in burnout power ratio (25 MW increase in burnout power) compared to the latest HSSHTC calculations of C-HFIR-2026-004. The study can be refined in the future by employing fuel fabrication data to provide more realistic input distributions. Future changes to the HSSHTC methodology would potentially allow a more comprehensive treatment of uncertainties which may further increase the burnout power ratio.

Wysocki, Aaron [ORNL] (ORCID:0000000222043779)

Cosmology with second- and third-order shear statistics for the Dark Energy Survey: Methods and simulated analysis

We present a new pipeline designed for the robust inference of cosmological parameters using both second- and third-order shear statistics. We build a theoretical model for rapid evaluation of three-point correlations using our fastnc code and integrate it into the cosmosis framework. We measure the two-point functions 𝜉 ± and the full configuration-dependent three-point shear correlation functions across all auto- and cross-redshift bins. We compress the three-point functions into the mass aperture statistic ⟨ℳ$^{3}_{ap}$⟩ for a set of 796 simulated shear maps designed to model the Dark Energy Survey Year 3 data. We estimate from it the full covariance matrix and model the effects of intrinsic alignments, shear calibration biases and photometric redshift uncertainties. We apply scale cuts to minimize the contamination from the baryonic signal as modeled through hydrodynamical simulations. We find a significant improvement of 83% on the figure of merit in the Ω m − 𝑆 8 plane when we add the ⟨ℳ$^{3}_{ap}$⟩ data to 𝜉 ± . Here, we present our findings for all relevant cosmological and systematic uncertainty parameters and discuss the complementarity of third-order and second-order statistics.

79 ASTRONOMY AND ASTROPHYSICS