Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,801 records · Page 100

Robust Data-Driven Predictive Run-to-Run Control for Automated Serial Sectioning

This letter presents a one-step predictive run-to-run controller (R2R-MPC) for the automation of mechanical serial sectioning (MSS), a destructive material analysis process. To address the inherent uncertainty and disturbances in the MSS process, a robust closed-loop approach is presented. Here, the robust R2R-MPC models the uncertainty of the MSS process using a linear differential inclusion. As an analytical model of the MSS process is unavailable, the differential inclusion is identified from historical data. The R2R-MPC is posed as an optimization problem that computes incremental changes to the control input which minimize the worst-case material removal errors. This optimization-based controller is combined with a run-to-run controller to provide integral action that rejects constant disturbances and tracks constant reference removal rates. To demonstrate the efficacy of our robust R2R-MPC, we present simulation results which compare the presented controller with a conventional non-robust R2R.

42 ENGINEERING↗

Climate Change Signal in Atlantic Tropical Cyclones Today and Near Future

This manuscript discusses the challenges in detecting and attributing recently observed trends in the Atlantic tropical cyclone (TC) and the epistemic uncertainty we face in assessing future risk. We use synthetic storms downscaled from five CMIP5 models by the Columbia HAZard model (CHAZ), and directly simulated storms from high-resolution climate models. We examine three aspects of recent TC activity: the upward trend and multi-decadal oscillation of the annual frequency, the increase in storm wind intensity, and the decrease in forward speed. Some data sets suggest that these trends and oscillation are forced while others suggest that they can be explained by natural variability. Projections under warming climate scenarios also show a wide range of possibilities, especially for the annual frequencies, which increase or decrease depending on the choice of moisture variable used in the CHAZ model and on the choice of climate model. The uncertainties in the annual frequency lead to epistemic uncertainties in TC risk assessment. Here, we investigate the potential for reduction of these epistemic uncertainties through a statistical practice, namely likelihood analysis. We find that historical observations are more consistent with the simulations with increasing frequency than those with decreasing frequency, but we are not able to rule out the latter. We argue that the most rational way to treat epistemic uncertainty is to consider all outcomes contained in the results. In the context of risk assessment, since the results contain possible outcomes in which TC risk is increasing, this view implies that the risk is increasing.

54 ENVIRONMENTAL SCIENCES↗

Cosmological leverage from the matter power spectrum in the presence of baryon and nonlinear effects

We investigate how the use of higher wavenumbers (smaller scales) in the galaxy clustering power spectrum influences cosmological constraints. We take into account uncertainties from nonlinear density fluctuations, (scale dependent) galaxy bias, and baryonic effects. Allowing for substantially model independent uncertainties through separate fit parameters in each wavenumber bin that also allow for the redshift evolution, we quantify strong gains in dark energy and neutrino mass leverage with increasing maximum wavenumber, despite marginalizing over numerous (up to 125) extra fit parameters. The leverage is due to not only an increased number of modes but, more significantly, breaking of degeneracies beyond the linear regime.

79 ASTRONOMY AND ASTROPHYSICS↗

Proton-induced fragmentation of carbon at energies below 100 MeV

Radiation effects caused by single cosmic ray particles have been studied for many years in radiobiological experiments for different biological objects and biological end-points. Additionally, single event effects in microelectronic devices have gained large interest. There are two fundamental mechanisms by which a single particle can cause radiation effects. On the one hand, a cosmic ray ion with high linear energy transfer can deposit a high dose along its path. On the other hand, in a nuclear collision, a high dose can be deposited by short range particles emitted from the target nucleus. In low earth orbits a large contribution to target fragmentation events originates from trapped protons which are encountered in the South Atlantic Anomaly. These protons have energies up to a few hundred MeV. We study the fragmentation of C, O and Si nuclei - the target nuclei of biological material and microelectronic devices - in nuclear collisions. Our aim is to measure production cross sections, energy spectra, emission directions and charge correlations of the emitted fragments. The present knowledge concerning these data is rather poor. M. Alurralde et al. have calculated cross sections and average energies of fragments produced from Si using the cascade-evaporation model. D.M. Ngo et al. have used the semiempirical cross section formula of Silberberg and Tsao to calculate fragment yields and the statistical model of Goldhaber to describe the reaction kinematics. Cross sections used in these models have uncertainties within a factor of two. Our data will help to test and improve existing models especially for energies below 300 MeV/nucleon. Charge correlations of fragments emitted in the same interaction are of particular importance, since high doses can be deposited if more than one heavy fragment with a short range is produced.

Schmitz, M.↗

National population mapping from sparse survey data: A hierarchical Bayesian modeling framework to account for uncertainty

Population estimates are critical for government services, development projects, and public health campaigns. Such data are typically obtained through a national population and housing census. However, population estimates can quickly become inaccurate in localized areas, particularly where migration or displacement has occurred. Some conflict-affected and resource-poor countries have not conducted a census in over 10 y. We developed a hierarchical Bayesian model to estimate population numbers in small areas based on enumeration data from sample areas and nationwide information about administrative boundaries, building locations, settlement types, and other factors related to population density. We demonstrated this model by estimating population sizes in every 10- m grid cell in Nigeria with national coverage. These gridded population estimates and areal population totals derived from them are accompanied by estimates of uncertainty based on Bayesian posterior probabilities. The model had an overall error rate of 67 people per hectare (mean of absolute residuals) or 43% (using scaled residuals) for predictions in out-of-sample survey areas (approximately 3 ha each), with increased precision expected for aggregated population totals in larger areas. This statistical approach represents a significant step toward estimating populations at high resolution with national coverage in the absence of a complete and recent census, while also providing reliable estimates of uncertainty to support informed decision making.

99 GENERAL AND MISCELLANEOUS↗

Bayesian inference for high confidence signal validation and sensor calibration assessment - 328

Online Monitoring (OLM) systems has been investigated for applications in the nuclear industry for the past two decades. These systems offer economic and technological advantages over the currently implemented time based testing methods for sensors and associated instrumentations. The advantages offered not only augment economic viability of current nuclear reactors but will be an inevitable change called for to suit the technologies of the advanced reactors (Gen III+). Irrespective, the acceptance of OLM into the regulatory structure in the U.S. is still hindered by technical and structural clarity on uncertainty quantification used by these systems. A Bayesian inference technique is implemented in the form of a residual model to quantify uncertainty in OLM predictions. The developed system used Gaussian processes to represent the OLM predictions and model inadequacy, the stationary representation of model based uncertainty. In addition, model selection techniques are used in conjunction with numerical methods such as Genetic Algorithm (GA) and Gibb's sampler to add robustness to the estimation model inadequacy, particularly in the presence of drifts and faulted conditions. The prediction model developed herein find applicability in fault detection, obtaining real values of processes after the onset of faults etc. Further development looks into the extension of current method for a multiple output scale implementation. (authors)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Dealing with Measurement Uncertainties as Nuisance Parameters in Bayesian Model Calibration

In the presence of model discrepancy, the calibration of physics-based models for physical parameter inference is a challenging problem. Lack of identifiability between calibration parameters and model discrepancy requires additional identifiability constraints to be placed on the model discrepancy to obtain unique physical parameter estimates. If these assumptions are violated, the inference for the calibration parameters can be systematically biased. In many applications, such as in dynamic material property experiments, many of the calibration inputs refer to measurement uncertainties. Here, we develop a metric for identifying overfitting of these measurement uncertainties, propose a prior capable of reducing this overfitting, and show how this leads to a diagnostic tool for validation of physical parameter inference. The approach is demonstrated for a benchmark example and applied for a material property application to perform inference on the equation of state parameters of tantalum.

97 MATHEMATICS AND COMPUTING↗

Efficient Uncertainty Quantification in Stochastic Economic Dispatch

Stochastic economic dispatch models usually address uncertainties in forecasts of renewable generation output by considering a finite number of realizations drawn from a stochastic process model, typically via Monte Carlo sampling. Accurate evaluations of expectations or higher order moments for quantities of interest, e.g., generating cost, can require a prohibitively large number of samples. We propose an alternative to Monte Carlo sampling based on polynomial chaos expansions. These representations enable efficient and accurate propagation of uncertainties in model parameters, using sparse quadrature methods. Furthermore, we use Karhunen-Loève expansions for efficient representation of uncertain renewable energy generation that follows geographical and temporal correlations derived from historical data at each wind farm. Considering expected production cost, we show that the proposed approach can yield several orders of magnitude reduction in computational cost for solving stochastic economic dispatch relative to Monte Carlo sampling, for a given target error threshold.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Validation of the DESI-DR1 3x2-pt analysis: scale cut and shear ratio tests

Combined survey analyses of galaxy clustering and weak gravitational lensing (3x2-pt studies) will allow new and accurate tests of the standard cosmological model. However, careful validation is necessary to ensure that these cosmological constraints are not biased by uncertainties associated with the modelling of astrophysical or systematic effects. In this study we validate the combined 3x2-pt analysis of the Dark Energy Spectroscopic Instrument Data Release 1 (DESI-DR1) spectroscopic galaxy clustering and overlapping weak lensing datasets from the Kilo-Degree Survey (KiDS), the Dark Energy Survey (DES), and the Hyper-Suprime-Cam Survey (HSC). By propagating the modelling uncertainties associated with the non-linear matter power spectrum, non-linear galaxy bias and baryon feedback, we design scale cuts to ensure that measurements of the matter density and the amplitude of the matter power spectrum are biased by less than 30% of the statistical error. We also test the internal consistency of the data and weak lensing systematics by performing new measurements of the lensing shear ratio. We demonstrate that the DESI-DR1 shear ratios can be successfully fit by the same model used to describe cosmic shear correlations, and analyse the additional information that can be extracted about the source redshift distributions and intrinsic alignment parameters. This study serves as crucial preparation for the upcoming cosmological parameter analysis of these datasets.

Emas, N. [Swinburne U., Ctr. Astrophys. Supercompu↗

CloudSat-Constrained Cloud Ice Water Path and Cloud Top Height Retrievals from MHS 157 and 183.3 GHz Radiances

Ice water path (IWP) and cloud top height (ht) are two of the key variables in determining cloud radiative and thermodynamical properties in climate models. Large uncertainty remains among IWP measurements from satellite sensors, in large part due to the assumptions made for cloud microphysics in these retrievals. In this study, we develop a fast algorithm to retrieve IWP from the 157, 183.3+/-3 and 190.3 GHz radiances of the Microwave Humidity Sounder (MHS) such that the MHS cloud ice retrieval is consistent with CloudSat IWP measurements. This retrieval is obtained by constraining the empirical forward models between collocated and coincident measurements of CloudSat IWP and MHS cloud-induced radiance depression (Tcir) at these channels. The empirical forward model is represented by a lookup table (LUT) of Tcir-IWP relationships as a function of ht and the frequency channel.With ht simultaneously retrieved, the IWP is found to be more accurate. The useful range of the MHS IWP retrieval is between 0.5 and 10 kg/sq m, and agrees well with CloudSat in terms of the normalized probability density function (PDF). Compared to the empirical model, current operational radiative transfer models (RTMs) still have significant uncertainties in characterizing the observed Tcir-IWP relationships. Therefore, the empirical LUT method developed here remains an effective approach to retrieving ice cloud properties from the MHS-like microwave channels.

cloud top height↗

Uncertainty quantification's role in modeling and simulation planning, and credibility assessment through the predictive capability maturity model

The importance of credible, trustworthy numerical simulations is obvious especially when using the results for making high-consequence decisions. Determining the credibility of such numerical predictions is much more difficult and requires a systematic approach to assessing predictive capability, associated uncertainties and overall confidence in the computational simulation process for the intended use of the model. This process begins with an evaluation of the computational modeling of the identified, important physics of the simulation for its intended use. This is commonly done through a Phenomena Identification Ranking Table (PIRT). Then an assessment of the evidence basis supporting the ability to computationally simulate these physics can be performed using various frameworks such as the Predictive Capability Maturity Model (PCMM). There were several critical activities that follow in the areas of code and solution verification, validation and uncertainty quantification, which will be described in detail in the following sections. Here, we introduce the subject matter for general applications but specifics are given for the failure prediction project. In addition, the first task that must be completed in the verification & validation procedure is to perform a credibility assessment to fully understand the requirements and limitations of the current computational simulation capability for the specific application intended use. The PIRT and PCMM are tools used at Sandia National Laboratories (SNL) to provide a consistent manner to perform such an assessment. Ideally, all stakeholders should be represented and contribute to perform an accurate credibility assessment. PIRTs and PCMMs are both described in brief detail below and the resulting assessments for an example project are given.

97 MATHEMATICS AND COMPUTING↗

ELM‐MOSART‐DOC: A Large‐Scale Riverine Dissolved Organic Carbon Model and Its Application Over the United States

Riverine dissolved organic carbon (DOC), primarily sourced from soil organic carbon (SOC), plays a crucial role in regional and global carbon cycles. However, the complexities of the underlying mechanisms and limited observations present significant challenges for predictive understanding of DOC at regional or larger scales. Recently, we developed a machine learning‐based (ML) map of DOC transformation rates, bridging the gap between SOC and DOC leaching flux and simplifying terrestrial DOC representation. Building on this advancement, we introduce ELM‐MOSART‐DOC, a DOC module integrated into the riverine component of the Energy Exascale Earth System Model (E3SM)—the Model for Scale Adaptive River Transport (MOSART). ELM‐MOSART‐DOC simulates DOC transport and transformation across both headwater streams and river networks, including those managed. Model validation demonstrates the ability of ELM‐MOSART‐DOC to accurately capture long‐term average DOC concentrations, with Kling‐Gupta Efficiency (KGE) scores of 0.58 and 0.76 at large and local stations, respectively. We further assess the impact of reservoirs through different simulation schemes, revealing that reservoirs significantly alter DOC fluxes by regulating streamflow patterns and promoting DOC mineralization. Model simulations indicate that reservoirs reduce total DOC flux from the Mississippi River into the ocean by 7.5%, with the long‐term average annual export decreasing from 3.34 to 3.14 teragrams (Tg) per year. ELM‐MOSART‐DOC integrates process‐based modeling with ML parameterization to enhance the predictive understanding of riverine biogeochemical processes. This approach reduces uncertainties in modeling regional and global carbon cycle ESMs and provides new insights into carbon cycling and its implications for global environmental change.

Li, Lingbo [Univ. of Houston, TX (United States); ↗

The Aqua-Planet Experiment (APE): CONTROL SST Simulation

Climate simulations by 16 atmospheric general circulation models (AGCMs) are compared on an aqua-planet, a water-covered Earth with prescribed sea surface temperature varying only in latitude. The idealised configuration is designed to expose differences in the circulation simulated by different models. Basic features of the aqua-planet climate are characterised by comparison with Earth. The models display a wide range of behaviour. The balanced component of the tropospheric mean flow, and mid-latitude eddy covariances subject to budget constraints, vary relatively little among the models. In contrast, differences in damping in the dynamical core strongly influence transient eddy amplitudes. Historical uncertainty in modelled lower stratospheric temperatures persists in APE.Aspects of the circulation generated more directly by interactions between the resolved fluid dynamics and parameterized moist processes vary greatly. The tropical Hadley circulation forms either a single or double inter-tropical convergence zone (ITCZ) at the equator, with large variations in mean precipitation. The equatorial wave spectrum shows a wide range of precipitation intensity and propagation characteristics. Kelvin mode-like eastward propagation with remarkably constant phase speed dominates in most models. Westward propagation, less dispersive than the equatorial Rossby modes, dominates in a few models or occurs within an eastward propagating envelope in others. The mean structure of the ITCZ is related to precipitation variability, consistent with previous studies.The aqua-planet global energy balance is unknown but the models produce a surprisingly large range of top of atmosphere global net flux, dominated by differences in shortwave reflection by clouds. A number of newly developed models, not optimised for Earth climate, contribute to this. Possible reasons for differences in the optimised models are discussed.The aqua-planet configuration is intended as one component of an experimental hierarchy used to evaluate AGCMs. This comparison does suggest that the range of model behaviour could be better understood and reduced in conjunction with Earth climate simulations. Controlled experimentation is required to explore individual model behavior and investigate convergence of the aqua-planet climate with increasing resolution.

AGCM↗

Hall Thruster Thermal Modeling and Test Data Correlation

The life of Hall Effect thrusters are primarily limited by plasma erosion and thermal related failures. NASA Glenn Research Center (GRC) in cooperation with the Jet Propulsion Laboratory (JPL) have recently completed development of a Hall thruster with specific emphasis to mitigate these limitations. Extending the operational life of Hall thursters makes them more suitable for some of NASA's longer duration interplanetary missions. This paper documents the thermal model development, refinement and correlation of results with thruster test data. Correlation was achieved by minimizing uncertainties in model input and recognizing the relevant parameters for effective model tuning. Throughout the thruster design phase the model was used to evaluate design options and systematically reduce component temperatures. Hall thrusters are inherently complex assemblies of high temperature components relying on internal conduction and external radiation for heat dispersion and rejection. System solutions are necessary in most cases to fully assess the benefits and/or consequences of any potential design change. Thermal model correlation is critical since thruster operational parameters can push some components/materials beyond their temperature limits. This thruster incorporates a state-of-the-art magnetic shielding system to reduce plasma erosion and to a lesser extend power/heat deposition. Additionally a comprehensive thermal design strategy was employed to reduce temperatures of critical thruster components (primarily the magnet coils and the discharge channel). Long term wear testing is currently underway to assess the effectiveness of these systems and consequently thruster longevity.

Hall thruster↗

Emissions Characterization and Smoke Transport of A Prescribed Fire

Under the background of climate change, vast regions of the world will face a hotter and probably drier future that favors ignition and spread of wildfires. This poses additional challenges to the communities who are fighting the ever-larger wildfires. Fire and smoke models are valuable tools to fire managers and decision-makers to mitigate the impact of fires. Existing fire modeling systems bear large uncertainties due to the difficulty in collecting data to characterize fire behavior and smoke transport. More observations are urgently needed for improvement of fire modeling and reduction in model uncertainty. The coordinated prescribed burn experiment, such as the Fire and Smoke Model and Measurement Evaluation Experiment (FSMMEE), will allow the concurrent collection of critical measurements of fuel, fire behavior, smoke, and meteorology to better understand and model fires. In this preliminary investigation, we employed the data from the prescribed burn experiment at Langdon Mountain, Utah, in November 2019, to reconstruct the fire emissions and characterize the smoke transport. The NASA Unified Weather Research and Forecasting Model (NU-WRF) was utilized to assist in identifying the potential pre-fire remote sensing capabilities, such as fuel load, moisture, and fire radiative power, which are helpful to model development and advancement. Along the way, two sets of NU-WRF experiments would be done by applying either a default fire emissions inventory (i.e., NASA’s Quick Fire Emissions Dataset, QFED) or reconstructed fire emissions using the data collected from the prescribed fire. The results would help answer the questions such as “How do reconstructed emissions compare to QFED emissions and their impact on plume transport”.

NU-WRF↗

Fuzzy-probabilistic calculations of water-balance uncertainty

Hydrogeological systems are often characterized by imprecise, vague, inconsistent, incomplete, or subjective information, which may limit the application of conventional stochastic methods in predicting hydrogeologic conditions and associated uncertainty. Instead, redictions and uncertainty analysis can be made using uncertain input parameters expressed as probability boxes, intervals, and fuzzy numbers. The objective of this paper is to present the theory for, and a case study as an application of, the fuzzyprobabilistic approach, ombining probability and possibility theory for simulating soil water balance and assessing associated uncertainty in the components of a simple waterbalance equation. The application of this approach is demonstrated using calculations with the RAMAS Risk Calc code, to ssess the propagation of uncertainty in calculating potential evapotranspiration, actual evapotranspiration, and infiltration-in a case study at the Hanford site, Washington, USA. Propagation of uncertainty into the results of water-balance calculations was evaluated by hanging he types of models of uncertainty incorporated into various input parameters. The results of these fuzzy-probabilistic calculations are compared to the conventional Monte Carlo simulation approach and estimates from field observations at the Hanford site.

54 ENVIRONMENTAL SCIENCES↗

UQ and V&V techniques applied to experiments and simulations of heated pipes pressurized to failure

This report demonstrates versatile and practical model validation and uncertainty quantification techniques applied to the accuracy assessment of a computational model of heated steel pipes pressurized to failure. The Real Space validation methodology segregates aleatory and epistemic uncertainties to form straightforward model validation metrics especially suited for assessing models to be used in the analysis of performance and safety margins. The methodology handles difficulties associated with representing and propagating interval and/or probabilistic uncertainties from multiple correlated and uncorrelated sources in the experiments and simulations including: material variability characterized by non-parametric random functions (discrete temperature dependent stress-strain curves); very limited (sparse) experimental data at the coupon testing level for material characterization and at the pipe-test validation level; boundary condition reconstruction uncertainties from spatially sparse sensor data; normalization of pipe experimental responses for measured input-condition differences among tests and for random and systematic uncertainties in measurement/processing/inference of experimental inputs and outputs; numerical solution uncertainty from model discretization and solver effects.

97 MATHEMATICS AND COMPUTING↗

Development of Covariance Capabilities in EMPIRE Code

The nuclear reaction code EMPIRE has been extended to provide evaluation capabilities for neutron cross section covariances in the thermal, resolved resonance, unresolved resonance and fast neutron regions. The Atlas of Neutron Resonances by Mughabghab is used as a primary source of information on uncertainties at low energies. Care is taken to ensure consistency among the resonance parameter uncertainties and those for thermal cross sections. The resulting resonance parameter covariances are formatted in the ENDF-6 File 32. In the fast neutron range our methodology is based on model calculations with the code EMPIRE combined with experimental data through several available approaches. The model-based covariances can be obtained using deterministic (Kalman) or stochastic (Monte Carlo) propagation of model parameter uncertainties. We show that these two procedures yield comparable results. The Kalman filter and/or the generalized least square fitting procedures are employed to incorporate experimental information. We compare the two approaches analyzing results for the major reaction channels on {sup 89}Y. We also discuss a long-standing issue of unreasonably low uncertainties and link it to the rigidity of the model.

99 GENERAL AND MISCELLANEOUS↗

Refine your search to explore more results.