Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

Adoption of switchgrass cultivation for biofuel under uncertainty: A discrete-time modeling approach

Production of biofuels from cellulosic sources, such as switchgrass, is being encouraged through man- dates, incentives, and subsidies. However, uncertainty in future prices coupled with large establishment costs often inhibit their cultivation. Owing to their inability to incorporate uncertainty and dynamic decision-making, standard discounted cash flow techniques are ineffective for analyzing such in- vestments. We formulate a discrete-time binomial framework to model output prices, allowing us to incorporate price uncertainty, stand age, and variable crop yields into the analytical framework. We analyze the feasibility of investments in switchgrass cultivation under varying price transition paths, evaluate the relationship between risk and profitability, and estimate the value of flexible decision- making options wherein the farmer can alter cultivation choices. Here, we find that switchgrass cultivation is only 32% likely to be profitable in the base model and infer that on-farm management could play an important role in entry and exit decisions. We also find that subsidies are important for project viability and policymakers could consider incorporating payments for ecosystem services to encourage adoption.

09 BIOMASS FUELS↗

CALPHAD Uncertainty Quantification and TDBX

CALPHAD uncertainty quantification (UQ) is the foundation of materials design with quantified confidence. We report a framework and software packages to enable CALPHAD UQ assessment and calculation using commercial CALPHAD software (Thermo-Calc). This Bayesian inference framework is coupled with a Markov chain Monte Carlo algorithm to establish uncertainty traces with a given thermodynamic database file (TDB) and corresponding experimental data points. This general framework is demonstrated with the Ni–Cr binary system. The algorithm is firstly validated on synthetic data with known ground truth. Then it is applied to real experimental data to generate posterior traces. We develop a file format named TDBX, which provides a single source of truth by combining the original TDB content and the traces for each assessed Gibbs energy parameter. CALPHAD UQ calculations are performed based on the TDBX file, from which uncertainties for phase boundaries, enthalpy curves, and solidification range are collected as examples of basic design parameters. This TDBX file with corresponding scripts are made open-source. Finally, the combination of CALPHAD UQ assessments and calculations connected by TDBX supports uncertainty-assisted modeling, enabling the integrated application of modern design with uncertainty methodologies to computational materials design.

36 MATERIALS SCIENCE↗

Erratum to: Measurement of jet multiplicity distributions in $\mathrm {t}\overline{\mathrm {t}}$ production in pp collisions at $\sqrt{s} = 7\,\text {TeV} $

Table 4 was incorrectly captioned in the originally published version. The correct caption is ‘Normalised differential tt - production cross section as a function of the number of additional jets with p T > 30 GeV in the lepton+jets channel. Furthermore, the statistical, systematic, and total uncertainties are also shown. Finally, the main experimental and model systematic uncertainties are displayed: JES and the combination of renormalisation and factorisation scales, jet-parton matching threshold, and hadronisation (in the table “Q 2 /Match./Had.”)’.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Suppressed Charmed B Decay

This thesis describes the measurement of the branching fractions of the suppressed charmed B 0 → D *- a 0 + decays and the non-resonant B 0 → D *- ηπ + decays in approximately 230 million Υ(4S) → B$\bar{B}$ events. The data have been collected with the BABAR detector at the PEP-II B factory at the Stanford Linear Accelerator Center in California. Theoretical predictions of the branching fraction of the B 0 → D *- a{sub 0} + decays show large QCD model dependent uncertainties. Non-factorizing terms, in the naive factorization model, that can be calculated by QCD factorizing models have a large impact on the branching fraction of these decay modes. The predictions of the branching fractions are of the order of 10 -6 . The measurement of the branching fraction gives more insight into the theoretical models. In general a better understanding of QCD models will be necessary to conduct weak interaction physics at the next level. The presence of CP violation in electroweak interactions allows the differentiation between matter and antimatter in the laws of physics. In the Standard Model, CP violation is incorporated in the CKM matrix that describes the weak interaction between quarks. Relations amongst the CKM matrix elements are used to present the two relevant parameters as the apex of a triangle (Unitarity Triangle) in a complex plane. The over-constraining of the CKM triangle by experimental measurements is an important test of the Standard Model. At this moment no stringent direct measurements of the CKM angle γ, one of the interior angles of the Unitarity Triangle, are available. The measurement of the angle γ can be performed using the decays of neutral B mesons. The B 0 → D *- a 0 + decay is sensitive to the angle γ and, in comparison to the current decays that are being employed, could significantly enhance the measurement of this angle. However, the low expected branching fraction for the B 0 → D *- a 0 + decay channels could severely impact the measurement. A prerequisite of the measurement of the CKM angle is the observation of the B 0 → D *- a 0 + decay on which this thesis reports. The BABAR experiment consists of the BABAR detector and the PEP-II e + e - collider. The design of the experiment has been optimized for the study of CP violation in the decays of neutral B mesons but is also highly suitable for the search for rare B decays such as the B0 → D *- a 0 + decay. The PEP-II collider operates at the Υ(4S) resonance and is a clean source of B$\bar{B}$ meson pairs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A Sensitivity Study of Radiative Fluxes at the Top of Atmosphere to Cloud-Microphysics and Aerosol Parameters in the Community Atmosphere Model CAM5

In this study, we investigated the sensitivity of net radiative fluxes (FNET) at the top of atmosphere (TOA) to 16 selected uncertain parameters mainly related to the cloud microphysics and aerosol schemes in the Community Atmosphere Model version 5 (CAM5). We adopted a quasi-Monte Carlo (QMC) sampling approach to effectively explore the high dimensional parameter space. The output response variables (e.g., FNET) were simulated using CAM5 for each parameter set, and then evaluated using generalized linear model analysis. In response to the perturbations of these 16 parameters, the CAM5-simulated global annual mean FNET ranges from -9.8 to 3.5 W m-2 compared to the CAM5-simulated FNET of 1.9 W m-2 with the default parameter values. Variance-based sensitivity analysis was conducted to show the relative contributions of individual parameter perturbation to the global FNET variance. The results indicate that the changes in the global mean FNET are dominated by those of cloud forcing (CF) within the parameter ranges being investigated. The size threshold parameter related to auto-conversion of cloud ice to snow is confirmed as one of the most influential parameters for FNET in the CAM5 simulation. The strong heterogeneous geographic distribution of FNET variation shows parameters have a clear localized effect over regions where they are acting. However, some parameters also have non-local impacts on FNET variance. Although external factors, such as perturbations of anthropogenic and natural emissions, largely affect FNET variations at the regional scale, their impact is weaker than that of model internal parameters in terms of simulating global mean FNET in this study. The interactions among the 16 selected parameters contribute a relatively small portion of the total FNET variations over most regions of the globe. This study helps us better understand the CAM5 model behavior associated with parameter uncertainties, which will aid the next step of reducing model uncertainty via calibration of uncertain model parameters with the largest sensitivity.

aerosol↗

Intercomparison of Precipitation Estimates over the Arctic Ocean and Its Peripheral Seas from Reanalyses

Precipitation over the Arctic Ocean has a significant impact on the basin-scale freshwater and energy budgets but is one of the most poorly constrained variables in atmospheric reanalyses. Precipitation controls the snow cover on sea ice, which impedes the exchange of energy between the ocean and atmosphere, inhibiting sea ice growth. Thus, accurate precipitation amounts are needed to inform sea ice modeling, especially for the production of thickness estimates from satellite altimetry freeboard data. However, obtaining a quantitative estimate of the precipitation distribution in the Arctic is notoriously difficult because of a number of factors, including a lack of reliable, long-term in situ observations; difficulties in remote sensing over sea ice; and model biases in temperature and moisture fields and associated uncertainty of modeled cloud microphysical processes in the polar regions. Here, we compare precipitation estimates over the Arctic Ocean from eight widely used atmospheric reanalyses over the period 2000–16 (nominally the ‘‘new Arctic’’). We find that the magnitude, frequency, and phase of precipitation vary drastically, although interannual variability is similar. Reanalysis-derived precipitation does not increase with time as expected; however, an increasing trend of higher fractions of liquid precipitation (rainfall) is found. When compared with drifting ice mass balance buoys, three reanalyses (ERA-Interim, MERRA, and NCEP R2) produce realistic magnitudes and temporal agreement with observed precipitation events, while two products [MERRA, version 2 (MERRA-2), and CFSR] show large, implausible magnitudes in precipitation events. All the reanalyses tend to produce overly frequent Arctic precipitation. Future work needs to be undertaken to determine the specific factors in reanalyses that contribute to these discrepancies in the new Arctic.

Mcpartland, Linette N.↗

Uncertainty Quantification and Sensitivity Analysis Applications to Fuel Performance Modeling

Best-estimate fuel performance codes such as BISON currently under development at the Idaho National Laboratory, utilize empirical and mechanistic lower-length-scale informed correlations to predict fuel behavior under normal operating and accident reactor conditions. Traditionally, best-estimate results are presented using the correlations with no quantification of the uncertainty in the output metrics of interest. However, there are associated uncertainties in the input parameters and correlations used to determine the behavior of the fuel and cladding under irradiation. Therefore, it is important to perform uncertainty quantification and include confidence bounds on the output metrics that take into account the uncertainties in the inputs. In addition, sensitivity analyses can be performed to determine which input parameters have the greatest influence on the outputs. In this paper we couple the BISON fuel performance code to the DAKOTA uncertainty analysis software to analyze a representative fuel performance problem. The case studied in this paper is based upon rod 1 from the IFA-432 integral experiment performed at the Halden Reactor in Norway. The rodlet is representative of a BWR fuel rod. The input parameters uncertainties are broken into three separate categories including boundary condition uncertainties (e.g., power, coolant flow rate), manufacturing uncertainties (e.g., pellet diameter, cladding thickness), and model uncertainties (e.g., fuel thermal conductivity, fuel swelling). Utilizing DAKOTA, a variety of statistical analysis techniques are applied to quantify the uncertainty and sensitivity of the output metrics of interest. Specifically, we demonstrate the use of sampling methods, polynomial chaos expansions, surrogate models, and variance-based decomposition. The output metrics investigated in this study are the fuel centerline temperature, cladding surface temperature, fission gas released, and fuel rod diameter. The results highlight the importance of quantifying the uncertainty and sensitivity in fuel performance modeling predictions and the need for additional research into improving the material models that are currently available.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

Cloud Feedback Uncertainty in the Equatorial Pacific Across CMIP6 Models

Cloud feedback is the largest uncertainty in estimating Equilibrium Climate Sensitivity. In this study we focus on the equatorial Pacific, where CMIP6 model cloud feedback spread is notably large. Cloud radiative effects in this region are relevant for the global climate. Our findings show that models predict a consistent shift towards the ascent regime in response to El Nino-like sea surface warming. Models diverge in terms of the radiative impact due to differences in cloud characteristics in ascent and subsidence regimes. Using the observed relationship between circulation regime and cloud radiative effect, we find a reduction in the regional mean cloud feedback estimate from 0.77 to 0.22 W m -2 K -1 , though this does not substantially lessen the model spread in total feedback. Pathways to reduce this spread include: improving confidence in the regional ocean warming pattern, and using observations and models to understand cloud type and circulation interactions.

CMIP6↗

Simulating wind power forecast error distributions for spatially aggregated wind power plants

Dispersion and aggregation of wind power plants lower the uncertainty of wind power by reducing wind power forecasting errors. Using quantitative methods, this paper studies the dispersion's impact on the uncertainty of the aggregated wind power production. A method to simulate day-ahead forecast error distributions at different dispersion and forecasting skill scenarios is presented. The proposed method models the uncertainty of wind power forecasting on an annual basis and at different levels of production. As a result, the uncertainty in the forecasting of spatially dispersed wind power plants is modelled using two continuous distributions: Laplace and beta distribution. The analysis shows that even the production level uncertainty can be modelled in various dispersion and forecasting skill scenarios. The model for aggregated forecast error distributions requires only four variables: capacity-weighted distance of the total wind power plant fleet, mean of the site-specific mean absolute errors (MAEs), number of aggregated wind power plants, and the mean variability of the elevations from the proximities of the aggregated wind power plants. Here, the results are especially promising when the number of aggregated wind power plants exceeds five, the terrain complexity is low or moderate, and the aggregation region is large. This is demonstrated through a case study for Texas, United States.

17 WIND ENERGY↗

A Moment-Based Polarimetric Radar Forward Operator for Rain Microphysics

There is growing interest in combining microphysical models and polarimetric radar observations to improve our understanding of storms and precipitation. Mapping model-predicted variables into the radar observational space necessitates a forward operator, which requires assumptions that introduce uncertainties into model–observation comparisons. These include uncertainties arising from the microphysics scheme a priori assumptions of a fixed drop size distribution (DSD) functional form, whereas natural DSDs display far greater variability. To address this concern, this study presents a moment-based polarimetric radar forward operator with no fundamental restrictions on the DSD form by linking radar observables to integrated DSD moments. The forward operator is built upon a dataset of >200 million realistic DSDs from one-dimensional bin microphysical rain-shaft simulations, and surface disdrometer measurements from around the world. This allows for a robust statistical assessment of forward operator uncertainty and quantification of the relationship between polarimetric radar observables and DSD moments. Comparison of “truth” and forward-simulated vertical profiles of the polarimetric radar variables are shown for bin simulations using a variety of moment combinations. Higher-order moments (especially those optimized for use with the polarimetric radar variables: the sixth and ninth) perform better than the lower-order moments (zeroth and third) typically predicted by many bulk microphysics schemes.

54 ENVIRONMENTAL SCIENCES↗

Time of Emergence and Large Ensemble Intercomparison for Ocean Biogeochemical Trends

Anthropogenically forced changes in ocean biogeochemistry are underway and critical for the ocean carbon sink and marine habitat. Detecting such changes in ocean biogeochemistry will require quantification of the magnitude of the change (anthropogenic signal) and the natural variability inherent to the climate system (noise). Here we use Large Ensemble (LE) experiments from four Earth system models (ESMs) with multiple emissions scenarios to estimate Time of Emergence (ToE) and partition projection uncertainty for anthropogenic signals in five biogeochemically important upper-ocean variables. We find ToEs are robust across ESMs for sea surface temperature and the invasion of anthropogenic carbon; emergence time scales are 20–30 yr. For the biological carbon pump, and sea surface chlorophyll and salinity, emergence time scales are longer (50+ yr), less robust across the ESMs, and more sensitive to the forcing scenario considered. We find internal variability uncertainty, and model differences in the internal variability uncertainty, can be consequential sources of uncertainty for projecting regional changes in ocean biogeochemistry over the coming decades. In combining structural, scenario, and internal variability uncertainty, this study represents the most comprehensive characterization of biogeochemical emergence time scales and uncertainty to date. Our findings delineate critical spatial and duration requirements for marine observing systems to robustly detect anthropogenic change.

54 ENVIRONMENTAL SCIENCES↗

Reconstruction and uncertainty quantification of lattice Hamiltonian model parameters from observations of microscopic degrees of freedom

The emergence of scanning probe and electron beam imaging techniques has allowed quantitative studies of atomic structure and minute details of electronic and vibrational structure on the level of individual atomic units. These microscopic descriptors, in turn, can be associated with local symmetry breaking phenomena, representing the stochastic manifestation of the underpinning generative physical model. In this work, we explore the reconstruction of exchange integrals in the Hamiltonian for a lattice model with two competing interactions from observations of microscopic degrees of freedom and establish the uncertainties and reliability of such analysis in a broad parameter-temperature space. In contrast to other approaches, we specifically specify a loss function inherent to thermodynamic systems and utilize it to estimate uncertainty in simulated realizations of different models. As an ancillary task, we develop a machine learning approach based on histogram clustering to predict phase diagrams efficiently using a reduced descriptor space. We further demonstrate that reconstruction is possible well above the phase transition and in the regions of parameter space when the macroscopic ground state of the system is poorly defined due to frustrated interactions. This suggests that this approach can be applied to the traditionally complex problems of condensed matter physics such as ferroelectric relaxors and morphotropic phase boundary systems, spin and cluster glasses, and quantum systems once the local descriptors linked to the relevant physical behaviors are known.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Machine learning enhanced predictions of ICRF heating: Overcoming numerical limitations via data curation

In this work, we present the development of robust surrogate models for Ion Cyclotron Range of Frequencies (ICRF) and High-Harmonic Fast Wave (HHFW) heating predictions in fusion plasmas. Building upon our previous efforts to achieve real-time capable models, we identify the cause of the outliers found using TORIC in certain HHFW heating scenarios. The outliers are observed to be spurious ion Bernstein wave (IBW)-like modes caused by a wavelength control algorithm designed to address challenging scenarios with high perpendicular wavenumbers. The effect arises from the modulation in the perpendicular susceptibility, which can induce sign reversal and IBW-like propagation for scenarios featuring normalized ion Larmor radius λ i ≫ 1. We use TORIC with this algorithm disabled to generate a novel HHFW-NSTX database that is free of outliers. Surrogate models trained on this database, including Random Forest Regressor (RFR), Multi-Layer Perceptrons, and Gaussian Process Regressors (GPR), demonstrate the ability to accurately predict HHFW heating profiles, with regression scores of R 2 ∈[0.93−0.99]. Additionally we demonstrate that it is possible to generalize predictions beyond training data by the use of both RFR and GPR models, enabling the prediction of scenarios previously limited to the original model. GPR models also provide uncertainty quantification, offering insights into model confidence. This work introduces a comprehensive Verification, Validation, and Uncertainty Quantification methodology for surrogate modeling, applicable not only to ICRF heating but also to other RF heating challenges and fusion physics problems. Beyond accelerated inference, these models show effective extrapolation capabilities, providing an alternative for addressing numerical challenges.

Artificial neural networks↗

An alternative approach for MLE calculation in nonlinear continuous dynamic systems

As an important metric to tell if a nonlinear dynamic system has a singular attractor or divergent trajectory, the maximal Lyapunov exponent (MLE) can be calculated from either system models or time series of state variable measurement. However, in the real world, due to inaccurate models, measurement noise, and the fact that sometimes state variables cannot be measured directly, it is very difficult to get an accurate MLE, which limits its application in, for example, in prediction of a nonlinear physical system (e. g. power systems, etc.) behavior. To overcome these factors, this paper proposed a trajectory-estimation-based MLE calculation approach. The proposed approach addressed how to calculate the MLE when state variables cannot be accessed directly, and uncertainties in system models, as well as noise in measurements. The simulation results shows that the proposed approach is able to handle well the nonlinear measurement functions between state variables and measurements, and get better results than pure model-based approaches or measurement-based approaches in front of measurement noise and model uncertainties.

maximal Lyapunov exponents, nonlinear differential↗

Estimation of Permanent Magnet Synchronous Motor Parameters using a Linear Unknown Input Interval Observer

This paper develops and evaluate a technique to estimate the speed and unknown load torque of a permanent magnet synchronous motor (PMSM). An interval unknown input observer (UIO) for linear time-invariant (LTI) systems is designed and utilized to estimate the PMSM parameters. Interval UIOs are advantageous as they allow for the estimation of both states and unknown inputs, while accounting for varying uncertainty sources, such as model and measurement uncertainties inherent in dynamic systems and processes. First, the nonlinear PMSM model is linearized to transform it to a suitable form for application of the linear interval UIO. Then, the interval UIO is applied to jointly estimate the motor speed and the unknown load torque disturbance. Assuming that the measurement noise and disturbances are bounded, lower and upper bounds are first computed for the unmeasured state (motor speed) and then for the unknown input (load torque). The proposed approach and its limitations are demonstrated for the nonlinear PMSM model derived from its equivalent electrical circuit.

Elinirina I Robinson↗

Accurate data-driven surrogates of dynamical systems for forward propagation of uncertainty

Stochastic collocation (SC) is a well-known non-intrusive method of constructing surrogate models for uncertainty quantification. In dynamical systems, SC is especially suited for full-field uncertainty propagation that characterizes the distributions of the high-dimensional solution fields of a model with stochastic input parameters. However, due to the highly nonlinear nature of the parameter-to-solution map in even the simplest dynamical systems, the constructed SC surrogates are often inaccurate. Here, this work presents an alternative approach, where we apply the SC approximation over the dynamics of the model, rather than the solution. By combining the data-driven sparse identification of nonlinear dynamics framework with SC, we construct dynamics surrogates and integrate them through time to construct the surrogate solutions. We demonstrate that the SC-over-dynamics framework leads to smaller errors, both in terms of the approximated system trajectories as well as the model state distributions, when compared against full-field SC applied to the solutions directly. We present numerical evidence of this improvement using three test problems: a chaotic ordinary differential equation, and two partial differential equations from solid mechanics.

42 ENGINEERING↗

REV-INR: Regularized Evidential Implicit Neural Representation for Uncertainty-Aware Volume Visualization

Applications of Implicit Neural Representations (INRs) have emerged as a promising deep learning approach for compactly representing large volumetric datasets. These models can act as surrogates for volume data, enabling efficient storage and on-demand reconstruction via model predictions. However, conventional deterministic INRs only provide value predictions without insights into the model’s prediction uncertainty or the impact of inherent noisiness in the data. This limitation can lead to unreliable data interpretation and visualization due to prediction inaccuracies in the reconstructed volume. Identifying erroneous results extracted from model-predicted data may be infeasible, as raw data may be unavailable due to its large size. To address this challenge, we introduce REV-INR, Regularized Evidential Implicit Neural Representation, which learns to predict data values accurately along with the associated coordinate-level data uncertainty and model uncertainty using only a single forward pass of the trained REV-INR during inference. By comprehensively comparing and contrasting REV-INR with existing well-established deep uncertainty estimation methods, we show that REV-INR achieves the best volume reconstruction quality with robust data (aleatoric) and model (epistemic) uncertainty estimates using the fastest inference time. Consequently, we demonstrate that REV-INR facilitates assessment of the reliability and trustworthiness of the extracted isosurfaces and volume visualization results, enabling analyses to be solely driven by model-predicted data.

Saklani, Shanu [Indian Institute of Technology, Ka↗

Active Subspaces for Wind Plant Surrogate Modeling

Understanding the uncertainty in wind plant performance is crucial to their cost-effective design and operation. However, conventional approaches to uncertainty quantification (UQ), such as Monte Carlo techniques or surrogate modeling, are often computationally intractable for utility-scale wind plants because of poor congergence rates or the curse of dimensionality. In this paper we demonstrate that wind plant power uncertainty can be well represented with a low-dimensional active subspace, thereby achieving a significant reduction in the dimension of the surrogate modeling problem. We apply the active sub-spaces technique to UQ of plant power output with respect to uncertainty in turbine axial induction factors, and find a single active subspace direction dominates the sensitivity in power output. When this single active subspace direction is used to construct a quadratic surrogate model, the number of model unknowns can be reduced by up to 3 orders of magnitude without compromising performance on unseen test data. We conclude that the dimension reduction achieved with active subspaces makes surrogate-based UQ approaches tractable for utility-scale wind plants.

17 WIND ENERGY↗