Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Photovoltaic System Modeling: Uncertainty and Sensitivity Analyses

We report an uncertainty and sensitivity analysis for modeling AC energy from photovoltaic systems. Output from a PV system is predicted by a sequence of models. We quantify uncertainty in the output of each model using empirical distributions of each model’s residuals. We propagate uncertainty through the sequence of models by sampling these distributions to obtain an empirical distribution of a PV system’s output. We consider models that: (1) translate measured global horizontal, direct and global diffuse irradiance to plane-of-array irradiance; (2) estimate effective irradiance; (3) predict cell temperature; (4) estimate DC voltage, current and power; (5) reduce DC power for losses due to inefficient maximum power point tracking or mismatch among modules; and (6) convert DC to AC power. Our analysis considers a notional PV system comprising an array of FirstSolar FS-387 modules and a 250 kW AC inverter; we use measured irradiance and weather at Albuquerque, NM. We found the uncertainty in PV system output to be relatively small, on the order of 1% for daily energy. We found that uncertainty in the models for POA irradiance and effective irradiance to be the dominant contributors to uncertainty in predicted daily energy. Our analysis indicates that efforts to reduce the uncertainty in PV system output predictions may yield the greatest improvements by focusing on the POA and effective irradiance models.

14 SOLAR ENERGY↗

Uncertainty Modeling for Mars Ascent Vehicle’s Aerodatabase Development

The design of the Mars Ascent Vehicle - Mars Sample Return (MAV-MSR) trajectories requires an accurate assessment of flight performance. Typically, these trajectories are developed by flight mechanics analysis to meet complex mission requirements and then flight performance assessed through Monte Carlo simulations. Consequently, it is crucial to develop an aerodynamic aerodatabase as an input model for flight mechanics analysis to provide static and dynamic force and moment coefficients under specific flight conditions. The force and moment coefficients in the MAV aerodatabase are determined using the FUN3D computational fluid dynamics solver. Firstly, an overview of the aerodatabase is presented to demonstrate its applicability to trajectory-defined simulations. This effort is followed by an initial attempt to quantify uncertainties in the force and moment coefficients necessary for updating the current aerodatabase. The uncertainty model identifies uncertainty adders and multipliers for coefficient-based forces and moments through a direct comparison between FUN3D and wind tunnel test data from NASA Marshall Space Center's 14x14 inch Trisonic Wind Tunnel. These uncertainties aim to encompass various changes in Mach number, angle of attack, and aerodynamic roll angle.

Uncertainty analysis↗

Uncertainty Modeling for Mars Ascent Vehicle’s Aerodynamic Database Development

The design of the Mars Ascent Vehicle - Mars Sample Return (MAV-MSR) trajectories requires an accurate assessment of flight performance. Typically, these trajectories are developed by flight mechanics analysis to meet complex mission requirements and then flight performance assessed through Monte Carlo simulations. Consequently, it is crucial to develop an aerodynamic aerodatabase as an input model for flight mechanics analysis to provide static and dynamic force and moment coefficients under specific flight conditions. The force and moment coefficients in the MAV aerodatabase are determined using the FUN3D computational fluid dynamics solver. Firstly, an overview of the aerodatabase is presented to demonstrate its applicability to trajectory-defined simulations. This effort is followed by an initial attempt to quantify uncertainties in the force and moment coefficients necessary for updating the current aerodatabase. The uncertainty model identifies uncertainty adders and multipliers for coefficient-based forces and moments through a direct comparison between FUN3D and wind tunnel test data from NASA Marshall Space Center's 14x14 inch Trisonic Wind Tunnel. These uncertainties aim to encompass various changes in Mach number, angle of attack, and aerodynamic roll angle.

Uncertainty analysis↗

Impact of Model Uncertainties on Quantitative Analysis of FUV Auroral Images: Peak Production Height

We demonstrate that small uncertainties in the modeled height of peak production for FUV emissions can lead to significant uncertainties in the analysis of these sai-ne emissions. In particular, an uncertainty of only 3 km in the peak production height can lead to a 50% uncertainty in the mean auroral energy deduced from the images. This altitude uncertainty is comparable to differences in different auroral deposition models currently used for UVI analysis. Consequently, great care must be taken in quantitative photometric analysis and interpretation of FUV auroral images.

Germany, G. A.↗

Host Model Uncertainties in Aerosol Radiative Forcing Estimates: Results from the AeroCom Prescribed Intercomparison Study

Simulated multi-model "diversity" in aerosol direct radiative forcing estimates is often perceived as mea- sure of aerosol uncertainty. However, current models used for aerosol radiative forcing calculations vary considerably in model components relevant for forcing calculations and the associated "host-model uncertainties" are generally convoluted with the actual aerosol uncertainty. In this AeroCom Prescribed intercomparison study we systematically isolate and quantify host model uncertainties on aerosol forcing experiments through prescription of identical aerosol radiative properties in nine participating models. Even with prescribed aerosol radiative properties,simulated clear-sky and all-sky aerosol radiative forcings show significant diversity. For a purely scattering case with globally constant optical depth of 0.2, the global-mean all-sky top-of-atmosphere radiative forcing is -4.51 Wm-2 and the inter-model standard deviation is 0.70 Wm-2, corresponding to a relative standard deviation of 15%. For a case with partially absorbing aerosol with an aerosol optical depth of 0.2 and single scattering albedo of 0.8, the forcing changes to 1.26 Wm-2, and the standard deviation increases to 1.21 W-2, corresponding to a significant relative standard deviation of 96%. However, the top-of-atmosphere forcing variability owing to absorption is low, with relative standard deviations of 9% clear-sky and 12% all-sky. Scaling the forcing standard deviation for a purely scattering case to match the sulfate radiative in the AeroCom Direct Effect experiment, demonstrates that host model uncertain- ties could explain about half of the overall sulfate forcing diversity of 0.13 Wm-2 in the AeroCom Direct Radiative Effect experiment. Host model errors in aerosol radiative forcing are largest in regions of uncertain host model components, such as stratocumulus cloud decks or areas with poorly constrained.

AeroCom↗

A preliminary study to Assess Model Uncertainties in Fluid Flows

The goal of this study is to assess the impact of various flow models for a simplified primary coolant loop of a light water nuclear reactor. The various fluid flow models are based on the Euler equations with an additional friction term, gravity term, momentum source, and energy source. The geometric model is purposefully chosen simple and consists of a one-dimensional (1D) loop system in order to focus the study on the validity of various fluid flow approximations. The 1D loop system is represented by a rectangle; the fluid is heated up along one of the vertical legs and cooled down along the opposite leg. A pressurizer and a pump are included in the horizontal legs. The amount of energy transferred and removed from the system is equal in absolute value along the two vertical legs. The various fluid flow approximations are compressible vs. incompressible, and complete momentum equation vs. Darcy’s approximation. The ultimate goal is to compute the fluid flow models’ uncertainties and, if possible, to generate validity ranges for these models when applied to reactor analysis. We also limit this study to single phase flows with low-Mach numbers. As a result, sound waves carry a very small amount of energy in this particular case. A standard finite volume method is used for the spatial discretization of the system.

97 MATHEMATICS AND COMPUTING↗

Characterizing model uncertainties in simulated coast-to-offshore wind over the northeast U.S. using multi-platform measurements from the TCAP field campaign

Numerical weather prediction (NWP) models, such as the Weather Research and Forecasting (WRF) model, are widely used to provide estimates of the offshore wind energy resource owing to their large spatial coverage compared to available observations. Nevertheless, spatiotemporal distribution of model biases is highly dependent on factors including model configuration, location, and the interplay of multi-scale physical processes. Here, in this study, we focus on the characterization of model uncertainties in simulated coast-to-offshore winds over the northeast U.S., by varying sea surface temperature (SST) forcings, surface layer (SL) and planetary boundary layer (PBL) parameterizations, as well as identifying biases that may be directly passed from initial and boundary conditions. Multiple measurements, including aircraft data collected during the U.S. Department of Energy's Two-Column Aerosol Project (TCAP) experiment, are used to constrain the model results and facilitate quantitative comparisons. Our analysis indicates while SST forcing has notable impacts on simulated air temperature and moisture within PBL, the modeled winds are in general more sensitive to the choices of SL and PBL physics than to SST. The model’s forcing data not only controls the vertical dependence of wind speed errors, but also alters regional variability in wind speed’s spatial correlation. Bias comparisons between ERA5 reanalysis and ensemble simulations revealed significant similarity, particularly in wind speed biases during winter, underscoring their dependency on initial and boundary conditions. Coastal and offshore near-surface wind speed biases tend to exhibit much higher similarity in winter than in summer due to the presence of much stronger and more persistent synoptic wind conditions. This study highlights the importance of accurate atmospheric forcing and parameterization choices in improving wind forecasts and suggests the potential for extrapolating coastal wind biases to offshore locations, aiding wind energy forecasting and informing the Wind Forecast Improvement Project-3 (WFIP3).

17 WIND ENERGY↗

An Entropy-Based Test and Development Framework for Uncertainty Modeling in Level-Set Visualizations

We present a simple comparative framework for testing and developing uncertainty modeling in uncertain marching cubes implementations. The selection of a model to represent the probability distribution of uncertain values directly influences the memory use, run time, and accuracy of an uncertainty visualization algorithm. We use an entropy calculation directly on ensemble data to establish an expected result and then compare the entropy from various probability models, including uniform, Gaussian, histogram, and quantile models. Our results verify that models matching the distribution of the ensemble indeed match the entropy. We further show that fewer bins in nonparametric histogram models are more effective whereas large numbers of bins in quantile models approach data accuracy.

Sisneros, Robert↗

Probabilistic Blast Damage Modeling Uncertainties and Sensitivities

Blast overpressure is the predominant source of ground damage posed by potentially hazardous asteroid strikes. Estimates of the extent, severity, and likelihoods of potential blast damage regions will be one of the key metrics needed to mount civil defense or disaster response plans in the face of an impending impact. However, there are many inherent sources of uncertainty in evaluating the damage, both in characterizing the properties of the incoming object and in the approaches used to model the entry/impact and resulting damage, which make it difficult to produce a single ‘accurate’ or ‘best guess’ prediction of ground damage. The current 2021 PDC hypothetical impact scenario poses a particular challenge due to its short warning time. The need for rapid disaster response to prepare for an immanent impact, combined with lack of observational opportunities to refine basic knowledge about the object’s basic size and properties, make understanding the range and relative likelihood of consequences particularly critical. The potential damage caused by these blasts can be evaluated using a range of modeling and simulation approaches and levels of fidelity. Fast-running engineering-level models can be used to run large numbers of probabilistically sampled cases covering wide variations of uncertain properties or parameters. High-fidelity simulations, on the other hand, can capture more detailed/accurate blast physics, but can only be performed for a small selection of specific cases, requiring many assumptions to be made about the initial object and its unpredictable entry/breakup characteristics. In order to provide a more complete picture of the potential threat for effective disaster response, both types of analysis need to be employed together. In this approach, high-fidelity simulations are used to refine and anchor engineering models, and the probabilistic engineering models are used to evaluate broad parameters spaces and guide selection of the most pertinent simulation cases for a given scenario. This presentation expands upon the probabilistic asteroid impact risk assessments being performed as part of the 2021 PDC hypothetical impact exercise, focusing on key aspects of blast damage modeling uncertainties and sensitivities. We review the current modeling and simulation approaches employed in the current assessment, compare the relative levels of uncertainty stemming from each main element of the problem (i.e., knowledge of the asteroid properties, modeling of the atmospheric entry/breakup and airburst, and estimates of the ground damage from the resulting blasts waves), and highlight any notable trends and sensitivities for the current scenario case.

SMD↗

Approximating and incorporating model uncertainty in an inversion for seismic source functions: Preliminary results

We present preliminary work on propagating model uncertainty into the estimation of the time domain source time functions of the seismic source. Our method is based on an estimated model covariance function, which we estimate from the data. The model covariance function is then used to construct a suite of surrogate Greens functions which we use in a Monte Carlo type inversion scheme. The result is a probability density function of the six independent source time functions, each of which corresponds to an individual component of the seismic moment tensor. We compare the results of our method with those obtained using a computationally expensive finite difference Monte Carlo method and find that our new method produces results that are deficient in low frequencies. The advantage of our new method, which we term the Karhunen-Loeve Monte Carlo (KLMC) method, is that is several orders of magnitude faster than our current method, which uses a finite difference scheme to produce the suite of forward models.

42 ENGINEERING↗

Market and Modeling Uncertainty in Distributed Solar Deployment Projections: A Multi-Model Comparison

Distributed solar photovoltaic (DPV) systems that generate energy in behind-the-meter (BTM) applications for residential, commercial, and other end-user sectors are a growing and contentious development in the U.S. power system. While less than one percent of all electricity generation in the United States came from DPV systems in 2016 (EIA, April 2017), this technology has experienced rapid growth in recent years and, as of the start of 2017, over 1.3 million DPV systems had been installed (Munsell 2017). Thus, projecting the feasibility and potential timing of mass-market breakout of distributed solar is increasingly pertinent - yet projections remain highly uncertain.

14 SOLAR ENERGY↗

How initial conditions-, structural-, and parameter-based model uncertainty interact and influence predictions in permafrost ecosystems: Modeling Archive

This dataset contains model output and input data, as well as source code examples for the Terrestrial Ecosystem Model with the Dynamic Vegetation Model and Dynamic Organic Soil (DVM-DOS-TEM) for the field sites Imnavait creek and the Bonanza creek Long Term Ecological Research Network (LTER). The data covers simulations from the last glacial maximum (LGM) until 2100 for a selection of paleo scenarios, setting the mean temperature of the LGM up to 10°C lower than pre-industrial conditions. The model structure was modulated to represent various model versions, and this dataset contains the relevant changes in the source code. The raw output data, the processed statistical data, the setup and processing scripts as well as parameter value distribution files from a parameter sensitivity analysis are included as well. Model outputs include active layer depth, organic soil carbon, soil layer depths, gross primary productivity (GPP) with and without nitrogen limitation, net primary productivity (NPP), soil liquid water content, heterotrophic, maintenance, and growth respiration, soil temperature, and vegetation carbon (*.nc files). The Next-Generation Ecosystem Experiments in the Arctic (NGEE Arctic) project is a research effort to reduce uncertainty in the Department of Energy’s Energy Exascale Earth System Model (E3SM) by developing a predictive understanding of Arctic tundra ecosystems underlain by permafrost and to quantify feedbacks from the Arctic tundra to the Earth system. NGEE Arctic is supported by the Department of Energy's Office of Biological and Environmental Research.Over Phases 1–3, observations made by the NGEE Arctic team across a gradient of permafrost landscapes in Arctic Alaska improved the representation of tundra processes in the land surface component of E3SM (the E3SM Land Model, ELM). Model improvements emphasized unique aspects of permafrost environments and explored reductions in model complexity while retaining predictive power. The Arctic-informed ELM developed by NGEE Arctic has been used to make novel predictions on processes ranging from permafrost thaw to soil biogeochemical cycling to Earth system feedbacks associated with the unique characteristics of tundra plants. In Phase 4, the NGEE Arctic team is evaluating our new predictive understanding under novel conditions across the Arctic domain. In collaboration with partners at long-term pan-Arctic research sites we are examining whether an Arctic-informed ELM can faithfully simulate interactions among surface and subsurface processes at site, regional, and pan-Arctic scales. In turn, we are using variety of tools to dynamically extend and evaluate ELM inference, with an emphasis on data synthesis and pan-Arctic model evaluation, reintegration of code with an evolving E3SM, scaling across heterogeneous Arctic landscapes, and the appropriate representation of the impacts of increasingly frequent Arctic disturbances.

54 ENVIRONMENTAL SCIENCES↗

235-F GoldSim Fate and Transport Model: Uncertainty Quantification

Building 235-F was configured with two missions in mind: Actinide Billet Line (ABL) and the fabrication of Pu-238 oxide for space program applications. ABL produced Np-237 billets for use in SRS reactors, whereas the design process, fabrication, and examination of Pu-238 oxide powder occurred within the following areas, respectively: Plutonium Experimental Facility (PEF), Plutonium Fuel Form (PuFF), and Old Metallography Lab (OML). By 1990 production ceased and by 2006 de-inventory occurred; however, assays have shown significant holdup remains within ABL and PuFF. As a result, 235-F is a Category 2 nuclear facility, with plans to undergo deactivation and decommission (D and D) via In-Situ Disposal (ISD). The purpose of this project is to ensure United States Environmental Protection Agency (USEPA) groundwater radiation maximum contaminant level (MCL) and dosage standards are met during the D and D of 235-F by quantifying uncertainty through probabilistic modeling and evaluation of various ISD alternatives. GoldSim is a dynamic modeling software package with a graphical, object-oriented interface capable of capturing the influence of complex system input variability on probabilistic system outcomes. A GoldSim stochastic fate and transport model for 235-F was developed and matched with a PORFLOW deterministic model to simulate probabilistic release and flow of radionuclides from ABL and PuFF into the vadose zone, the Upper Three Runs (UTR) Aquifer, and UTR Creek. The GoldSim model was used to probabilistically evaluate four ISD scenarios against USEPA groundwater radiation MCLs and dosage standards. The deterministic 235-F GoldSim fate and transport model continues to be refined to match the results of the PORFLOW deterministic model to ensure the model accurately represents radionuclide movement through the groundwater system. The stochastic variables that are utilized within the GoldSim model are founded on the most current data; a conservative perspective is taken where needed. Alignment with the PORFLOW deterministic model, coupled with input stochastic variability, allows the probabilistic 235-F GoldSim model to capture the conservative breadth of possible outcomes for radionuclide fate within this particular system. This ensures that the USEPA MCLs and dosage limits hold even in the worst case scenarios.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Effect of model uncertainty on failure detection - The threshold selector

The performance of all failure detection, isolation, and accomodation (DIA) algorithms is influenced by the presence of model uncertainty. A unique framework is presented to incorporate a knowledge of modeling error in the analysis and design of failure detection systems. The tools being used are very similar to those in robust control theory. A concept is introduced called the threshold selector, which is a nonlinear inequality whose solution defines the set of detectable sensor failure signals. The threshold selector represents an innovative tool for analysis and synthesis of DIA algorithms. It identifies the optimal threshold to be used in innovations-based DIA algorithms. The optimal threshold is shown to be a function of the bound on modeling errors, the noise properties, the speed of DIA filters, and the classes of reference and failure signals. The size of the smallest detectable failure is also determined. The results are applied to a multivariable turbofan jet engine example, which demonstrates improvements compared to previous studies.

Emami-Naeini, Abbas↗

Model Uncertainties for Valencia RPA Effect for MINERvA

This technical note describes the application of the Valencia RPA multi-nucleon effect and its uncertainty to QE reactions from the GENIE neutrino event generator. The analysis of MINERvA neutrino data in Rodrigues et al. PRL 116 071802 (2016) paper makes clear the need for an RPA suppression, especially at very low momentum and energy transfer. That published analysis does not constrain the magnitude of the effect; it only tests models with and without the effect against the data. Other MINERvA analyses need an expression of the model uncertainty in the RPA effect. A well-described uncertainty can be used for systematics for unfolding, for model errors in the analysis of non-QE samples, and as input for fitting exercises for model testing or constraining backgrounds. This prescription takes uncertainties on the parameters in the Valencia RPA model and adds a (not-as-tight) constraint from muon capture data. For MINERvA we apply it as a 2D ($q_0$,$q_3$) weight to GENIE events, in lieu of generating a full beyond-Fermi-gas quasielastic events. Because it is a weight, it can be applied to the generated and fully Geant4 simulated events used in analysis without a special GENIE sample. For some limited uses, it could be cast as a 1D $Q^2$ weight without much trouble. This procedure is a suitable starting point for NOvA and DUNE where the energy dependence is modest, but probably not adequate for T2K or MicroBooNE.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Effect of Epistemic Uncertainty Modeling Approach on Decision-Making: Example using Equipment Performance Indicator

Quantitative risk assessments are an integral part of risk-informed regulation of current and future nuclear plants in the U.S. The Bayesian approach to uncertainty, in which both stochastic and epistemic uncertainties are represented with precise probability distributions, is the standard approach to modeling uncertainties in such quantitative risk assessments. However, there are long-standing criticisms of the Bayesian approach to epistemic uncertainty from many perspectives, and a number of alternative approaches have been proposed. Among these alternatives, the most promising (and most rapidly developing) would appear to be the concept of imprecise probability. In this paper, we employ a performance indicator example to focus the discussion. We first give a short overview of the traditional Bayesian paradigm and review some its controversial aspects, for example, issues with so-called noninformative prior distributions. We then discuss how the imprecise probability approach treats these issues and compare it with two other approaches: sensitivity analysis and hierarchical Bayes modeling. We conclude with some practical implications for risk-informed decision making.

99 GENERAL AND MISCELLANEOUS↗

Minimum-Variance Control Allocation Considering Parametric Model Uncertainty

The control allocation problem was investigated for linear dynamical systems with known parametric uncertainty. Minimizing a cost function that penalizes the variance of the error in achieving commanded forces and moments on the vehicle resulted in a special case of the weighted pseudo-inverse allocator. Rather than an engineer designing the weighting matrix, it is computed from the covariances of the control effectiveness parameters. This minimum-variance allocator balances the effectiveness of the control inputs against the corresponding levels of uncertainty. The approach was demonstrated using simulations of aircraft with realistic uncertainty levels operating in open-loop and closed-loop configurations. Results showed that when model uncertainty is known, significant, and unevenly distributed amongst the controls, the minimum-variance allocator more often achieves the intended forces and moments on the vehicle in comparison to other allocators, which can lead to increased performance, reliability, and safety during flight tests. The cost for this robustness is a diminished achievable moment space for the vehicle.

Control allocation↗

An efficient method to propagate model uncertainty when inverting seismic data for time domain seismic moment tensors

SUMMARY We present a computationally efficient method to approximately propagate uncertainty when linearly inverting seismic data for point source, time variable moment tensor components. The method is based on the assumption that the data residual, given by the difference between the observed seismic data and the data predicated by a linear inversion, contains the effects of both data and model uncertainty. Our method uses a distribution of data residuals, added directly to the data, in a pseudo-Monte Carlo scheme. Using the assumption that the data residual is a stochastic process, we use the well-known Karhunen–Loève (KL) theorem to construct a distribution of data residuals, where the required basis functions are constructed using Fourier series. The Fourier series are scaled by a product of a random variable and the real-valued spectral amplitudes of the original data residual’s spectrum. Thus, the Fourier series and spectral amplitudes are eigenfunction-eigenvalue pairs used in the KL-based construction of data residual distribution. Using tests with synthetic data, we show that our method compares closely with a Finite Difference Monte Carlo (FDMC) method that we presented previously. More importantly, the method presented here is computationally several orders of magnitude faster than our previous FDMC method, and requires no a priori assumptions of model and/or data uncertainty.

Poppeliers, Christian (ORCID:0000000159526849)↗