Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,675 records · Page 93

Use of a State-Level Integrated Assessment Model for Policy Analysis: An Uncertainty Analysis of Energy and Water

This presentation discusses some recent uncertainty assessment work being done on climate policy issues at the state level. The work is being done with the Platform for Regional Integrated Modeling and Analysis (PRIMA), a new climate change policy assessment framework developed at Pacific Northwest National Laboratory in Richland and Seattle, Washington and College Park, Maryland. The central computaional engine of PRIMA is the Global Change Assessment Model (GCAM), a dynamic-recursive integrated assessment model of the world economy, climate policy, and climate change that that has been regionalized to provide policy analysis down to the level of U.S. states. The PRIMA framework also includes detailed sectoral models that address issues in the energy-land-water interface geospatially at the sub-national level as the climate change and socioeconomic change occur. This presentation illustrates two uncertainty analyses conducted with GCAM and with water demand and supply components of PRIMA. The energy uncertainty analysis was conducted with GCAM alone and examines the impact of aggressive residential and commercial building equipment standards across the United States in the context of socioeconomic and climate uncertainty. The analysis focuses on the impact on future net energy service costs under aggressive standards in the residential and commercial building sectors from 2005 to 2050. The analysis uses a combination of discrete scenarios and Monte Carlo sampling approaches to address uncertainties. Results for Arizona and Florida are used to illustrate whether aggressive building equipment standards save energy and reduce net energy service costs when compared with current standards. Analysis of the output indicates a robust result under a broad range of future socioeconomic, policy, and climate scenarios. The water uncertainty analysis demonstrates a multi-model approach used to bound the prospects for future water shortages in Florida, given socioeconomic uncertainty and future water supply under a future climate. In this analysis, water demands from GCAM are coupled with a water management model that simulates regulated streamflows and water supply deficits given naturalized streamflows, water demands, and reservoir operating rules. The naturalized streamflows are simulated with a regional earth system model coupled to a river routing model. The climate is obtained from a regional climate projection of the Intergovernmental Panel on Climate Change (IPCC) Representative Concentration Pathway 8.5 (RCP 8.5) for all of the river basins in the United States. GCAM is used in Monte Carlo mode to estimate the outer bounds of water demand given socioeconomic uncertainty and RCP 8.5 climate. Future water demand is downscaled to a river basin level for Florida in high, low, and middle cases and is compared with available water supply for the same region for RCP 8.5 climate to identify the potential location and severity of water shortages.

Climate change, policy, mitigation, impacts, uncer↗

Our Sun IV: The Standard Model and Helioseismology: Consequences of Uncertainties in Input Physics and in Observed Solar Parameters

Helioseismic frequency observations provide an extremely accurate window into the solar interior; frequencies from the Michaelson Doppler Imager (MDI) on the Solar and Heliospheric Observatory (SOHO) spacecraft, enable the adiabatic sound speed and adiabatic index to be inferred with an accuracy of a few parts in 10(exp 4) and the density with an accuracy of a few parts in 10(exp 3). This has become a Serious challenge to theoretical models of the Sun. Therefore, we have undertaken a self-consistent, systematic study of the sources of uncertainties in the standard solar models. We found that the largest effect on the interior structure arises from the observational uncertainties in the photospheric abundances of the elements, which affect the sound speed profile at the level of 3 parts in 10(exp 3). The estimated 4% uncertainty in the OPAL opacities could lead to effects of 1 part in 10(exp 3); the approximately 5%, uncertainty in the basic pp nuclear reaction rate would have a similar effect, as would uncertainties of approximately 15% in the diffusion constants for the gravitational settling of helium. The approximately 50% uncertainties in diffusion constants for the heavier elements would have nearly as large an effect. Different observational methods for determining the solar radius yield results differing by as much as 7 parts in 10(exp 4); we found that this leads to uncertainties of a few parts in 10(exp 3) in the sound speed int the solar convective envelope, but has negligible effect on the interior. Our reference standard solar model yielded a convective envelope position of 0.7135 solar radius, in excellent agreement with the observed value of 0.713 +/- 0.001 solar radius and was significantly affected only by Z/X, the pp rate, and the uncertainties in helium diffusion constants. Our reference model also yielded envelope helium abundance of 0.2424, in good agreement with the approximate range of 0.24 to 0.25 inferred from helioseismic observations; only extreme Z/X values yielded envelope helium abundance outside this range. We found that other current uncertainties, namely, in the solar age and luminosity, in nuclear rates other than the pp reaction, in the low-temperature molecular opacities, and in the low-density equation of state, have no significant effect on the quantities that can be inferred from helioseismic observations. The predicted pre-main-sequence lithium depletion is uncertain by a factor of 2. The predicted neutrino capture rate is uncertain by approximately 30% for the Cl-27 experiment and by approximately 3% for Ga-71 experiments, while the B-8 neutrino flux is uncertain by approximately 30%.

Boothroyd, Arnold I.↗

Characterization and Valuation of the Uncertainty of Calibrated Parameters in Microsimulation Decision Models

We evaluated the implications of different approaches to characterize the uncertainty of calibrated parameters of microsimulation decision models (DMs) and quantified the value of such uncertainty in decision making. We calibrated the natural history model of CRC to simulated epidemiological data with different degrees of uncertainty and obtained the joint posterior distribution of the parameters using a Bayesian approach. We conducted a probabilistic sensitivity analysis (PSA) on all the model parameters with different characterizations of the uncertainty of the calibrated parameters. We estimated the value of uncertainty of the various characterizations with a value of information analysis. We conducted all analyses using high-performance computing resources running the Extreme-scale Model Exploration with Swift (EMEWS) framework. The posterior distribution had a high correlation among some parameters. The parameters of the Weibull hazard function for the age of onset of adenomas had the highest posterior correlation of -0.958. When comparing full posterior distributions and the maximum-a-posteriori estimate of the calibrated parameters, there is little difference in the spread of the distribution of the CEA outcomes with a similar expected value of perfect information (EVPI) of $\$$653 and $\$$685, respectively, at a willingness-to-pay (WTP) threshold of $\$$66,000 per quality-adjusted life year (QALY). Ignoring correlation on the calibrated parameters’ posterior distribution produced the broadest distribution of CEA outcomes and the highest EVPI of $\$$809 at the same WTP threshold. Different characterizations of the uncertainty of calibrated parameters affect the expected value of eliminating parametric uncertainty on the CEA. Ignoring inherent correlation among calibrated parameters on a PSA overestimates the value of uncertainty.

97 MATHEMATICS AND COMPUTING↗

A Framework for the Cross-Sectoral Integration of Multi-Model Impact Projections: Land Use Decisions Under Climate Impacts Uncertainties

Climate change and its impacts already pose considerable challenges for societies that will further increase with global warming (IPCC, 2014a, b). Uncertainties of the climatic response to greenhouse gas emissions include the potential passing of large-scale tipping points (e.g. Lenton et al., 2008; Levermann et al., 2012; Schellnhuber, 2010) and changes in extreme meteorological events (Field et al., 2012) with complex impacts on societies (Hallegatte et al., 2013). Thus climate change mitigation is considered a necessary societal response for avoiding uncontrollable impacts (Conference of the Parties, 2010). On the other hand, large-scale climate change mitigation itself implies fundamental changes in, for example, the global energy system. The associated challenges come on top of others that derive from equally important ethical imperatives like the fulfilment of increasing food demand that may draw on the same resources. For example, ensuring food security for a growing population may require an expansion of cropland, thereby reducing natural carbon sinks or the area available for bio-energy production. So far, available studies addressing this problem have relied on individual impact models, ignoring uncertainty in crop model and biome model projections. Here, we propose a probabilistic decision framework that allows for an evaluation of agricultural management and mitigation options in a multi-impactmodel setting. Based on simulations generated within the Inter-Sectoral Impact Model Intercomparison Project (ISI-MIP), we outline how cross-sectorally consistent multi-model impact simulations could be used to generate the information required for robust decision making. Using an illustrative future land use pattern, we discuss the trade-off between potential gains in crop production and associated losses in natural carbon sinks in the new multiple crop- and biome-model setting. In addition, crop and water model simulations are combined to explore irrigation increases as one possible measure of agricultural intensification that could limit the expansion of cropland required in response to climate change and growing food demand. This example shows that current impact model uncertainties pose an important challenge to long-term mitigation planning and must not be ignored in long-term strategic decision making

farmlands↗

Understanding Uncertainties in Tropical Cyclone Rainfall Hazard Modeling Using Synthetic Storms

Tropical cyclone (TC) rainfall hazard assessment is subject to the bias in TC climatology estimation from climate simulations or synthetic downscaling. In this study, we investigate the uncertainty in TC rainfall hazard assessment induced by this bias using both rain gauge and radar observations and synthetic-storm-model-coupled TC rainfall simulations. We identify the storm’s maximum intensity, impact duration, and minimal distance to the site to be the three most important storm parameters for TC rainfall hazard, and the relationship between the important storm parameters and TC rainfall can be well captured by a physics-based TC rainfall model. The uncertainty in the synthetic rainfall hazard induced by the bias in TC climatology can be largely explained by the bias in the important storm parameters simulated by the synthetic storm model. Correcting the distribution of the most biased parameter may significantly improve rainfall hazard estimation. Bias correction based on the joint distribution of the important parameters may render more accurate rainfall hazard estimations; however, the general technical difficulties in resampling from high-dimensional joint probability distributions prevent more accurate estimations in some cases. The results of the study also support future investigation of the impact of climate change on TC rainfall hazards through the lens of future changes in the identified important storm parameters.

54 ENVIRONMENTAL SCIENCES↗

DEPENDENCE OF X-RAY BURST MODELS ON NUCLEAR REACTION RATES

X-ray bursts are thermonuclear flashes on the surface of accreting neutron stars, and reliable burst models are needed to interpret observations in terms of properties of the neutron star and the binary system. We investigate the dependence of X-ray burst models on uncertainties in (p, γ ), ( α , γ ), and ( α , p) nuclear reaction rates using fully self-consistent burst models that account for the feedbacks between changes in nuclear energy generation and changes in astrophysical conditions. A two-step approach first identified sensitive nuclear reaction rates in a single-zone model with ignition conditions chosen to match calculations with a state-of-the-art 1D multi-zone model based on the Kepler stellar evolution code. All relevant reaction rates on neutron-deficient isotopes up to mass 106 were individually varied by a factor of 100 up and down. Calculations of the 84 changes in reaction rate with the highest impact were then repeated in the 1D multi-zone model. We find a number of uncertain reaction rates that affect predictions of light curves and burst ashes significantly. The results provide insights into the nuclear processes that shape observables from X-ray bursts, and guidance for future nuclear physics work to reduce nuclear uncertainties in X-ray burst models.

79 ASTRONOMY AND ASTROPHYSICS↗

Measuring the Multi-Neutron Antineutrino Cross Section at Low Charged Hadron Energy in MINERvA

Current and future accelerator neutrino oscillation experiments need neutrino interaction models with smaller systematic uncertainties to resolve much of delta CP phase space. Final state interactions (FSI) and scattering off of correlated nuclei (2p2h) are poorly understood processes that currently contribute large uncertainties to leading models. These processes have proven difficult to study because they often produce relatively low energy nucleons. Protons up to about 100 MeV are below the detection threshold of some accelerator neutrino detectors, and neutrons are usually discounted as undetectable. This poster presents a measurement of the multi-neutron antineutrino cross section at low available energy using the MINERvA detector at Fermilab. This interaction channel is particularly sensitive to FSI and 2p2h interactions. A sideband-driven background constraint that greatly reduces uncertainties on the result will be presented. The measured cross section is compared to GENIE v3 models with different FSI treatments and the SuSA model's 2p2h predictions.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Yearly Report for the Period Jan-Dec 2012: IC PROJECT W12c_earthuq - “High-Performance Computing for Uncertainty Quantification of 3D Earth Models”

This proposal was written to be a new project leveraging on computational achievements of the two IC11 proposals “3D Geophysical Modeling Validation” and “Time-Reversal Imaging of tremor sources”. W12c_earthuq involves additional codes/tools other than SPECFEM3D for data processing and planned a strong effort to move toward modeling at much larger scales than the aforementioned projects. W12c_earthuq goal was to use extensive HPC resources at LANL to assess the uncertainty of high resolution 3D geophysical models. Validation of these models as planned in W11_geophys is the first step in a full assessment of uncertainty. So, the scientific and programmatic impacts of this project are the same as W11_geophys. The main effort related to w12c_earthuq is the preparation to transition to large runs with a resolution down to 2s. We already report the work done in the report for w11_geophys. Such resolution requires meshes with 10 billions elements with a size of about 5km and a few thousands of compute nodes. First tests on mustang have revealed that the I/O part of the code need to be reviewed because it opens too many files in its current version.

58 GEOSCIENCES↗

Uncertainties in Atomic Data and Their Propagation Through Spectral Models. I.

We present a method for computing uncertainties in spectral models, i.e., level populations, line emissivities, and emission line ratios, based upon the propagation of uncertainties originating from atomic data.We provide analytic expressions, in the form of linear sets of algebraic equations, for the coupled uncertainties among all levels. These equations can be solved efficiently for any set of physical conditions and uncertainties in the atomic data. We illustrate our method applied to spectral models of Oiii and Fe ii and discuss the impact of the uncertainties on atomic systems under different physical conditions. As to intrinsic uncertainties in theoretical atomic data, we propose that these uncertainties can be estimated from the dispersion in the results from various independent calculations. This technique provides excellent results for the uncertainties in A-values of forbidden transitions in [Fe ii]. Key words: atomic data - atomic processes - line: formation - methods: data analysis - molecular data - molecular processes - techniques: spectroscopic

linear sets↗

Statistical inference of anomalous thermal transport with uncertainty quantification for interpretive 2D SOL models

The critical task of inferring anomalous cross-field transport coefficients is addressed in simulations of boundary plasmas with fluid models. A workflow for parameter inference in the UEDGE fluid code is developed using Bayesian optimization with parallelized sampling and integrated uncertainty quantification. In this workflow, transport coefficients are inferred by maximizing their posterior probability distribution, which is generally multidimensional and non-Gaussian. Uncertainty quantification is integrated throughout the optimization within the Bayesian framework that combines diagnostic uncertainties and model limitations. As a concrete example, we infer the anomalous electron thermal diffusivity $\chi_\perp$ from an interpretive 2D model describing electron heat transport in the conduction-limited region with radiative power loss. The workflow is first benchmarked against synthetic data and then tested on H-, L-, and I-mode discharges to match their midplane temperature and divertor heat flux profiles. We demonstrate that the workflow efficiently infers diffusivity and its associated uncertainty, generating 2D profiles that match 1D measurements. Future efforts will focus on incorporating more complicated fluid models and analyzing transport coefficients inferred from a large database of experimental results.

Bayesian optimization↗

Data-Driven Modeling and Correction of Vehicle Dynamics

We develop a data-driven framework for learning and correcting nonautonomous vehicle dynamics. Physics-based vehicle models are often simplified for tractability and therefore exhibit inherent model-form uncertainty, motivating the need for data-driven correction. Moreover, nonautonomous dynamics are governed by time-dependent control inputs, which pose challenges in learning predictive models directly from temporal snapshot data. To address these, we reformulate the vehicle dynamics via a local parameterization of the time-dependent inputs, yielding a modified system composed ofa sequence of local parametric dynamical systems. Here, we approximate these parametric systems using two complementary approaches. First, we employ the dimension reduction and interpolation in parameter space (DRIPS) methodology to construct efficient linear surrogate models, equipped with lifted observable spaces and manifold-based operator interpolation. This enables data-efficient learning of vehicle models whose dynamics admit accurate linear representations in the lifted spaces. Second, for more strongly nonlinear systems, we employ flow map learning (FML), a deep neural network (DNN) approach that approximates the parametric evolution map without requiring special treatment of nonlinearities. We further extend FML with a transfer-learning-based model correction procedure, enabling the correction of misspecified prior models using only a sparse set of high-fidelity or experimental measurements, without assuming a prescribed form for the correction term. Through a suite of numerical experiments on unicycle, simplified bicycle, and slip-based bicycle models, we demonstrate that DRIPS offers robust and highly data-efficient learning of nonautonomous vehicle dynamics, while FML provides expressive nonlinear modeling and effective correction of model-form errors under severe data scarcity.

data-driven modeling↗

Coupling among Microbial Communities, Biogeochemistry, and Mineralogy across Biogeochemical Facies

Physical properties of sediments are commonly used to define subsurface lithofacies and these same physical properties influence subsurface microbial communities. This suggests an (unexploited) opportunity to use the spatial distribution of facies to predict spatial variation in biogeochemically relevant microbial attributes. Here, we characterize three biogeochemical facies—oxidized, reduced, and transition—within one lithofacies and elucidate relationships among facies features and microbial community biomass, diversity, and community composition. Consistent with previous observations of biogeochemical hotspots at environmental transition zones, we find elevated biomass within a biogeochemical facies that occurred at the transition between oxidized and reduced biogeochemical facies. Microbial diversity—the number of microbial taxa—was lower within the reduced facies and was well-explained by a combination of pH and mineralogy. Null modeling revealed that microbial community composition was influenced by ecological selection imposed by redox state and mineralogy, possibly due to effects on nutrient availability or transport. As an illustrative case, we predict microbial biomass concentration across a three-dimensional spatial domain by coupling the spatial distribution of subsurface biogeochemical facies with biomass-facies relationships revealed here. We expect that merging such an approach with hydro-biogeochemical models will provide important constraints on simulated dynamics, thereby reducing uncertainty in model predictions.

Stegen, James C.↗

Probabilistic Power Consumption Modeling for Commercial Buildings Using Logistic Regression Markov Chain

The total energy consumed by buildings takes up to 40% of U.S. energy use, in which a large portion is contributed by commercial buildings. Building performance optimization is desirable but requires accurate building models with uncertainties taken into account. This paper proposes a novel probabilistic modeling method using Logistic Regression Markov Chain (LRMC). The LRMC model enhances the performance of traditional Markov Chain (MC) models by adopting time-variant transition matrices calibrated using logistic regression with exogenous inputs. Compared with existing building models, the proposed model produces accurate multi-step modeling results with full probability distribution. The proposed probabilistic building model is tested using actual commercial building measurements and modeling performance is evaluated with two probabilisitc metrics. The results show that the LRMC model has higher accuracy than traditional MC model and Logistic Regression (LR) model in that it yields lower error scores under both evaluation metrics.

Building modeling↗

Hierarchical Modeling and Statistical Calibration for Photometric Redshifts

The cosmological exploitation of modern photometric galaxy surveys requires both accurate (unbiased) and precise (narrow) redshift probability distributions derived from broadband photometry. Existing methodologies do not meet these requirements. Standard template fitting delivers interpretable models and errors, but lacks the flexibility to learn inaccuracies in the observed photometry or spectral templates. Machine learning addresses those issues, but requires representative training data, and the resulting models and uncertainties cannot be interpreted in the context of a physical model or outside of the training data. We present a hierarchical modeling approach simultaneously addressing the issues of flexibility, interpretability, and generalization. It combines template fitting with flexible (machine-learning-like) models to correct the spectral templates, model their redshift distributions, and recalibrate the photometric observations. By optimizing the full posterior distribution of the model and solving for its (thousands of) parameters, one can perform a global statistical calibration of the data and the spectral energy distribution (SED) model. We apply this approach to the public Dark Energy Survey Science Verification data and show that it provides more accurate and compact redshift posterior distributions than existing methods, as well as insights into residual photometric and SED systematics. Here, the model is causal and makes predictions for future data (e.g., additional photometric bandpasses), and its internal parameters and components are interpretable. This approach does not formally require the training data to be complete or representative; in principle, it can even work in regimes in which few or no spectroscopic redshifts are available.

79 ASTRONOMY AND ASTROPHYSICS↗

The North American Multi-Model Ensemble (NMME): Phase-1 Seasonal to Interannual Prediction, Phase-2 Toward Developing Intra-Seasonal Prediction

The recent US National Academies report "Assessment of Intraseasonal to Interannual Climate Prediction and Predictability" was unequivocal in recommending the need for the development of a North American Multi-Model Ensemble (NMME) operational predictive capability. Indeed, this effort is required to meet the specific tailored regional prediction and decision support needs of a large community of climate information users. The multi-model ensemble approach has proven extremely effective at quantifying prediction uncertainty due to uncertainty in model formulation, and has proven to produce better prediction quality (on average) then any single model ensemble. This multi-model approach is the basis for several international collaborative prediction research efforts, an operational European system and there are numerous examples of how this multi-model ensemble approach yields superior forecasts compared to any single model. Based on two NOAA Climate Test Bed (CTB) NMME workshops (February 18, and April 8, 2011) a collaborative and coordinated implementation strategy for a NMME prediction system has been developed and is currently delivering real-time seasonal-to-interannual predictions on the NOAA Climate Prediction Center (CPC) operational schedule. The hindcast and real-time prediction data is readily available (e.g., http://iridl.ldeo.columbia.edu/SOURCES/.Models/.NMME/) and in graphical format from CPC (http://origin.cpc.ncep.noaa.gov/products/people/wd51yf/NMME/index.html). Moreover, the NMME forecast are already currently being used as guidance for operational forecasters. This paper describes the new NMME effort, presents an overview of the multi-model forecast quality, and the complementary skill associated with individual models.

NOAA CPC↗

Nonlinear Unsteady Aerodynamic Modeling Using Empirical Orthogonal Functions

Empirical orthogonal function modeling is explained and applied to identify compact discrete-time nonlinear unsteady aerodynamic models from data generated by an unsteady three-dimensional compressible Navier-Stokes flow solver for an airfoil undergoing various pitching motions. Model structures, model parameter estimates, and model parameter uncertainty estimates for nondimensional lift, drag, and pitching moment coefficient models were determined autonomously and directly from the data. Prediction tests using data that were not used in the modeling process showed that the identified models exhibited excellent prediction capability, which is a strong indicator of an accurate model.

empirical↗

UNCERTAINTIES IN ATOMIC DATA AND THEIR PROPAGATION THROUGH SPECTRAL MODELS. I

We present a method for computing uncertainties in spectral models, i.e., level populations, line emissivities, and emission line ratios, based upon the propagation of uncertainties originating from atomic data. We provide analytic expressions, in the form of linear sets of algebraic equations, for the coupled uncertainties among all levels. These equations can be solved efficiently for any set of physical conditions and uncertainties in the atomic data. We illustrate our method applied to spectral models of O III and Fe II and discuss the impact of the uncertainties on atomic systems under different physical conditions. As to intrinsic uncertainties in theoretical atomic data, we propose that these uncertainties can be estimated from the dispersion in the results from various independent calculations. This technique provides excellent results for the uncertainties in A-values of forbidden transitions in [Fe II].

79 ASTRONOMY AND ASTROPHYSICS↗