Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,477 records · Page 82

Instrument Drift Uncertainties and the Long-Term TOMS/SBUV Total Ozone Record

Long-term climate records from satellites are often constructed from the measurements of a sequence of instruments launched at different times. Each of these instruments is calibrated prior to launch. After launch they are subjected to potential offsets and slow drifts in calibration. We illustrate these issues in the construction of a merged total ozone record from two TOMS and three SBUV instruments. This record extends from late 1978 through the present. The question is "How good are these records?". We have examined the uncertainty in determining the relative calibration of two instruments during an overlap period in their measurements. When comparing a TOMS instrument, such as that on Nimbus 7, with an SBUV instrument, also on Nimbus 7, we find systematic differences and random differences. We have combined these findings with estimates of individual instrument drift into a monte- carlo uncertainty propagation model. We estimate an instrument drift uncertainty of a little larger than 1 percent per decade over the 25-year history of the TOMS/SBUV measurements. We make an independent estimate of the drift uncertainty in the ground-based network of total ozone measurements and find it to be of similar, but slightly smaller magnitude. The implications of these uncertainties for trend and recovery determination will be discussed.

Solarski, Richard S.↗

An Improved Analysis of Forest Carbon Dynamics using Data Assimilation

There are two broad approaches to quantifying landscape C dynamics - by measuring changes in C stocks over time, or by measuring fluxes of C directly. However, these data may be patchy, and have gaps or biases. An alternative approach to generating C budgets has been to use process-based models, constructed to simulate the key processes involved in C exchange. However, the process of model building is arguably subjective, and parameters may be poorly defined. This paper demonstrates why data assimilation (DA) techniques - which combine stock and flux observations with a dynamic model - improve estimates of, and provide insights into, ecosystem carbon (C) exchanges. We use an ensemble Kalman filter (EnKF) to link a series of measurements with a simple box model of C transformations. Measurements were collected at a young ponderosa pine stand in central Oregon over a 3-year period, and include eddy flux and soil C02 efflux data, litterfall collections, stem surveys, root and soil cores, and leaf area index data. The simple C model is a mass balance model with nine unknown parameters, tracking changes in C storage among five pools; foliar, wood and fine root pools in vegetation, and also fresh litter and soil organic matter (SOM) plus coarse woody debris pools. We nested the EnKF within an optimization routine to generate estimates from the data of the unknown parameters and the five initial conditions for the pools. The efficacy of the DA process can be judged by comparing the probability distributions of estimates produced with the EnKF analysis vs. those produced with reduced data or model alone. Using the model alone, estimated net ecosystem exchange of C (NEE)= -251 f 197g Cm-2 over the 3 years, compared with an estimate of -419 f 29gCm-2 when all observations were assimilated into the model. The uncertainty on daily measurements of NEE via eddy fluxes was estimated at 0.5gCm-2 day-1, but the uncertainty on assimilated estimates averaged 0.47 g Cm-2 day-1, and only exceeded 0.5gC m-2 day-1 on days where neither eddy flux nor soil efflux data were available. In generating C budgets, the assimilation process reduced the uncertainties associated with using data or model alone and the forecasts of NEE were statistically unbiased estimates. The results of the analysis emphasize the importance of time series as constraints. Occasional, rare measurements of stocks have limited use in constraining the estimates of other components of the C cycle. Long time series are particularly crucial for improving the analysis of pools with long time constants, such as SOM, woody biomass, and woody debris. Long-running forest stem surveys, and tree ring data, offer a rich resource that could be assimilated to provide an important constraint on C cycling of slow pools. For extending estimates of NEE across regions, DA can play a further important role, by assimilating remote-sensing data into the analysis of C cycles. We show, via sensitivity analysis, how assimilating an estimate of photosynthesis - which might be provided indirectly by remotely sensed data - improves the analysis of NEE.

Williams, Mathew↗

Stardust Interstellar Preliminary Examination X: Impact Speeds and Directions of Interstellar Grains on the Stardust Dust Collector

On the basis of an interstellar dust model compatible with Ulysses and Galileo observations, we calculate and predict the trajectories of interstellar dust (ISD) in the solar system and the distribution of the impact speeds, directions, and flux of ISD particles on the Stardust Interstellar Dust Collector during the two collection periods of the mission. We find that the expected impact velocities are generally low (less than 10 km per second) for particles with the ratio of the solar radiation pressure force to the solar gravitational force beta greater than 1, and that some of the particles will impact on the cometary side of the collector. If we assume astronomical silicates for particle material and a density of 2 grams per cubic centimeter, and use the Ulysses measurements and the ISD trajectory simulations, we conclude that the total number of (detectable) captured ISD particles may be on the order of 50. In companion papers in this volume, we report the discovery of three interstellar dust candidates in the Stardust aerogel tiles. The impact directions and speeds of these candidates are consistent with those calculated from our ISD propagation model, within the uncertainties of the model and of the observations.

interstellar↗

Modeling the Relationship Between Porosity and Permeability During Oxidation of Ablative Materials

The ablative materials used in thermal protection systems (TPS) undergo oxidation during atmospheric entry which leads to an in-depth change in both permeability and porosity. These properties have a significant affect on heat transfer in a TPS during entry. X-ray micro-tomography has provided 3D images capturing the micro-structure of TPS materials. In this study, we use micro-tomography based simulations to create high-fidelity models relating permeability to porosity during oxidation of FiberForm, the carbon fiber preform of the Phenolic Impregnated Carbon Ablator (PICA) often used as a TPS material. The goal of this study is to inform full-scale models and reduce uncertainty in TPS modeling.

Ablativ↗

Process for computing geometric perturbations for probabilistic analysis

A method for computing geometric perturbations for probabilistic analysis. The probabilistic analysis is based on finite element modeling, in which uncertainties in the modeled system are represented by changes in the nominal geometry of the model, referred to as "perturbations". These changes are accomplished using displacement vectors, which are computed for each node of a region of interest and are based on mean-value coordinate calculations.

97 MATHEMATICS AND COMPUTING↗

Uncertainty Quantification in Reduced Order Modeling

Presentation describes research to analyze radiation transport using reduced order modeling as an alternate approach to Monte Carlo-based methods, with a goal of developing a variance reduction method that increases computing efficiency.

97 MATHEMATICS AND COMPUTING↗

Application and Evaluation of a Snowmelt Runoff Model in the Tamor River Basin, Eastern Himalaya Using a Markov Chain Monte Carlo (MCMC) Data Assimilation Approach

Previous studies have drawn attention to substantial hydrological changes taking place in mountainous watersheds where hydrology is dominated by cryospheric processes. Modelling is an important tool for understanding these changes but is particularly challenging in mountainous terrain owing to scarcity of ground observations and uncertainty of model parameters across space and time. This study utilizes a Markov Chain Monte Carlo data assimilation approach to examine and evaluate the performance of a conceptual, degree-day snowmelt runoff model applied in the Tamor River basin in the eastern Nepalese Himalaya. The snowmelt runoff model is calibrated using daily streamflow from 2002 to 2006 with fairly high accuracy (average Nash-Sutcliffe metric approx. 0.84, annual volume bias <3%). The Markov Chain Monte Carlo approach constrains the parameters to which the model is most sensitive (e.g. lapse rate and recession coefficient) and maximizes model fit and performance. Model simulated streamflow using an interpolated precipitation data set decreases the fractional contribution from rainfall compared with simulations using observed station precipitation. The average snowmelt contribution to total runoff in the Tamor River basin for the 2002-2006 period is estimated to be 29.7+/-2.9% (which includes 4.2+/-0.9% from snowfall that promptly melts), whereas 70.3+/-2.6% is attributed to contributions from rainfall. On average, the elevation zone in the 4000-5500m range contributes the most to basin runoff, averaging 56.9+/-3.6% of all snowmelt input and 28.9+/-1.1% of all rainfall input to runoff. Model simulated streamflow using an interpolated precipitation data set decreases the fractional contribution from rainfall versus snowmelt compared with simulations using observed station precipitation. Model experiments indicate that the hydrograph itself does not constrain estimates of snowmelt versus rainfall contributions to total outflow but that this derives from the degree-day melting model. Lastly, we demonstrate that the data assimilation approach is useful for quantifying and reducing uncertainty related to model parameters and thus provides uncertainty bounds on snowmelt and rainfall contributions in such mountainous watersheds.

runoff↗

A high-performance workflow system for subsurface simulation

Subsurface modeling applications typically neglect uncertainty in the conceptual models, past or future scenarios, and attribute most or all uncertainty to errors in model parameters. In this contribution, uncertainty in technetium-99 transport in a heterogeneous, deep vadose zone is explored with respect to the conceptual model using a next generation user environment called Akuna. Akuna provides a range of tools to manage environmental modeling projects, from managing simulation data to visualizing results from high-performance computational simulators. Core toolsets accessible through the user interface include model setup, grid generation, parameter estimation, and uncertainty quantification. The BC Cribs site at Hanford in southeastern Washington State is used to demonstrate Akuna capabilities. At the BC Cribs site, conceptualization of the system is highly uncertain because only sparse information is available for the geologic conceptual model, the physical and chemical properties of the sediments, and the history of waste disposal operations. Using the Akuna toolset to perform an analysis of conservative solute transport, significant prediction uncertainty in simulated concentrations is demonstrated by conceptual model variation. This demonstrates that conceptual model uncertainty is an important consideration in sparse data environments such as BC Cribs. It is also demonstrated that Akuna and the underlying toolset provides an integrated modeling environment that streamlines model setup, parameter optimization, and uncertainty analyses for high-performance computing applications.

Akuna↗

Calculating Impacts of Energy Standards on Energy Demand in U.S. Buildings under Uncertainty with an Integrated Assessment Model: Technical Background Data

This report presents data and assumptions employed in an application of PNNL’s Global Change Assessment Model with a newly-developed Monte Carlo analysis capability. The model is used to analyze the impacts of more aggressive U.S. residential and commercial building-energy codes and equipment standards on energy consumption and energy service costs at the state level, explicitly recognizing uncertainty in technology effectiveness and cost, socioeconomics, presence or absence of carbon prices, and climate impacts on energy demand. The report provides a summary of how residential and commercial buildings are modeled, together with assumptions made for the distributions of state–level population, Gross Domestic Product (GDP) per worker, efficiency and cost of residential and commercial energy equipment by end use, and efficiency and cost of residential and commercial building shells. The cost and performance of equipment and of building shells are reported separately for current building and equipment efficiency standards and for more aggressive standards. The report also details assumptions concerning future improvements brought about by projected trends in technology.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Constraining Fossil Fuel CO2 Emissions from Urban Area Using OCO-2 Observations of Total Column CO2

Satellite observations of the total column dry-air CO2(XCO2) are expected to support the quantification and monitoring of fossil fuel CO2 (ffCO2) emissions from urban areas. We evaluate the utility of the Orbiting Carbon Observatory 2 (OCO-2) XCO2 retrievals to optimize whole-city emissions, using a Bayesian inversion system and high-resolution transport modeling. The uncertainties of constrained emissions related to transport model, satellite measurements, and local biospheric fluxes are quantified. For the first two uncertainty sources, we examine cities of different landscapes: “plume city” located in relatively flat terrain, represented by Riyadh and Cairo; “basin city” located in basin terrain, represented by Los Angeles (LA). The retrieved scaling factors of emissions and their uncertainties show prominent variabilities from track to track, due to the varying meteorological conditions and relative locations of the tracks transecting plumes. To explore the performance of multiple tracks in retrieving emissions, pseudo data experiments are carried out. The estimated least number of tracks required to constrain the total emissions for Riyadh (<10% uncertainty), Cairo (<10%), and LA (<5%) are 5, 8, and 7, respectively. Additionally, to evaluate the impact of biospheric fluxes on derivation of the ffXCO2 enhancements, we conduct simulations for Pearl River Delta metropolitan area. Significant fractions of local XCO2 enhancements associated with local biospheric XCO2 variations are shown, which potentially lead to biased estimates of ffCO2 emissions. We demonstrate that satellite measurements can be used to improve urban ffCO2 emissions with a sufficient amount of measurements and appropriate representations of the uncertainty components.

Xinxin Ye↗

Uncertainty Quantification in Atomistic Modeling of Metals and Its Effect on Mesoscale and Continuum Modeling: A Review

The design of next-generation alloys through the integrated computational materials engineering (ICME) approach relies on multiscale computer simulations to provide thermodynamic properties when experiments are difficult to conduct. Atomistic methods such as density functional theory (DFT) and molecular dynamics (MD) have been successful in predicting properties of never before studied compounds or phases. However, uncertainty quantification (UQ) of DFT and MD results is rarely reported due to computational and UQ methodology challenges. Over the past decade, studies that mitigate this gap have emerged. These advances are reviewed in the context of thermodynamic modeling and information exchange with mesoscale methods such as the phase-field method (PFM) and calculation of phase diagrams (CALPHAD). The importance of UQ is illustrated using properties of metals, with aluminum as an example, and highlighting deterministic, frequentist, and Bayesian methodologies. Finally, challenges facing routine uncertainty quantification and an outlook on addressing them are also presented.

36 MATERIALS SCIENCE↗

Context-aware learning of hierarchies of low-fidelity models for multi-fidelity uncertainty quantification

Multi-fidelity Monte Carlo methods leverage low-fidelity and surrogate models for variance reduction to make tractable uncertainty quantification even when numerically simulating the physical systems of interest with high-fidelity models is computationally expensive. This work proposes a context-aware multi-fidelity Monte Carlo method that optimally balances the costs of training low-fidelity models with the costs of Monte Carlo sampling. It generalizes the previously developed context-aware bi-fidelity Monte Carlo method to hierarchies of multiple models and to more general types of low-fidelity models. When training low-fidelity models, the proposed approach takes into account the context in which the learned low-fidelity models will be used, namely for variance reduction in Monte Carlo estimation, which allows it to find optimal trade-offs between training and sampling to minimize upper bounds of the mean-squared errors of the estimators for given computational budgets. This is in stark contrast to traditional surrogate modeling and model reduction techniques that construct low-fidelity models with the primary goal of approximating well the high-fidelity model outputs and typically ignore the context in which the learned models will be used in upstream tasks. Further, the proposed context-aware multi-fidelity Monte Carlo method applies to hierarchies of a wide range of types of low-fidelity models such as sparse-grid and deep-network models. Numerical experiments with the gyrokinetic simulation code Gene show speedups of up to two orders of magnitude compared to standard estimators when quantifying uncertainties in small-scale fluctuations in confined plasma in fusion reactors. This corresponds to a runtime reduction from 72 days to four hours on one node of the Lonestar6 supercomputer at the Texas Advanced Computing Center.

42 ENGINEERING↗

Characterizing uncertainty in Community Land Model version 5 hydrological applications in the United States

Abstract Land surface models such as the Community Land Model Version 5 (CLM5) are essential tools for simulating the behavior of the terrestrial system. Despite the extensive application of CLM5, limited attention has been paid to the underlying uncertainties associated with its hydrological parameters and how these uncertainties affect water resource applications. To address this long-standing issue, we use five meteorological datasets to conduct a comprehensive hydrological parameter uncertainty characterization of CLM5 over the hydroclimatic gradients of the conterminous United States. Key datasets produced from the uncertainty characterization experiment include: a benchmark dataset of CLM5 default hydrological performance, parameter sensitivities for 28 hydrological metrics, and large-ensemble outputs for CLM5 hydrological predictions. The presented datasets will assist CLM5 calibration and support broad applications, such as evaluating drought and flood vulnerabilities. The datasets can be used to identify the hydroclimatological conditions under which parametric uncertainties demonstrate substantial effects on hydrological predictions and clarify where further investigations are needed to understand how hydrological prediction uncertainties interact with other Earth system processes.

54 ENVIRONMENTAL SCIENCES↗

A Nonparametric Bayesian Framework for Short-Term Wind Power Probabilistic Forecast

To improve the energy system resilience and economic efficiency, the wind power as a renewable energy starts to be deeply integrated into smart power grids. However, the wind power forecast uncertainty brings operational challenges. In order to provide a reliable guidance on operational decisions, in this paper, we propose a short-term wind power probabilistic forecast. Specifically, to model the rich dynamic behaviors of underlying physical wind power stochastic process occurring in various meteorological conditions, we first introduce an infinite Markov switching autoregressive model. This nonparametric time series model can capture the important properties in the real world data to improve the prediction accuracy. Then, given finite historical data, the posterior distribution of flexible forecast model can correctly quantify the model estimation uncertainty. Built on it, we develop the posterior predictive distribution to rigorously quantify the overall forecasting uncertainty accounting for both inherent stochastic uncertainty and model estimation error. Furthermore, the proposed approach can provide accurate and reliable short-term wind power probabilistic forecast, which can be used to support smart power grids real-time risk management.

17 WIND ENERGY↗

Initial Land Use/Cover Distribution Substantially Affects Global Carbon and Local Temperature Projections in the Integrated Earth System Model

Initial land cover distribution varies among Earth system models, an uncertainty in initial conditions that can substantially affect carbon and climate projections. We use the integrated Earth System Model to show that a 3.9 M km2 difference in 2005 global forest area (9–14% of total forest area) generates uncertainties in initial atmospheric CO2 concentration, terrestrial carbon, and local temperature that propagate through a future simulation following the Representative Concentration Pathway 4.5. By 2095, the initial 6 ppmv uncertainty range increases to 9 ppmv and the initial 26 PgC uncertainty range in terrestrial carbon increases to 33 PgC. The initial uncertainty range in annual average local temperature of -0.74 to 0.96 °C persists throughout the future simulation, with a seasonal maximum in Dec-Jan-Feb. These results highlight the importance of accurately characterizing historical land use and land cover to reduce overall initial condition uncertainty.

Di Vittorio, Alan↗

Uncertainty quantification of calculated temperatures for advanced gas reactor fuel irradiation experiments

This paper presents the quantification of uncertainty of the calculated temperature data for the Advanced Gas Reactor (AGR) fuel irradiation experiments conducted in the Advanced Test Reactor at Idaho National Laboratory in support of the Advanced Reactor Technology Research and Development program. Recognizing uncertainties inherent in physics and thermal simulations of the AGR tests, the results of the numerical simulations are used in combination with statistical analysis methods to improve qualification of measured data. The temperature simulation data for AGR tests are also used for validation of the fission product transport and fuel performance simulation models. These crucial roles of the calculated fuel temperatures in ensuring achievement of the AGR experimental program objectives require accurate determination of the model temperature uncertainties. To quantify the uncertainty of AGR calculated temperatures, this study identifies and analyzes ABAQUS model parameters of potential importance to the AGR predicted fuel temperatures. The selection of input parameters for uncertainty quantification of the AGR calculated temperatures is based on the ranking of their influences on variation of temperature predictions. Thus, selected input parameters include those with high sensitivity and those with large uncertainty. Propagation of model parameter uncertainty and sensitivity is then used to quantify the overall uncertainty of AGR calculated temperatures. Expert judgment is used as the basis to specify the uncertainty range for selected input parameters. The input uncertainties are dynamic accounting for the effect of unplanned events and changes in thermal properties of capsule components over extended exposure to high temperature and fast neutron irradiation. The sensitivity analysis performed in this work went beyond the traditional local sensitivity. Using experimental design, analysis of pairwise interactions of model parameters was performed to establish sufficiency of the first-order (linear) expansion terms in constructing the response surface. To achieve completeness, uncertainty propagation made use of pairwise noise correlations of model parameters. Furthermore, time-dependent sensitivity over the test campaign duration was obtained using an interpolation scheme over the input parameter domain. This allows computation of uncertainty for the predicted peak fuel temperatures and the predicted graphite temperatures at TC locations over the whole AGR irradiation period.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

Uncertainty quantification in kinematic wave models

We developed a probabilistic approach to quantify parametric uncertainty in first-order hyperbolic conservation laws (kinematic wave equations). The approach relies on the derivation of a deterministic equation for the cumulative density function (CDF) of the system state, in which probabilistic descriptions (probability density functions or PDFs) of the system parameters and/or initial and boundary conditions serve as inputs. In contrast to PDF equations, which are often used in other contexts, CDF equations allow for straightforward and unambiguous determination of boundary conditions with respect to sample variables.The accuracy and robustness of solutions of the CDF equation for one such system, the Saint-Venant equations of river flows, were investigated via comparison with Monte Carlo simulations.

UQ, CDF methods, surface flow, kinematic wave, hyp↗

A Practical Statistical Model for Telecommunications Performance Uncertainty

A statistical method, the probability distribution method, is presented which will give the probability of link performance values. The advantages of a design control procedure are preserved and optimum use of the system capabilities is permitted by improving the accuracy and completeness of the system model.

Yuen, J. H.↗