Search NASA⌕ Search

SEARCH · Search NASA

Results for “Model Uncertainty”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,765 records · Page 98

The optimization of model ensemble composition and size can enhance the robustness of crop yield projections

Linked climate and crop simulation models are widely used to assess the impact of climate change on agriculture. However, it is unclear how ensemble configurations (model composition and size) influence crop yield projections and uncertainty. Here, we investigate the influences of ensemble configurations on crop yield projections and modeling uncertainty from Global Gridded Crop Models and Global Climate Models under future climate change. We performed a cluster analysis to identify distinct groups of ensemble members based on their projected outcomes, revealing unique patterns in crop yield projections and corresponding uncertainty levels, particularly for wheat and soybean. Furthermore, our findings suggest that approximately six Global Gridded Crop Models and 10 Global Climate Models are sufficient to capture modeling uncertainty, while a cluster-based selection of 3-4 Global Gridded Crop Models effectively represents the full ensemble. The contribution of individual Global Gridded Crop Models to overall uncertainty varies depending on region and crop type, emphasizing the importance of considering the impact of specific models when selecting models for local-scale applications. Our results emphasize the importance of model composition and ensemble size in identifying the primary sources of uncertainty in crop yield projections, offering valuable guidance for optimizing ensemble configurations in climate-crop modeling studies tailored to specific applications.

Agriculture↗

Application of Bound-to-Bound Data Collaboration approach for development and uncertainty quantification of a reduced char combustion model

The development of efficient industrial oxy-coal boilers can be significantly aided by Computational Fluid Dynamics (CFD) tools, as far as fidelity in modeling coal combustion is also complemented by feasible computational costs. Reduced and predictive models are the most suitable for this application scale. Reduced models feature predictivity when they are validated against a broad range of experiments and targeted by Uncertainty Quantification (UQ) procedures. This work proposes a numerical procedure that uses Bound-to-Bound Data Collaboration (B2B-DC) to derive a reduced char combustion model describing transport phenomena and reactions between char carbon and O 2 , CO 2 and H 2 O, in both conventional and oxy-conditions. The approach determines the consistency between a numerical model and an experimental dataset. The latter is made up of the experiments carried out in an optically accessible laminar entrained flow reactor, operated by Sandia National Laboratories. The procedure follows five steps towards predictive modeling capability, namely: quantification of the uncertainty in the experiments, via instrument verification and modeling; development of a physics model and continuous improvement of its fidelity, via model-form uncertainty; identification of the uncertain and most sensitive parameters and of their prior bounds; sampling of the initial uncertain parameter space and training of a surrogate model; validation of the physics model via inference from the data. The last step, also known as inverse problem, is performed by applying the Bound-to-Bound Data Collaboration approach. A char combustion model is found consistent with the experimental data and its validity stands for conventional and oxy-combustion conditions. It accounts for heterogeneous reactions at the particle surface, mass transport of species in the particle boundary layer, pore diffusion and surface area changes. The consistent reduced model overcomes the differences in mass transport and kinetics observed in the experimental campaign. In conclusion, a reduction of the initial degree of uncertainty in both model and experiments is achieved.

42 ENGINEERING↗

Parameter Estimation and Uncertainty Quantification for Systems Biology Models

Mathematical models can provide quantitative insights into immunoreceptor signaling, and other biological processes, but require parameterization and uncertainty quantification before reliable predictions become possible. We review currently available methods and software tools to address these problems. We consider gradient-based and gradient-free methods for point estimation of parameter values, and methods of profile likelihood, bootstrapping, and Bayesian inference for uncertainty quantification. We consider recent and potential future applications of these methods to systems-level modeling of immune-related phenomena.

59 BASIC BIOLOGICAL SCIENCES↗

Quantifying physical parameterization uncertainties associated with land-atmosphere interactions in the WRF model over Amazon

The Weather Research and Forecasting (WRF) model can be used to diagnose regional land-atmosphere (L-A) coupling strength in the absence of sufficient observations but subjected to uncertainties associated with model physical parameterizations. In this study, we propose a framework to quantify and reduce model physical parameterization uncertainties associated with surface fluxes and L-A coupling. An ensemble of WRF simulations with different physical schemes is used to simulate surface fluxes and land-atmosphere coupling strength over the Amazon region. The physical parameterizations investigated include cloud microphysics (MP), land surface processes (LSM), planetary boundary layer (PBL), surface layer (SL), and cumulus (CU). We perform 120 ensemble simulations using the WRF model and different combinations of six MPs, three LSMs, six PBLs and SLs and three CUs. The measurements from the GoAMAZON field campaign and satellite data are used to evaluate model performance. A Multi-way analysis of variance (ANOVA) approach is applied to quantify the relative importance of different physics processes on L-A coupling. The Tukey’s test is used to sort schemes that have no significant differences into one group. The suite of physics that result in the best simulations of the corresponding variables are selected based on the Taylor skill score. Results show that the relative importance of processes and their interaction vary with the variables of interest. For example, CU was the most important process in modulating soil moisture, 2 m-humidity, latent heat, and net radiation. LSM showed dominant effects on 2 m-temperature and also has the largest impact on sensible heat and the lifting condensation level. The best physical parameterization ensembles show much narrower ranges of the variables of interest than the priori ensemble. Results of this study show the roles of different physical processes in modulating L-A interactions, quantify model uncertainties from physical processes, and provide insights for improving the model physics parameterizations.

Wang, Chen↗

High-resolution hourly surrogate modeling framework for physics-based large-scale building stock modeling

Surrogate modeling can play a key role in reducing high computational burdens for large-scale physics-based modeling and uncertainty quantification. With the rapid development of large-scale building stock energy modeling, surrogate modeling has also begun to be widely applied in this field; however, most existing surrogate models lack hourly time resolution for regional-scale modeling, which is essential for understanding building demand profiles and grid impacts. Further, there is generally a lack of necessary data and feature engineering frameworks specific to building modeling for efficiently managing large datasets and complex computations. Furthermore, this paper proposes a modeling framework for large-scale (city-/region-scale), high-resolution, high-fidelity surrogate building stock energy models. Our developed framework consists of six modules: (1) building stock energy modeling (ComStock TM and ResStock TM ), (2) data engineering for large simulation data, (3) high performance computing workflow, (4) feature engineering, (5) machine learning model development, and (6) model performance evaluation. Two case studies apply the developed framework in both residential and commercial building stock analysis to demonstrate its computational efficiency and surrogate modeling accuracies. Results show that surrogate models, when efficiently trained using the HPC workflow module, reach a high level of modeling accuracy for two case studies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Analysis of Uncertainty Impacts on Emissions and Fuel Economy Evaluation for Chassis Dynamometer Testing

This study illustrates a methodology for quantifying the uncertainties encountered in the measurement of tailpipe emissions and in the fuel consumption measurements for light-duty conventional vehicles tested on a four-wheel drive chassis dynamometer. The study leverages high-fidelity experimental data collected over three standard drive cycles, UDDS, HWY and US06, intended to simulate a wide range of operating conditions. Here, a method is developed to estimate the measurement uncertainties in fuel consumption for a test cycle, which occur due to the accumulation of measurement uncertainties propagated through the system. The uncertainty determination model uses statistical analysis and standard propagation techniques to evaluate and combine the uncertainties introduced from various sources (including the vehicle, chassis dynamometer, driver, and instrumentation). The analysis also examines three different experimental methods for determining the fuel consumption: 1) carbon mass balance, 2) volumetric fuel scale and 3) gravimetric fuel scale, and takes into consideration the properties of the instrumentation used. The results show that the most significant influence on the determination of the emissions comes from the concentration measurement, and similarly the biggest impact on the total fuel consumption uncertainty comes from the uncertainty in the determination of the carbon dioxide mass, due to the large presence of this pollutant in the overall emissions. It was found that the fuel consumption uncertainties are in the range of ±1-2% for all three methods analyzed, with the lowest values being obtained for measurements performed using the gravimetric method for all three drive cycles considered.

33 ADVANCED PROPULSION SYSTEMS↗

Autonomous Frequency-Domain Indentification

Test and data-processing system determines plant models and uncertainties. Integrated system of methods, digital signal-processing, and algorithms identifies parametric model of large, flexible structures. Experiments in development of system conducted on laboratory model intended to represent large space antenna or flexible spacecraft. Also applicable to many terrestrial systems, robust control of dynamic plants and processes, robust control of systems about which knowledge uncertain or incomplete, decentralized control, and knowledge-based control systems.

Mettler, Edward↗

Derivation of satellite wind model functions using operational surface wind analyses - An altimeter example

One year of global surface wind products from multiple operational numerical weather prediction (NWP) forecast/analysis systems are used as comparison data to derive an empirical wind speed model function for the Geosat altimeter. The resulting model function is nearly identical to the modified Chelton-Wentz model for wind speeds from 4.5 to 15 m/s. Highly skewed distributions at low wind speeds are consistent with specular reflections and antenna mispointing errors hypothesized by others on the basis of extremely limited data. Mesoscale variability in the wind field and synoptic scale errors in the NWP products are shown to account for about 30 percent of the observed scatter of sigma(0) at each wind speed. The remaining scatter is largest at low winds, and decreases to a nearly constant value of about 12 percent at speeds greater than 7 m/s. Model function uncertainty expressed more traditionally in units of wind speed is examined for historical model functions as well as the present NWP-based model. The historical models have significant biases at high wind speeds owing to the lack of comparison in situ data used in their construction. The present study demonstrates that modern operational NWP surface wind products are sufficiently accurate to allow development of fully empirical model functions and associated error analyses.

Freilich, Michael H.↗

Long-term impact of light- and elevated temperature-induced degradation on photovoltaic arrays

Low levelized cost of electricity (LCOE) has been identified as critical for widespread adoption of photovoltaics (PV) without subsidies. Maintaining decades-long high-energy production is often an under-recognized opportunity in meeting cost goals because component lifetimes are not fully quantified at the time of manufacture. Whereas certain standardized tests minimize risk of early failure, there is little guidance to quantitatively predict degradation (or lack thereof) over decades, based on accelerated tests. In this article, we move toward bridging the understanding between indoor accelerated tests and outdoor performance data, with the goal of predicting energy yield with enough accuracy to inform financial decisions. Light- and elevated temperature-induced degradation (LETID) in p-type Si modules is analyzed in terms of impact on long-term module performance and thus LCOE. A method to predict the progression of LETID, using fixed kinetic constants and a numerical solution to the basic reaction rate equations, is detailed. Predictions are compared against both published data and that new to this study. These data include both indoor accelerated tests and fielded modules. We use the results in financial models to derive LCOE of modules in different climates with varying amounts of LETID, including uncertainty. Cost models based on the predictions indicate that LETID has a significant and climate-dependent impact on LCOE. Finally, we show that - even given the uncertainties identified in the study - these financial calculations can provide useful guidance to quantify risk based on accelerated test results. The analysis serves as an example of developing a predictive approach to PV reliability using physics of failure.

14 SOLAR ENERGY↗

Fuel performance uncertainty quantification and sensitivity analysis in the presence of epistemic and aleatoric sources of uncertainties

Fuel performance modeling and simulation includes many uncertain parameters from models to boundary conditions, manufacturing parameters and material properties. These parameters exhibit large uncertainties and can have an epistemic or aleatoric nature, something that renders fuel performance code-to-code and code-to-measurements comparisons for complex phenomena such as the pellet cladding mechanical interaction (PCMI) very challenging. Additionally, PCMI and other complex phenomena found in fuel performance modeling and simulation induce strong discontinuities and non-linearities that can render difficult to extract meaningful conclusions form uncertainty quantification (UQ) and sensitivity analysis (SA) studies. In this work, we develop and apply a consistent treatment of epistemic and aleatoric uncertainties for both UQ and SA in fuel performance calculations and use historical benchmark-quality measurement data to demonstrate it. More specifically, the developed methodology is applied to the OECD/NEA Multi-physics Pellet Cladding Mechanical Interaction Validation benchmark. A cold ramp test leading to PCMI is modeled. Two measured quantities of interest are considered: the cladding axial elongation during the irradiations and the cladding outer diameter after the cold ramp. The fuel performance code used to perform the simulation is FAST. The developed methodology involves various steps including a Morris screening to decrease the number of uncertain inputs, a nested loop approach for propagating the epistemic and aleatoric sources of uncertainties, and a global SA using Sobol indices. The obtained results indicate that the fuel and cladding thermal conductivities as well as the cladding outer diameter uncertainties are the three inputs having the largest impact on the measured quantities. More importantly, it was found that the epistemic uncertainties can have a significant impact on the measured quantities and can affect the outcome of the global sensitivity analysis.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

SU-F-T-316: A Model to Deal with Dosimetric and Delivery Uncertainties in Radiotherapy Treatment Planning

Purpose The conventional way of dealing with uncertainties resulting from dose calculation or beam delivery in IMRT, is to do verification measurements for the plan in question. Here we present an alternative based on recommendations given in the AAPM 142 report and treatment specific parameters that model the uncertainties for the plan delivery. Methods Basis of the model is the assignment of uncertainty parameters to all segment fields or control point sequences of a plan. The given field shape is analyzed for complexity, dose rate, number of MU, field size related output as well as factors for in/out field position and penumbra regions. Together with depth related uncertainties, a 3D matrix is generated by a projection algorithm. Patient anatomy is included as uncertainty CT data set as well. Therefore, object density is classified in 4 categories close to water, lung, bone and gradient regions with additional uncertainties. The result is then exported as a DICOM dose file by the software tool (written in IDL, Exelis), having the given resolution and target point. Results Uncertainty matrixes for several patient cases have been calculated and compared side by side in the planning system. The result is not quite always intuitive but it clearly indicates high and low uncertainties related to OARs and target volumes as well as to measured gamma distributions.ConclusionThe imported uncertainty datasets may help the treatment planner to understand the complexity of the treatment plan. He then might decide to change the plan to produce a more suited uncertainty distribution, e.g. by changing the beam angles the high uncertainty spots can be influenced or try to use another treatment setup, resulting in a plan with lower uncertainties. A next step could be to include such a model into the optimization algorithm to add a new dose uncertainty constraint.

60 APPLIED LIFE SCIENCES↗

Uranium particle age dating, aggregation, and model age best estimators

We present important aspects of uranium particle age dating by Large-Geometry Secondary Ion Mass Spectrometry (LG-SIMS) that can introduce bias and increase model age uncertainties, especially for small, young, and/or low-enriched particles. This metrology is important for applications related to International Nuclear Safeguards. We explore influential factors related to model age estimation, including the effects of evolving surface chemistry on inter-element measurements of particles (e.g., Th and U), detector background, and aggregation methods using simulated and actual particle samples. We introduce a new model age estimator, called “mid68”, that supplements 95% confidence intervals, providing a “best estimate” and uncertainty about the most likely age. The mid68 estimator can be calculated using the Feldman and Cousins method or Bayesian methods and provides a value with a symmetric uncertainty that can be used for calculations and approximate aggregation of processed model age values when the raw data and correction factors are not available. For particles yielding low 230 Th counts amidst nonzero detector background, their underlying model age probability distributions are asymmetric, so the mid68 estimator provides additional robust information regarding the underlying model age likelihood. This study provides a comprehensive and timely examination of critical aspects of uranium particle age dating as more laboratories establish particle chronometry capabilities.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Planning Satellite Swarm Measurements for Climate Models: Comparing Dynamic Constraint Processing and MILP Methods

We present D-SHIELD, a challenging climate science application to plan coordinated measurements (observations) for a constellation of satellites, each containing two different sensors, each with 61 pointing angle options. The L-band and P-band radar sensors collect data fed into a soil moisture model which tracks and predicts soil moisture across 1.67 million Ground Positions (GP). Soil moisture is an important predictor of wildfires, and then a predictor of floods, landslides and debris flow after a fire. Each measurement covers multiple GP due to the sensor footprint. Each GP has a "model error" which represents the uncertainty of the the soil moisture state prediction. Model error changes at different rates for each GP as the time since last observation increases and after significant events like rain. The planner's goal is to select measurements which maximize soil moisture model improvement (reduce model uncertainty). This problem is combinatorically explosive, involving many degrees of freedom for planner choices. Good domain heuristics can find solutions within a reasonable time for our application needs but cannot be proven optimal. In this paper we compare two different planning approaches to this problem: Dynamic Constraint Processing (DCP) and Mixed Integer Linear Programming (MILP). We match inputs and metrics for both DCP and MILP algorithms to enable a direct apples-to-apples comparison. We demonstrate and discuss the trades between DCP flexibility and performance vs. MILP's promise of provable optimality.

Rich Levinson↗

Bayesian calibration and uncertainty quantification of a rate-dependent cohesive zone model for polymer interfaces

In this work we present a rate-dependent cohesive zone model for the fracture of polymeric interfaces and performs a Bayesian calibration, an uncertainty quantification, and a sensitivity analysis for the model. The proposed cohesive zone model accounts for both reversible elastic and irreversible rate-dependent separation sliding deformation at the interface. The viscous dissipation due to the irreversible opening at the interface is modeled using elastic-viscoplastic kinematics that incorporates the effects of strain rate. Inverse calibration of parameters for such complex models through trial and error is challenging due to the large number of parameters of the model. Moreover, the calibrated parameter values are often non-unique and uncertain when the available experimental data is limited. To tackle this challenge, we employ a Bayesian calibration approach to identify parameters from experimental data, the resulting parameters significantly enhance the accuracy of the model. To quantify the uncertainty associated with the inverse parameter estimation, a modular Bayesian approach is employed to calibrate the unknown model parameters, accounting for the parameter uncertainty of the cohesive zone model. The advantages of the Bayesian calibration over a deterministic parameter fit are demonstrated. Further, to quantify the model uncertainties, such as incorrect assumptions or missing physics, a discrepancy function is introduced, which significantly improves the model’s prediction. Finally, the total uncertainty of the model is quantified in a predictive setting. A sensitivity analysis is performed to assess how changes in the input variables of the model affect the peak load, facilitating the identification of a concise set of highly influential parameters. The present approach can be used for calibration and uncertainty quantification for other complex computational mechanics models. It should also facilitate the designing of interface materials under uncertainty.

42 ENGINEERING↗

Updates to the Regional Seismic Travel Time (RSTT) Model: 2. Path-dependent Travel-time Uncertainty

Abstract The regional seismic travel time (RSTT) model and software were developed to improve travel-time prediction accuracy by accounting for three-dimensional crust and upper mantle structure. Travel-time uncertainty estimates are used in the process of associating seismic phases to events and to accurately calculate location uncertainty bounds (i.e. event location error ellipses). We improve on the current distance-dependent uncertainty parameterization for RSTT using a random effects model to estimate slowness (inverse velocity) uncertainty as a mean squared error for each model parameter. The random effects model separates the error between observed slowness and model predicted slowness into bias and random components. The path-specific travel-time uncertainty is calculated by integrating these mean squared errors along a seismic-phase ray path. We demonstrate that event location error ellipses computed for a 90% coverage ellipse metric (used by the Comprehensive Nuclear-Test-Ban Treaty Organization International Data Centre (IDC)), and using the path-specific travel-time uncertainty approach, are more representative (median 82.5% ellipse percentage) of true location error than error ellipses computed using distance-dependent travel-time uncertainties (median 70.1%). We also demonstrate measurable improvement in location uncertainties using the RSTT method compared to the current station correction approach used at the IDC (median 74.3% coverage ellipse).

58 GEOSCIENCES↗

THE PROPAGATION OF UNCERTAINTIES IN STELLAR POPULATION SYNTHESIS MODELING. II. THE CHALLENGE OF COMPARING GALAXY EVOLUTION MODELS TO OBSERVATIONS

Models for the formation and evolution of galaxies readily predict physical properties such as star formation rates, metal-enrichment histories, and, increasingly, gas and dust content of synthetic galaxies. Such predictions are frequently compared to the spectral energy distributions of observed galaxies via the stellar population synthesis (SPS) technique. Substantial uncertainties in SPS exist, and yet their relevance to the task of comparing galaxy evolution models to observations has received little attention. In the present work, we begin to address this issue by investigating the importance of uncertainties in stellar evolution, the initial stellar mass function (IMF), and dust and interstellar medium (ISM) properties on the translation from models to observations. We demonstrate that these uncertainties translate into substantial uncertainties in the ultraviolet, optical, and near-infrared colors of synthetic galaxies. Aspects that carry significant uncertainties include the logarithmic slope of the IMF above 1 M{sub sun}, dust attenuation law, molecular cloud disruption timescale, clumpiness of the ISM, fraction of unobscured starlight, and treatment of advanced stages of stellar evolution including blue stragglers, the horizontal branch, and the thermally pulsating asymptotic giant branch. The interpretation of the resulting uncertainties in the derived colors is highly non-trivial because many of the uncertainties are likely systematic, and possibly correlated with the physical properties of galaxies. We therefore urge caution when comparing models to observations.

79 ASTRONOMY AND ASTROPHYSICS↗

K-Long Facility for JLab and its Scientific Potential

Our main interest in creating a secondary high-quality KL-beam is to investigate hyperon spectroscopy through both formation and production processes. We propose to study two-body reactions induced by the KL-beam on the proton target. The experiment should measure both differential cross sections and self-analyzed polarizations of the produced Λ-, Σ-, and Ξ-hyperons using the GlueX detector at the Jefferson Lab Hall D. New data will greatly constrain partial-wave analysis and reduce modeldependent uncertainties in the extraction of strange resonance properties, providing a new benchmark for comparisons with QCD-inspired models and LQCD calculations. The measurements will span c.m. cos θ from -0.95 to 0.95 in c.m. range above W = 1490 MeV and up to 4000 MeV.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗