Search NASA⌕ Search

SEARCH · Search NASA

Results for “modeling discrepancy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Parameter Estimation for Electrode Degradation: Learning in the Face of Model-Experiment Discrepancies

Use of physics-based models to interpret battery degradation data over the course of cycling can provide deeper physical insight into the internal states of the system and how they evolve. We present a neural network trained on simulations generated by a previously published physics-based model for a lithium trivanadate (LVO) cathode to estimate parameters that evolve over the course of cycling. We focus on the robustness of the neural network through two case studies that probe different kinds of discrepancies between model and experiment: nonideal data and imperfect model. In the former, the experimental protocols do not meet the assumption made in the training data generated by the physics-based model, while in the latter, the physics-based model fails to describe all of the measured cathode behavior even under ideal conditions. When there is total model-experiment agreement, a neural network estimates parameters with improved accuracy compared to a maximum likelihood analysis using the same set of simulations. However, in both types of model-experiment discrepancy, the neural network returned biased parameter estimates. We introduce a data augmentation procedure into the neural network training to mitigate these effects and improve robustness, and employ it to estimate parameters for a cycling LVO cathode.

Mayilvahanan, Karthik S. (ORCID:0000000316282332)↗
DOE OSTI2020

Dealing with Measurement Uncertainties as Nuisance Parameters in Bayesian Model Calibration

In the presence of model discrepancy, the calibration of physics-based models for physical parameter inference is a challenging problem. Lack of identifiability between calibration parameters and model discrepancy requires additional identifiability constraints to be placed on the model discrepancy to obtain unique physical parameter estimates. If these assumptions are violated, the inference for the calibration parameters can be systematically biased. In many applications, such as in dynamic material property experiments, many of the calibration inputs refer to measurement uncertainties. Here, we develop a metric for identifying overfitting of these measurement uncertainties, propose a prior capable of reducing this overfitting, and show how this leads to a diagnostic tool for validation of physical parameter inference. The approach is demonstrated for a benchmark example and applied for a material property application to perform inference on the equation of state parameters of tantalum.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Fingerprints of external forcings on Sahel rainfall: aerosols, greenhouse gases, and model-observation discrepancies

Over the 20th and 21st centuries, both anthropogenic greenhouse gas increases and changes in anthropogenic aerosols have affected rainfall in the Sahel. Using multiple characteristics of Sahel precipitation, we construct a multivariate fingerprint that allows us to distinguish between the model-predicted responses to greenhouse gases and anthropogenic aerosols. Models project the emergence of a detectable signal of aerosol forcing in the middle of the 20th century and a detectable signal of greenhouse gas forcing at the beginning of the 21st. However, the signals of both aerosol and greenhouse gas forcing in observations emerge earlier and are stronger than in the models, far stronger in the case of aerosols. The similarity between the response to aerosol forcing and the leading mode of internal variability makes it difficult to attribute this model-observation discrepancy to errors in the forcing, errors in the forced response, model inability to capture the amplitude of internal variability, or some combination of these. For greenhouse gases, however, the forced response is distinct from internal variability as estimated by models, and the observations are largely commensurate with the model projections.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Computer Model Calibration with Time Series Data Using Deep Learning and Quantile Regression

Computer models play a key role in many scientific and engineering problems. One major source of uncertainty in computer model experiments is input parameter uncertainty. Computer model calibration is a formal statistical procedure to infer input parameters by combining information from model runs and observational data. The existing standard calibration framework suffers from inferential issues when the model output and observational data are high-dimensional dependent data, such as large time series, due to the difficulty in building an emulator and the nonidentifiability between effects from input parameters and data-model discrepancy. To overcome these challenges, we, in this work, propose a new calibration framework based on a deep neural network (DNN) with long short-term memory layers that directly emulates the inverse relationship between the model output and input parameters. Adopting the “learning with noise” idea, we train our DNN model to filter out the effects from data-model discrepancy on input parameter inference. We also formulate a new way to construct interval predictions for DNN using quantile regression to quantify the uncertainty in input parameter estimates. Through a simulation study and real data application with the Weather Research and Forecasting Model Hydrological modeling system (WRF-Hydro), we show our approach can yield accurate point estimates and well-calibrated interval estimates for input parameters.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Model-observation discrepancies in Arctic moisture intrusions: causes and pathways for improved simulation

Arctic moisture intrusions (MIs), narrow filaments of strong moisture transport, are key drivers of poleward moisture flux and Arctic weather extremes, yet their representation in climate models is poorly understood. Using a new Arctic MI detection algorithm, we document persistent biases across three CMIP generations (CMIP3–CMIP6): models overestimate MI occurrence over the Pacific sector and underestimate it over the Atlantic sector. These errors stem from misrepresented midlatitude westerly jets, with an equatorward North Atlantic jet associated with too few Atlantic MIs, and a poleward, weakened North Pacific jet linked to too many Pacific MIs. Experiments that correct sea surface temperature and sea ice concentration biases and increase atmospheric resolution improve jet structure and MI statistics, while a cloud-locking simulation indicates that better high-frequency cloud–radiation–circulation interactions can yield further gains. Our results clarify pathways to reducing long-standing MI and jet biases, providing guidance for improving simulations of Arctic and midlatitude climate.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Modeling Systematic Discrepancies in Nuclear-Data Measurements with Machine Learning

Nuclear data and their associated co-variances are constantly being reevaluated as techniques improve and as new experimental data, as well as nuclearmodel developments, emerge. A standard technique used to evaluate mean values in nuclear data, and their associated covariances, is the generalized linear least squares (GLLS) method. Aligning with recent efforts to incorporate measurement features into nuclear data evaluation, we augment GLLS by including a linear term which attempts to predict potential systematic discrepancies in experimental data as related to the measurement features. Due to the general nature of this augmentation, we are able to apply this evaluation to three key observables: neutroninduced fission cross sections, the average prompt neutron multiplicity, and the prompt-fission neutron spectrum of ²³⁹Pu.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Model metamers reveal divergent invariances between biological and artificial neural networks

Deep neural network models of sensory systems are often proposed to learn representational transformations with invariances like those in the brain. To reveal these invariances, we generated ‘model metamers’, stimuli whose activations within a model stage are matched to those of a natural stimulus. Metamers for state-of-the-art supervised and unsupervised neural network models of vision and audition were often completely unrecognizable to humans when generated from late model stages, suggesting differences between model and human invariances. Targeted model changes improved human recognizability of model metamers but did not eliminate the overall human–model discrepancy. The human recognizability of a model’s metamers was well predicted by their recognizability by other models, suggesting that models contain idiosyncratic invariances in addition to those required by the task. Metamer recognizability dissociated from both traditional brain-based benchmarks and adversarial vulnerability, revealing a distinct failure mode of existing sensory models and providing a complementary benchmark for model assessment.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Model Form Error Correction for a Black-Box Thermal Battery Heat Transfer Simulation

Thermal batteries are crucial for supplying power to high-consequence engineering applications such as rockets. Computational simulations have been developed to predict thermal battery behavior, but these simulations often suffer from modeling errors, including model form uncertainty. Addressing this uncertainty can be achieved by quantifying either the model discrepancy in the output or the model form error (MFE) in the governing equation. MFE is particularly valuable as it can be better extrapolated beyond observed outputs, which is essential for predictions involving changes in external system loading, system configuration and geometry, or output quantities. This paper employs a state estimation approach to estimate MFE using experimental data and then utilizes machine learning (ML) to model its relationship with state variables. A nonintrusive technique is used to estimate MFE in a black-box thermal battery heat transfer simulation. The trained machine learning model for MFE is then applied to correct simulation predictions under extrapolated initial conditions and battery configurations. In conclusion, the methodology's performance is evaluated using additional experimental data, demonstrating its effectiveness in improving prediction accuracy.

Batteries↗
DOE OSTI2022

Comparison of the Gaussian Wind Farm Model with Historical Data of Three Offshore Wind Farms

A recent expert elicitation showed that model validation remains one of the largest barriers for commercial wind farm control deployment. The Gaussian-shaped wake deficit model has grown in popularity in wind farm field experiments, yet its validation for larger farms and throughout annual operation remains limited. This article addresses this scientific gap, providing a model comparison of the Gaussian wind farm model with historical data of three offshore wind farms. The energy ratio is used to quantify the model’s accuracy. We assume a fixed turbulence intensity of $I_∞$ = 6% and a standard deviation on the inflow wind direction of $σ_{wd}$ = 3° in our Gaussian model. First, we demonstrate the non-uniqueness issue of $I_∞$ and $σ_{wd}$, which display a waterbed effect when considering the energy ratios. Second, we show excellent agreement between the Gaussian model and historical data for most wind directions in the Offshore Windpark Egmond aan Zee (OWEZ) and Westermost Rough wind farms (36 and 35 wind turbines, respectively) and wind turbines on the outer edges of the Anholt wind farm (110 turbines). Turbines centrally positioned in the Anholt wind farm show larger model discrepancies, likely due to deep-array effects that are not captured in the model. A second source of discrepancy is hypothesized to be inflow heterogeneity. In future work, the Gaussian wind farm model will be adapted to address those weaknesses.

17 WIND ENERGY↗
DOE OSTI2023

On the transient spatial localization model

Significant discrepancies relevant to helioseismology between experimental and theoretical photon absorption by plasmas remain unresolved. Interestingly, a new process called transient spatial localization (TSL), where the plasma perturbs the final states in photon ionization processes, ostensibly enhances cross-sections resolving the extant discrepancies. The TSL model, however, is shown to involve ad hoc formulas not derived from fundamental principles and systematic approximations. Additionally, a variant of the TSL model, which claimed to enhance electron collisional ionization, is inconsistent with the Schrodinger equation and fails to reproduce known results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2023

New Measurements to Resolve Discrepancies in Evaluated Model Parameters of 181 Ta

To resolve discrepancies in evaluated cross sections among major nuclear data libraries, energy-differential neutron transmission and radiative capture yield of 181 Ta were measured from 0.15 to 100 keV using multiple sample thicknesses. The new measurements provide resolution such that the resolved resonance region (RRR) can be evaluated up to at least 2.5 keV and the unresolved resonance region can be evaluated up to at least 100 keV. The transmission and capture yield measurements were modeled using resonance parameters from three major libraries to assess the predictive capability of each. It was found that JENDL-5.0 performed best in the RRR. Because of the poor performance of the U.S. ENDF/B evaluation, it is recommended that ENDF/B be reevaluated for 181 Ta.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗
DOE OSTI2023

Bayesian uncertainty quantification of tristructural isotropic particle fuel silver release: Decomposing model inadequacy plus experimental noise and parametric uncertainties

Tristructural isotropic (TRISO) particle fuel is one of the most promising fuel concepts enabling high temperature and high burnup reactor operation. One dominant source of radioactivity released from the TRISO particles is silver (Ag), which is subject to a high release fraction and long decay life compared to other fission products. Previous modeling efforts using the fuel performance code BISON indicated nonnegligible uncertainties in modeling the diffusion process of fission products in TRISO compared to the Advanced Gas Reactor experiments. The overall uncertainties observed when modeling the fission product diffusion can result from uncertainties in model parameters, noisy experimental measurements, and deficiencies in the developed models. The three types of underlying uncertainties have not yet been properly quantified in open literature. Here, this paper presents the Bayesian uncertainty quantification (UQ) using massively parallelizable Markov chain Monte Carlo samplers. The uncertainties due to model parameters, model inadequacy, and experimental measurement noise are quantified, with the σ term used to represent the sum of the model inadequacy and measurement noise uncertainties. It is worth noting that this is the first time the σ term is inferred for nuclear fuel experiments, as compared to using prescribed values for uncertainty quantification in previous work. The parallelizable Markov chain Monte Carlo samplers efficiently infer the model parameters and the σ term, giving insight into physical parameters like diffusion coefficients and the combined model discrepancy and measurement noise. A subsequent forward uncertainty quantification (UQ) is also performed based on the calibration results to generate more accurate predictions of the Ag release. The model inadequacy plus experimental noise is the most dominant source of uncertainty compared to the parametric uncertainty. All the UQ analyses presented in this work are based on the second series of the irradiation experiments in the Advanced Gas Reactor program.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗