Search NASA⌕ Search

SEARCH · Search NASA

Results for “model bias”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

The Lack of a QBO-MJO Connection in Climate Models With a Nudged Stratosphere

The observed stratospheric quasi-biennial oscillation (QBO) and the tropospheric Madden-Julian oscillation (MJO) are strongly connected in boreal winter, with stronger MJO activity when lower-stratospheric winds are easterly. However, the current generation of climate models with internally generated representations of the QBO and MJO do not simulate the observed QBO-MJO connection, for reasons that remain unclear. Furthermore, this study builds on prior work exploring the QBO-MJO link in climate models whose stratospheric winds are relaxed toward reanalysis, reducing stratospheric biases in the model and imposing a realistic QBO. A series of ensemble experiments are performed using four state-of-the-art climate models capable of representing the MJO over the period 1980–2015, each with similar nudging in the stratosphere. In these four models, nudging leads to a good representation of QBO wind and temperature signals, however no model simulates the observed QBO-MJO relationship. Biases in MJO vertical structure and cloud-radiative feedbacks are investigated, but no conclusive model bias or mechanism is identified that explains the lack of a QBO-MJO connection.

54 ENVIRONMENTAL SCIENCES↗

Evaluation of the Near-Surface Variables in the HRRR Weather Model Using Observations from the ARM SGP Site

Abstract The performance of version 4 of the NOAA High-Resolution Rapid Refresh (HRRR) numerical weather prediction model for near-surface variables, including wind, humidity, temperature, surface latent and sensible fluxes, and longwave and shortwave radiative fluxes, is examined over the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) region. The study evaluated the model’s bias and bias-corrected mean absolute error relative to the observations on different time scales. Forecasts of near-surface geophysical variables at five SGP sites (HRRR at 3-km scale) were found to agree well with observations, but some consistent observation–forecast differences also occurred. Sensible and latent heat fluxes are the most challenging variables to be reproduced. The diurnal cycle is the main temporal scale affecting observation–forecast differences of the near-surface variables, and almost all of the variables showed different biases throughout the diurnal cycle. Results show that the overestimation of downward shortwave and the underestimation of downward longwave radiative flux are the two major biases found in this study. The timing and magnitude of downward longwave flux, wind speed, and sensible and latent heat fluxes are also different with contributions from model representations, data assimilation limitations, and differences in scales between HRRR and SGP sites. The positive bias in downward shortwave and negative bias in longwave radiation suggests that the model is underestimating cloud fraction in the study domain. The study concludes by showing a brief comparison with version 3 of the HRRR and shows that version 4 has better performance in almost all near-surface variables. Significance Statement A correct representation of the near-surface variables is important for numerical weather prediction models. This study investigates the capability of the latest NOAA High-Resolution Rapid Refresh (HRRRv4) model in simulating the near-surface variables by comparing against the Atmospheric Radiation Measurement (ARM) Southern Great Plains (SGP) in situ observations. Among others, we find that the surface heat fluxes, such as sensible and latent heat fluxes, are the most difficult variables to be reproduced. This study also shows that the diurnal cycle has the dominant impact on the model’s performance, which means the majority of the outputted near-surface variables have the strong diurnal cycle in their bias errors.

54 ENVIRONMENTAL SCIENCES↗

Mesoscale Convective Systems Tracking Method Intercomparison (MCSMIP): Application to DYAMOND Global km‐Scale Simulations

Abstract Global kilometer‐scale models represent the future of Earth system modeling, enabling explicit simulation of organized convective storms and their associated extreme weather. Here, we comprehensively evaluate tropical mesoscale convective system (MCS) characteristics in the DYAMOND (DYnamics of the atmospheric general circulation modeled on non‐hydrostatic domains) simulations for both summer and winter phases. Using 10 different feature trackers applied to simulations and satellite observations, we assess MCS frequency, precipitation, and other key characteristics. Substantial differences (a factor of 2–3) arise among trackers in observed MCS frequency and their precipitation contribution, but model‐observation differences in MCS statistics are more consistent across trackers. DYAMOND models are generally skillful in simulating tropical mean MCS frequency, with multi‐model mean biases ranging from −2%–8% over land and −8%–8% over ocean (summer vs. winter). However, most DYAMOND models underestimate MCS precipitation amount (23%) and their contribution to total precipitation (17%). Biases in precipitation contributions are generally smaller over land (13%) than over ocean (21%), with moderate inter‐model variability. While models better simulate MCS diurnal cycles and cloud shield characteristics, they overestimate MCS precipitation intensity and underestimate stratiform rain contributions (up to a factor of 2), particularly over land, albeit observational uncertainties exist. Additionally, models exhibit a wide range of precipitable water in the tropics compared to reanalysis and satellite observations, with many models showing exaggerated sensitivity of MCS precipitation intensity to precipitable water. The MCS metrics developed here provide process‐oriented diagnostics to guide future model development.

54 ENVIRONMENTAL SCIENCES↗

Understanding the Cascade: Removing GCM Biases Improves Dynamically Downscaled Climate Projections

Polarization surrounding bias correction (BC) in creating climate projections arises from its lack of physicality. Here, we perform and analyze 18 dynamical downscaling simulations (with and without BC) to better understand the physical impacts of BC, applied before downscaling, on regional climate output across the western United States. Without BC, downscaled precipitation is systematically and unrealistically wet biased compared to a hierarchy of observationally based datasets over the 1980–2014 period due to cascading mean–state Global Climate Model (GCM) biases: (a) overly strong lower–tropospheric lapse rates (5 K/km), (b) overly cold (2 K) tropospheric temperatures, and (c) anomalous mid–tropospheric cyclonic vorticity advection. With BC, downscaled precipitation (snow) biases are virtually eliminated (halved). Identified GCM biases are common to the broader Coupled Model Intercomparison Project ensemble. Physical effects of BC on the quality of the regionalized projections, pending an evaluation of BC's distortion of the downscaled climate response, may motivate its broader application by dynamical downscalers.

54 ENVIRONMENTAL SCIENCES↗

A Spatiotemporal-Aware Weighting Scheme for Improving Climate Model Ensemble Predictions

Multimodel ensembling has been widely used to improve climate model predictions, and the improvement strongly depends on the ensembling scheme. In this work, we propose a Bayesian neural network (BNN) ensembling method, which combines climate models within a Bayesian model averaging framework, to improve the predictive capability of model ensembles. Our proposed BNN approach calculates spatiotemporally varying model weights and biases by leveraging individual models' simulation skill, calibrates the ensemble prediction against observations by considering observation data uncertainty, and quantifies epistemic uncertainty when extrapolating to new conditions. More importantly, the BNN method provides interpretability about which climate model contributes more to the ensemble prediction at which locations and times. Thus, beyond its predictive capability, the method also brings insights and understanding of the models to guide further model and data development. In this study, we design experiments using an ensemble of CMIP6 climate model simulations to illustrate the BNN ensembling method's capability with respect to prediction accuracy, interpretability, and uncertainty quantification (UQ). We demonstrate that BNN can correctly assign larger weights to the regions and seasons where the individual model fits the observation better. Moreover, its offered interpretability is consistent with our understanding of localized climate model performance. Additionally, BNN shows an increasing uncertainty when the prediction is farther away from the period with constrained data, which appropriately reflects our trustworthiness of the models in the changing climate.

54 ENVIRONMENTAL SCIENCES↗

The Chocolate Chip Cookie Model: Dust Geometry of Milky Way–like Disk Galaxies

We present a new two-component dust geometry model, the Chocolate Chip Cookie model, where the clumpy nebular regions are embedded in a diffuse stellar/interstellar medium disk, like chocolate chips in a cookie. By approximating the binomial distribution of the clumpy nebular regions with a continuous Gaussian distribution and omitting the dust scattering effect, our model solves the dust attenuation process for both the emission lines and stellar continua via analytical approaches. Our Chocolate Chip Cookie model successfully fits the inclination dependence of both the effective dust reddening of the stellar components derived from stellar population synthesis and that of the emission lines characterized by the Balmer decrement for a large sample of Milky Way–like (MW-like) disk galaxies selected from the main galaxy sample of the Sloan Digital Sky Survey. Our model shows that the clumpy nebular disk is about 0.55 times thinner and 1.6 times larger than the stellar disk for MW-like galaxies, whereas each clumpy region has a typical optical depth of τ cl,V ~ 0.5 in the V band. After considering the aperture effect, our model prediction on the inclination dependence of dust attenuation is also consistent with observations. Not only that, in our model, the dust attenuation curve of the stellar population naturally depends on the inclination, and its median case is consistent with the classical Calzetti law. As the modeling constraints are from the optical wavelengths, our model is unaffected by the optically thick dust component, which however could bias the model's prediction of the infrared emissions.

79 ASTRONOMY AND ASTROPHYSICS↗

Novel estimation of aerosol processes with particle size distribution measurements: a case study with the TOMAS algorithm v1.0.0

Atmospheric aerosol microphysical processes are a significant source of uncertainty in predicting climate change. Specifically, aerosol nucleation, emissions, and growth rates, which are simulated in chemical transport models to predict the particle size distribution, are not understood well. However, long-term size distribution measurements made at several ground-based sites across Europe implicitly contain information about the processes that created those size distributions. This work aims to extract that information by developing and applying an inverse technique to constrain aerosol emissions as well as nucleation and growth rates based on hourly size distribution measurements. We developed an inverse method based upon process control theory into an online estimation technique to scale aerosol nucleation, emissions, and growth so that the model–measurement bias in three measured aerosol properties exponentially decays. The properties, which are calculated from the measured and predicted size distributions, used to constrain aerosol nucleation, emission, and growth rates are the number of particles with a diameter between 3 and 6 nm, the number with a diameter greater than 10 nm, and the total dry volume of aerosol ( N 3–6 , N 10 , V dry ), respectively. In this paper, we focus on developing and applying the estimation methodology in a zero-dimensional “box” model as a proof of concept before applying it to a three-dimensional simulation in subsequent work. The methodology is first tested on a dataset of synthetic and perfect measurements that span diverse environments in which the true particle emissions, growth, and nucleation rates are known. The inverse technique accurately estimates the aerosol microphysical process rates with an average and maximum error of 2 % and 13 %, respectively. Next, we investigate the effect that measurement noise has on the estimated rates. The method is robust to typical instrument noise in the aerosol properties as there is a negligible increase in the bias of the estimated process rates. Finally, the methodology is applied to long-term datasets of in situ size distribution measurements in western Europe from May 2006 through June 2007. At Melpitz, Germany, and Hyytiälä, Finland, the average diurnal profiles of estimated 3 nm particle formation rates are reasonable, having peaks near noon local time with average peak values of 1 and 0.15 cm –3 s –1 , respectively. The normalized absolute error in estimated N 3–6 , N 10 , and V dry at three European measurement sites is less than 15 %, showing that the estimation framework developed here has potential to decrease model–measurement bias while constraining uncertain aerosol microphysical processes.

54 ENVIRONMENTAL SCIENCES↗

Surrogate modeling for efficiently, accurately and conservatively estimating measures of risk

We present a surrogate modeling framework for conservatively estimating measures of risk from limited realizations of an expensive physical experiment or computational simulation. Risk measures combine objective probabilities with the subjective values of a decision maker to quantify anticipated outcomes. Given a set of samples, we construct a surrogate model that produces estimates of risk measures that are always greater than their empirical approximations obtained from the training data. These surrogate models limit over-confidence in reliability and safety assessments and produce estimates of risk measures that converge much faster to the true value than purely sample-based estimates. We first detail the construction of conservative surrogate models that can be tailored to a stakeholder’s risk preferences and then present an approach, based on stochastic orders, for constructing surrogate models that are conservative with respect to families of risk measures. Our surrogate models include biases that permit them to conservatively estimate the target risk measures. We provide theoretical results that show that these biases decay at the same rate as the L 2 error in the surrogate model. Numerical demonstrations confirm that risk-adapted surrogate models do indeed overestimate the target risk measures while converging at the expected rate.

42 ENGINEERING↗

A unified thermionic and thermionic-field emission (TE–TFE) model for ideal Schottky reverse-bias leakage current

We present a unified thermionic emission (TE) and thermionic-field emission (TFE) model for the ideal reverse-bias leakage current in Schottky junctions. The unified TE–TFE analytical model advances upon previous analytical TFE models by Murphy–Good and Padovani–Stratton, which are the two most widely adopted models by the community, in two major aspects: (i) the applicability of the TFE expression therein is extended to near-zero surface electric fields by an error-function correction, allowing for the calculation of the total current by a nontrivial sum of TE (over-the-barrier current) and TFE (below-the-barrier current) contributions; therefore, an accurate description of the TE-to-TFE transition region is captured analytically for the first time; (ii) image-force lowering is considered with much-simpler correction terms. Comparisons with the reference numerical model show that the unified TE–TFE model has excellent accuracy, as well as a 10 000× reduction in computation time. The unified model is further tested against experimental data from Schottky barrier diodes based on Si, 4H-SiC, GaN, and β-Ga 2 O 3 , revealing accurate extractions of barrier heights and correct descriptions of the ideal reverse leakage characteristics. With the extended applicable range, improved accuracy, and computational efficiency, the unified TE–TFE model is highly valuable for the design and analysis of devices based on Schottky junctions, as well as for potential integration in technology computer-aided design (TCAD) tools.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Why are we still using 3D masses for cluster cosmology?

ABSTRACT The abundance of clusters of galaxies is highly sensitive to the late-time evolution of the matter distribution, since clusters form at the highest density peaks. However, the 3D cluster mass cannot be inferred without deprojecting the observations, introducing model-dependent biases and uncertainties due to the mismatch between the assumed and the true cluster density profile and the neglected matter along the sightline. Since projected aperture masses can be measured directly in simulations and observationally through weak lensing, we argue that they are better suited for cluster cosmology. Using the Mira–Titan suite of gravity-only simulations, we show that aperture masses correlate strongly with 3D halo masses, albeit with large intrinsic scatter due to the varying matter distribution along the sightline. Nonetheless, aperture masses can be measured ≈2–3 times more precisely from observations, since they do not require assumptions about the density profile and are only affected by the shape noise in the weak lensing measurements. We emulate the cosmology dependence of the aperture mass function directly with a Gaussian process. Comparing the cosmology sensitivity of the aperture mass function and the 3D halo mass function for a fixed survey solid angle and redshift interval, we find the aperture mass sensitivity is higher for Ωm and $w_a$, similar for σ8, ns, and $w_0$, and slightly lower for h. With a carefully calibrated aperture mass function emulator, cluster cosmology analyses can use cluster aperture masses directly, reducing the sensitivity to model-dependent mass calibration biases and uncertainties.

79 ASTRONOMY AND ASTROPHYSICS↗

The impact of neutrino-nucleus interaction modeling on new physics searches

Accurate neutrino-nucleus interaction modeling is an essential requirement for the success of the accelerator-based neutrino program. As no satisfactory description of cross sections exists, experiments tune neutrino-nucleus interactions to data to mitigate mis-modeling. In this work, we study how the interplay between near detector tuning and cross section mis-modeling affects new physics searches. We perform a realistic simulation of neutrino events and closely follow NOvA’s tuning, the first published of such procedures in a neutrino experiment. We analyze two illustrative new physics scenarios, sterile neutrinos and light neutrinophilic scalars, presenting the relevant experimental signatures and the sensitivity regions with and without tuning. While the tuning does not wash out sterile neutrino oscillation patterns, cross section mis-modeling can bias the experimental sensitivity. In the case of light neutrinophilic scalars, variations in cross section models completely dominate the sensitivity regardless of any tuning. Our findings reveal the critical need to improve our theoretical understanding of neutrino-nucleus interactions, and to estimate the impact of tuning on new physics searches. We urge neutrino experiments to follow NOvA’s example and publish the details of their tuning procedure, and to develop strategies to more robustly account for cross section uncertainties, which will expand the scope of their physics program.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Arctic ice-ocean interactions in an 8-to-2 kilometer resolution global model

In the last decades, the Arctic climate has changed dramatically, with the loss of multiyear sea ice one of the clearest consequences. These changes have occurred on relatively rapid timescales, and both accurate short-term Arctic prediction (e.g., 10 days to three months) and climate projection of future Arctic scenarios present ongoing challenges. Here we describe a representation of the Arctic ocean and sea ice in a ultrahigh resolution simulation in which the horizontal grid mesh reduces from 8 km at the equator to 2 km at the poles (UH8to2) for the years 2017-2020. We find the simulation reproduces observed distributions of seasonal sea-ice thickness and concentration realistically, although concentration is biased low in the spring and summer and low biases in thickness are found in the central and eastern basins in the fall. Volume, fresh water, and heat transports through key passages are realistic, lying within observationally determined ranges. Climatological comparisons reveal that the UH8to2 Atlantic Water is shallower, warmer, and saltier than the World Ocean Atlas 2018 climatology for 2005-2017 in the eastern basin. Our analysis suggests that these biases, combined with a lack of stratification in the upper 100 m of the simulated ocean, contribute to the winter biases in modeled sea ice thickness. This relationship between biases in the sea ice and ocean points to a potential positive feedback within the model, illuminating challenges for long term model predictive power in a changing Arctic climate.

58 GEOSCIENCES↗

Tracking and Rejection of Biased Sinusoidal Signals Using Generalized Predictive Controller

Some novel applications require the tracking/rejection of biased sinusoidal reference/distur-bances. According to the internal model principle (IMP), a controller must embed the model of a biased sinusoidal signal to track references and also reject perturbations modeled through the aforementioned signal. However, the design of that kind of controller is not straightforward, especially when they are implemented in digital processors. This paper presents a controller, based on generalized predictive control (GPC), designed for tracking/rejection of biased sinusoidal signals. In general, GPC is based on the prediction of the plant responses through an augmented prediction model. The proposed approach develops an augmented model that predicts the future errors. The prediction model and the control law used in the proposed approach embed the discrete-time model of a biased sinusoidal signal. Thus, the proposed controller can track/reject biased sinusoidal references/disturbances. The predicted errors and the future inputs of the proposed augmented model are used to define the cost function that measures the control performance. An optimization technique was applied to obtain the solution of the cost function, which is the optimal sequence of future model inputs that allows defining the control law. Experimental tests prove that the proposed controller can asymptotically track and reject biased sinusoidal signals.

42 ENGINEERING↗

Influence of Antarctic and Greenland Continental Shelf Circulation on High‐Latitude Oceans in E3SM

The science objectives of this project are to simulate and understand the impacts of both deep-basin warm-water intrusions and land-ice melt on the continental shelf circulations and sea-ice distributions around the margins of Greenland and Antarctica. As well, the role of subsurface ocean heat from the Atlantic on declining sea-ice cover in the Arctic is explored. Mesoscale processes and fine bathymetry are implicated in cross-shelf property transports around both Greenland and Antarctica. Therefore, we configured and ran an atmospheric reanalysis-forced global ocean/sea-ice simulation on a grid that reduces from 8 km at the Equator to 2 km at the poles (UH8to2) with 60 vertical levels. It was produced using the Energy Exascale Earth System Model ‘‘HiLAT’’ code (E3SMv0-HiLAT) that uses the Parallel Ocean Program (POP) and CICE5 as its ocean and sea-ice components, respectively. Two main UH8to2 simulations were carried out: one for 1975-2009 and the other for July 2016-2020 after it was initialized from a 1/25° data-assimilative ocean/sea-ice prediction system ocean/sea-ice state. The UH8to2 is not coupled to an active land-ice model. Rather, land-ice melt is represented by observationally informed freshwater fluxes (FWFs). Short (multi-year) UH8to2 simulations were conducted to understand sensitivities when Greenland ice sheet (GrIS) melt is released only at the ocean surface or when it is distributed over the upper water column in accordance with fjord melt plume behavior; these cases were compared with a no GrIS melt case. West Greenland continental shelf currents were fastest in the vertical distribution case and an increase in baroclinic conversion at the shelf break associated with increased eddy kinetic energy was found relative to the surface release case. Further, salinity is lower and meltwater volume greater in the eastern Labrador Sea in the vertical distribution case. For the Arctic, the veracity of the UH8to2 was evaluated for 2017-2020 using available observations. Simulated seasonal sea-ice thickness and concentration are realistic, but the ice is unrealistically thin in the central and eastern Arctic in the fall. Comparisons of vertical sections of ocean temperature, salinity, and buoyancy collected from Ice-Tethered Profilers (ITPs) in the eastern Arctic in the fall and winter of 2019/2020 and co-located/concurrent UH8to2 fields show the stratification over the top 100 m of the water column is too low in the model, the simulated mixed layer too deep, and the simulated subsurface Atlantic Water (AW) too warm; these biases may contribute to the sea-ice biases. A model intercomparison study using the UH8to2 and a forced 1/25° regional Arctic ocean/sea-ice (uses the HYbrid Coordinate Ocean Model and CICE5) simulation further investigates the relationship between AW and sea-ice in the eastern Arctic. The models show a mesoscale-rich pulse of Atlantic Water extending into the eastern basin that reaches maximum intensity in late winter of 2018, after which it decreases in strength. Concurrent and co-located sea-ice melt or the inhibition of sea-ice growth is seen and is attributed to halocline mesoscale eddies doming into the mixed layer with convection bringing this heat into the vicinity of the sea-ice.

58 GEOSCIENCES↗

The Implementation of Framework for Improvement by Vertical Enhancement Into Energy Exascale Earth System Model

Abstract The low cloud bias in global climate models (GCMs) remains an unsolved problem. Coarse vertical resolution in GCMs has been suggested to be a significant cause of low cloud bias because planetary boundary layer parameterizations cannot resolve sharp temperature and moisture gradients often found at the top of subtropical stratocumulus layers. This work aims to ameliorate the low cloud problem by implementing a new computational method, the Framework for Improvement by Vertical Enhancement (FIVE), into the Energy Exascale Earth System Model (E3SM). Three physics schemes representing microphysics, radiation, and turbulence as well as vertical advection are interfaced to vertically enhanced physics (VEP), which allows for these processes to be computed on a higher vertical resolution grid compared to the rest of the E3SM model. We demonstrate the better representation of subtropical boundary layer clouds with FIVE while limiting additional computational cost from the increased number of levels. When the vertical resolution approaches the large eddy simulation‐like vertical resolution in VEP, the climatological low cloud amount shows a significant increase of more than 30% in the southeastern Pacific Ocean. Using FIVE to improve the representation of low‐level clouds does not come with any negative side effects associated with the simulation of mid‐ and high‐level cloud and precipitation, that can occur when running the full model at higher vertical resolution.

54 ENVIRONMENTAL SCIENCES↗

A Bayesian model for multivariate discrete data using spatial and expert information with application to inferring building attributes

When modeling sparsely observed multivariate data, strong prior information elicited from experts can be used to bolster predictive accuracy and counteract sampling bias. Similarly, modeling autocorrelation in space can help make use of co-occurrence patterns present in many types of spatial data. To make use of both expert prior information and spatial structure, we propose a novel graphical model for a spatial Bayesian network developed specifically to address challenges in inferring the attributes of buildings from geographically sparse observational data. This model is implemented as the sum of a spatial multivariate Gaussian random field and a tabular conditional probability function in real-valued space prior to projection onto the probability simplex. This modeling form is especially suitable for the usage of prior information in the form of sets of atomic rules obtained from experts. To perform inference with missing data, we implement a Markov chain Monte Carlo scheme composed of alternating steps of Gibbs sampling of missing entries and Hamiltonian Monte Carlo for model parameters. A case study in building attribution is presented to highlight the advantages and limitations of this approach.

97 MATHEMATICS AND COMPUTING↗

Modeling features in the redshift-space halo power spectrum with perturbation theory

In this work, we study the ability of perturbative models with effective field theory contributions and infra-red resummation to model the redshift space clustering of biased tracers in models where the linear power spectrum has "features"- either imprinted during inflation or induced by non-standard expansion histories. We show that both Eulerian and Lagrangian perturbation theory are capable of reproducing the Fourier space two-point functions of halos up to the non-linear scale from a suite of 40963 particle N-body simulations. This is the first demonstration that perturbative models can accurately fit the redshift-space clustering of biased tracers in N-body simulations of such theories. By comparing different theoretical models and IR resummation schemes we assess the current theoretical uncertainty in predicting power spectra for models with features. Our results suggest that future surveys will be able to detect or tightly constrain features in the primordial spectrum below the one percent level across a wide range of scales.

redshift surveys↗

MAPPER – A NOVEL CAPABILITY TO SUPPORT NUCLEAR MODEL VALIDATION AND MAPPING OF BIASES AND UNCERTAINTIES

This paper overviews the initial results of a new project at the Oak Ridge National Laboratory -- supported via an internal seed funding program -- focused on the development of a novel computational capability, called MAPPER, to support model validation. The MAPPER development aims to eliminate the need for empirical criteria, such as similarity indices, often employed to identify applicable experiments for given application conditions. To achieve that, MAPPER employs an information-theoretic-based approach, based on the Kullback-Leibler (KL) divergence principle, to combine responses of available or to-be-built experiments with application responses of interest using a training set of samples generated using randomized execution of the experiments and the application high fidelity analysis models. These samples are condensed using reduced order modeling techniques in the form of a joint probability distribution function (PDF) connecting each application response of interest with a new effective experimental response. The initial focus of the MAPPER capability will be to support the confirmatory analysis required for criticality safety analysis of storage facilities which require k-eff biases to be known for safe operation. This paper reports some of the initial results obtained with MAPPER as applied to a set of critical experiments for which existing similarity-based methods have been shown to provide inaccurate estimates of the biases.

Mertyurek, Ugur↗