Search NASA⌕ Search

SEARCH · Search NASA

Results for “error modeling”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13

Geometric Field Errors of Short Models for MQXF, the Nb3Sn Low-β Quadrupole for the High Luminosity LHC

© 2002-2011 IEEE. In the framework of the high-luminosity upgrade of the large hadron collider, the U.S. LARP collaboration and CERN are jointly developing a 150-mm aperture Nb3Sn quadrupole for the Large Hadron Collider (LHC) interaction regions. Due to the large beam size and orbit displacement in the final focusing triplet, MQXF has challenging targets for field quality at nominal operation conditions. Three short model magnets have been tested and around 30 coils have been built, allowing a first analysis of the reproducibility of the coil size and turns positioning. The impact of the coil shimming on field quality is evaluated, with special emphasis on the warm magnetic measurements and the correlation to field measurements at cold and nominal field. The variability of the field harmonics along the magnet axis is studied by means of a Monte-Carlo analysis and the effects of the corrective actions implemented to suppress the low-order unallowed multipoles are discussed.

Bermudez, Susana Izquierdo↗

Parametric Sensitivity and Calibration for Kain-Fritsch Convective Parameterization Scheme in the WRF Model

Convective parameterizations used in weather and climate models all display sensitivity to model resolution and variable skill in different climatic regimes. Although parameters in convective schemes can be calibrated using observations to reduce model errors, it is not clear if the optimal parameters calibrated based on regional data can robustly improve model skill across different model resolutions and climatic regimes. In this study, this issue is investigated using a regional modeling framework based on the Weather Research and Forecasting (WRF) model. To quantify the response and sensitivity of model performance to model parameters, we identified five key input parameters and specified their ranges in the Kain-Fritsch (KF) convection scheme in WRF and calibrated them across different spatial resolutions, climatic regimes, and radiation schemes using observed precipitation data. Results show that the optimal values for the five input parameters in the KF scheme are close and model sensitivity and error exhibit similar dependence on the input parameters for all experiments conducted in this study despite differences in the precipitation climatology. We found that the model overall performances in simulating precipitation are more sensitive to the coefficients of downdraft (Pd) and entrainment (Pe) mass flux and starting height of downdraft (Ph). However, we found that rainfall biases, which are probably more related to structural errors, still exist over some regions in the simulation even with the optimal parameters, suggesting further studies are needed to identify the sources of uncertainties and reduce the model biases or structural errors associated with missed or misrepresented physical processes and/or potential problems with the modeling framework.

calibration↗

Quantifying and Visualizing Uncertainty for Source Localisation in Electrocardiographic Imaging

Electrocardiographic imaging (ECGI) presents a clinical opportunity to noninvasively understand the sources of arrhythmias for individual patients. To help increase the effectiveness of ECGI, we provide new ways to visualise associated measurement and modelling errors. Here, we study source localisation uncertainty in two steps: First, we perform Monte Carlo simulations of a simple inverse ECGI source localisation model with error sampling to understand the variations in ECGI solutions. Second, we present multiple visualisation techniques, including confidence maps, level-sets, and topology-based visualisations, to better understand uncertainty in source localization. Our approach offers a new way to study uncertainty in the ECGI pipeline.

47 OTHER INSTRUMENTATION↗

Bayesian modeling of inconsistent plastic response due to material variability

The advent of fabrication techniques such as additive manufacturing has focused attention on the considerable variability of material response due to defects and other microstructural aspects. This variability motivates the development of an enhanced design methodology that incorporates inherent material variability to provide robust predictions of performance. In this work, we develop plasticity models capable of representing the distribution of mechanical responses observed in experiments using traditional plasticity models of the mean response and recently developed uncertainty quantification (UQ) techniques. To account for material response variability through variations in physical parameters, we adapt a recent Bayesian embedded modeling error calibration technique. We use Bayesian model selection to determine the most plausible of a variety of plasticity models and the optimal embedding of parameter variability. To expedite model selection, we develop an adaptive importance-sampling-based numerical integration scheme to compute the Bayesian model evidence. In conclusion, we demonstrate that the new framework provides predictive realizations that are superior to more traditional ones, and how these UQ techniques can be used in model selection and assessing the quality of calibrated physical parameters.

36 MATERIALS SCIENCE↗

The Continual Intercomparison of Radiation Codes: Results from Phase I

We present results from Phase I of the Continual Intercomparison of Radiation Codes (CIRC), intended as an evolving and regularly updated reference source for evaluation of radiative transfer (RT) codes used in Global Climate Models. CIRC differs from previous intercomparisons in that it relies on an observationally validated catalogue of cases. The seven CIRC Phase I baseline cases, five cloud-free, and two with overcast liquid clouds, are built around observations by the Atmospheric Radiation Measurements (ARM) program that satisfy the goals of Phase I, namely to examine radiative transfer (RT) model performance in realistic, yet not overly complex, atmospheric conditions. In addition to the seven baseline cases, additional idealized "subcases" are also examined to facilitate intrepretation of the causes of model errors. In addition to summarizing individual model performance with respect to reference line-by-line calculations and inter-model differences, we also highlight RT model behavior for conditions of doubled CO2, aspects of utilizing a spectral specification of surface albedo, and the impact of the inclusion of scattering in the thermal infrared. Our analysis suggests that RT models should work towards improving their calculation of diffuse shortwave flux, shortwave absorption, treatment of spectral surface albedo, and shortwave CO2 forcing. On the other hand, LW calculations appear to be significantly closer to the reference results. By enhancing the range of conditions under which participating codes are tested, future CIRC phases will hopefully allow even more rigorous examination of RT code performance.

radiative transfer, climate models, radiative forc↗

Robust Optimal Experimental Design of Infinite-Dimensional Bayesian Nonlinear Inverse Problems

Abstract. We consider robust optimal experimental design (ROED) for nonlinear Bayesian inverse problems governed by partial differential equations (PDEs). An optimal design is one that maximizes some utility quantifying the quality of the solution of an inverse problem. However, the optimal design is dependent on elements of the inverse problem such as the simulation model, the prior, or the measurement error model. ROED aims to produce an optimal design that is aware of the additional uncertainties encoded in the inverse problem and remains optimal even after variations in them. We follow a worst-case scenario approach to develop a new framework for robust optimal design of nonlinear Bayesian inverse problems. The proposed framework (a) is scalable and designed for infinite-dimensional Bayesian nonlinear inverse problems constrained by PDEs; (b) develops efficient approximations of the utility, namely the expected information gain; (c) employs eigenvalue sensitivity techniques to develop analytical forms and efficient evaluation methods of the gradient of the utility with respect to the uncertainties against which we wish to be robust; and (d) employs a probabilistic optimization paradigm that properly defines and efficiently solves the resulting combinatorial max-min optimization problem. The effectiveness of the proposed approach is illustrated for optimal sensor placement problem in an inverse problem governed by an elliptic PDE.

Chowdhary, Abhijit↗

Turbulent Processes that Influence Boundary-Layer Cloud Structure (Final Technical Report)

Many models of the atmosphere simulate vertical profiles of observable fields, such as temperature, moisture, and vertical velocity. To assess the realism of such model output, it is important to evaluate the modeled profiles against observations. However, many extant evaluations consist of comparing time averaged profiles from the model and the observations. Such time averages can smooth out unrealistic features that appear in instantaneous profiles. In this way, the time averages may obscure certain model errors from detection. For instance, many models misrepresent turbulent processes, leading to profiles that are too smoothed out or too noisy. E.g., if a model has coarse vertical resolution and overly strong diffusion, then the model may be unable to produce observed sharp peaks. On the other hand, a model may have artificial approximations that produce spurious jumps in the vertical. Much can be learned by browsing through instantaneous snapshots of model output. But the volume of output produced by a global model is far too great to rely purely on visual inspection. In addition, we need a way to statistically characterize the profiles, so that anomalies can be detected more conveniently.

54 ENVIRONMENTAL SCIENCES↗

Deep Learning for Multigroup Cross-Section Representation in Two-Step Core Calculations

Here we investigate using deep learning, a type of machine-learning algorithm employing multiple layers of artificial neurons, for the mathematical representation of multigroup cross sections for use in the Griffin reactor multiphysics code for two-step deterministic neutronics calculations. A three-dimensional fuel element typical of a high-temperature gas reactor as well as a two-dimensional sodium-cooled fast reactor lattice are modeled using the Serpent Monte Carlo code, and multigroup macroscopic cross sections are generated for various state parameters to produce a training data set and a separate validation data set. A fully connected, feedforward neural network is trained using the open-source PyTorch machine-learning framework, and its accuracy is compared against the standard piecewise linear interpolation model. Additionally, we provide in this work a generic technique for propagating the cross-section model errors up to the k eff using sensitivity coefficients with the first-order uncertainty propagation rule. Quantifying the eigenvalue error due to the cross-section regression errors is especially practical for appropriately selecting the mathematical representation of the cross sections. We demonstrate that the artificial neural network model produces lower errors and therefore enables better accuracy relative to the piecewise linear model when the cross sections exhibit nonlinear dependencies; especially when a coarse grid is employed, where the errors can be halved by the artificial neural network. However, for linearly dependent multigroup cross sections as found for the sodium-cooled fast reactor case, a simpler linear regression outperforms deeper networks.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A Hybrid Multiscale Framework for Subsurface Flow and Transport Simulations

Extensive research efforts have been invested in reducing model errors to improve the predictive ability of biogeochemical earth and environmental system simulators, with applications ranging from contaminant transport and remediation to impacts of biogeochemical elemental cycling (e.g., carbon and nitrogen) on local ecosystems and regional to global climate. While the bulk of this research has focused on improving model parameterizations in the face of observational limitations, the more challenging type of model error/uncertainty to identify and quantify is model structural error which arises from incorrect mathematical representations of (or failure to consider) important physical, chemical, or biological processes, properties, or system states in model formulations. While improved process understanding can be achieved through scientific study, such understanding is usually developed at small scales. Process-based numerical models are typically designed for a particular characteristic length and time scale. For application-relevant scales, it is generally necessary to introduce approximations and empirical parameterizations to describe complex systems or processes. This single-scale approach has been the best available to date because of limited understanding of process coupling combined with practical limitations on system characterization and computation. While computational power is increasing significantly and our understanding of biological and environmental processes at fundamental scales is accelerating, using this information to advance our knowledge of the larger system behavior requires the development of multiscale simulators. Accordingly there has been much recent interest in novel multiscale methods in which microscale and macroscale models are explicitly coupled in a single hybrid multiscale simulation. A limited number of hybrid multiscale simulations have been developed for biogeochemical earth systems, but they mostly utilize application-specific and sometimes ad-hoc approaches for model coupling. We are developing a generalized approach to hierarchical model coupling designed for high-performance computational systems, based on the Swift computing workflow framework. In this presentation we will describe the generalized approach and provide two use cases: 1) simulation of a mixing-controlled biogeochemical reaction coupling pore- and continuum-scale models, and 2) simulation of biogeochemical impacts of groundwater – river water interactions coupling fine- and coarse-grid model representations. This generalized framework can be customized for use with any pair of linked models (microscale and macroscale) with minimal intrusiveness to the at-scale simulators. It combines a set of python scripts with the Swift workflow environment to execute a complex multiscale simulation utilizing an approach similar to the well-known Heterogeneous Multiscale Method. User customization is facilitated through user-provided input and output file templates and processing function scripts, and execution within a high-performance computing environment is handled by Swift, such that minimal to no user modification of at-scale codes is required.

54 ENVIRONMENTAL SCIENCES↗

Listening to the Forest: An Artificial Neural Network‐Based Model of Carbon Uptake at Harvard Forest

Abstract The terrestrial biosphere strongly modulates atmospheric CO 2 mixing ratios, whose inexorable rise propels anthropogenic climate change. Modeling and mechanistically understanding C uptake by the terrestrial biosphere are thus of broad societal concerns. Yet despite considerable progress, scaling up point observations to landscape and larger scales continues to frustrate analyses of the anthropogenically perturbed global C cycle. While that up‐scaling is our overarching motivation, here we focus on one of its elements, modeling C uptake at a given site. We devise a novel artificial neural network (ANN)‐based model of C uptake at Harvard Forest that combines locally observed and remotely sensed variables. Most of our model predictors are those used by an established ecosystem C uptake model, the Vegetation Photosynthesis and Respiration Model (VPRM), easing comparisons. To those, we add observed cumulative antecedent precipitation and soil temperature. We find that model errors are much larger in winter, indicating that better understanding and modeling of respiration will likely discernibly improve model performance. Comparing the ANN and VPRM results reveals errors attributed to unrealistic treatment of temperature in the VPRM formulation, indicating that better representation of temperature dependencies is also likely to enhance model skill. By judiciously comparing VPRM and ANN errors we thus overcome ANNs' notoriety for concealing the mechanisms underlying their predictive skills. We demonstrate their ability to identify outstanding ecosystem science knowledge gaps and particularly fruitful corresponding model development directions, improving site specific and up‐scaling flux modeling and understanding of the climate impacts of the northern forest.

Eshel, Gidon↗

Integrated Nondestructive Assay Systems to Estimate Plutonium in Spent Fuel Assemblies

An integrated nondestructive assay (NDA) system combining active (neutron generator) and passive neutron detection and passive gamma (PG) detection is being analyzed in order to estimate the amount of plutonium, verify initial enrichment, burnup, and cooling time, and detect partial defects in a spent fuel assembly (SFA). Active signals are measured using the differential die-away (DDA), delayed neutron (DN), and delayed gamma (DG) techniques. Passive signals are measured using total neutron (TN) counts and both gross and spectral resolved gamma counts. To quantify how a system of several NDA techniques is expected to perform, all of the relevant NDA techniques listed above were simulated as a function of various reactor conditions such as initial enrichment, burnup, cooling time, assembly shuffling pattern, reactor operating conditions (including temperature, pressure, and the presence of burnable poisons) by simulating the NDA response for five sets of light water reactor assemblies. In this study, we compare the performance of several exploratory model-fitting options (including neural networks, adaptive regression with splines, iterative bias reduction smoothing, projection pursuit regression, and regression with quadratic terms and interaction terms) to relate data simulated with measurement and model error effects from various subsets of the NDA techniques to the total Pu mass. Isotope masses for SFAs and expected detector responses (DRs) for several NDA techniques are simulated using MCNP, and the DRs become inputs to the fitting process. Such responses include eight signals from DDA, one from DN, one from TN, and up to seven from PG; the DG signal will be examined separately. Results are summarized using the root-mean-squared estimation error for plutonium mass in held-out subsets of the data for a range of model and measurement error variances. Different simulation assumptions lead to different spent fuel libraries relating DRs to Pu mass. Some results for training with one library and testing with another library are also given.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Doppler-Lidar Evaluation of HRRR-Model Skill at Simulating Summertime Wind Regimes in the Columbia River Basin during WFIP2

Complex-terrain locations often have repeatable near-surface wind patterns, such as synoptic gap flows and local thermally forced flows. An example is the Columbia River Valley in east-central Oregon-Washington, a significant wind-energy-generation region and the site of the Second Wind-Forecast Improvement Project (WFIP2). Data from three Doppler lidars deployed during WFIP2 define and characterize summertime wind regimes and their large-scale contexts, and provide insight into NWP model errors by examining differences in the ability of a model [NOAA’s High-Resolution Rapid-Refresh (HRRR-version1)] to forecast wind-speed profiles for different regimes. Seven regimes were identified based on daily time series of the lidar-measured rotor-layer winds, which then suggested two broad categories. First, in three regimes the primary dynamic forcing was the large-scale pressure gradient. Second, in two regimes the dominant forcing was the diurnal heating-cooling cycle (regional sea-breeze-type dynamics), including the marine intrusion previously described, which generates strong nocturnal winds over the region. The other two included a hybrid regime and a non-conforming regime. For the large-scale pressure-gradient regimes, HRRR had wind-speed biases of ~1 m s -1 and RMSEs of 2-3 m s -1 . Errors were much larger for the thermally forced regimes, owing to the premature demise of the strong nocturnal flow in HRRR. Thus, the more dominant the role of surface heating in generating the flow, the larger the errors. Major errors could result from surface heating of the atmosphere, boundary-layer responses to that heating, and associated terrain interactions. Finally, measurement/modeling research programs should be aimed at determining which modeled processes produce the largest errors, so those processes can be improved and errors reduced.

17 WIND ENERGY↗

The Economic Impact of Battery Degradation Modelling Uncertainty

Battery energy storage systems (BESS) are used for a variety of applications, with their economic benefit often being the decisive factor for deployment. A multitude of physico-chemical aging mechanisms lead to capacity fade over a BESS life cycle. The models that are used to describe this capacity fade are prone to inherent model errors. Through a holistic techno-economic modelling approach, we investigate the impact of battery degradation modelling uncertainty on the economic benefit of representative BESS applications. Here, it is shown how improved parameter fit quality can reduce the resulting economic uncertainty. Furthermore, we highlight that the consideration of degradation modelling uncertainty is especially crucial when: (i) the cash flow highly depends on the available battery capacity, (ii) a fixed, e.g. warranty mandated, state of health limit acts as the threshold for battery end-of-life, (iii) long evaluation periods and low discount rates are the focus of economic evaluation.

aging↗

Moist Process Biases in Simulations of the Madden–Julian Oscillation Episodes Observed during the AMIE/DYNAMO Field Campaign

Two Madden–Julian oscillation (MJO) episodes observed during the 2011 Atmospheric Radiation Measurement Program MJO Investigation Experiment (AMIE)/DYNAMO field campaign are simulated using a regional model with various cumulus parameterizations, a regional cloud-permitting model, and a global variable-resolution model with a high-resolution region centered over the tropical Indian Ocean. Model biases in relationships relevant to existing instability theories of MJO are examined and their relative contributions to the overall model errors are quantified using a linear statistical model. The model simulations capture the observed approximately log-linear relationship between moisture saturation fraction and precipitation, but precipitation associated with the given saturation fraction is overestimated especially at low saturation fraction values. This bias is a major contributor to the excessive precipitation during the suppressed phase of MJO. After accounting for this bias using a linear statistical model, the spatial and temporal structures of the model-simulated MJO episodes are much improved, and what remains of the biases is strongly correlated with biases in saturation fraction. The excess precipitation bias during the suppressed phase of the MJO episodes is accompanied by excessive column-integrated radiative forcing and surface evaporation. A large portion of the bias in evaporation is related to biases in wind speed, which are correlated with those of precipitation. Furthermore, these findings suggest that the precipitation bias sustains itself at least partly by cloud radiative feedbacks and convection–surface wind interactions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Performance-based earthquake early warning for tall buildings

The ShakeAlert Earthquake Early Warning (EEW) system aims to issue an advance warning to residents on the West Coast of the United States seconds before the ground shaking arrives, if the expected ground shaking exceeds a certain threshold. However, residents in tall buildings may experience much greater motion due to the dynamic response of the buildings. Therefore, there is an ongoing effort to extend ShakeAlert to include the contribution of building response to provide a more accurate estimation of the expected shaking intensity for tall buildings. Currently, the supposedly ideal solution of analyzing detailed finite element models of buildings under predicted ground-motion time histories is not theoretically or practically feasible. The authors have recently investigated existing simple methods to estimate peak floor acceleration (PFA) and determined these simple formulas are not practically suitable. Instead, this article explores another approach by extending the Pacific Earthquake Engineering Research Center (PEER) performance-based earthquake engineering (PBEE) to EEW, considering that every component involved in building response prediction is uncertain in the EEW scenario. Additionally, while this idea is not new and has been proposed by other researchers, it has two shortcomings: (1) the simple beam model used for response prediction is prone to modeling uncertainty, which has not been quantified, and (2) the ground motions used for probabilistic demand models are not suitable for EEW applications. In this article, we address these two issues by incorporating modeling errors into the parameters of the beam model and using a new set of ground motions, respectively. We demonstrate how this approach could practically work using data from a 52-story building in downtown Los Angeles. Using the criteria and thresholds employed by previous researchers, we show that if peak ground acceleration (PGA) is accurately estimated, this approach can predict the expected level of human comfort in tall buildings.

58 GEOSCIENCES↗

Full-stack Quantification of Variability in Predicting Ion Transport Properties using Machine-learned Interatomic Potentials

Machine-learned interatomic potentials (MLIPs) have become the state-of-the-art for performing accurate, scalable molecular dynamics (MD) simulations. It is therefore crucial to understand and quantify the reliability of MLIPs for downstream property predictions. Uncertainty in predicted properties can arise from limitations in first-principles training data, intrinsic MLIP model errors in representing the data, and the statistical noise introduced during subsequent MD simulations. Using ion transport in Li7P3S11 as a case study, we systematically assess the impact of training set size and selection, neural network stochasticity, and MD sampling statistics on predicted diffusivity and activation energy. We find that when using equivariant MLIP architectures with standard MD protocols, uncertainty arising from MD sampling dominates over model-induced errors. In contrast, MLIP errors relative to the underlying first-principles data are consistently minor. Given this, there are two main routes to improving the accuracy of predictions based on MLIP potentials: adopting higher accuracy reference data generation methods, and improving the MD sampling statistics.

36 MATERIALS SCIENCE↗

Nonlinear Advection Algorithms Applied to Inter-related Tracers: Errors and Implications for Modeling Aerosol-Cloud Interactions

Monotonicity constraints and gradient preserving flux corrections employed by many advection algorithms used in atmospheric models make these algorithms non-linear. Consequently, any relations among model variables transported separately are not necessarily preserved in such models. These errors cannot be revealed by traditional algorithm testing based on advection of a single tracer. New type of tests are developed and conducted to evaluate the preservation of a sum of several number mixing ratios advected independently of each other, as is the case, for example, in models using bin or sectional representation of aerosol or cloud particle size distribution. The tests show that when three tracers are advected in 1D uniform constant velocity flow, local errors in the sum can be on the order of 10%. When cloud-like interactions are allowed among the tracers, errors in total sum of three mixing ratios can reach up to 30%. Several approaches to eliminate the error are suggested, all based on advecting the sum as a separate variable and then normalizing mixing ratios for individual tracers to match the total sum. A simple scalar normalization preserves the total number mixing ratio and positive definiteness of the variables but the monotonicity constraint for individual tracers is no longer maintained. More involved flux normalization procedures are developed for the flux based advection algorithms to maintain the monotonicity for individual scalars and their sum.

54 ENVIRONMENTAL SCIENCES↗

Kinetic isotope effects significantly influence intracellular metabolite 13 C labeling patterns and flux determination

Rigorous mathematical modeling of carbon-labeling experiments allows estimation of fluxes through the pathways of central carbon metabolism, yielding powerful information for basic scientific studies as well as for a wide range of applications. However, the mathematical models that have been developed for flux determination from 13 C labeling data have commonly neglected the influence of kinetic isotope effects on the distribution of 13 C label in intracellular metabolites, as these effects have often been assumed to be inconsequential. We have used measurements of the 13 C isotope effects on the pyruvate dehydrogenase enzyme from the literature to model isotopic fractionation at the pyruvate node and quantify the modeling errors expected to result from the assumption that isotope effects are negligible. We show that under some conditions kinetic isotope effects have a significant impact on the 13 C labeling patterns of intracellular metabolites, and the errors associated with neglecting isotope effects in 13 C-metabolic flux analysis models can be comparable in size to measurement errors associated with GC–MS. Thus, kinetic isotope effects must be considered in any rigorous assessment of errors in 13 C labeling data, goodness-of-fit between model and data, confidence intervals of estimated metabolic fluxes, and statistical significance of differences between estimated metabolic flux distributions.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗