Search NASA⌕ Search

SEARCH · Search NASA

Results for “model evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,009 records · Page 56

Challenging Practices of Algebraic Battery Life Models through Statistical Validation and Model Identification via Machine-Learning

Various modeling techniques are used to predict the capacity fade of Li-ion batteries. Algebraic reduced-order models, which are inherently interpretable and computationally fast, are ideal for use in battery controllers, technoeconomic models, and multi-objective optimizations. For Li-ion batteries with graphite anodes, solid-electrolyte-interphase (SEI) growth on the graphite surface dominates fade. This fade is often modeled using physically informed equations, such as square-root of time for predicting solvent-diffusion limited SEI growth, and Arrhenius and Tafel-like equations predicting the temperature and state-of-charge rate dependencies. In some cases, completely empirical relationships are proposed. However, statistical validation is rarely conducted to evaluate model optimality, and only a handful of possible models are usually investigated. This article demonstrates a novel procedure for automatically identifying reduced-order degradation models from millions of algorithmically generated equations via bi-level optimization and symbolic regression. Identified models are statistically validated using cross-validation, sensitivity analysis, and uncertainty quantification via bootstrapping. On a LiFePO 4 /Graphite cell calendar aging data set, automatically identified models utilizing square-root, power law, stretched exponential, and sigmoidal functions result in greater accuracy and lower uncertainty than models identified by human experts, and demonstrate that previously known physical relationships can be empirically "rediscovered" using machine learning.

25 ENERGY STORAGE↗

Quantifying sources of black carbon in western North America using observationally based analysis and an emission tagging technique in the Community Atmosphere Model

The Community Atmosphere Model (CAM5), equipped with a technique to tag black carbon (BC) emissions by source regions and types, has been employed to establish source–receptor relationships for atmospheric BC and its deposition to snow over western North America. The CAM5 simulation was conducted with meteorological fields constrained by reanalysis for year 2013 when measurements of BC in both near-surface air and snow are available for model evaluation. We find that CAM5 has a significant low bias in predicted mixing ratios of BC in snow but only a small low bias in predicted atmospheric concentrations over northwestern USA and western Canada. Even with a strong low bias in snow mixing ratios, radiative transfer calculations show that the BC-in-snow darkening effect is substantially larger than the BC dimming effect at the surface by atmospheric BC. Local sources contribute more to near-surface atmospheric BC and to deposition than distant sources, while the latter are more important in the middle and upper troposphere where wet removal is relatively weak. Fossil fuel (FF) is the dominant source type for total column BC burden over the two regions. FF is also the dominant local source type for BC column burden, deposition, and near-surface BC, while for all distant source regions combined the contribution of biomass/biofuel (BB) is larger than FF. An observationally based positive matrix factorization (PMF) analysis of the snow-impurity chemistry is conducted to quantitatively evaluate the CAM5 BC source-type attribution. While CAM5 is qualitatively consistent with the PMF analysis with respect to partitioning of BC originating from BB and FF emissions, it significantly underestimates the relative contribution of BB. In addition to a possible low bias in BB emissions used in the simulation, the model is likely missing a significant source of snow darkening from local soil found in the observations.

54 ENVIRONMENTAL SCIENCES↗

Toward Improved Land Surface Initialization in Support of Regional WRF Forecasts at the Kenya Meteorological Service (KMS)

Flooding and drought are two key forecasting challenges for the Kenya Meteorological Service (KMS). Atmospheric processes leading to excessive precipitation and/or prolonged drought can be quite sensitive to the state of the land surface, which interacts with the planetary boundary layer (PBL) of the atmosphere providing a source of heat and moisture. The development and evolution of precipitation systems are affected by heat and moisture fluxes from the land surface, particularly within weakly-sheared environments such as in the tropics and sub-tropics. These heat and moisture fluxes during the day can be strongly influenced by land cover, vegetation, and soil moisture content. Therefore, it is important to represent the land surface state as accurately as possible in land surface and numerical weather prediction (NWP) models. Enhanced regional modeling capabilities have the potential to improve forecast guidance in support of daily operations and high-impact weather over eastern Africa. KMS currently runs a configuration of the Weather Research and Forecasting (WRF) NWP model in real time to support its daily forecasting operations, making use of the NOAA/National Weather Service (NWS) Science and Training Resource Center's Environmental Modeling System (EMS) to manage and produce the KMS-WRF runs on a regional grid over eastern Africa. Two organizations at the NASA Marshall Space Flight Center in Huntsville, AL, SERVIR and the Shortterm Prediction Research and Transition (SPoRT) Center, have established a working partnership with KMS for enhancing its regional modeling capabilities through new datasets and tools. To accomplish this goal, SPoRT and SERVIR is providing enhanced, experimental land surface initialization datasets and model verification capabilities to KMS as part of this collaboration. To produce a land-surface initialization more consistent with the resolution of the KMS-WRF runs, the NASA Land Information System (LIS) is run at a comparable resolution to provide real-time, daily soil initialization data in place of data interpolated from the National Centers for Environmental Prediction (NCEP) Global Forecast System (GFS) model soil moisture and temperature fields. Additionally, realtime green vegetation fraction (GVF) data from the Visible Infrared Imaging Radiometer Suite (VIIRS) on the Suomi National Polar-orbiting Partnership (Suomi- NPP) satellite will be incorporated into the KMS-WRF runs, once it becomes publicly available from the National Environmental Satellite Data and Information Service (NESDIS). Finally, model verification capabilities will be transitioned to KMS using the Model Evaluation Tools (MET; Brown et al. 2009) package in conjunction with a dynamic scripting package developed by SPoRT (Zavodsky et al. 2014), to help quantify possible improvements in simulated temperature, moisture and precipitation resulting from the experimental land surface initialization. Furthermore, the transition of these MET tools will enable KMS to monitor model forecast accuracy in near real time. This paper presents preliminary efforts to improve land surface model initialization over eastern Africa in support of operations at KMS. The remainder of this extended abstract is organized as follows: The collaborating organizations involved in the project are described in Section 2; background information on LIS and the configuration for eastern Africa is presented in Section 3; the WRF configuration used in this modeling experiment is described in Section 4; sample experimental WRF output with and without LIS initialization data are given in Section 5; a summary is given in Section 6 followed by acknowledgements and references.

Case, Johnathan L.↗

Historical perspectives of BEPU research in US

Civilian nuclear energy started in earnest in the 1950s and experienced rapid growth in 1960-80s with increasingly larger reactors. These reactors were initially regulated based on the experience from the smaller reactors, but this could not be applied to the larger power reactors. Therefore, in 1974 the US Nuclear Regulatory Commission set up safety requirements based on defense in depth in 10 CFR 50.46, and set of guidance in 10 CFR 50 presented in Appendix K, for models and simulations of reactor safety analyses, to ensure conservatism in predicted safety parameters. These methods resulted in both conservative safety margins as well as economic and operational penalties. In the late 1970s and early 1980s, a large number of experiential programs provided data that allowed for the creation of best estimate models. These best estimate models showed the conservatism in Appendix K models. In 1988-89, USNRC modified the regulations and allowed the use of best estimate models provided they were coupled to a reliable and defensible measure of uncertainty in the prediction of safety parameters. This change in regulation strongly encouraged global activity for the development of best estimate codes and methods. To aide in this development, the USNRC provided one acceptable approach, the Code Scaling, Acceptability and Uncertainty Evaluation Methodology (CSAU). This approach was later refined in the Evaluation Model Development and Assessment Process (EMDAP).

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Accelerated Education Program in Radiation Medicine: International Learner Perceptions of Experiences, Outcomes, and Impact

The Accelerated Education Program (AEP) at the Princess Margaret Cancer Centre (PM) has been offering continuing medical education courses since 2006. The purpose of this study was to assess learner experiences, perspectives, and outcomes using Kirkpatrick’s Four Level Training Evaluation Model (ie, reaction, learning, behavior, results) to ascertain whether it was meeting stated goals.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

High-Resolution Mesoscale Model Setup for the Eastern Range and Wallops Flight Facility

Mesoscale weather conditions can have an adverse effect on space launch, landing, ground processing, and weather advisories, watches, and warnings at the Eastern Range (ER) in Florida and Wallops Flight Facility (WFF) in Virginia. During summer, land-sea interactions across Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS) lead to sea breeze front formation, which can spawn deep convection that can hinder operations and endanger personnel and resources. Many other weak locally-driven low-level boundaries and their interactions with the sea breeze front and each other can also initiate deep convection in the KSC/CCAFS area. These convective processes often last 60 minutes or less and pose a significant challenge to the local forecasters. Surface winds during the transition seasons (spring and fall) pose the most difficulties for the forecasters at WFF. They also encounter problems forecasting convective activity and temperature during those seasons. Therefore, accurate mesoscale model forecasts are needed to better forecast a variety of unique weather phenomena. Global and national scale models cannot properly resolve important local-scale weather features at each location due to their horizontal resolutions being much too coarse. Therefore, a properly tuned local data assimilation (DA) and forecast model at a high resolution is needed to provide improved capability. To accomplish this, a number of sensitivity tests were performed using the Weather Research and Forecasting (WRF) model in order to determine the best DA/model configuration for operational use at each of the space launch ranges to best predict winds, precipitation, and temperature. A set of Perl scripts to run the Gridpoint Statistical Interpolation (GSI)/WRF in real-time were provided by NASA's Short-term Prediction Research and Transition Center (SPoRT). The GSI can analyze many types of observational data including satellite, radar, and conventional data. The GSI/WRF scripts use a cycled GSI system similar to the operational North American Mesoscale (NAM) model. The scripts run a 12-hour pre-cycle in which data are assimilated from 12 hours prior up to the model initialization time. A number of different model configurations were tested for both the ER and WFF by varying the horizontal resolution on which the data assimilation was done. Three different grid configurations were run for the ER and two configurations were run for WFF for archive cases from 27 Aug 2013 through 10 Nov 2013. To quantify model performance, standard model output will be compared to the Meteorological Assimilation Data Ingest System (MADIS) data. The MADIS observation data will be compared to the WRF forecasts using the Model Evaluation Tools (MET) verification package. In addition, the National Centers for Environmental Prediction's Stage IV precipitation data will be used to validate the WRF precipitation forecasts. The author will summarize the relative skill of the various WRF configurations and how each configuration behaves relative to the others, as well as determine the best model configuration for each space launch range.

Watson, Leela R.↗

Radiatively important parameters best estimate (RIPBE) value-added product (VAP)

Currently, to calculate radiative heating rate profiles for the Broadband Heating Rate Profile (BBHRP) product, radiatively important parameters (water vapor, ozone, surface albedo, aerosol properties, and cloud properties) from multiple VAPs and datastreams are combined into input text files that are then used to run the RRTM radiative transfer codes. These input parameters have different temporal and spatial scales and are difficult to extract from the text files to be used for other purposes such as running other radiative transfer codes, analyzing results, or error tracking. The purpose of the Radiatively Important Parameters Best Estimate (RIPBE) VAP is to improve this process by creating a clearly identified set of inputs for BBHRP (and other radiation codes) on a uniform vertical and temporal grid. This process will decouple the input/output portion of the BBHRP from the core physics (the RRTM radiative transfer model) and will add error tracking and version information to the input data set. Critical parameters (which must exist for the radiation code to be run) will be designated; for other parameters, climatological or fixed values will be used when the preferred values are missing. This should increase the number of cases for which radiative transfer calculations can be run. In all cases, flags will clearly identify the source for each parameter. RIPBE will serve multiple functions: (1) it will provide a clearly identifiable set of inputs for BBHRP, (2) it will facilitate the use of BBHRP as a retrieval and radiation code development testbed by providing a vehicle for easily extracting and swapping input parameters needed to conduct radiative transfer calculations, and (3) it will be a complement to the Climate Modeling Best Estimate (CMBE) VAP and will provide a significantly expanded set of parameters for model evaluation in a showcase data set form. At the ASR meeting, we will present examples and evaluation of the initial RIPBE dataset at SGP.

54 ENVIRONMENTAL SCIENCES↗

Dixie Valley Engineered Geothermal System Exploration Methodology Project, Baseline Conceptual Model Report

The Engineered Geothermal System (EGS) Exploration Methodology Project is developing an exploration approach for EGS through the integration of geoscientific data. The Project chose the Dixie Valley Geothermal System in Nevada as a field laboratory site for methodology calibration purposes because, in the public domain, it is a highly characterized geothermal system in the Basin and Range with a considerable amount of geoscience and most importantly, well data. The overall project area is 2500km2 with the Calibration Area (Dixie Valley Geothermal Wellfield) being about 170km2. The project was subdivided into five tasks (1) collect and assess the existing public domain geoscience data; (2) design and populate a GIS database; (3) develop a baseline (existing data) geothermal conceptual model, evaluate geostatistical relationships, and generate baseline, coupled EGS favorability/trust maps from +1km above sea level (asl) to -4km asl for the Calibration Area at 0.5km intervals to identify EGS drilling targets at a scale of 5km x 5km; (4) collect new geophysical and geochemical data, and (5) repeat Task 3 for the enhanced (baseline + new ) data. Favorability maps were based on the integrated assessment of the three critical EGS exploration parameters of interest: rock type, temperature and stress. A complimentary trust map was generated to compliment the favorability maps to graphically illustrate the cumulative confidence in the data used in the favorability mapping. The Final Scientific Report (FSR) is submitted in two parts with Part I describing the results of project Tasks 1 through 3 and Part II covering the results of project Tasks 4 through 5 plus answering nine questions posed in the proposal for the overall project. FSR Part I presents (1) an assessment of the readily available public domain data and some proprietary data provided by Terra-Gen Power, LLC, (2) a re-interpretation of these data as required, (3) an exploratory geostatistical data analysis, (4) the baseline geothermal conceptual model, and (5) the EGS favorability/trust mapping. The conceptual model presented applies to both the hydrothermal system and EGS in the Dixie Valley region. FSR Part II presents (1) 278 new gravity stations; (2) enhanced gravity-magnetic modeling; (3) 42 new ambient seismic noise survey stations; (4) an integration of the new seismic noise data with a regional seismic network; (5) a new methodology and approach to interpret this data; (5) a novel method to predict rock type and temperature based on the newly interpreted data; (6) 70 new magnetotelluric (MT) stations; (7) an integrated interpretation of the enhanced MT data set; (8) the results of a 308 station soil CO2 gas survey; (9) new conductive thermal modeling in the project area; (10) new convective modeling in the Calibration Area; (11) pseudo-convective modeling in the Calibration Area; (12) enhanced data implications and qualitative geoscience correlations at three scales (a) Regional, (b) Project, and (c) Calibration Area; (13) quantitative geostatistical exploratory data analysis; and (14) responses to nine questions posed in the proposal for this investigation. Enhanced favorability/trust maps were not generated because there was not a sufficient amount of new, fully-vetted (see below) rock type, temperature, and stress data. The enhanced seismic data did generate a new method to infer rock type and temperature. However, in the opinion of the Principal Investigator for this project, this new methodology needs to be tested and evaluated at other sites in the Basin and Range before it is used to generate the referenced maps. As in the baseline conceptual model, the enhanced findings can be applied to both the hydrothermal system and EGS in the Dixie Valley region.

15 GEOTHERMAL ENERGY↗

Is the assumption of normality or log-normality for continuous response data critical for benchmark dose estimation?

Continuous responses (e.g. body weight) are widely used in risk assessment for determining the benchmark dose (BMD) which is used to derive a U.S. EPA reference dose. One critical question that is not often addressed in dose–response assessments is whether to model the continuous data as normally or log-normally distributed. Additionally, if lognormality is assumed, and only summarized response data (i.e., mean ± standard deviation) are available as is usual in the peer-reviewed literature, the BMD can only be approximated. In this study, using the “hybrid” method and relative deviation approach, we first evaluate six representative continuous dose–response datasets reporting individual animal responses to investigate the impact on BMD/BMDL estimates of (1) the distribution assumption and (2) the use of summarized versus individual animal data when a log-normal distribution is assumed. We also conduct simulation studies evaluating model fits to various known distributions to investigate whether the distribution assumption has influence on BMD/BMDL estimates. Our results indicate that BMDs estimated using the hybrid method are more sensitive to the distribution assumption than counterpart BMDs estimated using the relative deviation approach. The choice of distribution assumption has limited impact on the BMD/BMDL estimates when the within dose-group variance is small, while the lognormality assumption is a better choice for relative deviation method when data are more skewed because of its appropriateness in describing the relationship between mean and standard deviation. Additionally, the results suggest that the use of summarized data versus individual response data to characterize log-normal distributions has minimal impact on BMD estimates. - Highlights: • We investigate to what extent the distribution assumption can affect BMD estimates. • Both real data analysis and simulation study are conducted. • BMDs estimated using hybrid method are more sensitive to distribution assumption. • Summarized continuous data are adequate for BMD estimation.

60 APPLIED LIFE SCIENCES↗

Are Atmospheric Models Too Cold in the Mountains? The State of Science and Insights from the SAIL Field Campaign

Mountains play an outsized role in water resource availability, and the amount and timing of water they provide depend strongly on temperature. To that end, we ask the question: How well are atmospheric models capturing mountain temperatures? We synthesize results showing that high-resolution, regionally relevant climate models produce 2-m air temperature (T2m) measurements colder than what is observed (a “cold bias”), particularly in snow-covered midlatitude mountain ranges during winter. We find common cold biases in 44 studies across global mountain ranges, including single-model and multimodel ensembles. We explore the factors driving these biases and examine the physical mechanisms, data limitations, and observational uncertainties behind T2m. Our analysis suggests that the biases are genuine and not due to observation sparsity or resolution mismatches. Cold biases occur primarily on mountain peaks and ridges, whereas valleys are often warm biased. Our literature review suggests that increasing model resolution does not clearly mitigate the bias. By analyzing data from the Surface Atmosphere Integrated Field Laboratory (SAIL) field campaign in the Colorado Rocky Mountains, we test various hypotheses related to cold biases and find that local wind circulations, longwave (LW) radiation, and surface-layer parameterizations contribute to the T2m biases in this particular location. We conclude by emphasizing the value of coordinated model evaluation and development efforts in heavily instrumented mountain locations for addressing the root cause(s) of T2m biases and improving predictive understanding of mountain climates.

54 ENVIRONMENTAL SCIENCES↗

Coupled SAM/Griffin Model of a Reference Fluoride-Salt-Cooled High-Temperature Reactor for Multi-Physics Simulations

A multi-physics coupled simulation model of a reference pebble bed fluoride-salt-cooled high-temperature reactor (PB-FHR) has been developed with SAM and Griffin computer codes for transient safety analysis. The reference problem of a prototypical reactor design serves as the foundation for the U.S. NRC (Nuclear Regulatory Commission) to verify the adequacy of computer codes and evaluation models for specific reactor types. In this work, the previously developed SAM model for PB-FHR primary loop has been updated for the coupled simulation. The updated SAM PB-FHR model includes a 2-D axial symmetric core region and external core components in 0-D/1-D. In addition to the primary loop, a detailed model of the RCCS (reactor cavity cooling system) is added. The 2-D and 1-D domains are tightly coupled using the single-solve approach developed in SAM. In the pebble bed region, the SAM multiscale explicit pebble model is applied to calculate the pebble and TRISO fuel kernel temperatures. The Griffin model used in this work is based on a model developed at Idaho National Laboratory in collaboration with the U.S. NRC. The Griffin neutronics model and SAM thermal hydraulics model is coupled with the Comprehensive Reactor Analysis Bundle (CRAB or alternately BlueCRAB) application. Both steady-state and transient scenarios are simulated to demonstrate the model's suitability for multi-physics simulations of PB-FHR transients.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗

On the use of radiative surface temperature to estimate sensible heat flux over sparse shrubs in Nevada

The accurate partitioning of available energy into sensible and latent heat flux is crucial to the understanding of surface atmosphere interactions. This issue is more complicated in arid and semi arid regions where the relative contribution to surface fluxes from the soil and vegetation may vary significantly throughout the day and throughout the season. A three component model to estimate sensible heat flux over heterogeneous surfaces is presented. The surface was represented with two adjacent compartments. The first compartment is made up of two components, shrubs and shaded soil, the second of open 'illuminated' soil. Data collected at two different sites in Nevada (U.S.) during the Summers of 1991 and 1992 were used to evaluate model performance. The results show that the present model is sufficiently general to yield satisfactory results for both sites.

Chehbouni, A.↗

Adoption of image-driven machine learning for microstructure characterization and materials design: A Perspective

Microstructure characterization enables the development of structure-processing-property relationships critical to several research areas within the broad field of materials science, from alloy design to the assessment of corrosion resistance, and failure analysis. Conventional approaches to material characterization have relied on either qualitative inference by the human ex-pert or software applications that can extract high-level features from images, such as boundary segmentation, average grain diameter, etc. Such approaches rely heavily on subject matter expert user intervention and knowledge of what phases or more generally, what microstructural features, are of interest. The recent surge in the adoption of machine learning techniques to address problems in materials engineering has brought with it an increased interest and application of Image Driven Machine Learning (IDML) approaches. In this work, we review the applications of IDML to the field of materials characterization. A canonical hierarchy of stages is defined, which when put sequentially together completes an IDML study: problem definition, dataset building, model selection and training, model evaluation, and integration with existing instrumentation or simulation workflow. The studies reviewed in this work are analyzed from the perspective of each of these stages. Such a review permits agranular assessment of the field, for example the impact of IDML on materials characterization at the nanoscale, the size of a typical dataset required to train a semantic segmentation model on electron microscopy images, ubiquitousness of transfer learning in the domain, etc. Finally, we discuss the importance of interpretability and explainability in the field of IDML for materials characterization, and provide an overview of two emerging techniques in the field: semantic segmentation and generative adversarial networks.

Baskaran, Arun↗

An expert system for a distributed real-time trainer

The problem addressed by this expert system concerns the expansion of capability of a Real Time Trainer for the Spacelab flight crew. As requirements for more models or fidelity are placed upon the system, expansion is necessary. The simulator can be expanded using a larger processor or by going to a distributed system and expand by adding additional processors. The distributed system is preferable because it is more economical and can be expanded in a more incremental manner. An expert system was developed to evaluate modeling and timing capability within a real time training simulator. The expert system is based upon a distributed configuration. Components of the modeled system are control tasks, network tasks, emulator tasks, processors, displays, and a network. The distributed module expert system (DMES) allows the configuring of processors, tasks, display use, keyboard use, and selection of alternate methods to update the data buffer. Modules can be defined with execution occurring in a specific processor on a network. The system consists of a knowledge front end editor to interactively generate or update the knowledge base, an inference engine, a display module, and a recording module.

Purinton, Steven C.↗

Dynamic modeling of orographically induced precipitation

Local orography governs the triggering of cloud formation and the enhancement of processes such as condensation and hydrometeor nucleation and growth in mountainous regions. Intense, lengthy precipitation events are typical upwind of the topographic divide, with sharply decreasing magnitude and duration on the lee side. Differences in mean annual precipitation of several hundred percent between windward slopes of orographic barriers and adjacent valleys or lee side slopes are not unusual. Because much of the streamflow in areas such as the western United States is derived from mountainous areas that are remote and often poorly instrumented, modeling of orographic precipitation has important implications for water resources management. Models of orographically induced precipitation differ by their treatment of atmospheric dynamics and by the extent to which they rely on bulk parameterization of cloud and precipitation physics. Adiabatic ascent and a direct proportionality between efficiency and orographically magnified updrafts are the most frequent assumptions in orographic precipitation modeling. Space-time discretization (i.e., resolution) is a major issue because of the high spatial variability of orographic precipitation. For a specific storm, relative errors as large as 50 to 100% are common in the forecast/hindcast of precipitation intensity and can be even larger in the case of catastrophic storms. When monthly or seasonal timescales are used to evaluate model performance, the magnitude of such errors decreases dramatically, reaching values as low as 10 to 15%. Current research is focusing on the development of data assimilation techniques to incorporate radar and satellite observations, and on the development of aggregation and disaggregation methodologies to address the implications of modeling a multiscale problem at restricted spatial and temporal resolutions.

Barros, Ana Paula↗

Global Sensitivity Analysis Using the Ultra‐Low Resolution Energy Exascale Earth System Model

Abstract For decades, Arctic temperatures have increased twice as fast as average global temperatures. As a first step toward quantifying parametric uncertainty in Arctic climate, we performed a variance‐based global sensitivity analysis (GSA) using a fully coupled, ultra‐low resolution (ULR) configuration of version 1 of the U.S. Department of Energy's Energy Exascale Earth System Model (E3SMv1). Specifically, we quantified the sensitivity of six quantities of interests (QOIs), which characterize changes in Arctic climate over a 75 year period, to uncertainties in nine model parameters spanning the sea ice, atmosphere, and ocean components of E3SMv1. Sensitivity indices for each QOI were computed with a Gaussian process emulator using 139 random realizations of the random parameters and fixed preindustrial forcing. Uncertainties in the atmospheric parameters in the Cloud Layers Unified by Binormals (CLUBB) scheme were found to have the most impact on sea ice status and the larger Arctic climate. Our results demonstrate the importance of conducting sensitivity analyses with fully coupled climate models. The ULR configuration makes such studies computationally feasible today due to its low computational cost. When advances in computational power and modeling algorithms enable the tractable use of higher‐resolution models, our results will provide a baseline that can quantify the impact of model resolution on the accuracy of sensitivity indices. Moreover, the confidence intervals provided by our study, which we used to quantify the impact of the number of model evaluations on the accuracy of sensitivity estimates, have the potential to inform the computational resources needed for future sensitivity studies.

54 ENVIRONMENTAL SCIENCES↗

Coupled SAM/Griffin Model of a Reference Pebble Bed High-Temperature Gas Cooled Reactor for Multi-Physics Simulations

An effort has been dedicated to developing a reference model for multi-physics coupled simulation of the pebble bed high-temperature gas-cooled reactor (PB-HTGR) with SAM and Griffin computer codes for safety analysis and licensing purpose. The reference problem of a prototypical reactor design serves as the foundation for the U.S. NRC (Nuclear Regulatory Commission) to verify the adequacy of computer codes and evaluation models for specific reactor types. In this work, a SAM model of the HTR-PM reactor has been developed based on publicly available design information and the multi-dimensional Pronghorn model developed by Idaho National Laboratory. The SAM HTR-PM model includes a multi-dimensional core region and 0- D/1-D fluid components. Additionally, a simplified air RCCS loop is modeled for decay heat removal. The Griffin model is based on a recent work by Idaho National Laboratory. The coupling between the models is achieved through the MOOSE MultiApp system. Both steady-state and transient scenarios were simulated to demonstrate the coupled model’s capability for multi-physics simulations.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗