Search NASA⌕ Search

SEARCH · Search NASA

Results for “exascale simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Parallel Multigrid in Time and Space for Extreme-Scale Computational Science: Chaotic and Hyperbolic Problems

The coming massive parallelism of exascale computing presents a pressing challenge for the many DOE simulations of time-dependent partial differential equations (PDEs), which typically use traditional sequential time stepping methods. Since this traditional approach is inherently serial, it presents a sequential bottleneck when moving to exascale computing, because future performance gains will come through greater concurrency, not faster clock speeds. Thus, the goal of this work is to research parallelism in time, i.e., methods that compute multiple time values simultaneously, not sequentially. The focus will be on hyperbolic and chaotic problems of interest to DOE, with the goal of enabling scalable simulations of time-dependent hyperbolic and chaotic problems on future architectures. The chosen methodology for solving these problems parallel-in-time is multigrid, because multigrid (when it works) is a powerful, optimal, and scalable solver for discretized PDEs. Multigrid is already commonly used in many DOE simulations for scalably and optimally solving space-only PDE problems. The areas of hyperbolic and chaotic problems are chosen because of their relevance to problems of programmatic interest to DOE. However, these problems are also well-known to be difficult for parallelin-time methods, with the most common method, parareal, diverging in many cases. The current stateof-the-art for parallel-in-time at LLNL is the multigrid reduction in time (MGRIT) XBraid package, which also struggles for such problems, while still showing some improvement over parareal. In summary, new methods are needed for an efficient parallel-in-time scheme for hyperbolic and chaotic problems, and this work shall research promising new multigrid methods in this area. In particular, we take inspiration from the Least Squares Shadowing (LSS by Wang) approach for solving chaotic problems. Here, an optimization approach is able to find “well-conditioned” shadow trajectories/solutions to the original “ill-conditioned” chaotic problem. Thus, the new multigrid methods researched here also arise in an optimization context.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Multigrid Reduction in Time for Chaotic and Hyperbolic Problems (Final Report)

The coming massive parallelism of exascale computing presents a pressing challenge for the many DOE simulations of time-dependent partial differential equations (PDEs), which typically use traditional sequential time stepping methods. Since this traditional approach is inherently serial, it presents a sequential bottleneck when moving to exascale computing, because future performance gains will come through greater concurrency, not faster clock speeds. Thus, the goal of this work is to research parallelism in time, i.e., methods that compute multiple time values simultaneously, not sequentially. The focus will be on hyperbolic and chaotic problems of interest to DOE, with the goal of enabling scalable simulations of time-dependent hyperbolic and chaotic problems on future architectures. The chosen methodology for solving these problems parallel-in-time is multigrid, because multigrid (when it works) is a powerful, optimal, and scalable solver for discretized PDEs. Multigrid is already commonly used in many DOE simulations for scalably and optimally solving space-only PDE problems. The areas of hyperbolic and chaotic problems are chosen because of their relevance to problems of programmatic interest to DOE. However, these problems are also well-known to be difficult for parallelin-time methods, with the most common method, parareal, diverging in many cases. The current state-of-the-art for parallel-in-time at LLNL is the multigrid reduction in time (MGRIT) XBraid package, which also struggles for such problems, while still showing some improvement over parareal. In summary, new methods are needed for an efficient parallel-in-time scheme for hyperbolic and chaotic problems, and this work shall research promising new multigrid methods in this area. In particular, this work shall continue researching the directions from the current collaboration with Dr. Falgout, which are laid out in the work Toward Parallel in Time for Chaotic Dynamical Systems and showed the first known results of a parallel-in-time speedup for a chaotic problem. This work outlines two key improvements to XBraid for chaotic problems, the so-called “theta” and “delta-correction” methods. Here, these two improvements will be implemented in a high-performance but general way in XBraid and explored for more complicated problems. We will additionally research, as time allows, improvements to these techniques, as well as multigrid relaxation techniques based on Least Squares Shadowing (LSS by Wang) and a nonintrusive block tridiagonal solver based on MGRIT, called TriMGRIT.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Multigrid Reduction in Time for Chaotic and Hyperbolic Problems (Final Report)

The coming massive parallelism of exascale computing presents a pressing challenge for the many DOE simulations of time-dependent partial differential equations (PDEs), which typically use traditional sequential time stepping methods. Since this traditional approach is inherently serial, it presents a sequential bottleneck when moving to exascale computing, because future performance gains will come through greater concurrency, not faster clock speeds. Thus, the goal of this work is to research parallelism in time, i.e., methods that compute multiple time values simultaneously, not sequentially. The focus will be on hyperbolic and chaotic problems of interest to DOE, with the goal of enabling scalable simulations of time-dependent hyperbolic and chaotic problems on future architectures. The chosen methodology for solving these problems parallel-in-time is multigrid, because multigrid (when it works) is a powerful, optimal, and scalable solver for discretized PDEs. Multigrid is already commonly used in many DOE simulations for scalably and optimally solving space-only PDE problems. The areas of hyperbolic and chaotic problems are chosen because of their relevance to problems of programmatic interest to DOE. However, these problems are also well-known to be difficult for parallel-in-time methods, with the most common method, parareal, diverging in many cases. The current state of-the-art for parallel-in-time at LLNL is the multigrid reduction in time (MGRIT) XBraid package, which also struggles for such problems, while still showing some improvement over parareal. In summary, new methods are needed for an efficient parallel-in-time scheme for hyperbolic and chaotic problems, and this work shall research promising new multigrid methods in this area. In particular, this work shall continue researching the directions from the current collaboration with Dr. Falgout, which are laid out in the work Toward Parallel in Time for Chaotic Dynamical Systems and showed the first known results of a parallel-in-time speedup for a chaotic problem. This work outlines two key improvements to XBraid for chaotic problems, the so-called “theta” and “delta-correction” methods. Here, these two improvements will be further researched and improved (including with a new relaxation method inspired by on Least Squares Shadowing (LSS)) and explored for more complicated problems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

A machine learning approach targeting parameter estimation for plant functional type coexistence modeling using ELM-FATES (v2.0)

Tropical forest dynamics play a crucial role in the global carbon, water, and energy cycles. However, realistically simulating the dynamics of competition and coexistence between different plant functional types (PFTs) in tropical forests remains a significant challenge. This study aims to improve the modeling of PFT coexistence in the Functionally Assembled Terrestrial Ecosystem Simulator (FATES), a vegetation demography model implemented in the Energy Exascale Earth System Model (E3SM) land model (ELM), ELM-FATES. Specifically, we explore (1) whether plant trait relationships established from field measurements can constrain ELM-FATES simulations and (2) whether machine learning (ML)-based surrogate models can emulate the complex ELM-FATES model and optimize parameter selections to improve PFT coexistence modeling. We conducted three ensembles of ELM-FATES experiments at a tropical forest site near Manaus, Brazil. By comparing the ensemble experiments without (Exp-CTR) and with (Exp-OBS) consideration of observed trait relationships, we found that accounting for these relationships slightly improves the simulations of water, energy, and carbon variables when compared to observations but degrades the simulation of PFT coexistence. Using ML-based surrogate models trained on Exp-CTR, we optimized the trait parameters in ELM-FATES and conducted another ensemble of experiments (Exp-ML) with these optimized parameters. The proportion of PFT coexistence experiments significantly increased from 21 % in Exp-CTR to 73 % in Exp-ML. After filtering the experiments that allow for PFT coexistence to agree with observations (within 15 % tolerance), 33 % of the Exp-ML experiments were retained, which is a significant improvement compared to the 1.4 % in Exp-CTR. Exp-ML also accurately reproduces the annual means and seasonal variations in water, energy, and carbon fluxes and the field inventory of aboveground biomass. This study represents a reproducible method that utilizes machine learning to identify parameter values that improve model fidelity against observations and PFT coexistence in vegetation demography models for diverse ecosystems. Our study also suggests the need for new mechanisms to enhance the robust simulation of coexisting plants in ELM-FATES and has significant implications for modeling the response and feedbacks of ecosystem dynamics to climate change.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Improving thermodynamic nudging in the E3SM Atmosphere Model version 2 (EAMv2): strategy and hindcast skills on weather systems

Nudging techniques are commonly employed to constrain atmospheric simulations toward observed states, facilitating model evaluation and sensitivity studies. However, if applied improperly – particularly to thermodynamic variables such as temperature and humidity – nudging can distort physical processes and introduce spurious biases, undermining the credibility of the simulations. This study presents an improved nudging implementation that applies vertically modulated tendencies to reduce adverse impacts on model physics. The framework is tested in version 2 of the Energy Exascale Earth System Model (EAMv2) using a suite of hindcast simulations nudged toward ERA5 reanalysis. We systematically evaluate the individual and combined effects of nudging wind, temperature, and humidity fields on the model's ability to represent large-scale atmospheric states and high-impact weather systems. Results show that the revised strategy – particularly when nudging temperature and humidity at selected levels – enhances hindcast skill by improving agreement with ERA5 without degrading the hydrological cycle or precipitation processes. Additional improvements in surface temperature, outgoing longwave radiation, and precipitation biases are achieved through targeted nudging of land-surface variables. The proposed approach strengthens the representation of large-scale conditions relevant to tropical cyclones, atmospheric rivers, and extratropical cyclones in the low-resolution EAMv2. These findings demonstrate that carefully designed thermodynamic nudging, especially of temperature and humidity, improves the realism of constrained simulations and broadens the utility of nudged EAMv2 for atmospheric modeling, machine learning, and high-impact weather research.

Atmospheric river↗
DOE OSTI2021

Nitrogen and phosphorus cycling in an ombrotrophic peatland: a benchmark for assessing change

Aims Slow decomposition and isolation from groundwater mean that ombrotrophic peatlands store a large amount of soil carbon (C) but have low availability of nitrogen (N) and phosphorus (P). To better understand the role these limiting nutrients play in determining the C balance of peatland ecosystems, we compile comprehensive N and P budgets for a forested bog in northern Minnesota, USA. Methods N and P within plants, soils, and water are quantified based on field measurements. The resulting empirical dataset are then compared to modern-day, site-level simulations from the peatland land surface version of the Energy Exascale Earth System Model (ELM-SPRUCE).

Salmon, Verity G.↗
DOE OSTI2020

E3SM Water Cycle Visualization Project (Final Report)

Motivated by the need to improve visualizations of Earth's complex water cycle, this team embarked on non-trivial tasks to push from traditional methods of viewing data from simulations as static line graphs and contour plots into new realms with multiple dimensions (three spatial dimensions and the time component) viewable at once. To do this, we chose to feature the extremes in the general circulation of the atmosphere because these Earth system elements are short-lived, but impactful events. We used simulation data produced by the Department of Energy's (DOE) Energy Exascale Earth System Model (E3SM),which is designed to answer DOE science questions using DOE computing facilities. The E3SM project includes three sets of simulation experiments: cryosphere, bio-geochemical cycles, and the water cycle. The water cycle experiment campaign includes a set of simulations designed to understand how the water cycle will change in coming decades under a changing climate.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Implementing a neural network interatomic model with performance portability for emerging exascale architectures

The two main thrusts of computational science are increasingly accurate predictions and faster calculations; to this end, the zeitgeist in molecular dynamics (MD) simulations is pursuing machine learned and data driven interatomic models, e.g. neural network potentials, and novel hardware architectures, e.g. GPUs. Current implementations of neural network potentials are orders of magnitude slower than traditional interatomic models and while looming exascale computing offers the ability to run large, accurate simulations with these models, achieving portable performance for MD with new and varied exascale hardware requires rethinking traditional algorithms, using novel data structures, and library solutions. We re-implement a neural network interatomic model in CabanaMD, an MD proxy application, built on libraries developed for performance portability. Our implementation shows significantly improved thread scaling in this complex kernel as compared to a current LAMMPS implementation, across both strong and weak scaling. Our single-source solution enables simulations up to 20 million atoms on a single CPU node and 4 million atoms with improved performance on a single GPU. Furthermore, we also explore parallelism and data layout choices (using flexible data structures called AoSoAs) and their effect on performance, seeing up to ~50% and ~5% improvements in performance on a GPU by choosing the right level of parallelism and data layout respectively.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

A Machine Learning Bias Correction on Large–Scale Environment of High–Impact Weather Systems in E3SM Atmosphere Model

Large–scale dynamical and thermodynamical processes are common environmental drivers of high–impact weather systems causing extreme weather events. However, such large–scale environmental conditions often display systematic biases in climate simulations, posing challenges to evaluating high–impact weather systems and extreme weather events. In this paper, a machine learning (ML) approach was employed to bias correct the large–scale wind, temperature, and humidity simulated by the atmospheric component of the Energy Exascale Earth System Model (E3SM) at ~1° resolution. The usefulness of the ML approach for extreme weather analysis was demonstrated with a focus on three high–impact weather systems, including tropical cyclones (TCs), extratropical cyclones (ETCs), and atmospheric rivers (ARs). We show that the ML model can effectively reduce climate bias in large–scale wind, temperature, and humidity while preserving their responses to imposed climate change perturbations. The bias correction is found to directly improve water vapor transport associated with ARs, and representations of thermodynamical flows associated with ETCs. When the bias–corrected large–scale winds are used to drive a synthetic TC track forecast model over the Atlantic basin, the resulting TC track density agrees better with that of the TC track model driven by observed winds. In addition, the ML model insignificantly interferes with the mean climate change signals of large–scale storm environments as well as the occurrence and intensity of three weather systems. This study suggests that the proposed ML approach can be used to improve the downscaling of extreme weather events by providing more realistic large–scale storm environments simulated by low–resolution climate models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Cloud Phase Simulation at High Latitudes in EAMv2: Evaluation using CALIPSO Observations and Comparison with EAMv1

This study performs a comprehensive evaluation of the simulated cloud phase in the U.S. Department of Energy (DOE) Energy Exascale Earth System Model (E3SM) atmosphere model version 2 (EAMv2) and version 1 (EAMv1). Enabled by the CALIPSO (Cloud-Aerosol Lidar and Infrared Pathfinder Satellite Observation) simulator, EAMv2 and EAMv1 predicted cloud phase is compared against the GCM-Oriented CALIPSO Cloud Product (CALIPSO-GOCCP) at high latitudes where mixed-phase clouds are prevalent. Our results indicate that the underestimation of cloud ice in simulated high-latitude mixed-phase clouds in EAMv1 has been significantly reduced in EAMv2. The increased ice clouds in the Arctic mainly result from the modification on the WBF (Wegner-Bergeron-Findeisen) process in EAMv2. The impact of the modified WBF process is moderately compensated by the low limit of cloud droplet number concentration (CDNC) in cloud microphysics and the new dCAPE_ULL trigger used in deep convection in EAMv2. Moreover, it is found that the new trigger largely contributes to the better cloud phase simulation over the Norwegian Sea and Barents Sea in the Arctic and the Southern Ocean where large errors are found in EAMv1. However, errors in simulated cloud phase in EAMv1, such as the overestimation of supercooled liquid clouds near the surface in both hemispheres and the underestimation of ice clouds over Antarctica, persist in EAMv2. In conclusion, this study highlights the impact of deep convection parameterizations, which has received little attention, on high-latitude mixed-phase clouds, and the importance of continuous improvement of cloud microphysics in climate models for accurately representing mixed-phase clouds.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

xSDK: Building an ecosystem of highly efficient math libraries for exascale

Current efforts to build increasingly powerful computer architectures are opening up new avenues for more complex and higher fidelity simulations coupled with data analytics and learning, leading to new scientific insights and deeper understanding. At one extreme, exascale computers will be much faster than previous computer generations (performing 10 18 operations per second—that is, 1,000 times faster than petascale). To achieve these performance improvements, computer architectures are becoming increasingly complex, with deep memory hierarchies, very high node and core counts, and heterogeneous features such as graphics processing units (GPUs). Such architectural changes impact the full breadth of computing scales, as heterogeneity pervades even current-generation laptops, workstations, and moderate-sized clusters. While emerging advanced architectures provide unprecedented opportunities, they also present significant challenges for developers of scientific applications, such as multiphysics and multiscale codes, who must adapt their software to handle disruptive changes in architectures and new programming models that have not yet stabilized. Developers must consider increasing concurrency while reducing communication and synchronization, and other complexities such as the potential for using mixed precision to leverage the compute power available in low-precision tensor cores. On one hand, developers must implement new scientific capabilities, which in turn increase code complexity. On the other hand, the codes must be ported to new architectures, requiring the inclusion of new programming models and the restructuring of code to achieve good performance. Addressing these issues is beyond the capability of any single person or team—leading to the need for collaboration among many teams, who encapsulate their expertise in reusable software and work together to create sustainable software ecosystems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Evaluating ecosystem water use efficiency and recovery dynamics during flash droughts: insights from observations and model simulations

Flash droughts (FD), rapidly emerging in a warming future, disrupt ecosystems, agriculture, and water security. Ecosystem water use efficiency (WUE), the ratio of gross primary production (GPP) to actual evapotranspiration (AET), balances carbon assimilation and water loss. FD rapidly disrupts this balance, making WUE critical for assessing plant stress and recovery. Here, this study investigates the dynamics of landscape-scale WUE, and the components of GPP and AET under FD utilizing both observed data from the Missouri Ozark AmeriFlux site (US-MOz) and version 2 of the U.S. Department of Energy’s Earth, Energy, Exascale System Model (E3SM) Land Model (ELMv2). Observations and simulations reveal GPP as dominant for WUE during earlier FD events (2005, 2007, 2012), shifting to AET in recent events (2014, 2018). This agreement indicates that the ELM can capture the shifting dynamics of GPP and AET in regulating WUE under FD conditions. However, the ELM systematically underestimates both GPP and AET and does so in a manner that does not preserve their ratio. As a result, WUE is also underestimated, suggesting that GPP is more strongly underestimated than AET. Furthermore, the ELM also underestimates the speed of GPP recovery, producing an artificially prolonged GPP recovery time following FD events. Observed environmental drivers such as vapor pressure deficit (VPD), soil moisture (SM), and predawn leaf water potential (PLWP) effectively predict WUE, but ELM primarily highlights SM, underestimating VPD’s role. This study demonstrates that relying solely on soil moisture fails to capture the rapid hydraulic recovery observed in PLWP, underscoring the necessity of integrating plant hydraulics into land surface models to improve flash drought predictability.

Evapotranspiration↗
DOE OSTI2024

Nutrient Dynamics in a Coupled Terrestrial Biosphere and Land Model (ELM-FATES-CNP)

We present a representation of nitrogen and phosphorus cycling in the Functionally Assembled Terrestrial Ecosystem Simulator, a demographic vegetation model within the Energy Exascale Earth System land model. This representation is modular, and designed to allow testing of multiple hypothetical approaches for carbon-nutrient coupling in plants. Novel model hypotheses introduced in this work include, (a) the controls on plant acquisition of aqueous mineralized nutrients in the soil and (b) fairly straight forward methods of allocating nutrients to specific plant organs and their losses through live plant turnover as well as litter fluxes generated through plant mortality. This combines the new with pre-existing hypotheses (such as nitrogen fixation and soil decomposition) into a system that can accommodate plant-soil dynamics for a large number of size- and functional-type-resolved plant cohorts within a time-since-disturbance-resolved ecosystem. Root uptake of nutrients is governed by fine root biomass, and plants vary in their fine root biomass allocation in order to balance carbon and nutrient limitations to growth. We test the sensitivity of the model to a wide range of parameter variations and structural representations, and in the context of observations at Barro Colorado Island, Panama. A key model prediction is that plants in the high-light-availability canopy positions allocate more carbon to fine roots than plants in low-light understory environments, given the widely different carbon versus nutrient constraints of these two niches within a given ecosystem. This model provides a basis for exploring carbon-nutrient coupling with vegetation demography within Earth system models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

An Integrated Modeling Framework for Sediment Dynamics During Urban Flooding: Application to Hurricane Harvey in Houston

Floodwater can mobilize and redistribute large volumes of sediment from upland to downstream urban areas, threatening infrastructure, water quality, and ecosystem health. However, existing modeling approaches often fail to capture sediment dynamics in urban floodplains due to the lack of integration between upland hydrological processes and riverine sediment transport. This study presents the first integrated modeling framework that couples the Energy Exascale Earth System Model (E3SM) land component, which simulates runoff and hillslope erosion, with TELEMAC-GAIA, a two-dimensional hydrodynamic and sediment transport model. This framework enables the fully distributed, process-based simulation of high-resolution (as fine as 30 m) sediment dynamics from hillslopes to floodplains. Applied to a highly urbanized watershed in Houston during Hurricane Harvey, this framework reproduced observed water levels at 16 USGS gauges (median R 2 = 0.83 and KGE = 0.78), key sediment dynamics such as sediment transport and deposition processes, and reproduced spatial deposition patterns consistent with LiDAR-derived data. Based on the simulation, we estimate 8.0 million m 3 of event-scale sediment deposition, including 5.7 million m 3 trapped in the flood-control reservoirs and 2.3 million m 3 deposited along major channels and floodplains. Using a representative unit removal cost, this corresponds to an estimated dredging cost of $581 million for total deposition. These results provide a first-order, physically based quantification of Harvey-scale sediment impacts. This study provides a valuable tool for the holistic analysis of sediment dynamics triggered by extreme urban flooding, supporting flood-resilience planning. More broadly, it highlights the importance of integrating physically based hydrological processes for urban flooding and sediment research.

Hurricane Harvey↗
DOE OSTI2026

A GPU-based compressible combustion solver for applications exhibiting disparate space and time scales

High-speed chemically active flows pose significant computational challenges due to their disparate space and time scales, with stiff chemistry often dominating simulation time. While modern scientific computing programs achieve exascale performance by leveraging graphics processing units (GPUs), existing GPU-based compressible combustion solvers face critical limitations in memory management, load balancing, and handling the highly localized nature of chemical reactions. To this end, we present a high-performance compressible reacting flow solver built on the AMReX framework and optimized for multi-GPU settings. Here, our approach addresses three GPU performance bottlenecks: memory access patterns through column-major storage optimization, computational workload variability via a bulk-sparse integration strategy for chemical kinetics, and multi-GPU load distribution for adaptive mesh refinement applications. The solver adapts existing matrix-based chemical kinetics formulations to multi-grid contexts. Using representative combustion applications, including 2D and 3D detonations and a 3D jet-in-crossflow configuration, we demonstrate 1.4–5× performance improvements over initial implementations on an in-house cluster of NVIDIA H100 GPUs, and near-ideal weak scaling on the Frontier supercomputer (Oak Ridge Leadership Computing Facility) with up to 1024 AMD Instinct MI250X GPUs. Roofline analysis reveals substantial improvements in arithmetic intensity for both convection (∼ 10 ×) and chemistry (∼ 4 ×) routines, confirming efficient utilization of GPU memory bandwidth and computational resources.

42 ENGINEERING↗
DOE OSTI2021

Effects of coupling a stochastic convective parameterization with the Zhang–McFarlane scheme on precipitation simulation in the DOE E3SMv1.0 atmosphere model

Abstract. A stochastic deep convection parameterization is implemented into the US Department of Energy (DOE) Energy Exascale Earth System Model (E3SM) Atmosphere Model version 1.0 (EAMv1). This study evaluates its performance in simulating precipitation. Compared to the default model, the probability distribution function (PDF) of rainfall intensity in the new simulation is greatly improved. The well-known problem of “too much light rain and too little heavy rain” is alleviated, especially over the tropics. As a result, the contribution from different rain rates to the total precipitation amount is shifted toward heavier rain. The less frequent occurrence of convection contributes to suppressed light rain, while more intense large-scale and convective precipitation contributes to enhanced heavy total rain. The synoptic and intraseasonal variabilities of precipitation are enhanced as well to be closer to observations. The sensitivity of the rainfall intensity PDF to the model vertical resolution is examined. The relationship between precipitation and dilute convective available potential energy in the stochastic simulation agrees better with that in the Atmospheric Radiation Measurement (ARM) observations compared with the standard model simulation. The annual mean precipitation is largely unchanged with the use of the stochastic scheme except over the tropical western Pacific, where a moderate increase in precipitation represents a slight improvement. The responses of precipitation and its extremes to climate warming are similar with or without the stochastic deep convection scheme.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Ensuring statistical reproducibility of ocean model simulations in the age of hybrid computing

Novel high performance computing systems that feature hybrid architectures require large scale code refactoring to unravel underlying exploitable parallelism. Such redesign can often be accompanied with machine-precision changes as the order of computation cannot always be maintained. For chaotic systems like climate models, these round-off level differences can grow rapidly. Systematic errors may also manifest initially as machine-precision differences. Isolating genuine round off level differences from such errors remains a challenge. Here, we apply two-sample equality of distribution tests to evaluate statistical reproducibility of the ocean model component of US Department of Energy's Energy Exascale Earth System Model (E3SM). A 2-year control simulation ensemble is compared to a modified ensemble as a test case - after a known non-bit-for-bit change in a model component is introduced - to evaluate the null hypothesis that the two ensembles are statistically indistinguishable. To quantify the false negative rates of these tests, we conduct a formal power analysis using a targeted suite of short simulation ensembles. The ensemble suite contains several perturbed ensembles, each with a progressively different climate than the baseline ensemble - obtained by perturbing the magnitude of a single model tuning parameter, the Gent and McWilliams κ, in a controlled manner. The null hypothesis is evaluated for each of perturbed ensembles using these tests. The power analysis informs on the detection limits of the tests for given ensemble size allowing model developers to evaluate the impact of an introduced non-bit-for-bit change to the model.

Mahajan, Salil↗