Search NASA⌕ Search

SEARCH · Search NASA

Results for “exascale simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 325 records · Page 18
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

GR-Athena++: Puncture Evolutions on Vertex-centered Oct-tree Adaptive Mesh Refinement

Numerical relativity is central to the investigation of astrophysical sources in the dynamical and strong-field gravity regime, such as binary black hole and neutron star coalescences. Current challenges set by gravitational-wave and multimessenger astronomy call for highly performant and scalable codes on modern massively parallel architectures. We present GR-Athena++, a general-relativistic, high-order, vertex-centered solver that extends the oct-tree, adaptive mesh refinement capabilities of the astrophysical (radiation) magnetohydrodynamics code Athena++. To simulate dynamical spacetimes, GR-Athena++ uses the Z4c evolution scheme of numerical relativity coupled to the moving puncture gauge. We demonstrate stable and accurate binary black hole merger evolutions via extensive convergence testing, cross-code validation, and verification against state-of-the-art effective-one-body waveforms. GR-Athena++ leverages the task-based parallelism paradigm of Athena++ to achieve excellent scalability. We measure strong-scaling efficiencies above 95% for up to ~1.2 × 10 4 CPUs and excellent weak scaling is shown up to ~10 5 CPUs in a production binary black hole setup with adaptive mesh refinement. GR-Athena++ thus allows for the robust simulation of compact binary coalescences and offers a viable path toward numerical relativity at exascale.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Numerical coupling of aerosol emissions, dry removal, and turbulent mixing in the E3SM Atmosphere Model version 1 (EAMv1) – Part 1: Dust budget analyses and the impacts of a revised coupling scheme

Abstract. An earlier study evaluating dust life cycle in the Energy Exascale Earth System Model (E3SM) Atmosphere Model version 1 (EAMv1) has revealed that the simulated global mean dust lifetime is substantially shorter when higher vertical resolution is used, primarily due to significant strengthening of dust dry removal in source regions. This paper demonstrates that the sequential splitting of aerosol emissions, dry removal, and turbulent mixing in the model's time integration loop, especially the calculation of dry removal after surface emissions and before turbulent mixing, is the primary reason for the vertical resolution sensitivity reported in that earlier study. Based on this reasoning, we propose a revised numerical process coupling scheme that requires the least amount of code changes, in which the surface emissions are applied before turbulent mixing instead of before dry removal. The revised scheme allows newly emitted particles to be transported aloft by turbulence before being removed from the atmosphere, and hence better resembles the dust life cycle in the real world. Sensitivity experiments show that the revised process coupling substantially weakens dry removal and strengthens vertical mixing in dust source regions. It also strengthens the large-scale transport from source to non-source regions, strengthens dry removal outside the source regions, and strengthens wet removal and activation globally. In transient simulations of the years 2000–2009 conducted using 1∘ horizontal grid spacing, 72 vertical layers, and unchanged tuning parameters of emission strength, the revised process coupling leads to a 40 % increase in the global total dust burden and an increase of dust lifetime from 1.8 to 2.5 d in terms of 10-year averages. Weakened dry removal and increased mixing ratios are also seen for other aerosol species that have substantial surface emissions, although the changes in mixing ratio are considerably smaller for the submicron species than for dust and sea salt. Numerical experiments confirm that the revised coupling scheme significantly reduces the strong and non-physical sensitivities of model results to vertical resolution in the original EAMv1. This provides a motivation for adopting the revised scheme in EAM as well as for further improvements on the simple revision presented in this paper.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Multiscale Nuclear-Electronic Orbital Quantum Dynamics in Complex Environments

Many renewable energy conversion processes rely on the movement of protons as well as electrons through either electrocatalysis or photoexcitation. The simulation of such processes requires a quantum mechanical description of coupled nuclear-electronic dynamics in a solvent or heterogeneous chemical environment. The overall objective of this project is the development of theoretical and computational capabilities for simulating nuclear-electronic quantum dynamics in complex environments and the creation of high-performance, open-source software. This multiscale framework will enable simulations of the real-time dynamics of nonequilibrium excited state proton-coupled electron transfer, quantum decoherence, vibronic energy transfer, and ultrafast radiolysis, as well as their associated time-resolved multidimensional spectroscopies. An important outcome of this project will be a sustainable, reusable, and interoperable open-source software ecosystem. This software will be designed for emerging exascale and future national leadership computers. Another key outcome will be a multiscale quantum dynamics method and software enabling simulations of nonequilibrium nuclear-electronic quantum dynamics in complex environments.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2022

Combining Physics and Machine Learning for the Next Generation of Molecular Simulation

Simulating molecules and atomic systems at quantum accuracy is a grand challenge for science in the 21 st century. Quantum-accurate simulations would enable the design of new medicines and the discovery of new materials. The defining problem in this challenge is that quantum calculations on large molecules, like proteins or DNA, are fundamentally impossible with current algorithms. In this work, we explore a range of different methods that aim to make large, quantum-accurate simulations possible. We show that using advanced classical models, we can accurately simulate ion channels, an important biomolecular system. We show how advanced classical models can be implemented in an exascale-ready software package. Lastly, we show how machine learning can learn the laws of quantum mechanics from data and enable quantum electronic structure calculations on thousands of atoms, a feat that is impossible for current algorithms. Altogether, this work shows that combining advances in physics models, computing, and machine learning, we are moving closer to the reality of accurately simulating our molecular world.

74 ATOMIC AND MOLECULAR PHYSICS↗
DOE OSTI2024

Validating a microphysical prognostic stratospheric aerosol implementation in E3SMv2 using observations after the Mount Pinatubo eruption

Abstract. This paper describes the addition of a stratospheric prognostic aerosol (SPA) capability – developed with the goal of accurately simulating sulfate aerosol formation and evolution in the stratosphere – in the Department of Energy (DOE) Energy Exascale Earth System Model, version 2 (E3SMv2). The implementation includes changes to the four-mode Modal Aerosol Module microphysics in the stratosphere to allow for larger particle growth and more accurate stratospheric aerosol lifetime following the Pinatubo eruption. E3SMv2-SPA reasonably reproduces stratospheric aerosol lifetime, burden, aerosol optical depth, and top-of-atmosphere flux when compared to remote sensing observations. E3SMv2-SPA also has close agreement with the interactive chemistry–climate model CESM2-WACCM (Community Earth System Model version 2–Whole Atmosphere Community Climate Model) – which has a more complete chemical treatment – and the observationally constrained, prescribed volcanic aerosol treatment in E3SMv2. Global stratospheric aerosol size distributions identify the nucleation and growth of sulfate aerosol from volcanically injected SO2 from both major and minor volcanic eruptions from 1991 to 1993. The modeled aerosol effective radius is consistently lower than satellite and in situ measurements (max differences of ∼ 30 %). Comparisons with in situ size distribution samples indicate that this simulated underestimation in both E3SMv2-SPA and CESM2-WACCM is due to overly small accumulation and coarse-mode aerosols 6–18 months post-eruption, with E3SMv2-SPA simulating ∼ 50 % of the coarse-mode geometric mean diameters of observations 11 months post-eruption. Effective radii from the models and observations are used to calculate offline scattering and absorption efficiencies to explore the implications of smaller simulated aerosol size for the Pinatubo climate impacts. Scattering efficiencies at wavelengths of peak solar irradiance (∼ 0.5 µm) are 10 %–80 % higher for daily samples in models relative to observations through 1993, suggesting higher diffuse radiation at the surface and a larger cooling effect in the models due to the smaller simulated aerosol; absorption efficiencies at the peak wavelengths of outgoing terrestrial radiation (∼ 10 µm) are 15 %–40 % lower for daily samples in models relative to observations, suggesting an underestimation in stratospheric heating in the models due to the smaller simulated aerosol. These potential biases are based on aerosol size alone and do not take into account differences in the aerosol number. The overall agreement of E3SMv2-SPA with observations and its similar performance to the well-validated CESM2-WACCM makes E3SMv2-SPA a viable alternative to simulating climate impacts from stratospheric sulfate aerosols.

Brown, Hunter York (ORCID:0000000218147874)↗
DOE OSTI2026

Understanding Biases in Simulated Cloud Radiative Effects in E3SMv3

This study systematically investigates biases in cloud radiative effects (CREs) within the recently released Energy Exascale Earth System Model version 3 (E3SMv3). Compared to its previous version (E3SMv2), E3SMv3 shows excessively strong shortwave CRE over tropical and subtropical oceans, the Southern Ocean, and the Northern Hemisphere storm tracks, which is primarily caused by an overestimation of optically intermediate low clouds. The model also displays excessive longwave CRE over the Maritime Continent and other tropical deep convection regions, resulting from an overestimation of optically thick high clouds. Implementing the Predicted Particle Properties (P3) scheme for stratiform clouds played the most significant role in these cloud changes. In addition, using a double-moment scheme for convective clouds contributed to the increase in intermediate low clouds and optically thick clouds in tropical deep convection regions. Error metrics for total cloud amount (E TCA ), cloud properties (E ctp-τ ), and cloud properties weighted by their SW and LW radiative impacts (E SW and E LW ) indicate that E3SMv3's ability to reproduce observed cloud radiative effect of low, middle, and high clouds has not been improved compared to E3SMv2. Nevertheless, the performance of E3SMv3 remains well within the spread of CMIP6 models, with E SW and E LW values smaller than those in most CMIP6 models. This study underscores the importance of integrating diverse satellite observations for robust cloud evaluation and using cloud-radiation relationships as consistency check for model errors. It suggests that further model developments focus on improving cloud microphysics and their interactions with radiation.

Environmental sciences↗
DOE OSTI2024

Influence of Antarctic and Greenland Continental Shelf Circulation on High‐Latitude Oceans in E3SM

The science objectives of this project are to simulate and understand the impacts of both deep-basin warm-water intrusions and land-ice melt on the continental shelf circulations and sea-ice distributions around the margins of Greenland and Antarctica. As well, the role of subsurface ocean heat from the Atlantic on declining sea-ice cover in the Arctic is explored. Mesoscale processes and fine bathymetry are implicated in cross-shelf property transports around both Greenland and Antarctica. Therefore, we configured and ran an atmospheric reanalysis-forced global ocean/sea-ice simulation on a grid that reduces from 8 km at the Equator to 2 km at the poles (UH8to2) with 60 vertical levels. It was produced using the Energy Exascale Earth System Model ‘‘HiLAT’’ code (E3SMv0-HiLAT) that uses the Parallel Ocean Program (POP) and CICE5 as its ocean and sea-ice components, respectively. Two main UH8to2 simulations were carried out: one for 1975-2009 and the other for July 2016-2020 after it was initialized from a 1/25° data-assimilative ocean/sea-ice prediction system ocean/sea-ice state. The UH8to2 is not coupled to an active land-ice model. Rather, land-ice melt is represented by observationally informed freshwater fluxes (FWFs). Short (multi-year) UH8to2 simulations were conducted to understand sensitivities when Greenland ice sheet (GrIS) melt is released only at the ocean surface or when it is distributed over the upper water column in accordance with fjord melt plume behavior; these cases were compared with a no GrIS melt case. West Greenland continental shelf currents were fastest in the vertical distribution case and an increase in baroclinic conversion at the shelf break associated with increased eddy kinetic energy was found relative to the surface release case. Further, salinity is lower and meltwater volume greater in the eastern Labrador Sea in the vertical distribution case. For the Arctic, the veracity of the UH8to2 was evaluated for 2017-2020 using available observations. Simulated seasonal sea-ice thickness and concentration are realistic, but the ice is unrealistically thin in the central and eastern Arctic in the fall. Comparisons of vertical sections of ocean temperature, salinity, and buoyancy collected from Ice-Tethered Profilers (ITPs) in the eastern Arctic in the fall and winter of 2019/2020 and co-located/concurrent UH8to2 fields show the stratification over the top 100 m of the water column is too low in the model, the simulated mixed layer too deep, and the simulated subsurface Atlantic Water (AW) too warm; these biases may contribute to the sea-ice biases. A model intercomparison study using the UH8to2 and a forced 1/25° regional Arctic ocean/sea-ice (uses the HYbrid Coordinate Ocean Model and CICE5) simulation further investigates the relationship between AW and sea-ice in the eastern Arctic. The models show a mesoscale-rich pulse of Atlantic Water extending into the eastern basin that reaches maximum intensity in late winter of 2018, after which it decreases in strength. Concurrent and co-located sea-ice melt or the inhibition of sea-ice growth is seen and is attributed to halocline mesoscale eddies doming into the mixed layer with convection bringing this heat into the vicinity of the sea-ice.

58 GEOSCIENCES↗
DOE OSTI2025

Observationally constrained analysis on the distribution of fine- and coarse-mode nitrate in global models

Nitrate plays an important role in the Earth system and air quality. A key challenge in simulating the life cycle of nitrate aerosol in global models is to accurately represent mass size distribution of nitrate aerosol. In this study, we evaluate the performance of the Energy Exascale Earth System Model version 2 (E3SMv2) and the Community Earth System Model version 2 (CESM2), along with Aerosol Comparisons between Observations and Models (AeroCom) phase III models, in simulating spatial distribution of fine-mode nitrate, the mass size distribution of fine- and coarse-mode nitrate, and the gas–aerosol partitioning between nitric acid gas and nitrate, using long-term ground-based observations and measurements from multiple aircraft campaigns. We find that most models underestimate the annual mean PM 2.5 (particulate matter with diameter less than 2.5 µm) nitrate surface concentration averaged over all sites. The observed nitrate PM 2.5 / PM 10 and PM 1 / PM 4 ratios are influenced by the relative contribution of fine sulfate or organic particles and coarse dust or sea salt particles. Overall, the ground-based observations give an annual mean surface nitrate PM 2.5 / PM 10 ratio of 0.7. Most models underestimate the annual mean PM 2.5 / PM 10 ratio in all regions. There are large spreads in the modeled nitrate PM 1 / PM 4 ratios, which span the full range from 0 to 1. Most models underestimate the surface molar ratio of nitrate to total inorganic nitrate averaged across all sites. Our study indicates the importance of gas–aerosol partition parameterization and the simulation of dust and sea salt in correctly simulating the mass size distribution of nitrate.

Nitrate↗
DOE OSTI2022

Modeling Global Carbon Costs of Plant Nitrogen and Phosphorus Acquisition

Abstract Most Earth system models (ESMs) do not explicitly represent the carbon (C) costs of plant nutrient acquisition, which leads to uncertainty in predictions of the current and future constraints to the land C sink. We integrate a plant productivity‐optimizing nitrogen (N) and phosphorus (P) acquisition model (fixation & uptake of nutrients, FUN) into the energy exascale Earth system (E3SM) land model (ELM). Global plant N and P uptake are dynamically simulated by ELM‐FUN based on the C costs of nutrient acquisition from mycorrhizae, direct root uptake, retranslocation from senescing leaves, and biological N fixation. We benchmarked ELM‐FUN with three classes of products: ILAMB, a remotely sensed nutrient limitation product, and CMIP6 models; we found significant improvements in C cycle variables, although the lack of more observed nutrient data prevents a comprehensive level of benchmarking. Overall, we found N and P co‐limitation for 80% of land area, with the remaining 20% being either predominantly N or P limited. Globally, the new model predicts that plants invested 4.1 Pg C yr −1 to acquire 841.8 Tg N yr −1 and 48.1 Tg P yr −1 (1994–2005), leading to significant downregulation of global net primary production (NPP). Global NPP is reduced by 20% with C costs of N and 50% with C costs of NP. Modeled and observed nutrient limitation agreement increases when N and P are considered together ( r 2 from 0.73 to 0.83).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Evaluation of Flow Routing on the Unstructured Voronoi Meshes in Earth System Modeling

Flow routing is a fundamental process of Earth System Models' (ESMs) river component. Traditional flow routing models rely on Cartesian rectangular meshes, which exhibit limitations, particularly when coupled with unstructured mesh-based ocean components. They also lack the support for regionally refined models. While previous studies have highlighted the potential benefits of unstructured meshes for flow routing, their widespread application and comprehensive evaluation within ESMs remain limited. This study extends the river component of the Energy Exascale Earth System Model to unstructured Voronoi meshes. We evaluated the model's performance in simulating river discharge and water depth across three watersheds spanning the Arctic, temperate, and tropical regions. The results show that while providing several benefits, unstructured mesh-based flow routing can achieve comparable performance to structured mesh-based routing, and their difference is often less than 10%. Although the unstructured mesh-based method could address several existing limitations, this research also shows that additional improvements in the numerical method are needed to fully exploit the advantages of unstructured mesh for hydrologic and ESMs.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Changing Characteristics of Tropical Extreme Precipitation–Cloud Regimes in Warmer Climates

In this study, we investigated the changing characteristics of climatic scale (monthly) tropical extreme precipitation in warming climates using the Energy Exascale Earth System Model (E3SM). The results are from Atmospheric Model Intercomparison Project (AMIP)-type simulations driven by (a) a control experiment with the present-day sea surface temperature (SST) and CO 2 concentration, (b) P4K, the same as in (a) but with a uniform increase of 4K in the SST globally, and (c) the same as in (a), but with an imposed SST and CO 2 concentration from the outputs of the coupled E3SM forced by a 4xCO 2 concentration. We found that as the surface warmed under P4K and 4xCO 2 , both convective and stratiform rain increased. Importantly, there was an increasing fractional contribution of stratiform rain as a function of the precipitation intensity, with the most extreme but rare events occurring preferentially over land more than the ocean, and more so under 4xCO 2 than P4K. Extreme precipitation was facilitated by increased precipitation efficiency, reflecting accelerated rates of recycling of precipitation cloud water (both liquid and ice phases) in regions with colder anvil cloud tops. Changes in the vertical profiles of clouds, condensation heating, and vertical motions indicate increasing precipitation–cloud–circulation organization from the control and P4K to 4xCO 2 . The results suggest that large-scale ocean warming, that is, P4K, was the primary cause contributing to an organization structure resembling the well-known mesoscale convective system (MCS), with increased extreme precipitation on shorter (hourly to daily) time scales. Additional 4xCO 2 atmospheric radiative heating and dynamically consistent anomalous SST further amplified the MCS organization under P4K. Analyses of the surface moist static energy distribution show that increases in the surface moisture (temperature) under P4K and 4xCO 2 was the key driver leading to enhanced convective instability over tropical ocean (land). However, a fast and large increase in the land surface temperature and lack of available local moisture resulted in a strong reduction in the land surface relative humidity, reflecting severe drying and enhanced convective inhibition (CIN). It is argued that very extreme and rare “record-breaking” precipitation events found over land under P4K, and more so under 4xCO 2 , are likely due to the delayed onset of deep convection, that is, the longer the suppression of deep convection by CIN, the more severe the extreme precipitation when it eventually occurs, due to the release of a large amount of stored surplus convective available potential energy in the lower troposphere during prolonged CIN.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Modeling the topographic influence on aboveground biomass using a coupled model of hillslope hydrology and ecosystem dynamics

Abstract. Topographic heterogeneity and lateral subsurface flow at the hillslope scale of ≤1 km may have outsized impacts on tropical forest through their impacts on water available to plants under water-stressed conditions. However, vegetation dynamics and finer-scale hydrologic processes are not concurrently represented in Earth system models. In this study, we integrate the Energy Exascale Earth System Model (E3SM) land model (ELM) that includes the Functionally Assembled Terrestrial Ecosystem Simulator (FATES), with a three-dimensional hydrology model (ParFlow) to explicitly resolve hillslope topography and subsurface flow and perform numerical experiments to understand how hillslope-scale hydrologic processes modulate vegetation along water availability gradients at Barro Colorado Island (BCI), Panama. Our simulations show that groundwater table depth (WTD) can play a large role in governing aboveground biomass (AGB) when drought-induced tree mortality is triggered by hydraulic failure. Analyzing the simulations using random forest (RF) models, we find that the domain-wide simulated AGB and WTD can be well predicted by static topographic attributes, including surface elevation, slope, and convexity, and adding soil moisture or groundwater table depth as predictors further improves the RF models. Different model representations of mortality due to hydraulic failure can change the dominant topographic driver for the simulated AGB. Contrary to the simulations, the observed AGB in the well-drained 50 ha forest census plot within BCI cannot be well predicted by the RF models using topographic attributes and observed soil moisture as predictors, suggesting other factors such as nutrient status may have a larger influence on the observed AGB. The new coupled model may be useful for understanding the diverse impact of local heterogeneity by isolating the water availability and nutrient availability from the other external and internal factors in ecosystem modeling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Origin of large variations of current on/off ratio and switching voltage in atomically thin memristors: an exascale ab initio transport study

Nonvolatile resistive switching in two-dimensional monolayers opens a new avenue for high-density memory/computing devices. However, questions remain as to why the current on/off ratio and switching voltage vary significantly among different devices. Here, we simulate electronic transport of large systems consisting of a h-BN monolayer sandwiched by gold electrodes, enabled by an implementation of the nonequilibrium Green’s function method in the exascale density functional theory (DFT) code: Real-space MultiGrid. Systematic calculations reveal that the wide range of on/off ratios is due to variations in interface distances between the electrode and h-BN that significantly modulate their wavefunction overlap. In addition, DFT calculations demonstrate that the energy barrier of a gold atom dissociating from the electrode to h-BN increases dramatically with the interface distance, thereby explaining the strong dependence of the switching voltage on distance. Our work demonstrates the significance of interface distance in governing the current on/off ratio and switching voltage.

Electronic devices↗
DOE OSTI2020

Developing a simulator-based satellite dataset for using machine learning techniques to derive aerosol-cloud-precipitation interactions in models and observations in a consistent framework

Aerosol-cloud-precipitation interactions (ACPI) remain a major uncertainty in understanding the Earth’s radiation budget and water cycle (including extremes). After decades of active research, various observationally based metrics have been developed to constrain ACPI in Earth System Models (ESMs), but direct comparison of model and data estimates can confound scientific understanding because limitations and uncertainties in sampling and retrieval procedures may combine with model deficiencies in process representations of ACPI to obstruct understanding. Furthermore, conventional ACPI metrics often vary from one regime to another, and the ACPI process representation in ESMs is also typically derived based on only a limited area/regime (even though the parameterization applies globally). To bridge the gap between models and data and to correctly describe ACPI in all regimes, we propose to construct a new CALIPSO-CloudSat merged dataset that is produced by the same algorithms used in satellite simulators in ESMs, and to use machine learning techniques to derive new ACPI metrics that can be accurately estimated by satellites and can provide meaningful constraints on cloud microphysical process representations in ESMs. The dataset will include measured and retrieved variables for aerosol, cloud, and precipitation from CALIPSO and CloudSat, and environmental variables from meteorological reanalysis. The data will be used to train a neural network to construct the ACPI metrics as a function of environmental conditions. The new ACPI formula will be used to constrain the ACPI in the Energy Exascale Earth System Model (E3SM), and to augment/reformulate the ACPI process representation in the E3SM to improve the simulation of the evolution of the atmosphere under different environmental conditions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Enhancing Photosynthesis Simulation Performance in ESMs with Machine Learning-Assisted Solvers

When simulating vegetation dynamics, photosynthesis accounts for a large fraction of the computational cost in most Earth System Models (ESMs). This is largely since photosynthesis is represented as a system of nonlinear equations, and the solution requires the use of an initial guess followed by many iterations of the numerical solver to obtain a solution. We use machine learning (ML) to replicate the response surface of the model’s numerical solver to improve the choice of initial guess, therefore requiring fewer iterations to obtain a final solution. We implemented this test on the leaf-level calculations as well as at the canopy scale, and for both we observed fewer iterations of the photosynthesis solver when a ML-based initial guess was implemented. The model tested here is the Energy Exascale Earth System Model - Land Model (ELM). The ML-based algorithms used here are trained on simulations from the model itself and used only to improve the initial guess for the solver; therefore, the model maintains its own set of physics to obtain the final solution. This work shows novel ways to utilize ML-based methods to improve the performance of numerical solvers in ESMs.

Massoud, Elias [ORNL] (ORCID:0000000217725361)↗
DOE OSTI2020

Toward Understanding the Simulated Phase Partitioning of Arctic Single-Layer Mixed-Phase Clouds in E3SM

21 Mixed-phase clouds are widespread in the Arctic and have substantial impacts on the 22 surface energy budget, sea ice extent, and regional climate. Significant changes are found in the 23 modeled phase partitioning of Arctic mixed-phase clouds in the newly developed U.S. 24 Department of Energy (DOE) Energy Exascale Earth System Model (E3SM) Atmosphere Model 25 version 1 (EAMv1) compared to its predecessor (CAM5/EAMv0). The mixed-phase clouds 26 simulated by EAMv1 is overly dominated by super-cool liquid which is often underestimated by 27 CAM5. Compared to CAM5, EAMv1 has made several important changes in its cloud physical 28 parameterizations, including using CLUBB to unify shallow convection, PBL turbulence, and 29 cloud macrophysics, as well as updating the MG two-moment cloud microphysics scheme and 30 using the CNT heterogeneous ice nucleation scheme to replace the Meyers scheme for mixed- 31 phase clouds. To understand which of the newly-implemented physical parameterizations is 32 responsible for the change of modeled mixed-phase cloud phase partitioning in EAMv1, 33 sensitivity tests are conducted by utilizing the short-term hindcast approach and results are 34 compared to the observations from the ARM Mixed-Phase Arctic Cloud Experiment (M-PACE) 35 field campaign. 36 It is found that although each scheme contributes to the decrease of cloud ice water 37 content (IWC) and increase of cloud liquid water content (LWC), only the combined effect of 38 CLUBB and CNT can explain the significant underestimation of IWC. By examining the budgets 39 of cloud microphysical processes, CLUBB is found to play a dominant role due to the fact that 40 CLUBB does not diagnoses cloud ice phase water in its assumed joint PDF method and thus may 41 not provide sufficient cloud ice to initialize ice phase microphysical processes such as the growth 42 of ice crystals through vapor deposition. Although a more effective heterogeneous ice nucleation 43 may alleviate the underestimation of IWC, the ice phase process in CLUBB requires urgent 44 attention in the future model development.

Zhang, Meng↗
DOE OSTI2021

LLNL Response to the DOE ASCR RFI, "Stewardship of Software for Scientific and High-Performance Computing"

For decades, Lawrence Livermore National Laboratory (LLNL) has been engaged in significant research, development, and support for software to enable scientific computing and, particularly, the use of high performance computing (HPC) in the NNSA mission space. In particular, the move in the mid-1990’s to simulation as a leading component of stockpile stewardship through the ASCI and the successor ASC programs, as well as the need for reliable data acquisition and control software for the National Ignition Facility, have been important drivers in building expertise in production-quality software development at LLNL. LLNL has also been a leader in the DOE SciDAC FASTMath Institute and the DOE Exascale Computing Project (ECP), both of which have striven to make scientific computing software – in particular, the enabling technologies underpinning simulation capabilities – more widely adopted and sustainable. As such, we believe that our experience can inform the broader goal of software stewardship for scientific and high-performance computing. LLNL strongly supports the formation of a new DOE ASCR program element in software stewardship and sustainment. Historically, DOE ASCR has funded applied mathematics and computer science research that has led to the development of important new capabilities and algorithms that are expressed as artifacts in research software. Such frameworks, libraries, and tools have seldom been directly funded to address the important issues of code maintenance, documentation, robustness, and community building. Software engineering and support have typically been done on the side in support of the ASCR-driven research products. DOE funding priorities have been slow to recognize that good software engineering, the kind that ensures research investments have more adoption and longevity, requires significant resources. Based upon our experiences, we have prepared this response to highlight the concerns and issues we believe to be important as DOE ASCR considers its role in scientific software stewardship. We believe that role is important and will require a significant investment of new funding to legitimately support the technologies past and future DOE ASCR investments have and will produce to facilitate their uptake and adoption in the broader scientific computing community. Following a summary of our involvement in scientific software development, the remainder our response is organized around the nine topics specifically identified in the RFI.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Asynchronous-many-task systems: Challenges and opportunities - Scaling an AMR astrophysics code on exascale machines using Kokkos and HPX

Dynamic and adaptive mesh refinement is pivotal in high-resolution, multi-physics, multi-model simulations, necessitating precise physics resolution in localized areas across expansive domains. Today’s supercomputers’ extreme heterogeneity presents a significant challenge for dynamically adaptive codes, highlighting the importance of achieving performance portability at scale. Our research focuses on astrophysical simulations, particularly stellar mergers, to elucidate early universe dynamics. Here, we present Octo-Tiger, leveraging Kokkos, HPX, and SIMD for portable performance at scale in complex, massively parallel adaptive multi-physics simulations. Octo-Tiger supports diverse processors, accelerators, and network backends. Experiments demonstrate exceptional scalability across several heterogeneous supercomputers including Perlmutter, Frontier, and Fugaku, encompassing major GPU architectures and x86, ARM, and RISC-V CPUs. Parallel efficiency of 47.59% (110,080 cores and 6880 hybrid A100 GPUs) on a full-system run on Perlmutter (26% HPCG peak performance) and 51.37% (using 32,768 cores and 2048 MI250X) on Frontier are achieved.

97 MATHEMATICS AND COMPUTING↗