Search NASA⌕ Search

SEARCH · Search NASA

Results for “exascale simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17

Runoff evaluation in an Earth System Land Model for permafrost regions in Alaska

Modeling of hydrological runoff is essential for accurately capturing spatiotemporal feedbacks within the land–atmosphere system, particularly in sensitive regions such as permafrost landscapes. However, substantial uncertainties persist in the terrestrial runoff parameterization schemes used in Earth system and land surface models. This is particularly true in permafrost regions, where landscape heterogeneity is high and reliable observational data are scarce. In this study, we evaluate the performance of runoff parameterization schemes in the Energy Exascale Earth System Model (E3SM) land model (ELM). Our proposed framework leverages simulation results from the Advanced Terrestrial Simulator (ATS), which is a physics-based integrated surface/subsurface hydrologic model that has been successfully evaluated previously in Arctic tundra regions. We used ATS to simulate runoff from 22 representative hillslopes in the Sagavanirktok River basin, located on the North Slope of Alaska, then compared the output with ELM's parameterized representation of total runoff. Results show that (1) ELM's total runoff was the same order of magnitude as the ATS simulations, and both models were similarly variable over time; (2) minor adjustments to coefficients in ELM's runoff parameterization improved the match between the ATS simulation and ELM's parameterized representation of annual and seasonal total runoff; (3) overall, runoff responses in ATS and ELM are more similar in flat hillslope environments compared to steep hillslopes; and (4) shallower active layer thicknesses and higher precipitation simulations resulted in lower correlations between the two models due to greater total runoff. By incorporating the optimized runoff coefficients from the Sagavanirktok River basin into ELM, the simulated total runoff better matched the streamflow observations at a small watershed located on the Seward Peninsula of Alaska. Our findings revealed important insights into the effectiveness of runoff parameterizations in land surface models and pathways for improving runoff coefficients in typical Arctic regions.

54 ENVIRONMENTAL SCIENCES↗

Enhanced climate reproducibility testing with false discovery rate correction

Simulating the Earth's climate is an important and complex problem, thus climate models are similarly complex, comprised of millions of lines of code. In order to appropriately utilize the latest computational and software infrastructure advancements in Earth system models running on modern hybrid computing architectures to improve their performance, precision, accuracy, or all three; it is important to ensure that model simulations are repeatable and robust. This introduces the need for establishing statistical or non-bit-for-bit reproducibility, since bit-for-bit reproducibility may not always be achievable. Here, we propose a short-simulation ensemble-based test for an atmosphere model to evaluate the null hypothesis that modified model results are statistically equivalent to that of the original model. We implement this test in version 2 of the US Department of Energy's Energy Exascale Earth System Model (E3SM). The test evaluates a standard set of output variables across the two simulation ensembles and uses a false discovery rate correction to account for multiple testing. The false positive rates of the test are examined using re-sampling techniques on large simulation ensembles and are found to be lower than the currently implemented bootstrapping-based testing approach in E3SM. We also evaluate the statistical power of the test using perturbed simulation ensemble suites, each with a progressively larger magnitude of change to a tuning parameter. The new test is generally found to exhibit more statistical power than the current approach, being able to detect smaller changes in parameter values with higher confidence.

Kelleher, Michael E. [Oak Ridge National Laborator↗

Modeling pre-Exascale AMR Parallel I/O Workloads via Proxy Applications

The present work investigates the modeling of preexascale input/output (I/O) workloads of Adaptive Mesh Refinement (AMR) simulations through a simple proxy application. We collect data from the AMReX Castro framework running on the Summit supercomputer for a wide range of scales and mesh partitions for the hydrodynamic Sedov case as a baseline to provide sufficient coverage to the formulated proxy model. The non-linear analysis data production rates are quantified as a function of a set of input parameters such as output frequency, grid size, number of levels, and the Courant-Friedrichs-Lewy (CFL) condition number for each rank, mesh level and simulation time step. Linear regression is then applied to formulate a simple analytical model which allows to translate AMReX inputs into MACSio proxy I/O application parameters, resulting in a simple “kernel” approximation for data production at each time step. Results show that MACSio can simulate actual AMReX nonlinear “static” I/O workloads to a certain degree of confidence on the Summit supercomputer using the present methodology. The goal is to provide an initial level of understanding of AMR I/O workloads via lightweight proxy applications models to facilitate autotune data management strategies in anticipation of exascale systems.

Godoy, William↗

Using Satellite and ARM Observations to Evaluate Cold Air Outbreak Cloud Transitions in E3SM Global Storm‐Resolving Simulations

Abstract This study examines marine boundary layer cloud regime transition during a cold air outbreak (CAO) over the Norwegian Sea, simulated by a global storm‐resolving model (GSRM) known as the Simple Cloud‐Resolving Energy Exascale Earth System Model Atmosphere Model (SCREAM). By selecting observational references based on a combination of large‐scale conditions rather than strict time‐matched comparisons, this study finds that SCREAM qualitatively captures the CAO cloud transition, including boundary layer growth, cloud mesoscale structure, and phase partitioning. SCREAM also accurately locates the greatest ice and liquid in the mesoscale updrafts, however, underestimates supercooled liquid water in cumulus clouds. The model evaluation approach adopted by this study takes advantages of the existing computational‐expensive global simulations of GSRM and the available observations to understand model performance and can be applied to assessments of other cloud regimes in different regions. Such practice provides valuable guidance on the future effort to correct and improve biased model behaviors.

54 ENVIRONMENTAL SCIENCES↗

Understanding processes that control dust spatial distributions with global climate models and satellite observations

Dust aerosol is important in modulating the climate system at local and global scales, yet its spatiotemporal distributions simulated by global climate models (GCMs) are highly uncertain. In this study, we evaluate the spatiotemporal variations of dust extinction profiles and dust optical depth (DOD) simulated by the Community Earth System Model version 1 (CESM1) and version 2 (CESM2), the Energy Exascale Earth System Model version 1 (E3SMv1), and the Modern-Era Retrospective analysis for Research and Applications version 2 (MERRA-2) against satellite retrievals from Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP), Moderate Resolution Imaging Spectroradiometer (MODIS), and Multi-angle Imaging SpectroRadiometer (MISR). We find that CESM1, CESM2, and E3SMv1 underestimate dust transport to remote regions. E3SMv1 performs better than CESM1 and CESM2 in simulating dust transport and the northern hemispheric DOD due to its higher mass fraction of fine dust. CESM2 performs the worst in the Northern Hemisphere due to its lower dust emission than in the other two models but has a better dust simulation over the Southern Ocean due to the overestimation of dust emission in the Southern Hemisphere. DOD from MERRA-2 agrees well with CALIOP DOD in remote regions due to its higher mass fraction of fine dust and the assimilation of aerosol optical depth. The large disagreements in the dust extinction profiles and DOD among CALIOP, MODIS, and MISR retrievals make the model evaluation of dust spatial distributions challenging. Our study indicates the importance of representing dust emission, dry/wet deposition, and size distribution in GCMs in correctly simulating dust spatiotemporal distributions.

54 ENVIRONMENTAL SCIENCES↗

Representing Fine‐Scale Topographic Effects on Surface Radiation Balance in Hyper‐Resolution Land Surface Models

Land surface models are increasingly used to simulate land surface processes at hyper-spatial resolutions (e.g., ∼1 km). As model resolution increases, grid-scale topographic effects on surface radiation fluxes and their interactions between adjacent grids become more pronounced. However, current land surface models routinely neglect the fine-scale topographic effects on surface radiation balance. This study developed physically-based and computationally-efficient parameterizations (fineTOP) that explicitly resolve fine-scale topographic effects on downward shortwave and longwave radiation as well as land surface radiative properties. The newly developed parameterizations were implemented and tested in the Energy Exascale Earth System Model (E3SM) Land Model (ELM). Multi-decadal km-resolution ELM simulations over the California Sierra Nevada show that fine-scale topography significantly impacts the surface energy balance and snow processes across seasons. Slope determines the magnitude of topographic effects, while aspect controls their sign. For slopes larger than 30°, topography-induced change in annual surface temperature can be as large as 3.3 K. Regionally, the mean value and standard deviation of topography-induced changes in annual surface temperature are −0.22 ± 0.38 K and +0.25 ± 0.37 K over north-facing and south-facing slopes, respectively. Topography-induced changes in surface radiative properties account for 3.5% ± 13.8% of total topographic effects on annual net radiation. With fineTOP, ELM captures the aspect-dependence of snow cover fraction, snow water equivalent, and land surface temperature found in MODIS satellite observations and a snow reanalysis data set, while the default ELM fails to capture this phenomenon. The enhanced capability to represent fine-scale topographic effects on surface radiation balance can be used to advance understanding of the role of fine-scale topography in land surface processes and land-atmosphere interactions over mountainous regions.

Hao, Dalei [Pacific Northwest National Laboratory ↗

Quantifying the long-term changes of terrestrial water storage and their driving factors

Global warming is expected to cause changes in terrestrial water storage (TWS) across the land surface, with widespread impacts on ecosystems and society. Although extensive research has been performed to analyze TWS changes and possible drivers during the post-2000 period, longer-term evolution of TWS and associated environmental forcings remain relatively unexplored. In this study, we evaluated the performance of the Energy Exascale Earth System model (E3SM) land model ELM version 1 (ELM v1) in simulating global TWS, and used factorial simulations of ELMv1 to quantify global TWS changes and their drivers during 1948–2012. We found that ELM’s agreed best with existing satellites and reconstruction datasets in temperate regions unaffected by irrigation. Biome- and climate zone-averaged TWS mainly increased at rates between 0 and 10 mm/year over 1948–2012, but the second half of that period saw smaller positive trends than the first half or even negative trends. Climate change explained >80 % of the TWS trends across most biomes and climate zones, followed by land use and land cover change. The physiological and phenological effects of CO2 primarily induced noticeable TWS trends in the more humid biomes and climate zones across different latitudes. In contrast, nitrogen deposition and aerosol deposition generally had smaller and negative impacts across the biomes and climate regions. Among the meteorological drivers analyzed, the long-term average imbalance between precipitation (P), evapotranspiration (E), and runoff (Q) contributed >50 % of the TWS trends in most biomes and climate zones, with nonlinearity being induced by spatially heterogenous changes in E/P and Q/P ratios. The accumulated detrended anomalies in P, E, and Q also often contributed substantially, while the trends difference between P, E, and Q contributed little. Together, these findings unveiled an intensification of the global TWS and its diverse patterns of climate change and different non-withdrawal human-induced alterations, contributing to a more comprehensive understanding and projection of the global water cycle.

54 ENVIRONMENTAL SCIENCES↗

Understanding Precipitation Bias Sensitivities in E3SM-Multi-Scale Modeling Framework From a Dilution Framework

We investigate a set of Energy Exascale Earth System Model Multi-scale modeling framework (MMF) (E3SM-MMF) simulations that vary the dimensionality and momentum transport configurations of the embedded cloud-resolving models (CRMs), including unusually ambitious 3D configurations. Issues endemic to all MMF simulations include too much Intertropical Convergence Zone rainfall and too little over the Amazon. Systematic MMF improvements include more on-equatorial rainfall across the Warm Pool. Interesting sensitivities to the CRM domain are found in the regional time-mean precipitation pattern over the tropics. The 2D E3SM-MMF produces an unrealistically rainy region over the northwestern tropical Pacific; this is reduced in computationally ambitious 3D configurations that use 1,024 embedded CRM grid columns per host cell. Trajectory analysis indicates that these regional improvements are associated with desirably fewer tropical cyclones and less extreme precipitation rates. To understand why and how the representation of precipitation improved in 3D, we propose a framework that dilution is stronger in 3D. This viewpoint is supported by multiple indirect lines of evidence, including a delayed moisture-precipitation pickup, smaller precipitation efficiency, and amplified convective mass flux profiles and more high clouds. We also demonstrate that the effects of varying embedded CRM dimensionality and momentum transport on precipitation can be identified during the first few simulated days, providing an opportunity for rapid model tuning without high computational cost. Meanwhile the results imply that other less computationally intensive ways to enhance dilution within MMF CRMs may also be strategic tuning targets.

54 ENVIRONMENTAL SCIENCES↗

A PEPS Plugin for TNQVM

This work introduces an extension to the Tensor Network Quantum Virtual Machine (TNQVM) tool, enhancing the existing stack of ExaScale Tensor Network (ExaTN), ExaScale Accelerator (XACC), and TNQVM. It features a new plugin that enables efficient simulation of a Projected Entangled Pair State (PEPS), a 2D tensor network. To improve simulation efficiency for PEPS, we have implemented the snake boundary contraction algorithm. By integrating this capability into the existing stack, we enhance the overall functionality and versatility of the framework. We tested this new PEPS topology for a simple GHZ bell-pair generation quantum circuit and saw that its runtime is very close to that of the MPS topology. We estimate that the real potential of the PEPS topology becomes discernible when quantum circuits with multidimensional entanglement are simulated using tensor networks. In such cases, 1D tensor networks fail to represent or contract them efficiently.

Chundury, Srikar↗

The Simple Cloud-Resolving E3SM Atmosphere Model Running on the Frontier Exascale System

We present an efficient and performance portable implementation of the Simple Cloud Resolving E3SM Atmosphere Model (SCREAM). SCREAM is a full featured atmospheric global circulation model with a nonhydrostatic dynamical core and state-of-the-art parameterizations for microphysics, moist turbulence and radiation. It has been written from scratch in C++ with the Kokkos library used to abstract the on-node execution model for both CPUs and GPUs. SCREAM is one of only a few global atmosphere models to be ported to GPUs. As far as we know, SCREAM is the first such model to run on both AMD GPUs and NVIDIA GPUs, as well as the first to run on nearly an entire Exascale system (Frontier). On Frontier, we obtained a record setting performance of 1.26 simulated years per day for a realistic cloud resolving simulation.

Taylor, Mark↗

Tracking carbon dioxide in the Southern Ocean (Final Technical Report)

We investigated the discrepancy in observed and modeled Southern Ocean carbon dioxide (CO 2 ) absorption through the lens of the Energy Exascale Earth System Model (E3SM), leveraging recent and upcoming E3SM development advances to simulate Lagrangian Biogeochemical-Argo floats. E3SM output, together with observational data streams and output from the evolving CMIP6 archive, are being used to study the spatiotemporal bias in modeled Southern Ocean CO 2 flux.

54 ENVIRONMENTAL SCIENCES↗

Aerosol-Cloud Interactions and the Intersection of Climate Forcing and Feedback

The goal of this project has been to understand at the process level how the interaction of aerosols and cloud microphysics may alter the cloud response to climate change from the scale of turbulence to the global scale. Atmospheric aerosols (suspended particulates) have a unique role to play in the climate system. Anthropogenic aerosols may be an air pollution hazard and degrade human health. Their presence also results in the direct scattering or absorption of sunlight, with small net impacts on climate. But aerosols are also a key part of cloud formation, as the locations on which cloud droplets and ice crystals form. Understanding these Aerosol Cloud Interactions (ACI) is a critical uncertainty for climate models, including the Energy Exascale Earth System Model (E3SM), and affects how well models like E3SM can simulate the past and future. This work aims to understand cloud microphysics as well as the interaction of aerosol forcing and cloud feedback through improving our understanding of aerosol-cloud interactions (ACI) by looking at their uncertainty in critical environments at the process level. It will also contribute to the development of E3SM. Specific goals include: first, high level analysis of Perturbed Parameter Ensemble (PPE) simulations already available from the Community Earth System Model (CESM) and E3SM. Second, detailed analysis of recent changes to temperature and the role of aerosols.

54 ENVIRONMENTAL SCIENCES↗

Description of historical and future projection simulations by the global coupled E3SMv1.0 model as used in CMIP6

Abstract. This paper documents the experimental setup and general features of the coupled historical and future climate simulations with the first version of the US Department of Energy (DOE) Energy Exascale Earth System Model (E3SMv1.0). The future projected climate characteristics of E3SMv1.0 at the highest emission scenario (SSP5-8.5) designed in the Scenario Model Intercomparison Project (ScenarioMIP) and the SSP5-8.5 greenhouse gas (GHG) only forcing experiment are analyzed with a focus on regional responses of atmosphere, ocean, sea ice, and land. Due to its high equilibrium climate sensitivity (ECS of 5.3 K), E3SMv1.0 is one of the Coupled Model Intercomparison Project phase 6 (CMIP6) models with the largest surface warming by the end of the 21st century under the high-emission SSP5-8.5 scenario. The global mean precipitation change is highly correlated with the global temperature change, while the spatial pattern of the change in runoff is consistent with the precipitation changes. The oceanic mixed layer generally shoals throughout the global ocean. The annual mean Atlantic meridional overturning circulation (AMOC) is overly weak with a slower change from ∼ 11 to ∼ 6 Sv (Sverdrup) relative to other CMIP6 models. The sea ice, especially in the Northern Hemisphere, decreases rapidly with large seasonal variability. We detect a significant polar amplification in E3SMv1.0 from the atmosphere, ocean, and sea ice. Comparing the SSP5-8.5 all-forcing experiment with the GHG-only experiment, we find that the unmasking of the aerosol effects due to the decline of the aerosol loading in the future projection period causes transient accelerated warming in the all-forcing experiment in the first half of the 21st century. While the oceanic climate response is mainly controlled by the GHG forcing, the land runoff response is impacted primarily by forcings other than GHG over certain regions, e.g., southern North America, southern Africa, central Africa, and eastern Asia. However, the importance of the GHG forcing on the land runoff changes grows in the future climate projection period compared to the historical period.

54 ENVIRONMENTAL SCIENCES↗

High Latitude Atmospheric Rivers: Teleconnections and Impacts

Atmospheric rivers (ARs) are long, narrow synoptic scale features that act as moisture transport vehicles by moving water vapor poleward. They are typically found in storm tracks and often have profound implications for regional hydroclimate. For high latitude locales such as Antarctica and the Arctic, ARs are fewer in number but often have an outsized impact by either producing significant snow accumulation events, or, depending on their thermal characteristics, initiating melt events on ice sheets, ice shelves, and sea ice. In this study, we apply both reanalysis and climate model data to evaluate high latitude ARs for both the Arctic and Antarctic in the context of teleconnections and modes of variability. Specifically, we fold in both MERRA-2 and ERA5 reanalysis as well as historical and climate change simulations from the CESM2 (Community Earth System Model, Version 2) and E3SMv2 (Energy Exascale Earth System Model, v2) with multiple ensemble members to better understand natural variability versus climate change signals. An overview of AR climatology and impacts will be presented, including a baseline uncertainty quantification analysis using data from ARTMIP (the Atmospheric River Tracking Method Intercomparison Project). AR impacts during specific modes of variability will be characterized by diagnosing precipitation and boundary layer temperature associated with Ars influencing the cryosphere. Modes of variability investigated include the SAM (Southern Annular Mode), PDO (Pacific Decadal Oscillation), PSA2 (Pacific South American Mode 2), the IOD (Indian Ocean Dipole), and the AO (Arctic Oscillation).

Atmospheric Rivers↗

Enabling Scalable and Extensible Memory-mapped Datastores in Userspace

Exascale workloads are expected to incorporate data-intensive processing in close coordination with traditional physics simulations. These emerging scientific, data-analytics and machine learning applications need to access a wide variety of datastores in flat files and structured databases. Programmer productivity is greatly enhanced by mapping datastores into the application process's virtual memory space to provide a unified “in-memory” interface. Currently, memory mapping is provided by system software primarily designed for generality and reliability. However, scalability at high concurrency is a formidable challenge on exascale systems. Also, there is a need for extensibility to support new datastores potentially requiring HPC data transfer services. In this article, we present UMap , a scalable and extensible userspace service for memory-mapping datastores. Furthermore, through decoupled queue management, concurrency aware adaptation, and dynamic load balancing, UMap enables application performance to scale even at high concurrency. We evaluate UMap in data-intensive applications, including sorting, graph traversal, database operations, and metagenomic analytics. Our results show that UMap as a userspace service outperforms an optimized kernel-based service across a wide range of intra-node concurrency by 1.22-1.9 × . We performed two case studies to demonstrate UMap 's extensibility. First, a new datastore residing in remote memory is incorporated into UMap as an application-specific plugin. Second, we present a persistent memory allocator Metall built atop UMap for unified storage/memory.

97 MATHEMATICS AND COMPUTING↗

Visualizing an Exascale Data Center Digital Twin: Considerations, Challenges and Opportunities

Digital twins are an excellent tool to model, visualize, and simulate complex systems, to understand and optimize their operation. In this work, we present the technical challenges of real-time visualization of a digital twin of the Frontier supercomputer.We show the initial prototype and current state of the twin and highlight technical design challenges of visualizing such a large High Performance Computing (HPC) system. The goal is to understand the use of augmented reality as a primary way to extract information and collaborate on digital twins of complex systems. This leverages the spatio-temporal aspect of a 3D representation of a digital twin, with the ability to view historical and real-time telemetry, triggering simulations of a system state and viewing the results, which can be augmented via dashboards for details. Finally, we discuss considerations and opportunities for augmented reality of digital twins of large-scale, parallel computers.

Maiterth, Matthias↗

ExaWorks: Workflows for Exascale

Exascale computers will offer transformative capabilities to combine data-driven and learning-based approaches with traditional simulation applications to accelerate scientific discovery and insight. These software combinations and integrations, however, are difficult to achieve due to challenges of coordination and deployment of heterogeneous software components on diverse and massive platforms. We present the ExaWorks project, which can address many of these challenges: ExaWorks is leading a co-design process to create a workflow Software Development Toolkit (SDK) consisting of a wide range of workflow management tools that can be composed and interoperate through common interfaces. We describe the initial set of tools and interfaces supported by the SDK, efforts to make them easier to apply to complex science challenges, and examples of their application to exemplar cases. Furthermore, we discuss how our project is working with the workflows community, large computing facilities as well as HPC platform vendors to sustainably address the requirements of workflows at the exascale.

97 MATHEMATICS AND COMPUTING↗

Disentangling the chemistry and transport impacts of the quasi-biennial oscillation on stratospheric ozone

The quasi-biennial oscillation (QBO) in tropical winds perturbs stratospheric ozone throughout much of the atmosphere via changes in transport of ozone and other trace gases, as well as via temperature changes, both of which alter ozone chemistry. Attributing these causes of QBO–ozone variability may provide insights into model-to-model differences that contribute to ozone simulation. Here we develop a novel metric of steady-state ozone (SSO) to separate these effects: SSO calculates the local steady-state response of ozone due to the changes in temperature, chemical species, and overhead ozone column; the response due to circulation change is presumed when SSO shows no response. It is applied to the nudged Department of Energy's Energy Exascale Earth System Model version 2 (E3SMv2) with interactive ozone chemistry to demonstrate its validity. The E3SMv2 simulations nudged to reanalysis data produced reasonable wind and ozone patterns, especially in the tropics. Consistent with previous studies, we find clear demarcations with pressure. Ozone perturbations in the upper stratosphere (<6 hPa) are predicted by temperature changes; those between 6 and 20 hPa are predicted by NO y changes, and those in the lower stratosphere show no temperature or NO y response and are presumably driven by circulation changes. These results are important for diagnosing model-to-model discrepancy in QBO–ozone response and enhancing the reliability of ozone projections.

Xie, Jinbo [Lawrence Livermore National Laboratory↗