Search NASA⌕ Search

SEARCH · Search NASA

Results for “exascale simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Evaluating the Simulation of CONUS Precipitation by Storm Type in E3SM

Abstract Conventional low‐resolution (LR) climate models, including the Energy Exascale Earth System Model (E3SMv1), have well‐known biases in simulating the frequency, intensity, and timing of precipitation. Approaches to next‐generation E3SM, whether the high‐resolution (HR) or multiscale modeling framework (MMF) configuration, improve the simulation of the intensity and frequency of precipitation, but regional and seasonal deficiencies still exist. Here we apply a methodology to assess the contribution of tropical cyclones (TCs), extratropical cyclones (ETCs), and mesoscale convective systems (MCSs) to simulated precipitation in E3SMv1‐HR and E3SMv1‐MMF relative to E3SMv1‐LR. Across the United States, E3SMv1‐MMF provides the best simulation in terms of precipitation accumulation, frequency and intensity from MCSs and TCs compared to E3SMv1‐LR and E3SMv1‐HR. All E3SMv1 configurations overestimate precipitation amounts from and the frequency of ETCs over CONUS, with conventional E3SMv1‐LR providing the best simulation compared to observations despite limitations in precipitation intensity within these events.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

PeleMP: The Multiphysics Solver for the Combustion Pele Adaptive Mesh Refinement Code Suite

Combustion encompasses multiscale, multiphase reacting flow physics spanning a wide range of scales from the molecular scales, where chemical reactions occur, to the device scales, where the turbulent flow is affected by the geometry of the combustor. This scale disparity and the limited measurement capabilities from experiments make modeling combustion a significant challenge. Recent advancements in high-performance computing (HPC), particularly with the Department of Energy's Exascale Computing Project (ECP), have enabled high-fidelity simulations of practical applications to be performed. The major physics submodels, including chemical reactions, turbulence, sprays, soot, and thermal radiation, exhibit distinctive computational characteristics that need to be examined separately to ensure efficient utilization of computational resources. This paper presents the multiphysics solver for the Pele code suite, called PeleMP, which consists of models for spray, soot, and thermal radiation. Here, the mathematical and algorithmic aspects of the model implementations are described in detail as well as the verification process. The computational performance of these models is benchmarked on multiple supercomputers, including Frontier, an exascale machine. Results are presented from production simulations of a turbulent sooting ethylene flame and a bluff-body swirl stabilized spray flame with sustainable aviation fuels to demonstrate the capability of the Pele codes for modeling practical combustion problems with multiphysics. This work is an important step toward the exascale computing era for high-fidelity combustion simulations providing physical insights and data for predictive modeling of real-world devices.

42 ENGINEERING↗
DOE OSTI2024

Performance Results on CPU/GPU Exascale Architectures for OMEGA: The Ocean Model for E3SM Global Applications

The US Department of Energy (DOE) conducts climate simulations on some of the world’s largest supercomputers. These exascale machines use heterogeneous architectures with both CPUs and GPUs, and scientific codes must adapt to make full use of this computing power. Los Alamos National Lab is developing Omega: The Ocean Model for E3SM Global Applications, which is specifically designed for modern exascale computers. It uses external libraries that have been optimized for a variety of architectures to run on different supercomputers. Omega is an unstructured-mesh ocean model based on TRiSK numerical methods. It will be the new ocean component of the DOE’s Energy Exascale Earth System Model (E3SM). The algorithms in Omega follow those of the current ocean component, MPAS-Ocean, but it will be written in C++ rather than Fortran to take advantage of the Kokkos performance portability library. Omega spatial operators are written as Kokkos kernels to run efficiently on both CPUs and GPUs. Work on Omega began in 2023 with a new C++ framework for unstructured mesh partitioning, halo exchanges, parallel IO, and Kokkos interfaces. The current version, Omega-0, is being developed to solve the shallow water equations and at present includes all of the tendency terms but not time stepping. Here we share the results of Omega-0 verification and performance testing. Verification includes unit tests implemented with CTest as well as convergence tests in Polaris, an in-house python package with a large suite of test problems. Performance tests compare simulations conducted on CPUs versus GPUs and across different architectures: tests are run on Frontier, which has AMD “Optimized 3rd Gen EPYC” CPUs and AMD MI250X GPUs, as well as Perlmutter, which is composed of AMD EPYC 7763 CPUs and NVIDIA A100 GPUs.

58 GEOSCIENCES↗
DOE OSTI2025

ELM model simulations of Plum Island Ecosystems LTER low marsh site 2018-2020

Model simulations using the Department of Energy's Energy Exascale Earth System Model (E3SM) land model (ELM) with improved capabilities to represent vegetation response to salinity and inundation. The simulations were conducted for a tidal salt marsh at Plum Island Ecosystems Long Term Ecological Research (LTER) site near Rowley, Massachusetts, USA; the site is a low marsh dominated by Spartina alterniflora. The model was forced with site-specific meteorology, salinity and tidal cycles from 2018-2020. Four sets of model simulations are included and described below:1. Parameterization of the salinity response function. These simulations tested different combinations of values for optimal salinity and salinity tolerance.2. Model evaluation. This comparison conducted simulations using the default model, the salinity function only, the submergence function only, and both the salinity and submergence functions. 3. Salinity scenarios. These simulations used the 2018 salinity input data varied by -5 to +10 ppt salinity.4. Water level scenarios. These simulations used the tide height varied by -10 to +50 cm. These simulations were used to demonstrate how the salinity and submergence functions better represent carbon uptake by tidal salt marshes.The data package includes netCDF files used as forcing files for tide height and salinity, one for each year 2018-2020 at observed salinity concentrations, and an additional three forcing files in which salinity concentrations were varied 5 ppt lower, 5 ppt higher, and 10 ppt higher than the measured 2018 time series. Also included are python scripts for creating forcing files, plain text parameter and command files for running simulations, model outputs in netCDF format, and python scripts for visualizing outputs. Code for the modified E3SM model is archived in Sulman et al 2023 at doi:10.15485/1991625. More detail about files is provided in the README.md file.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

PeleC: An adaptive mesh refinement solver for compressible reacting flows

Reacting flow simulations for combustion applications require extensive computing capabilities. Leveraging the AMReX library, the Pele suite of combustion simulation tools targets the largest supercomputers available and future exascale machines. We introduce PeleC, the compressible solver in the Pele suite, and detail its capabilities, including complex geometry representation, chemistry integration, and discretization. We present a comparison of development efforts using both OpenACC and AMReX’s C++ performance portability framework for execution on multiple GPU architectures. We discuss relevant details that have allowed PeleC to achieve high performance and scalability. PeleC’s performance characteristics are measured through relevant simulations on multiple supercomputers. The success of PeleC’s design for exascale is exhibited through demonstration of a 160 billion cell simulation and weak scaling onto 100% of Summit, an NVIDIA-based GPU supercomputer at Oak Ridge National Laboratory. Our results provide confidence that PeleC will enable future combustion science simulations with unprecedented fidelity.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Clustering Effects on the Structure of Ionomer Solutions: A Combined SANS and Simulations Study

Ionic assemblies, or clusters, determine the structure and dynamics of ionizable polymers and enable their many applications. Fundamental to attaining well-defined materials is controlling the balance between van der Waals interactions that govern the backbone behavior and the forces that drive the formation of ionic clusters. Here, using small angle neutron scattering and fully atomistic molecular dynamics simulations, the structure of a model ionomer, sulfonated polystyrene in toluene solutions, was investigated as the cluster cohesion was tweaked by the addition of ethanol. The static structure factor was measured by both techniques and correlated with the size of the ionic clusters as the polymer concentration was varied. The conjunction of SANS results and molecular insight from MD simulations enabled the determination of the structure in these inhomogeneous networks on multiple length scales. Additionally, we find that across the entire concentration range studied, a network driven by the formation of ionic clusters was formed, where the size of the clusters drives the inhomogeneity of these systems. Tweaking the ionic clusters through the addition of ethanol impacts the packing of the sulfonated groups, their shape, and their size distribution, which in turn, affects the structure of these networks.

36 MATERIALS SCIENCE↗
DOE OSTI2024

The ECP ALPINE project: In situ and post hoc visualization infrastructure and analysis capabilities for exascale

A significant challenge on an exascale computer is the speed at which we compute results exceeds by many orders of magnitude the speed at which we save these results. Therefore the Exascale Computing Project (ECP) ALPINE project focuses on providing exascale-ready visualization solutions including in situ processing. In situ visualization and analysis runs as the simulation is run, on simulations results are they are generated avoiding the need to save entire simulations to storage for later analysis. The ALPINE project made post hoc visualization tools, ParaView and VisIt, exascale ready and developed in situ algorithms and infrastructures. The suite of ALPINE algorithms developed under ECP includes novel approaches to enable automated data analysis and visualization to focus on the most important aspects of the simulation. Many of the algorithms also provide data reduction benefits to meet the I/O challenges at exascale. ALPINE developed a new lightweight in situ infrastructure, Ascent.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Development and Evaluation of E3SM‐MOSAIC: Spatial Distributions and Radiative Effects of Nitrate Aerosol

Abstract Nitrate aerosol plays an important role in affecting regional air quality as well as Earth's climate. However, it is not well represented or even neglected in many global climate models. In this study, we couple the Model for Simulating Aerosol Interactions and Chemistry (MOSAIC) module with the four‐mode version of the Modal Aerosol Module (MAM4) in DOE's Energy Exascale Earth System Model version 2 (E3SMv2) to simulate nitrate aerosol and its radiative effects. We find that nitrate aerosol simulated by E3SMv2‐MAM4‐MOSAIC is sensitive to the treatment of gaseous HNO 3 transfer to/from interstitial particles related to accommodation coefficients of HNO 3 ( ) on dust and non‐dust particles. We compare three different treatments of HNO 3 transfer: (a) a treatment (MTC_SLOW) that uses a low in the mass transfer coefficient (MTC) calculation; (b) a dust‐weighted MTC treatment (MTC_WGT) that uses a high on non‐dust particles; and (c) a dust‐weighted MTC treatment that also splits coarse mode aerosols into the coarse dust and sea salt sub‐modes in MOSAIC (MTC_SPLC). MTC_WGT and MTC_SPLC increase the global annual mean (2005–2014) nitrate burden from 0.096 (MTC_SLOW) to 0.237 and 0.185 Tg N, respectively, mostly in the coarse mode. MTC_WGT and MTC_SPLC also produce stronger nitrate direct radiative forcing (−0.048 and −0.051 W m −2 , respectively) and indirect forcing (−0.33 and −0.35 W m −2 , respectively) than MTC_SLOW (−0.021 and −0.24 W m −2 ). MTC_WGT and MTC_SPLC improve nitrate surface concentrations over remote oceans based on limited observations and vertical profiles of nitrate concentrations against aircraft measurements below 400 hPa.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Effects of organized convection parameterization on the MJO and precipitation in E3SMv1. Part I: Mesoscale heating

Mesoscale organization of convection is typically not represented in global circulation models, and hence its influence on the global circulation is not accounted for. The heating component of a parameterization that represents the dynamical and physical effects of circulations associated with organized convection, referred to as the multiscale coherent structure parameterization (MCSP), is implemented in the Energy Exascale Earth System Model version 1 (E3SMv1). Numerical simulations are conducted to assess its impact on the simulated climate. Besides E3SMv1 simulations, we performed high-resolution (1 km) simulations using the Weather Research and Forecasting (WRF) Model to determine the temperature tendencies induced by mesoscale convective systems embedded in deep convection. We tuned the free parameters of the MCSP based on the WRF simulations. MCSP heating enhances Kevin wave spectra in E3SMv1, improves the representation of the Madden-Julian Oscillation, and impacts on mean precipitation that vary with locations and seasons, including a reduction of biases over the tropical Pacific.

Climate Modeling↗
DOE OSTI2021

Assembly and Analysis of Cell-Scale Membrane Envelopes

The march toward exascale computing will enable routine molecular simulation of larger and more complex systems, for example, simulation of entire viral particles, on the scale of approximately billions of atoms-a simulation size commensurate with a small bacterial cell. Anticipating the future hardware capabilities that will enable this type of research and paralleling advances in experimental structural biology, efforts are currently underway to develop software tools, procedures, and workflows for constructing cell-scale structures. Herein, we describe our efforts in developing and implementing an efficient and robust workflow for construction of cell-scale membrane envelopes and embedding membrane proteins into them. A new approach for construction of massive membrane structures that are stable during the simulations is built on implementing a subtractive assembly technique coupled with the development of a structure concatenation tool (fastmerge), which eliminates overlapping elements based on volumetric criteria rather than adding successive molecules to the simulation system. Using this approach, we have constructed two "protocells" consisting of MARTINI coarse-grained beads to represent cellular membranes, one the size of a cellular organelle and another the size of a small bacterial cell. The membrane envelopes constructed here remain whole during the molecular dynamics simulations performed and exhibit water flux only through specific proteins, demonstrating the success of our methodology in creating tight cell-like membrane compartments. Extended simulations of these cell-scale structures highlight the propensity for nonspecific interactions between adjacent membrane proteins leading to the formation of protein microclusters on the cell surface, an insight uniquely enabled by the scale of the simulations. We anticipate that the experiences and best practices presented here will form the basis for the next generation of cell-scale models, which will begin to address the addition of soluble proteins, nucleic acids, and small molecules essential to the function of a cell.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Impact of Turbulence Representation on the Relationship Between Cloud Feedback and Aerosol‐Cloud Interaction in an E3SMv2 Perturbed Parameter Ensemble

Recent studies reveal an anti‐correlation between global cloud feedback (CF) and effective radiative forcing due to aerosol‐cloud interaction (ERFaci) in Earth system models, but the physical mechanisms underlying it remain uncertain. Here we investigate how different turbulence representations contribute to this relationship over the global ocean using an ensemble of Energy Exascale Earth System Model version 2 simulations with perturbed turbulence parameters. The anti‐correlation appears only in the tropical ascent regime. In the Northern Hemisphere midlatitude and high latitude regimes, there is no significant correlation, and in the tropical marine low cloud and Southern Ocean regimes, the correlation is positive. These opposite correlations are primarily driven by opposing CF responses to perturbed parameters. We find that the mean‐state turbulent mixing strength affects both CF and ERFaci, enabling strong correlations in certain regimes. This study highlights the complex linkages between CF and ERFaci through turbulent processes across diverse cloud regimes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Numerical Water Tracers in the Atmospheric Component of the Energy Exascale Earth System Model: Implementation and Changes in Moisture Origin

Numerical water tracers are implemented in the Energy Exascale Earth System Model version 2. Simulations performed with the water‐tag‐enabled model for both pre‐industrial and future greenhouse gas concentrations reveal a marked increase in the role of mid‐latitude and southern subtropical regions as exporters of atmospheric moisture—to the extratropical upper troposphere and the tropical free troposphere. For the latter, the northward shift of the Intertropical Convergence Zone increases cross‐hemispheric transport of subtropical water vapor to the Northern Hemisphere. In the polar regions, most of the lower tropospheric moistening instead arises from increases in local evaporation. These findings illustrate the utility of the water tags, underscore critical changes in global hydrologic cycle, and provide insight into atmospheric dynamics under future climate scenarios. For applications when a global grid is desired, we additionally propose a novel statistical reconstruction, based on copula modeling, of the joint distribution of origin of water vapor, which reduces the number of tracers from order $\mathcal{O}\left({n}^{2}\right)$to order $\mathcal{O}(n)$, substantially ameliorating the considerable computational cost of water tracers. This statistical reconstruction is particularly beneficial to the interpretation of the relationship between latitude and longitude of origin of moisture over the tropical oceans and in the lower troposphere over land.

copula modeling↗
DOE OSTI2020

Landsat near-infrared (NIR) band and ELM-FATES sensitivity to forest disturbances and regrowth in the Central Amazon

Forest disturbance and regrowth are key processes in forest dynamics, but detailed information on these processes is difficult to obtain in remote forests such as the Amazon. We used chronosequences of Landsat satellite imagery (Landsat 5 Thematic Mapper and Landsat 7 Enhanced Thematic Mapper Plus) to determine the sensitivity of surface reflectance from all spectral bands to windthrow, clear-cut, and clear-cut and burned (cut + burn) and their successional pathways of forest regrowth in the Central Amazon. We also assessed whether the forest demography model Functionally Assembled Terrestrial Ecosystem Simulator (FATES) implemented in the Energy Exascale Earth System Model (E3SM) Land Model (ELM), ELM-FATES, accurately represents the changes for windthrow and clear-cut. The results show that all spectral bands from the Landsat satellites were sensitive to the disturbances but after 3 to 6 years only the near-infrared (NIR) band had significant changes associated with the successional pathways of forest regrowth for all the disturbances considered. In general, the NIR values decreased immediately after disturbance, increased to maximum values with the establishment of pioneers and early successional tree species, and then decreased slowly and almost linearly to pre-disturbance conditions with the dynamics of forest succession. Statistical methods predict that NIR values will return to pre-disturbance values in about 39, 36, and 56 years for windthrow, clear-cut, and cut + burn disturbances, respectively. The NIR band captured the observed, and different, successional pathways of forest regrowth after windthrow, clear-cut, and cut + burn. Consistent with inferences from the NIR observations, ELM-FATES predicted higher peaks of biomass and stem density after clear-cuts than after windthrows. ELM-FATES also predicted recovery of forest structure and canopy coverage back to pre-disturbance conditions in 38 years after windthrows and 41 years after clear-cut. The similarity of ELM-FATES predictions of regrowth patterns after windthrow and clear-cut to those of the NIR results suggests the NIR band can be used to benchmark forest regrowth in ecosystem models. Our results show the potential of Landsat imagery data for mapping forest regrowth from different types of disturbances, benchmarking, and the improvement of forest regrowth models.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2022

Building a Transdisciplinary, Exascale-Capable Workforce for Geospace Science

Key Points: ●First-principles, self-consistent geospace modeling will require at least exascale-level computing capabilities; however, the technical skills necessary to develop such simulation codes are not taught as part of Heliophysics training/PhD programs. ●Developing exascale Heliophysics codes will require transdisciplinary collaborations between physicists, computer scientists, software engineers, data scientists, and applied mathematics. Such teams must be persistent and formed around specific skills, not specific problems. ●We must have stable, positive long-term career outcomes for Heliophysics scientific developers in order to retain knowledge of and promote future innovation in scientific algorithm development and advanced computing techniques. One such way to do this is by funding long-term scientific programming groups, akin to Heliophysics DRIVE Centers. ●We must have a balance between promoting innovation via funding short-term closed-source development and allowing the open-source community to benefit from and build on the newest scientific modeling techniques.

C Bard↗
DOE OSTI2023

Incorporation of aerosol into the COSPv2 satellite lidar simulator for climate model evaluation

Abstract. Atmospheric aerosol has substantial impacts on climate, air quality and biogeochemical cycles, and its concentrations are highly variable in space and time. A key variability to evaluate within models that simulate aerosol is the vertical distribution, which influences atmospheric heating profiles and aerosol–cloud interactions, to help constrain aerosol residence time and to better represent the magnitude of simulated impacts. To ensure a consistent comparison between modeled and observed vertical distribution of aerosol, we implemented an aerosol lidar simulator within the Cloud Feedback Model Intercomparison Project (CFMIP) Observation Simulator Package version 2 (COSPv2). We assessed the attenuated total backscattered (ATB) signal and the backscatter ratios (SRs) at 532 nm in the U.S. Department of Energy's Energy Exascale Earth System Model version 1 (E3SMv1). The simulator performs the computations at the same vertical resolution as the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP), making use of aerosol optics from the E3SMv1 model as inputs and assuming that aerosol is uniformly distributed horizontally within each model grid box. The simulator applies a cloud masking and an aerosol detection threshold to obtain the ATB and SR profiles that would be observed above clouds by CALIOP with its aerosol detection capability. Our analysis shows that the aerosol distribution simulated at a seasonal timescale is generally in good agreement with observations. Over the Southern Ocean, however, the model does not produce the SR maximum as observed in the real world. Comparison between clear-sky and all-sky SRs shows little differences, indicating that the cloud screening by potentially incorrect model clouds does not affect the mean aerosol signal averaged over a season. This indicates that the differences between observed and simulated SR values are due not to sampling errors, but to deficiencies in the representation of aerosol in models. Finally, we highlight the need for future applications of lidar observations at multiple wavelengths to provide insights into aerosol properties and distribution and their representation in Earth system models.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

LHC Event Generation in the Exascale Era

MCFM is a dedicated Monte-Carlo simulation program for collider phenomenology at highest energies. Designed during the Tevatron era, it has successfully incorporated the latest developments needed for LHC precision calculations and remained on the forefront of collider phenomenology. The Fortran code includes interfaces to modern PDF and loop reduction libraries but has been unchanged structurally compared to the earlier versions. Parallel computing has been enabled using OpenMP and MPI. MCFM provides numerically highly stable one-loop amplitudes and superior phase-space efficiency, leading to excellent performance in NXLO calculations using jettiness or qT subtraction techniques for IR regularization.

Campbell, John [Fermilab]↗
DOE OSTI2024

Large-scale Multiphysics Simulations of Small Modular Reactors Operating in Natural Circulation

Thanks to the advancements in high-performance computing, advanced modeling and simulation have become crucial in driving the development and deployment of next-generation nuclear reactors, such as small modular reactors (SMRs). SMRs offer the promise of cost-effective baseload electricity production and improved safety, while addressing some of the challenges associated with large reactor designs, such as high capital costs and extended construction timelines. As part of the Exascale Computing Project, the large-scale multiphysics simulation of an entire SMR primary system has been achieved by combining computational fluid dynamics and neutronics. In addition to the successful demonstration of full-core SMR simulations, the current study integrated the impact of natural circulation into the system. Natural circulation is the primary mechanism driving coolant circulation in SMRs. The mass flow rate in the core depends on the core power, and a numerical model has been developed to predict it. The pressure drop caused by the helical coil steam generator was also accounted for by developing a pressure drop correlation based on high-fidelity large eddy simulation results, further improving prediction accuracy. In conclusion, the results of the study demonstrate that the implemented natural circulation model is effective in predicting the responses of SMR full-core multiphysics simulations.

ECP↗
DOE OSTI2023

Ship-based Observations and Climate Model Simulations of Cloud Phase over the Southern Ocean

The Southern Ocean (SO) clouds exert a significant influence on the Earth’s radiation budget. Here we analyzed ship-based remote sensing observations of SO clouds over a five-month long DOE ARM Measurements of Aerosols, Radiation and Clouds over the Southern Oceans (MARCUS) field campaign to better understand cloud phase variability. We developed a method to classify eight categories of hydrometeors (ice, liquid, mixed phase, rain, drizzle, snow, aerosols, and clear sky) based on measurements of lidar, radar and radiosondes. Cloud thermodynamic phases (liquid, ice and mixed phase) at coarser scales were further derived to compare with the DOE Energy Exascale Earth System Model version 1 (E3SMv1) simulation and the Earth Model Column Collaboratory (EMC 2 ) instrument simulator. For a scale-aware comparison with climate model simulations, we found that spatially averaging the raw remote sensing data (e.g., backscatter, reflectivity) results in increased cloud cover and cloud liquid, whereas, directly averaging cloud phase from higher to lower resolution maintains clear air regions and is thus recommended for in-cloud frequency comparisons. For cloud thermodynamic phases in stratiform clouds, the E3SM underestimates cloud ice and overestimates cloud liquid at temperatures between -40 and 0°C. When latitudes increase, both observations and simulations show a transition of dominant phase from liquid to ice for cloud tops as well as for the entire cloud columns, but the model underestimation of ice phase is more severe at higher latitudes. Such model bias is unlikely caused by spatial scale differences or lack of heterogeneity in cloud vertical structure in the simulation.

54 ENVIRONMENTAL SCIENCES↗