Search NASA⌕ Search

SEARCH · Search NASA

Results for “exascale simulation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

ELM model simulations of Plum Island Ecosystems LTER low marsh site 2018-2020

Model simulations using the Department of Energy's Energy Exascale Earth System Model (E3SM) land model (ELM) with improved capabilities to represent vegetation response to salinity and inundation. The simulations were conducted for a tidal salt marsh at Plum Island Ecosystems Long Term Ecological Research (LTER) site near Rowley, Massachusetts, USA; the site is a low marsh dominated by Spartina alterniflora. The model was forced with site-specific meteorology, salinity and tidal cycles from 2018-2020. Four sets of model simulations are included and described below:1. Parameterization of the salinity response function. These simulations tested different combinations of values for optimal salinity and salinity tolerance.2. Model evaluation. This comparison conducted simulations using the default model, the salinity function only, the submergence function only, and both the salinity and submergence functions. 3. Salinity scenarios. These simulations used the 2018 salinity input data varied by -5 to +10 ppt salinity.4. Water level scenarios. These simulations used the tide height varied by -10 to +50 cm. These simulations were used to demonstrate how the salinity and submergence functions better represent carbon uptake by tidal salt marshes.The data package includes netCDF files used as forcing files for tide height and salinity, one for each year 2018-2020 at observed salinity concentrations, and an additional three forcing files in which salinity concentrations were varied 5 ppt lower, 5 ppt higher, and 10 ppt higher than the measured 2018 time series. Also included are python scripts for creating forcing files, plain text parameter and command files for running simulations, model outputs in netCDF format, and python scripts for visualizing outputs. Code for the modified E3SM model is archived in Sulman et al 2023 at doi:10.15485/1991625. More detail about files is provided in the README.md file.

54 ENVIRONMENTAL SCIENCES↗

PeleC: An adaptive mesh refinement solver for compressible reacting flows

Reacting flow simulations for combustion applications require extensive computing capabilities. Leveraging the AMReX library, the Pele suite of combustion simulation tools targets the largest supercomputers available and future exascale machines. We introduce PeleC, the compressible solver in the Pele suite, and detail its capabilities, including complex geometry representation, chemistry integration, and discretization. We present a comparison of development efforts using both OpenACC and AMReX’s C++ performance portability framework for execution on multiple GPU architectures. We discuss relevant details that have allowed PeleC to achieve high performance and scalability. PeleC’s performance characteristics are measured through relevant simulations on multiple supercomputers. The success of PeleC’s design for exascale is exhibited through demonstration of a 160 billion cell simulation and weak scaling onto 100% of Summit, an NVIDIA-based GPU supercomputer at Oak Ridge National Laboratory. Our results provide confidence that PeleC will enable future combustion science simulations with unprecedented fidelity.

97 MATHEMATICS AND COMPUTING↗

Clustering Effects on the Structure of Ionomer Solutions: A Combined SANS and Simulations Study

Ionic assemblies, or clusters, determine the structure and dynamics of ionizable polymers and enable their many applications. Fundamental to attaining well-defined materials is controlling the balance between van der Waals interactions that govern the backbone behavior and the forces that drive the formation of ionic clusters. Here, using small angle neutron scattering and fully atomistic molecular dynamics simulations, the structure of a model ionomer, sulfonated polystyrene in toluene solutions, was investigated as the cluster cohesion was tweaked by the addition of ethanol. The static structure factor was measured by both techniques and correlated with the size of the ionic clusters as the polymer concentration was varied. The conjunction of SANS results and molecular insight from MD simulations enabled the determination of the structure in these inhomogeneous networks on multiple length scales. Additionally, we find that across the entire concentration range studied, a network driven by the formation of ionic clusters was formed, where the size of the clusters drives the inhomogeneity of these systems. Tweaking the ionic clusters through the addition of ethanol impacts the packing of the sulfonated groups, their shape, and their size distribution, which in turn, affects the structure of these networks.

36 MATERIALS SCIENCE↗

The ECP ALPINE project: In situ and post hoc visualization infrastructure and analysis capabilities for exascale

A significant challenge on an exascale computer is the speed at which we compute results exceeds by many orders of magnitude the speed at which we save these results. Therefore the Exascale Computing Project (ECP) ALPINE project focuses on providing exascale-ready visualization solutions including in situ processing. In situ visualization and analysis runs as the simulation is run, on simulations results are they are generated avoiding the need to save entire simulations to storage for later analysis. The ALPINE project made post hoc visualization tools, ParaView and VisIt, exascale ready and developed in situ algorithms and infrastructures. The suite of ALPINE algorithms developed under ECP includes novel approaches to enable automated data analysis and visualization to focus on the most important aspects of the simulation. Many of the algorithms also provide data reduction benefits to meet the I/O challenges at exascale. ALPINE developed a new lightweight in situ infrastructure, Ascent.

97 MATHEMATICS AND COMPUTING↗

Development and Evaluation of E3SM‐MOSAIC: Spatial Distributions and Radiative Effects of Nitrate Aerosol

Abstract Nitrate aerosol plays an important role in affecting regional air quality as well as Earth's climate. However, it is not well represented or even neglected in many global climate models. In this study, we couple the Model for Simulating Aerosol Interactions and Chemistry (MOSAIC) module with the four‐mode version of the Modal Aerosol Module (MAM4) in DOE's Energy Exascale Earth System Model version 2 (E3SMv2) to simulate nitrate aerosol and its radiative effects. We find that nitrate aerosol simulated by E3SMv2‐MAM4‐MOSAIC is sensitive to the treatment of gaseous HNO 3 transfer to/from interstitial particles related to accommodation coefficients of HNO 3 ( ) on dust and non‐dust particles. We compare three different treatments of HNO 3 transfer: (a) a treatment (MTC_SLOW) that uses a low in the mass transfer coefficient (MTC) calculation; (b) a dust‐weighted MTC treatment (MTC_WGT) that uses a high on non‐dust particles; and (c) a dust‐weighted MTC treatment that also splits coarse mode aerosols into the coarse dust and sea salt sub‐modes in MOSAIC (MTC_SPLC). MTC_WGT and MTC_SPLC increase the global annual mean (2005–2014) nitrate burden from 0.096 (MTC_SLOW) to 0.237 and 0.185 Tg N, respectively, mostly in the coarse mode. MTC_WGT and MTC_SPLC also produce stronger nitrate direct radiative forcing (−0.048 and −0.051 W m −2 , respectively) and indirect forcing (−0.33 and −0.35 W m −2 , respectively) than MTC_SLOW (−0.021 and −0.24 W m −2 ). MTC_WGT and MTC_SPLC improve nitrate surface concentrations over remote oceans based on limited observations and vertical profiles of nitrate concentrations against aircraft measurements below 400 hPa.

54 ENVIRONMENTAL SCIENCES↗

Effects of organized convection parameterization on the MJO and precipitation in E3SMv1. Part I: Mesoscale heating

Mesoscale organization of convection is typically not represented in global circulation models, and hence its influence on the global circulation is not accounted for. The heating component of a parameterization that represents the dynamical and physical effects of circulations associated with organized convection, referred to as the multiscale coherent structure parameterization (MCSP), is implemented in the Energy Exascale Earth System Model version 1 (E3SMv1). Numerical simulations are conducted to assess its impact on the simulated climate. Besides E3SMv1 simulations, we performed high-resolution (1 km) simulations using the Weather Research and Forecasting (WRF) Model to determine the temperature tendencies induced by mesoscale convective systems embedded in deep convection. We tuned the free parameters of the MCSP based on the WRF simulations. MCSP heating enhances Kevin wave spectra in E3SMv1, improves the representation of the Madden-Julian Oscillation, and impacts on mean precipitation that vary with locations and seasons, including a reduction of biases over the tropical Pacific.

Climate Modeling↗

Assembly and Analysis of Cell-Scale Membrane Envelopes

The march toward exascale computing will enable routine molecular simulation of larger and more complex systems, for example, simulation of entire viral particles, on the scale of approximately billions of atoms-a simulation size commensurate with a small bacterial cell. Anticipating the future hardware capabilities that will enable this type of research and paralleling advances in experimental structural biology, efforts are currently underway to develop software tools, procedures, and workflows for constructing cell-scale structures. Herein, we describe our efforts in developing and implementing an efficient and robust workflow for construction of cell-scale membrane envelopes and embedding membrane proteins into them. A new approach for construction of massive membrane structures that are stable during the simulations is built on implementing a subtractive assembly technique coupled with the development of a structure concatenation tool (fastmerge), which eliminates overlapping elements based on volumetric criteria rather than adding successive molecules to the simulation system. Using this approach, we have constructed two "protocells" consisting of MARTINI coarse-grained beads to represent cellular membranes, one the size of a cellular organelle and another the size of a small bacterial cell. The membrane envelopes constructed here remain whole during the molecular dynamics simulations performed and exhibit water flux only through specific proteins, demonstrating the success of our methodology in creating tight cell-like membrane compartments. Extended simulations of these cell-scale structures highlight the propensity for nonspecific interactions between adjacent membrane proteins leading to the formation of protein microclusters on the cell surface, an insight uniquely enabled by the scale of the simulations. We anticipate that the experiences and best practices presented here will form the basis for the next generation of cell-scale models, which will begin to address the addition of soluble proteins, nucleic acids, and small molecules essential to the function of a cell.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Impact of Turbulence Representation on the Relationship Between Cloud Feedback and Aerosol‐Cloud Interaction in an E3SMv2 Perturbed Parameter Ensemble

Recent studies reveal an anti‐correlation between global cloud feedback (CF) and effective radiative forcing due to aerosol‐cloud interaction (ERFaci) in Earth system models, but the physical mechanisms underlying it remain uncertain. Here we investigate how different turbulence representations contribute to this relationship over the global ocean using an ensemble of Energy Exascale Earth System Model version 2 simulations with perturbed turbulence parameters. The anti‐correlation appears only in the tropical ascent regime. In the Northern Hemisphere midlatitude and high latitude regimes, there is no significant correlation, and in the tropical marine low cloud and Southern Ocean regimes, the correlation is positive. These opposite correlations are primarily driven by opposing CF responses to perturbed parameters. We find that the mean‐state turbulent mixing strength affects both CF and ERFaci, enabling strong correlations in certain regimes. This study highlights the complex linkages between CF and ERFaci through turbulent processes across diverse cloud regimes.

54 ENVIRONMENTAL SCIENCES↗

Numerical Water Tracers in the Atmospheric Component of the Energy Exascale Earth System Model: Implementation and Changes in Moisture Origin

Numerical water tracers are implemented in the Energy Exascale Earth System Model version 2. Simulations performed with the water‐tag‐enabled model for both pre‐industrial and future greenhouse gas concentrations reveal a marked increase in the role of mid‐latitude and southern subtropical regions as exporters of atmospheric moisture—to the extratropical upper troposphere and the tropical free troposphere. For the latter, the northward shift of the Intertropical Convergence Zone increases cross‐hemispheric transport of subtropical water vapor to the Northern Hemisphere. In the polar regions, most of the lower tropospheric moistening instead arises from increases in local evaporation. These findings illustrate the utility of the water tags, underscore critical changes in global hydrologic cycle, and provide insight into atmospheric dynamics under future climate scenarios. For applications when a global grid is desired, we additionally propose a novel statistical reconstruction, based on copula modeling, of the joint distribution of origin of water vapor, which reduces the number of tracers from order $\mathcal{O}\left({n}^{2}\right)$to order $\mathcal{O}(n)$, substantially ameliorating the considerable computational cost of water tracers. This statistical reconstruction is particularly beneficial to the interpretation of the relationship between latitude and longitude of origin of moisture over the tropical oceans and in the lower troposphere over land.

copula modeling↗

Landsat near-infrared (NIR) band and ELM-FATES sensitivity to forest disturbances and regrowth in the Central Amazon

Forest disturbance and regrowth are key processes in forest dynamics, but detailed information on these processes is difficult to obtain in remote forests such as the Amazon. We used chronosequences of Landsat satellite imagery (Landsat 5 Thematic Mapper and Landsat 7 Enhanced Thematic Mapper Plus) to determine the sensitivity of surface reflectance from all spectral bands to windthrow, clear-cut, and clear-cut and burned (cut + burn) and their successional pathways of forest regrowth in the Central Amazon. We also assessed whether the forest demography model Functionally Assembled Terrestrial Ecosystem Simulator (FATES) implemented in the Energy Exascale Earth System Model (E3SM) Land Model (ELM), ELM-FATES, accurately represents the changes for windthrow and clear-cut. The results show that all spectral bands from the Landsat satellites were sensitive to the disturbances but after 3 to 6 years only the near-infrared (NIR) band had significant changes associated with the successional pathways of forest regrowth for all the disturbances considered. In general, the NIR values decreased immediately after disturbance, increased to maximum values with the establishment of pioneers and early successional tree species, and then decreased slowly and almost linearly to pre-disturbance conditions with the dynamics of forest succession. Statistical methods predict that NIR values will return to pre-disturbance values in about 39, 36, and 56 years for windthrow, clear-cut, and cut + burn disturbances, respectively. The NIR band captured the observed, and different, successional pathways of forest regrowth after windthrow, clear-cut, and cut + burn. Consistent with inferences from the NIR observations, ELM-FATES predicted higher peaks of biomass and stem density after clear-cuts than after windthrows. ELM-FATES also predicted recovery of forest structure and canopy coverage back to pre-disturbance conditions in 38 years after windthrows and 41 years after clear-cut. The similarity of ELM-FATES predictions of regrowth patterns after windthrow and clear-cut to those of the NIR results suggests the NIR band can be used to benchmark forest regrowth in ecosystem models. Our results show the potential of Landsat imagery data for mapping forest regrowth from different types of disturbances, benchmarking, and the improvement of forest regrowth models.

54 ENVIRONMENTAL SCIENCES↗

Incorporation of aerosol into the COSPv2 satellite lidar simulator for climate model evaluation

Abstract. Atmospheric aerosol has substantial impacts on climate, air quality and biogeochemical cycles, and its concentrations are highly variable in space and time. A key variability to evaluate within models that simulate aerosol is the vertical distribution, which influences atmospheric heating profiles and aerosol–cloud interactions, to help constrain aerosol residence time and to better represent the magnitude of simulated impacts. To ensure a consistent comparison between modeled and observed vertical distribution of aerosol, we implemented an aerosol lidar simulator within the Cloud Feedback Model Intercomparison Project (CFMIP) Observation Simulator Package version 2 (COSPv2). We assessed the attenuated total backscattered (ATB) signal and the backscatter ratios (SRs) at 532 nm in the U.S. Department of Energy's Energy Exascale Earth System Model version 1 (E3SMv1). The simulator performs the computations at the same vertical resolution as the Cloud-Aerosol Lidar with Orthogonal Polarization (CALIOP), making use of aerosol optics from the E3SMv1 model as inputs and assuming that aerosol is uniformly distributed horizontally within each model grid box. The simulator applies a cloud masking and an aerosol detection threshold to obtain the ATB and SR profiles that would be observed above clouds by CALIOP with its aerosol detection capability. Our analysis shows that the aerosol distribution simulated at a seasonal timescale is generally in good agreement with observations. Over the Southern Ocean, however, the model does not produce the SR maximum as observed in the real world. Comparison between clear-sky and all-sky SRs shows little differences, indicating that the cloud screening by potentially incorrect model clouds does not affect the mean aerosol signal averaged over a season. This indicates that the differences between observed and simulated SR values are due not to sampling errors, but to deficiencies in the representation of aerosol in models. Finally, we highlight the need for future applications of lidar observations at multiple wavelengths to provide insights into aerosol properties and distribution and their representation in Earth system models.

54 ENVIRONMENTAL SCIENCES↗

LHC Event Generation in the Exascale Era

MCFM is a dedicated Monte-Carlo simulation program for collider phenomenology at highest energies. Designed during the Tevatron era, it has successfully incorporated the latest developments needed for LHC precision calculations and remained on the forefront of collider phenomenology. The Fortran code includes interfaces to modern PDF and loop reduction libraries but has been unchanged structurally compared to the earlier versions. Parallel computing has been enabled using OpenMP and MPI. MCFM provides numerically highly stable one-loop amplitudes and superior phase-space efficiency, leading to excellent performance in NXLO calculations using jettiness or qT subtraction techniques for IR regularization.

Campbell, John [Fermilab]↗

Large-scale Multiphysics Simulations of Small Modular Reactors Operating in Natural Circulation

Thanks to the advancements in high-performance computing, advanced modeling and simulation have become crucial in driving the development and deployment of next-generation nuclear reactors, such as small modular reactors (SMRs). SMRs offer the promise of cost-effective baseload electricity production and improved safety, while addressing some of the challenges associated with large reactor designs, such as high capital costs and extended construction timelines. As part of the Exascale Computing Project, the large-scale multiphysics simulation of an entire SMR primary system has been achieved by combining computational fluid dynamics and neutronics. In addition to the successful demonstration of full-core SMR simulations, the current study integrated the impact of natural circulation into the system. Natural circulation is the primary mechanism driving coolant circulation in SMRs. The mass flow rate in the core depends on the core power, and a numerical model has been developed to predict it. The pressure drop caused by the helical coil steam generator was also accounted for by developing a pressure drop correlation based on high-fidelity large eddy simulation results, further improving prediction accuracy. In conclusion, the results of the study demonstrate that the implemented natural circulation model is effective in predicting the responses of SMR full-core multiphysics simulations.

ECP↗

Ship-based Observations and Climate Model Simulations of Cloud Phase over the Southern Ocean

The Southern Ocean (SO) clouds exert a significant influence on the Earth’s radiation budget. Here we analyzed ship-based remote sensing observations of SO clouds over a five-month long DOE ARM Measurements of Aerosols, Radiation and Clouds over the Southern Oceans (MARCUS) field campaign to better understand cloud phase variability. We developed a method to classify eight categories of hydrometeors (ice, liquid, mixed phase, rain, drizzle, snow, aerosols, and clear sky) based on measurements of lidar, radar and radiosondes. Cloud thermodynamic phases (liquid, ice and mixed phase) at coarser scales were further derived to compare with the DOE Energy Exascale Earth System Model version 1 (E3SMv1) simulation and the Earth Model Column Collaboratory (EMC 2 ) instrument simulator. For a scale-aware comparison with climate model simulations, we found that spatially averaging the raw remote sensing data (e.g., backscatter, reflectivity) results in increased cloud cover and cloud liquid, whereas, directly averaging cloud phase from higher to lower resolution maintains clear air regions and is thus recommended for in-cloud frequency comparisons. For cloud thermodynamic phases in stratiform clouds, the E3SM underestimates cloud ice and overestimates cloud liquid at temperatures between -40 and 0°C. When latitudes increase, both observations and simulations show a transition of dominant phase from liquid to ice for cloud tops as well as for the entire cloud columns, but the model underestimation of ice phase is more severe at higher latitudes. Such model bias is unlikely caused by spatial scale differences or lack of heterogeneity in cloud vertical structure in the simulation.

54 ENVIRONMENTAL SCIENCES↗

The DOE E3SM v1.2 Cryosphere Configuration: Description and Simulated Antarctic Ice‐Shelf Basal Melting

Abstract The processes responsible for freshwater flux from the Antarctic Ice Sheet (AIS), ice‐shelf basal melting and iceberg calving, are generally poorly represented in current Earth System Models (ESMs). Here we document the cryosphere configuration of the U.S. Department of Energy's Energy Exascale Earth System Model (E3SM) v1.2. This includes simulating Antarctic ice‐shelf basal melting, which has been implemented through simulating the ocean circulation within static Antarctic ice‐shelf cavities, allowing for the ability to calculate ice‐shelf basal melt rates from the associated heat and freshwater fluxes. In addition, we added the capability to prescribe forcing from iceberg melt, allowing for realistic representation of the other dominant mass loss process from the AIS. In standard resolution simulations (using a noneddying ocean) under preindustrial climate forcing, we find high sensitivity of modeled ocean/ice shelf interactions to the ocean state, which can result in a transition to a high basal melt regime under the Filchner‐Ronne Ice Shelf (FRIS), presenting a significant challenge to representing the ocean/ice shelf system in a coupled ESM. We show that inclusion of a spatially dependent parameterization of eddy‐induced transport reduces biases in water mass properties on the Antarctic continental shelf. With these improvements, E3SM produces realistic ice‐shelf basal melt rates across the continent that are generally within the range inferred from observations. The accurate representation of ice‐shelf basal melting within a coupled ESM is an important step toward reducing uncertainties in projections of the Antarctic response to climate change and Antarctica's contribution to global sea‐level rise.

54 ENVIRONMENTAL SCIENCES↗

Roadmap on electronic structure codes in the exascale era

Electronic structure calculations have been instrumental in providing many important insights into a range of physical and chemical properties of various molecular and solid-state systems. Their importance to various fields, including materials science, chemical sciences, computational chemistry and device physics, is underscored by the large fraction of available public supercomputing resources devoted to these calculations. As we enter the exascale era, exciting new opportunities to increase simulation numbers, sizes, and accuracies present themselves. In order to realize these promises, the community of electronic structure software developers will however first have to tackle a number of challenges pertaining to the efficient use of new architectures that will rely heavily on massive parallelism and hardware accelerators. This roadmap provides a broad overview of the state-of-the-art in electronic structure calculations and of the various new directions being pursued by the community. It covers 14 electronic structure codes, presenting their current status, their development priorities over the next five years, and their plans towards tackling the challenges and leveraging the opportunities presented by the advent of exascale computing.

36 MATERIALS SCIENCE↗

Atmospheric-river-induced precipitation in California as simulated by the regionally refined Simple Convective Resolving E3SM Atmosphere Model (SCREAM) Version 0

Abstract. Using the regionally refined mesh (RRM) configuration of the US Department of Energy's Simple Cloud-Resolving Energy Exascale Earth System Model (E3SM) Atmosphere Model (SCREAM), we simulate and evaluate four meteorologically distinct atmospheric river events over California. We test five different RRM configurations, each differing in terms of the areal extent of the refined mesh and the resolution (ranging from 800 m to 3.25 km). We find that SCREAM RRM generally has a good representation of the AR-generated precipitation in CA, even for the control simulation which has a very small 3 km refined patch, and is able to capture the fine-scale regional distributions that are controlled largely by the fine-scale topography of the state. It is found that SCREAM generally has a wet bias over topography, most prominently over the Sierra Nevada mountain range, with a corresponding dry bias on the lee side. We find that refining the resolution beyond 3 km (specifically 1.6 km and 800 m) has virtually no benefit towards reducing systematic precipitation biases but that improvements can be found when increasing the areal extent of the upstream refined mesh. However, these improvements are relatively modest and only realized if the size of the refined mesh is expanded to the scale where employing RRM no longer achieves the substantial cost benefit it was intended for.

54 ENVIRONMENTAL SCIENCES↗

An Assessment of Nonhydrostatic and Hydrostatic Dynamical Cores at Seasonal Time Scales in the Energy Exascale Earth System Model (E3SM)

Abstract In global atmospheric modeling, the differences between nonhydrostatic (NH) and hydrostatic (H) dynamical cores are negligible in dry simulations when grid spacing is larger than 10 km. However, recent studies suggest that those differences can be significant at far coarser resolution when moisture is included. To better understand how NH and H differences manifest in global fields, we perform and analyze an ensemble of 28 and 13 km seasonal simulations with the NH and H dynamical cores in the Energy Exascale Earth System Model global atmosphere model, where the differences between H and NH configurations are minimized. A set of idealized rising bubble experiments is also conducted to further investigate the differences. Although NH and H differences are not significant in global statistics and zonal averages, significant differences in precipitation amount and patterns are observed in parts of the tropics. The most prominent differences emerge near India and the Western Pacific in the boreal summer, and the central‐southern Indian Ocean and Pacific in the boreal winter. Tropical differences influence surrounding regions through modification of the regional circulation and can propagate to the extratropics, leading to significant temperature and geopotential differences over the middle to high latitudes. While the dry bubble experiments show negligible deviation between H and NH dynamics until grid spacing is below 6.25 km, precipitation amount and vertical velocity are different in the moist case even at 25 km resolution.

58 GEOSCIENCES↗