Search NASA⌕ Search

Engineering topics

Hillman, Benjamin

Publications and source records attributed to Hillman, Benjamin.

14 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Using feature importance as an exploratory data analysis tool on Earth system models

Abstract. Machine learning (ML) models are commonly used to generate predictions, but these models can also support the discovery of new science. Generating accurate predictions necessitates that a model captures the structure of the underlying data. If the structure is properly extracted, ML could be a useful exploratory and evidential tool. In this paper, we present a case study that demonstrates the use of ML for exploratory data analysis (EDA) in the climate space. We apply the ML explainability method of spatiotemporal zeroed feature importance (stZFI) to understand how climate-variable associations evolve over space and time. Our analyses focus on data from ensembles of Earth system models (ESMs) which provide data on different climate states and conditions. We elect to work with ESM ensembles since they allow us to compare feature importance across alternative scenarios not available with observed data. The ensembles also account for natural variability so that we can distinguish between signal and noise due to natural climate variability when computing feature importance. The use of perturbed initial condition ensembles introduces variability mimicking the natural variability in the atmosphere; thus the signals emerging using feature importance (FI) can be evaluated against the natural variability in the climate system. For our analyses, we consider the 1991 volcanic eruption of Mount Pinatubo, which was a large stratospheric aerosol injection. We explore the climate pathway associated with the eruption from aerosols to radiation to temperature at both the near-surface and stratospheric levels. In addition to applying the method to data generated from two different ESMs, we apply stZFI to reanalysis data to compare the associations identified by stZFI. We show how stZFI tracks the importance of aerosol optical depth over time on forecasting temperatures. This case study illustrates usefulness of an ML tool (stZFI) for EDA on a well-studied climate exemplar.

Ries, Daniel (ORCID:0000000250294647)↗
DOE OSTI2024

CLDERA-E3SM

SAND2025-03846O CLDERA-E3SM enhances the E3SMv2 model by adding new options such as complete stratospheric volcanic aerosol representation and idealized physics model configuration for the atmosphere component. CLDERA-E3SM also allows for aerosol source emission specification, which is a powerful method for tracking aerosol and its climate impacts in E3SMv2. This new code better represents stratospheric sulfate aerosol and includes modifications such as changes to the default aerosol size distributions and to stratospheric aerosol microphysical treatment, which allows stratospheric sulfate aerosol to grow larger than in the default E3SMv2. New aerosol source tagging can be customized to separate the global emission of select aerosol tracers—such as sulfate, black carbon, and organic carbon aerosol—into a new, user specified list of sources. It also includes idealized simulations of the atmosphere and volcanic aerosol tracers. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Hillman, Benjamin↗
DOE OSTI2024

Validating a microphysical prognostic stratospheric aerosol implementation in E3SMv2 using observations after the Mount Pinatubo eruption

Abstract. This paper describes the addition of a stratospheric prognostic aerosol (SPA) capability – developed with the goal of accurately simulating sulfate aerosol formation and evolution in the stratosphere – in the Department of Energy (DOE) Energy Exascale Earth System Model, version 2 (E3SMv2). The implementation includes changes to the four-mode Modal Aerosol Module microphysics in the stratosphere to allow for larger particle growth and more accurate stratospheric aerosol lifetime following the Pinatubo eruption. E3SMv2-SPA reasonably reproduces stratospheric aerosol lifetime, burden, aerosol optical depth, and top-of-atmosphere flux when compared to remote sensing observations. E3SMv2-SPA also has close agreement with the interactive chemistry–climate model CESM2-WACCM (Community Earth System Model version 2–Whole Atmosphere Community Climate Model) – which has a more complete chemical treatment – and the observationally constrained, prescribed volcanic aerosol treatment in E3SMv2. Global stratospheric aerosol size distributions identify the nucleation and growth of sulfate aerosol from volcanically injected SO2 from both major and minor volcanic eruptions from 1991 to 1993. The modeled aerosol effective radius is consistently lower than satellite and in situ measurements (max differences of ∼ 30 %). Comparisons with in situ size distribution samples indicate that this simulated underestimation in both E3SMv2-SPA and CESM2-WACCM is due to overly small accumulation and coarse-mode aerosols 6–18 months post-eruption, with E3SMv2-SPA simulating ∼ 50 % of the coarse-mode geometric mean diameters of observations 11 months post-eruption. Effective radii from the models and observations are used to calculate offline scattering and absorption efficiencies to explore the implications of smaller simulated aerosol size for the Pinatubo climate impacts. Scattering efficiencies at wavelengths of peak solar irradiance (∼ 0.5 µm) are 10 %–80 % higher for daily samples in models relative to observations through 1993, suggesting higher diffuse radiation at the surface and a larger cooling effect in the models due to the smaller simulated aerosol; absorption efficiencies at the peak wavelengths of outgoing terrestrial radiation (∼ 10 µm) are 15 %–40 % lower for daily samples in models relative to observations, suggesting an underestimation in stratospheric heating in the models due to the smaller simulated aerosol. These potential biases are based on aerosol size alone and do not take into account differences in the aerosol number. The overall agreement of E3SMv2-SPA with observations and its similar performance to the well-validated CESM2-WACCM makes E3SMv2-SPA a viable alternative to simulating climate impacts from stratospheric sulfate aerosols.

Brown, Hunter York (ORCID:0000000218147874)↗
DOE OSTI2023

The Simple Cloud-Resolving E3SM Atmosphere Model Running on the Frontier Exascale System

We present an efficient and performance portable implementation of the Simple Cloud Resolving E3SM Atmosphere Model (SCREAM). SCREAM is a full featured atmospheric global circulation model with a nonhydrostatic dynamical core and state-of-the-art parameterizations for microphysics, moist turbulence and radiation. It has been written from scratch in C++ with the Kokkos library used to abstract the on-node execution model for both CPUs and GPUs. SCREAM is one of only a few global atmosphere models to be ported to GPUs. As far as we know, SCREAM is the first such model to run on both AMD GPUs and NVIDIA GPUs, as well as the first to run on nearly an entire Exascale system (Frontier). On Frontier, we obtained a record setting performance of 1.26 simulated years per day for a realistic cloud resolving simulation.

Taylor, Mark↗
DOE OSTI2023

Arctic cyclones have become more intense and longer-lived over the past seven decades

Intense cyclones driving extreme Arctic weather and climate events have been more frequently observed during recent years, causing dramatic environmental and socioeconomic impacts. However, inconsistencies have emerged about long-term changes in Arctic cyclone activity. Here we analyze multiple reanalysis datasets covering a multidecadal period with improvements to the cyclone tracking algorithm and the integrated cyclone activity metric. The results indicate an intensification of Arctic cyclone activity over the last seven decades. There has been a long-term shift of the maximum cyclone counts from weaker to stronger cyclones and a pronounced lengthening of the duration of strong cyclones. Spatial analysis shows increased strong cyclone frequency over the Arctic, driven by enhanced lower troposphere baroclinicity, amplified winter jet stream waves over the subpolar North Atlantic, and a strengthened summer tropospheric vortex over the central Arctic. The stratospheric vortex has also intensified the tropospheric waves and vortex with distinct dynamics between winter and summer. Recently enhanced baroclinicity over large areas of the Arctic and midlatitudes suggests more complicated atmospheric dynamics than what is hypothesized with Arctic-amplification-induced decrease in meridional temperature gradients.

Atmospheric dynamics↗
DOE OSTI2021

Impact of a New Cloud Microphysics Parameterization on the Simulations of Mesoscale Convective Systems in E3SM

Abstract Mesoscale convective systems (MCSs) are one of the most climatically significant forms of convection because of their large role in water and energy cycles. The mesoscale features associated with MCS are difficult to represent in climate models because the relevant dynamics and physics are absent or poorly represented with coarse model resolution (∼100 km). Using a regionally refined model (RRM) with 0.25° grid spacing embedded in the Energy Exascale Earth System Model (E3SM), we explore the impact of cloud microphysics parameterizations on the simulation of precipitation, particularly MCS precipitation over the contiguous United States. The Predicted Particle Properties (P3) cloud microphysics scheme has been modified and implemented into E3SM to overcome the limitations of the default Morrison and Gettelman (MG2) scheme in which rimed precipitating ice particles (graupel/hail) are absent and frozen particles are artificially partitioned into cloud ice and snow. We show that P3 improves the simulation of precipitation statistics including frequency distribution compared with MG2 with a limited effect on the diurnal cycle. P3 predicts higher hourly rain rates, resulting in 20% more MCSs and a higher total MCS precipitation (4.4%) compared to MG2, agreeing better with observations. The improvements with P3 mainly result from improved representations of ice microphysics, which not only produces higher rain rates through melting but also leads to a stronger large‐scale ascending motion by releasing more latent heating. This study suggests that improving microphysics parameterization is important for simulating MCS precipitation as future climate model resolutions continue to increase.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

The Fingerprints of Stratospheric Aerosol Injection in E3SM

The June 15, 1991 Mt. Pinatubo eruption is simulated in E3SM by injecting 10 Tg of SO 2 gas in the stratosphere, turning off prescribed volcanic aerosols, and enabling E3SM to treat stratospheric volcanic aerosols prognostically. This experimental prognostic treatment of volcanic aerosols in the stratosphere results in some realistic behaviors (SO 2 evolves into H 2 SO 4 which heats the lower stratosphere), and some expected biases (H 2 SO 4 aerosols sediment out of the stratosphere too quickly). Climate fingerprinting techniques are used to establish a Mt. Pinatubo fingerprint based on the vertical profile of temperature from the E3SMv1 DECK ensemble. By projecting reanalysis data and preindustrial simulations onto the fingerprint, the Mt. Pinatubo stratospheric heating anomaly is detected. Projecting the experimental prognostic aerosol simulation onto the fingerprint also results in a detectable heating anomaly, but, as expected, the duration is too short relative to reanalysis data.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Integrative data-driven approaches for characterization & prediction of aerosol-cloud processes

Focal Area: Advanced methods to glean insights from complex data (Focal Area 3). Science Challenge: Fusing and interpreting the vast amount of data from disjoint sources for the purpose of elevating our understanding of aerosol-cloud interaction presents an enormous challenge and opportunity and is necessary to improve uncertainty quantification and predictions, especially for extreme events.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Making Atmospheric Convective Parameterizations Obsolete with Machine Learning Emulation

Parameterizations of moist convection in atmospheric models are notoriously problematic, and while global cloud resolving models (GCRM) are often touted as the ultimate solution, the computational cost is a considerable hurdle to overcome. Machine learning emulation of GCRMs for predictive modelling can leverage the DOE’s computational resource investments and allow widespread use of GCRMs such that traditional parameterizations become obsolete for most applications.

54 ENVIRONMENTAL SCIENCES↗