Search NASA⌕ Search

SEARCH · Search NASA

Results for “model benchmark”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

A comparison of probabilistic generative frameworks for molecular simulations

Generative artificial intelligence is now a widely used tool in molecular science. Despite the popularity of probabilistic generative models, numerical experiments benchmarking their performance on molecular data are lacking. Here, in this work, we introduce and explain several classes of generative models, broadly sorted into two categories: flow-based models and diffusion models. We select three representative models: neural spline flows, conditional flow matching, and denoising diffusion probabilistic models, and examine their accuracy, computational cost, and generation speed across datasets with tunable dimensionality, complexity, and modal asymmetry. Our findings are varied, with no one framework being the best for all purposes. In a nutshell, (i) neural spline flows do best at capturing mode asymmetry present in low-dimensional data, (ii) conditional flow matching outperforms other models for high-dimensional data with low complexity, and (iii) denoising diffusion probabilistic models appear the best for low-dimensional data with high complexity. Our datasets include a Gaussian mixture model and the dihedral torsion angle distribution of the Aib9 peptide, generated via a molecular dynamics simulation. We hope our taxonomy of probabilistic generative frameworks and numerical results may guide model selection for a wide range of molecular tasks.

Artificial intelligence↗

Analysis and modeling of tungsten emission and net erosion in the DIII-D divertor using updated atomic data

Tungsten (W) is one of the leading candidate materials for plasma-facing components. However, its main drawback is its high radiative efficiency; if W penetrates the plasma, it can lead to core degradation or even collapse. Since eroded tungsten tends to ionize in the sheath and redeposit promptly, the net erosion flux that escapes prompt redeposition can differ significantly from the gross erosion. This work presents a modeling framework to estimate net erosion and photon emission from W coatings exposed to the lower divertor of DIII-D using the DiMES material exposure probe. The approach couples RustBCA for sputtering yields with a Monte Carlo transport code (LPTMC) that models redeposition and W emission. Computation is carried out with new atomic data, based on R-matrix and Mons calculations, leading to lower ionization probabilities and a twofold increase in net erosion estimates compared to calculations done with OPEN-ADAS atomic data. The model results are benchmarked against experimental measurements, showing quantitative agreement for erosion, although the trends in W emission are reproduced only qualitatively. The model is also used to assess whether W II emission can serve as a direct measurement of the net erosion of W in the lower divertor of DIII-D. Simulations show that this is not valid if the electron pressure is above ~120 Pa or if the toroidal length of the eroded material is smaller than the parallel-to-B distance traveled by impurity ions before steady-state conditions are reached. Finally, simulations suggest that when W is sputtered by carbon ions with high impact energies (≳300 eV) in DIII-D, W net erosion scales with W gross erosion and can be numerically approximated using W I flux alone as input.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Temporal sequence transformer to advance long-term streamflow prediction

Accurate streamflow prediction is crucial for understanding climate change impacts on water resources and for effective management of extreme hydrological events. While Long Short-Term Memory (LSTM) networks have been the dominant data-driven approach for streamflow forecasting, recent advancements in transformer architectures for time series tasks have shown promise in outperforming traditional LSTM models. This study introduces a transformer-based model that integrates historical streamflow data with climatic variables to enhance streamflow prediction accuracy. We evaluated our transformer model against a benchmark LSTM across five diverse basins in the United States. Results demonstrate that the transformer architecture consistently outperforms the LSTM model across all evaluation metrics, highlighting its potential as a more effective tool for hydrological forecasting. This research contributes to the ongoing development of advanced AI techniques for improved water resource management and climate change adaptation strategies.

Singh, Ruhaan [Farragut High School]↗

Neutronic Consideration of TREAT Facility Fuel SiC Recladding

The Transient Reactor Test (TREAT) Facility is an air-cooled reactor composed of graphite-urania fuel encapsulated in zirconium alloy canisters and surrounded by ~2 ft (~61 cm) of nuclear grade graphite. The primary role of TREAT is to provide in-pile nuclear-heated safety research via transient testing [1]. Benchmark efforts have demonstrated sensitivity of TREAT neutronics models to graphite cross section data and key neutron poisons found in the fuel assemblies [2]. During fabrication of TREAT fuel assemblies, a small concentration of boron was inadvertently introduced with variable concentration into the aggregate of fuel blocks prepared for TREAT use. The concentration of boron, and its respective uncertainty, represent the most sensitive component in a neutronics study; unfortunately, nothing can be done to reduce or otherwise mitigate its impact. Hydrogen in the fuel blocks reduces the mean free path of the core and its true quantity and uncertainty is approximated. The hydrogen remains from pitch binder used in the fuel fabrication process and was not completely released due to incomplete fuel graphitization. Destructive fuel testing is necessary to quantify the actual hydrogen content and to improve benchmark model quality. A third neutron poison of some significance is the hafnium impurity in the Zircaloy-3 (Zry-3) assembly cladding. The quantity of hafnium is expected to be within nominal manufacturing limits for nuclear grade zircaloy. Recladding the fuel assemblies with material that is less neutron absorbing is expected to benefit reactor neutron economy. Moreover, TREAT’s total transient energy is restricted based on the rate of Zry-3 oxidation in TREAT’s air coolant environment. Hence, cladding with more benign air reaction kinetics could dramatically uprate the facility’s experimental capability. Silicon carbide (SiC) has been proposed as a candidate material for recladding TREAT assemblies, as SiC/SiC demonstrate favorable properties within nuclear environments [3]. The current operational limits of TREAT are restricted by the oxidation of Zry-3. Change of the cladding to SiC could feasibly double the current temperature limitation. Recladding opportunities allow for previously damaged fuel assemblies to be returned to service, as Zry-3 is not commercially available. The initial effort required to consider proceeding with any recladding effort is to neutronically characterize key reactor parameters while replacing Zry-3 with SiC. A characterization summary, with respective results, is provided herein.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

gdess: A framework for evaluating simulated atmospheric CO 2 in Earth System Models

Atmospheric carbon dioxide (CO 2 ) plays a key role in the global carbon cycle and global warming. Climate-carbon feedbacks are often studied and estimated using Earth System Models (ESMs), which couple together multiple model components—including the atmosphere, ocean, terrestrial biosphere, and cryosphere—to jointly simulate mass and energy exchanges within and between these components. Despite tremendous advances, model intercomparisons and benchmarking are aspects of ESMs that warrant further improvement (Fer et al., 2021; Smith et al., 2014). Such benchmarking is critical because comparing the value of state variables in these simulations against observed values provides evidence for appropriately refining model components; moreover, researchers can learn much about Earth system dynamics in the process (Randall et al., 2019). We introduce `gdess` (a.k.a., Greenhouse gas Diagnostics for Earth System Simulations), which parses observational datasets and ESM simulation output, combines them to be in a consistent structure, computes statistical metrics, and generates diagnostic visualizations. In its current incarnation, `gdess` facilitates evaluating a model's ability to reproduce observed temporal and spatial variations of atmospheric CO 2 . The diagnostics implemented modularly in `gdess` support more rapid assessment and improvement of model-simulated global CO 2 sources and sinks associated with land and ocean ecosystem processes. We intend for this set of automated diagnostics to form an extensible, open source framework for future comparisons of simulated and observed concentrations of various greenhouse gases across Earth system models.

97 MATHEMATICS AND COMPUTING↗

AI Benchmark Democratization and Carpentry

Benchmarks are a cornerstone of modern machine learning, enabling reproducibility, comparison, and scientific progress. However, AI benchmarks are increasingly complex, requiring dynamic, AI-focused workflows. Rapid evolution in model architectures, scale, datasets, and deployment contexts makes evaluation a moving target. Large language models often memorize static benchmarks, causing a gap between benchmark results and real-world performance. Beyond traditional static benchmarks, continuous adaptive benchmarking frameworks are needed to align scientific assessment with deployment risks. This calls for skills and education in AI Benchmark Carpentry. From our experience with MLCommons, educational initiatives, and programs like the DOE's Trillion Parameter Consortium, key barriers include high resource demands, limited access to specialized hardware, lack of benchmark design expertise, and uncertainty in relating results to application domains. Current benchmarks often emphasize peak performance on top-tier hardware, offering limited guidance for diverse, real-world scenarios. Benchmarking must become dynamic, incorporating evolving models, updated data, and heterogeneous platforms while maintaining transparency, reproducibility, and interpretability. Democratization requires both technical innovation and systematic education across levels, building sustained expertise in benchmark design and use. Benchmarks should support application-relevant comparisons, enabling informed, context-sensitive decisions. Dynamic, inclusive benchmarking will ensure evaluation keeps pace with AI evolution and supports responsible, reproducible, and accessible AI deployment. Community efforts can provide a foundation for AI Benchmark Carpentry.

von Laszewski, Gregor [Virginia U.]↗

Modeling gas release from a Bingham plastic slurry and deconvoluting measured data

Physics-based models for predicting the off-gassing characteristics of agitated slurries are presented. This approach decomposes the system into two separate but coupled slurry and headspace models. The physics driving bubble transport through the slurry and gas mixing within the headspace are discussed. An analytical expression for predicting the time evolution of the headspace concentration using first principles theory is also presented. Predictions from the numerical models, as well as expectations from the analytical solution, both agree with measured off gassing data for two different experimental operating conditions. After benchmarking the numerical model predictions against experimental data, the model was used to make predictions for gas release from a full-scale vessel and to perform sensitivity analyses to examine the sensitivity of gas release to parameters such as yield stress, consistency index, slurry density, bubble size, bubble concentration, and impeller speed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Hybrid Solid Oxide Fuel Cell/Gas Turbine Model Development for Electric Aviation

A thermodynamic model was developed and validated to analyze a high-performance solid oxide fuel cell and gas turbine (SOFC-GT) hybrid power system for electric aviation. This study used a process simulation software package (ProMax) to study the role of SOFC design and operation on the feasibility and performance of the hybrid system. Standard modules, including compressor, turbine, heat exchanger, reforming reactor, and combustor were used from the ProMax tool suite while a custom module was created to simulate the SOFC stack. The model used an SOFC test data set as an input. Additional SOFC stack performance effects, such as pressure, temperature, and utilization of air and fuel, were added from open source data. System performance predictors were SOFC specific power, fuel-to-electricity conversion efficiency, and hybrid system efficiency. Using these input data and predictors, a static thermodynamic performance model was created that can be modified for different system configurations and operating conditions. Prior to creating the final aircraft performance model, initial demonstration models were developed to validate output results. We used the NASA SOFC model as a benchmark, which was created with their Numerical Propulsion System Simulator (NPSS) software framework. Our output results matched within 1% of both the NASA model and open source SOFC performance data. With confidence gained in the accuracy of this model, a 1-MW SOFC-GT hybrid power system was constructed for an aircraft propulsion concept. Overall hybrid system efficiencies of > 75% FTE were observed during standard 36,000 feet cruise flight conditions.

30 DIRECT ENERGY CONVERSION↗

Informing Robust Functional Relationship Benchmarks: An Evaluation of the Temperature Sensitivity of Ecosystem Respiration Across the Arctic-Boreal Region

During land model development, simulated carbon dynamics are often benchmarked against observational data sets to evaluate model performance. Functional relationship benchmarks are the relationship between a driving variable (e.g., temperature) and a response variable (e.g., ecosystem respiration) and are a promising tool for assessing model performance by evaluating modeled sensitivities to changing environmental conditions. However, observed functional relationships can be influenced by choices made during data collection and throughout the benchmarking process, impacting the inferred skill of land models. To avoid misrepresenting a model's true performance, it is necessary to systematically evaluate best practices when constructing functional relationship benchmarks. We developed a set of guidelines for constructing functional relationship benchmarks, considering the choice of data set, number of daily observations, temporal extent, and temporal resolution across Alaska and Canada over a 20-year period from 2001 to 2020. The temperature sensitivity of ecosystem respiration from observations, evaluated through an apparent Q 10 , is highly variable both spatially and as a result of the data processing approach applied in the benchmark formation. When benchmarking 13 models from the Warming Permafrost Model Intercomparison Project (WrPMIP), the range in inferred model skill is substantially impacted by the choices applied in constructing functional relationship benchmarks. The inferred performance of a given model is most sensitive to the number of daily observations and temporal extent, followed by choice of benchmark data set and temporal averaging. Results from this analysis can guide the development of consistent and robust functional relationships for future model evaluation studies.

Poe, Jeralyn [Northern Arizona University, Flagsta↗

Search for heavy resonances and quantum black holes in eμ, eτ, and μτ final states in proton-proton collisions at $\sqrt{s}$ = 13 TeV

A search is reported for heavy resonances and quantum black holes decaying into eμ, eτ, and μτ final states in proton-proton collision data recorded by the CMS experiment at the CERN LHC during 2016–2018 at $\sqrt{s}$ = 13 TeV, corresponding to an integrated luminosity of 138 fb -1 . The eμ, eτ, and μτ invariant mass spectra are reconstructed, and no evidence is found for physics beyond the standard model. Upper limits are set at 95% confidence level on the product of the cross section and branching fraction for lepton flavor violating signals. Three benchmark signals are studied: resonant τ sneutrino production in R parity violating supersymmetric models, heavy Z' gauge bosons with lepton flavor violating decays, and nonresonant quantum black hole production in models with extra spatial dimensions. Resonant τ sneutrinos are excluded for masses up to 4.2TeV in the eμ channel, 3.7TeV in the eτ channel, and 3.6TeV in the μτ channel. A Z' boson with lepton flavor violating couplings is excluded up to a mass of 5.0TeV in the eμ channel, up to 4.3Te V in the eτ channel, and up to 4.1TeV in the μτ channel. Quantum black holes in the benchmark model are excluded up to the threshold mass of 5.6TeV in the eμ channel, 5.2TeV in the eτ channel, and 5.0TeV in the μτ channel. In addition, model-independent limits are extracted to allow comparisons with other models for the same final states and similar event selection requirements. The results of these searches provide the most stringent limits available from collider experiments for heavy particles that undergo lepton flavor violating decays.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Apparatus and method for safety analysis evaluation with data-driven workflow

An apparatus and method for system safety analysis evaluation is provided, the apparatus including processing circuitry configured for generating a calculation matrix for a system, generating a plurality of models based on the calculation matrix, performing a benchmarking or convolution analysis of the plurality of models, identifying a design envelope based on the benchmarking or convolution analysis, deriving uncertainty models from the benchmarking or convolution analysis, deriving an assessment judgment based on the uncertainty models and acceptance criteria, defining one or more limiting scenarios based on the design envelope, and determining a safety margin in at least one figure-of-merit for the system based on the design envelope and the acceptance criteria.

Martin, Robert P.↗

Apparatus and method for safety analysis evaluation with data-driven workflow

An apparatus and method for system safety analysis evaluation is provided, the apparatus including processing circuitry configured for generating a calculation matrix for a system, generating a plurality of models based on the calculation matrix, performing a benchmarking or convolution analysis of the plurality of models, identifying a design envelope based on the benchmarking or convolution analysis, deriving uncertainty models from the benchmarking or convolution analysis, deriving an assessment judgment based on the uncertainty models and acceptance criteria, defining one or more limiting scenarios based on the design envelope, and determining a safety margin in at least one figure-of-merit for the system based on the design envelope and the acceptance criteria.

Martin, Robert P.↗

Mathematical Reconstruction of Land Carbon Models From Their Numerical Output: Computing Soil Radiocarbon From C Dynamics

Radiocarbon ( 14 C) is a powerful tracer of the global carbon cycle that is commonly used to assess carbon cycling rates in various Earth system reservoirs and as a benchmark to assess model performance. Therefore, it has been recommended that Earth System Models (ESMs) participating in the Coupled Model Intercomparison Project Phase 6 report predicted radiocarbon values for relevant carbon pools. However, a detailed representation of radiocarbon dynamics may be an impractical burden on model developers. Here, we present an alternative approach to compute radiocarbon values from the numerical output of an ESM that does not explicitly represent these dynamics. The approach requires computed 12 C stocks and fluxes among all carbon pools for a particular simulation of the model. From this output, a time-dependent linear compartmental system is computed with its respective state-transition matrix. Using transient atmospheric 14 C values as inputs, the state-transition matrix is then applied to compute radiocarbon values for each pool, the average value for the entire system, and component fluxes. We demonstrate the approach with ELMv1-ECA, the land component of an ESM model that explicitly represents 12 C, and 14 C in 7 soil pools and 10 vertical layers. Results from our proposed method are highly accurate (relative error <0.01%) compared with the ELMv1-ECA 12 C and 14 C predictions, demonstrating the potential to use this approach in CMIP6 and other model simulations that do not explicitly represent 14 C.

54 ENVIRONMENTAL SCIENCES↗

The Role of Nuclear Data Sensitivities in Prompt α-Eigenvalue Predictions of Delayed Critical Benchmarks

Alpha (α) eigenvalues, which describe the logarithmic time derivative of the neutron population in a multiplying system, are integral to time-dependent behavior and diagnostic applications. However, uncertainties in the evaluated nuclear data can significantly impact the accuracy of transport simulations for such quantities. This work explores the use of machine learning models to predict two key outputs, α-eigenvalues and keff bias, using input features derived from α-eigenvalue sensitivities to nuclear data. The criticality safety benchmark models used in this study come from the International Handbook of Evaluated Criticality Safety Benchmark Experiments. Three models, random forest, XGBoost, and NGBoost, are trained on both energy-resolved and energy-summed α sensitivities. For the α-eigenvalue bias prediction, NGBoost achieved the highest R 2 (0.9476) using energy-resolved features, while XGBoost performed best using summed sensitivities. In contrast, when predicting the keff bias, all the models showed moderate predictive capability (best R 2 ≈ 0.72), as the mapping from the static α-sensitivities to the static keff bias was less direct. SHAP (SHapley Additive exPlanations) analysis was used to interpret the model predictions. Across both prediction tasks, the features associated with neutron capture [H-1 (n, γ)], uranium scattering reactions (such as 235 U elastic/inelastic), and actinide capture/fission reactions (such as 239 Pu and 234 U) were consistently identified as the most impactful. This highlights the key role of specific nuclear reactions and energy ranges in shaping both time-dependent and steady-state criticality behavior. These results demonstrated that α-sensitivities, despite being computed for time-dependent metrics, can provide valuable insights for predicting both α-eigenvalues and the keff bias. Moreover, machine learning models offer a promising pathway for uncovering important nuclear data dependencies and guiding future data evaluation efforts.

Nuclear data↗

Forest aboveground biomass estimation through integration of sentinel-2 and PALSAR-2 time series: assessing models trained on GEDI and field inventory benchmarks

Accurate and spatially explicit forest Aboveground Biomass (AGB) mapping through remote sensing is critical for quantifying terrestrial carbon stocks and informing effective forest management strategies. However, AGB estimation in dense forests with complex terrain remains challenging due to satellite sensor signal saturation problem (saturation issue occurs in high biomass forests), structural complexity, and limited ground truth for calibration. This study presents a novel framework that integrates multi-temporal Sentinel-2 optical imagery, ALOS PALSAR-2 Synthetic Aperture Radar (SAR) data, and topographic variables with explainable Machine Learning to map AGB across mountainous forests within subtropical and temperate oceanic climate zones of Mexico. We evaluate the effects of temporal granularity and sensor synergy by comparing multiple temporal inputs and sensor configurations (Sentinel-2, PALSAR-2, and their fusion), and assess model performance using two reference datasets: NASA GEDI LiDAR-derived biomass and Mexico’s National Forest and Soil Inventory (INFyS). Our results showed that models trained on INFyS consistently outperformed those trained on GEDI, highlighting limitations in GEDI’s reliability in biomass estimates within this study region. Furthermore, the integration of Sentinel-2 and PALSAR-2 provided improved predictions compared to single-sensor models, particularly when combined with temporally explicit yearly statistics. The best-performing model, which was trained on INFyS data, and considered both Sentinel-2 and PALSAR-2 yearly statistics, as well as topographic variables, achieved an R2 of 0.64, RMSE of 51.10 Mg/ha, and relative RMSE (rRMSE) of 58.69%. Explainable ML analysis identified Sentinel-2 spectral indices and topographic features as key predictors, while PALSAR-2 metrics provided complementary information, partially mitigating saturation effects in high-biomass areas. Specifically, integrating both sensors substantially improved AGB estimation in high biomass forest (≥200 Mg/ha), yielding 98% gains over optical-only model, with resulting estimates exceeding GEDI L4B by 29% and ESA-CCI-BIOMASS by 174%. Terrain-stratified analysis indicated close agreement with GEDI in low-slope areas, with increasing divergence as slope steepness increased, while estimates remained consistently higher than ESA-CCI-BIOMASS across all slope classes. The proposed approach advances multi-sensor fusion and temporal feature engineering for AGB mapping using open-access satellite datasets, providing a scalable and reproducible framework for annual biomass monitoring in topographically complex mountainous forests. The resulting 25 m resolution biomass product has the potential to provide spatially detailed information for forest monitoring and may support applications in carbon accounting and forest management.

54 ENVIRONMENTAL SCIENCES↗

Spatiotemporal forecasting of the edge localized modes in tokamak plasmas using neural networks

Artificial intelligence techniques have been increasingly adopted by the plasma and fusion science to address problems like plasma reconstruction, surrogate modeling, and tokamak/stellarator optimization. A key focus in sustained fusion research is the prediction and mitigation of edge-localized-modes (ELMs), instabilities that occur in short, periodic bursts and can cause erosion to the tokamak vessel wall. Recent research has demonstrated the power of neural networks in approximating continuous functions. In this work, we build spatiotemporal forecasting models that can predict the onset of ELMs and their evolution at early stages. We leverage recent advances in generative modeling, sequence-to-sequence modeling, and Fourier neural operators to propose architectures and training strategies that can learn to forecast short to long term dynamics of the noisy signals due to ELMs. We benchmark the developed model against a state-of-the-art foundation model using the beam emission spectroscopy (BES) data that captures the plasma fluctuations due to ELMs over a 8 x 8 spatial grid. Our models demonstrate high accuracy, outperforming the baselines, in predicting the evolution of BES signals during ELM events. Furthermore, the developed models exhibit high accuracy in predicting the rapid rise and relaxation of the signals due to ELMs within 30–80 µs.

edge localized modes↗

Investigation of Benchmark $k$ eff Sensitivity and Uncertainty for 239 Pu fission in Specific Energy Ranges

Nuclear data at intermediate energies (from 1 to 100s of keV) are evaluated based on scarce differential data and theory unable to capture physics’ expected structure. There is also a lack of integral data. This is a known deficiency and is challenging to address. Calculated effective multiplication factor, k eff , values for intermediate energy experiments are ~25× further from experiment than for fast energies and are often well outside the experimental uncertainties. The goal of the PARADIGM (PARallel Approach of Differential and InteGral Measurements) project is to significantly re duce the uncertainties of intermediate energy nuclear data for 239 Pu. To this end, PARADIGM simultaneously optimizes experiments at both the Los Alamos Neutron Science Center (LANSCE) and National Criticality Experiments Research Center (NCERC). The combined set of data will inform new intermediate-energy nuclear data. By execution of differential and integral experiments, establishment of new theory, and undertaking nuclear data evaluation in parallel, the timeline to deliver improved nuclear data to users will be reduced significantly that is to three years. For the PARADIGM project, it was decided to optimize an integral experiment for two neutron energy ranges, within the full intermediate energy range. The low energy range goes from 1 to 30 keV, while the higher energy range goes from 30 to 600 keV. This work focuses on nuclear data sensitivities and uncertainties for 239 Pu fission for existing experiments in the International Criticality Safety Benchmark Evaluation Project (ICSBEP). When designing new experiments, it is important to understand what benchmarks currently exist. For a more traditional experiment design (in which a specific application model(s) exists), comparisons would be made between the application model(s) and existing benchmarks. For PARADIGM, there is no specific application model, but instead the specific nuclear data reaction and energy ranges of interest can be explored for existing benchmarks.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Quantifying the structural uncertainty of the aerosol mixing state representation in a modal model

Abstract. Aerosol mixing state is an important emergent property that affects aerosol radiative forcing and aerosol–cloud interactions, but it has not been easy to constrain this property globally. This study aims to verify the global distribution of aerosol mixing state represented by modal models. To quantify the aerosol mixing state, we used the aerosol mixing state indices for submicron aerosol based on the mixing of optically absorbing and non-absorbing species (χo), the mixing of primary carbonaceous and non-primary carbonaceous species (χc), and the mixing of hygroscopic and non-hygroscopic species (χh). To achieve a spatiotemporal comparison, we calculated the mixing state indices using output from the Community Earth System Model with the four-mode version of the Modal Aerosol Module (MAM4) and compared the results with the mixing state indices from a benchmark machine-learned model trained on high-detail particle-resolved simulations from the particle-resolved stochastic aerosol model PartMC-MOSAIC. The two methods yielded very different spatial patterns of the mixing state indices. In some regions, the yearly averaged χ value computed by the MAM4 model differed by up to 70 percentage points from the benchmark values. These errors tended to be zonally structured, with the MAM4 model predicting a more internally mixed aerosol at low latitudes and a more externally mixed aerosol at high latitudes compared to the benchmark. Our study quantifies potential model bias in simulating mixing state in different regions and provides insights into potential improvements to model process representation for a more realistic simulation of aerosols towards better quantification of radiative forcing and aerosol–cloud interactions.

54 ENVIRONMENTAL SCIENCES↗