SEARCH · Search NASA

Results for “ensemble modeling system”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

All sources NASA NTRS DOE OSTI

DOE OSTI2025

Projected changes in African easterly wave activity due to climate change

African easterly waves significantly influence regional hydroclimate, making it crucial to understand how global warming will impact their activity. Here, we investigate future changes in wave activity and assess the underlying mechanisms using an ensemble of Earth system models. We find a robust increase in wave activity over the Sahel–Sahara region by the end of the 21st century under two emission scenarios. This intensification is linked to increased baroclinicity associated with a strengthening of the meridional temperature gradient between the Guinea Coast and the Sahara. Our results also indicate that low-level warming enhances the waves by reinforcing monsoon flow, leading to increased convergence and vertical motion along the intertropical discontinuity. These energetic alterations significantly modify the conditions that currently produce these waves. Overall, our findings suggest that changes in wave activity could impact the transport of Saharan dust and mesoscale convective activity over the Sahel.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2025

BEAST

The Bilinear Ensemble Actuation Synthesis Toolkit (BEAST) is a computational platform that optimizes time-varying control signals to achieve a specified transfer of states governed by bilinear ensemble systems in which model parameters are subject to uncertainty.

Zlotnik, anatoly↗

DOE OSTI2024

Evaluating Ensemble Predictions of South Asian Monsoon Low Pressure System Genesis

Abstract Synoptic-scale vortices known as monsoon low pressure systems (LPSs) frequently produce intense precipitation and hydrological disasters in South Asia, so accurately forecasting LPS genesis is crucial for improving disaster preparedness and response. However, the accuracy of LPS genesis forecasts by numerical weather prediction models has remained unknown. Here, we evaluate the performance of two global ensemble models—the U.S. Global Ensemble Forecast System (GEFS) and the Ensemble Prediction System of the European Centre for Medium-Range Weather Forecasts (ECMWF)—in predicting LPS genesis during the years 2021–22. The GEFS successfully predicted about half the observed LPS genesis events 1–2 days in advance; the ECMWF model captured an additional 10% of observed genesis events. Both models had a false alarm ratio (FAR) of around 50% for 1–2-day lead times. In both ensembles, the control run typically exhibited a higher probability of detection (POD) of observed events and a lower FAR compared to the perturbed ensemble members. However, a consensus forecast, in which genesis is predicted when at least 20% of ensemble members forecast LPS formation, had POD values surpassing those of the control run for all lead times. Moreover, probabilistic predictions of genesis over the Bay of Bengal, where most LPSs form, were skillful, with the fraction of ensemble members predicting LPS formation over a 5-day lead time approximating the observed frequency of genesis, without any adjustment or bias correction.

Suhas, D. L.↗

DOE OSTI2026

Decadal Spiciness Variability in the Subtropical-Tropical Pacific in the CESM2 Large Ensemble

Tropical Pacific decadal variations impact weather and climate around the world and are also connected to variations in the global warming trend. The mechanisms driving these long-term modulations, particularly the role of subsurface ocean dynamics, are still debated. Here, we investigate the dynamics of spiciness (density-compensated temperature and salinity) anomalies in the tropical and subtropical Pacific, which are hypothesized as a possible driving mechanism of decadal climate variability. Based on the analysis of 100 realizations from the Community Earth System Model Version 2 Large Ensemble (CESM2-LE), we demonstrate a coupling between the subtropics and the equatorial Pacific by propagating spiciness anomalies at decadal time scales. The CESM2-LE simulates spiciness variability along a subduction path from the subtropics to the equator with frequency spectra that show the highest power at low frequencies and a power decay proportional to a −4 slope for frequencies greater than 0.01 cycles per months, corresponding to periods smaller than ∼8.5 years. Signals that originate in the Southern Hemisphere (SH) dominate and arrive with a larger magnitude at the equator compared to spiciness anomalies from the Northern Hemisphere (NH). Spiciness anomalies from the SH have shorter propagation times and are strengthened along their pathway as stochastic wind stress curl forcing generates anomalous baroclinic ocean pressure gradients. These pressure gradients generate spiciness anomalies via anomalous advection across climatological spiciness gradients in the SH. We conclude that the observed spiciness variance at decadal time scales is consistent with a forcing by stochastic wind variations that are low-pass filtered by ocean dynamics.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Uncertainty-informed selection of CMIP6 Earth System Model subsets for use in multisectoral and impact models

Earth system models (ESMs) and general circulation models (GCMs) are heavily used to provide inputs to sectoral impact and multisector dynamic models, which include representations of energy, water, land, economics, and their interactions. Therefore, representing the full range of model uncertainty, scenario uncertainty, and interannual variability that ensembles of these models capture is critical to the exploration of the future co-evolution of the integrated human–Earth system. The pre-eminent source of these ensembles has been the Coupled Model Intercomparison Project (CMIP). With more modeling centers participating in each new CMIP phase, the size of the model archive is rapidly increasing, which can be intractable for impact modelers to effectively utilize due to computational constraints and the challenges of analyzing large datasets. In this work, we present a method to select a subset of the latest phase, CMIP6, featuring models for use as inputs to a sectoral impact or multisector dynamics models, while prioritizing preservation of the range of model uncertainty, scenario uncertainty, and interannual variability in the full CMIP6 ensemble results. This method is intended to help impact modelers select climate information from the CMIP archive efficiently for use in downstream models that require global coverage of climate information. This is particularly critical for large-ensemble experiments of multisector dynamic models that may be varying additional features beyond climate inputs in a factorial design, thus putting constraints on the number of climate simulations that can be used. We focus on temperature and precipitation outputs of CMIP6 models, as these are two of the most used variables among impact models, and many other key input variables for impacts are at least correlated with one or both of temperature and precipitation (e.g., relative humidity). Besides preserving the multi-model ensemble variance characteristics, we prioritize selecting CMIP6 models in the subset that preserve the very likely distribution of equilibrium climate sensitivity values as assessed by the latest Intergovernmental Panel on Climate Change (IPCC) report. This approach could be applied to other output variables of climate models and, possibly when combined with emulators, offers a flexible framework for designing more efficient experiments on human-relevant climate impacts. It can also provide greater insight into the properties of existing CMIP6 models.

Snyder, Abigail C.↗

DOE OSTI2025

Evaluating an Earth system model from a water manager perspective

Abstract. The large spatial scale of global Earth system models (ESMs) is often cited as an obstacle to using the output by water resource managers in localized decisions. Recent advances in computing have improved the fidelity of hydrological responses in ESMs through increased connectivity between model components. However, the models are seldom evaluated for their ability to reproduce metrics that are important for and resonate with practitioners or that allow practitioners to situate higher-resolution model outputs within a cascade of uncertainty stemming from different models and scenarios. We draw on the combined experience of the author team and water manager workshop participants to identify salient water management metrics and evaluate whether they are credibly reproduced over the conterminous USA by the Community Earth System Model v2 (CESM2) Large Ensemble. We find that, while the exact values may not match the observations, aspects such as interannual variability can be reproduced by CESM2 for the mean wet day precipitation and length of dry spells. CESM2 also captures the proportion of total annual precipitation that derives from the heaviest rain days in watersheds that are not snow-dominated. Aggregating the 7 d mean daily runoff to two-digit Hydrological Unit Code (HUC2) watersheds also shows that rain-dominated regions capture the timing and interannual variability of annual maximum and minimum flows. We conclude that there is potential for far greater use of large-ensemble ESMs, such as CESM2, in long-range water management decisions to supplement high-resolution regional projections.

Tye, Mari R. (ORCID:0000000324911020)↗

DOE OSTI2025

A Greening Future Elevates Flash Drought Risk in Northern Mid‐to‐High Latitudes

Flash droughts have become a growing concern, as they can emerge rapidly and increase the risk of crop failure. Although past studies have investigated the meteorological drivers and future changes of flash drought, why flash drought is more frequent over humid and vegetated regions remains underexplored. This study delves further into the mechanism by which vegetation regulates flash drought and its future change using observations from multiple data sets and large ensemble simulations from three Earth system models. On an interannual timescale, both observations and simulations show robust increases in flash drought frequency and a higher flash-to-sub-seasonal drought ratio during spring or antecedent conditions with dense vegetation, supporting the important role of vegetation in flash drought occurrence, especially in the northern mid-to-high latitudes. In the latter regions, the large ensemble simulations show robust increases in flash drought (e.g., 67% and 46% increases in Eastern U.S. and North Asia in 2050–2100 relative to 1950–2000 under the high emission scenario), where the growing season is lengthening. Although greening might suggest reduced drought stress, it drives precipitation-soil moisture-evapotranspiration decoupling by increasing evapotranspiration partitioning to transpiration. As transpiration can access deep soil water through the plant root system, its increased portion can weaken the constraints of concurrent precipitation on evapotranspiration, thus accelerating soil moisture depletion under high evaporative demand, driving a slow-to-rapid drought transition. How vegetation regulates flash drought by regulating surface moisture budget is supported by observations and simulations. Although warming supports early planting, agriculture may increasingly be threatened by surging flash drought risk.

Drought↗

DOE OSTI2025

A multi model ensemble reveals net climate benefits from regenerative practices in US Midwest croplands

Process-based cropping systems models (CSMs) are key components of measurement, monitoring, reporting, and verification frameworks of carbon markets, but model-specific differences limit their applicability across diverse pedo-climatic conditions and agronomic practices. Multi-model ensemble (MME) provides an opportunity to better estimate changes in soil organic carbon (SOC) and nitrous oxide (N 2 O) emissions from agronomic practices at scale. We used an MME across 46 million hectares of US Midwest cropland at a resolution of 4-km 2 to assess the aggregate ability of different regenerative practices to sequester SOC and N 2 O emissions compared to their counterfactual dynamic baselines. MME was validated against long-term trials and compared to its constituent CSMs, showing greater accuracy and lower uncertainty. The results show that adopting no-till combined with cover crops increased SOC stocks by 0.36 ± 0.12 Mg ha -1 yr -1 , corresponding to a net regional SOC gain of 16.4 Tg C yr -1 compared to business-as-usual baselines. These benefits are halved when each management is practiced individually, and the SOC gains are only fully realized with low initial carbon stock. By including N 2 O emissions, we can assess the overall climate mitigation potential, specifically, the extent to which carbon sequestration can offset direct N 2 O emissions. The magnitude of this potential varies depending on management practices and geographic location with net climate benefits on average ranging from 0 to 3 Mg CO 2 -eq ha -1 yr -1 . High-resolution MME results allow for robust estimates of climate mitigation, reducing barriers to carbon market participation and supporting regenerative agriculture initiatives at scale.

carbon credits↗

DOE OSTI2024

Earth's record-high greenness and its attributions in 2020

Terrestrial vegetation is a crucial component of Earth's biosphere, regulating global carbon and water cycles and contributing to human welfare. Despite an overall greening trend, terrestrial vegetation exhibits a significant inter-annual variability. The mechanisms driving this variability, particularly those related to climatic and anthropogenic factors, remain poorly understood, which hampers our ability to project the long-term sustainability of ecosystem services. Here, in this work, by leveraging diverse remote sensing measurements, we pinpointed 2020 as a historic landmark, registering as the greenest year in modern satellite records from 2001 to 2020. Using ensemble machine learning and Earth system models, we found this exceptional greening primarily stemmed from consistent growth in boreal and temperate vegetation, attributed to rising CO 2 levels, climate warming, and reforestation efforts, alongside a transient tropical green-up linked to the enhanced rainfall. Contrary to expectations, the COVID-19 pandemic lockdowns had a limited impact on this global greening anomaly. Our findings highlight the resilience and dynamic nature of global vegetation in response to diverse climatic and anthropogenic influences, offering valuable insights for optimizing ecosystem management and informing climate mitigation strategies.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Land Processes Can Substantially Impact the Mean Climate State

Terrestrial processes influence the atmosphere by controlling land-to-atmosphere fluxes of energy, water, and carbon. Prior research has demonstrated that parameter uncertainty drives uncertainty in land surface fluxes. However, the influence of land process uncertainty on the climate system remains underexplored. Here, we quantify how assumptions about land processes impact climate using a perturbed parameter ensemble for 18 land parameters in the Community Earth System Model version 2 under preindustrial conditions. We find that an observationally-informed range of land parameters generate biogeophysical feedbacks that significantly influence the mean climate state, largely by modifying evapotranspiration. Global mean land surface temperature ranges by 2.2°C across our ensemble (σ = 0.5°C) and precipitation changes were significant and spatially variable. Our analysis demonstrates that the impacts of land parameter uncertainty on surface fluxes propagate to the entire Earth system, and provides insights into where and how land process uncertainty influences climate.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Tropical Interbasin Interaction as Effective Predictors of Late-Spring Precipitation Variability in the Southern Great Plains

Abstract The southern Great Plains experience fluctuating precipitation extremes that significantly impact agriculture and water management. Despite ongoing efforts to enhance forecast accuracy, the underlying causes of these climatic phenomena remain inadequately understood. This study elucidates the relative influence of the tropical Pacific and Atlantic basins on April–May–June precipitation variability in this region. Our partial ocean assimilation experiments using the Community Earth System Model unveil the prominent role of interbasin interaction, with the Pacific and Atlantic contributing approximately 70% and 30%, respectively, to these interbasin contrasts. Our statistical analyses suggest that these tropical interbasin contrasts could serve as a more reliable indicator for late-spring precipitation anomalies than El Niño–Southern Oscillation. The conclusions are reinforced by analyses of seven climate forecasting systems within the North American Multi-Model Ensemble, offering an optimistic outlook for enhancing real-time forecasting of late-spring precipitation in the southern plains. However, the current predictive skills of the interbasin contrasts across the prediction systems are hindered by the lower predictability of the tropical Atlantic Ocean, pointing to the need for future research to refine climate prediction models further. Significance Statement Agriculture and infrastructure in the southern plains face challenges from severe late-spring precipitation extremes. Traditional predictors like El Niño–Southern Oscillation (ENSO) lose effectiveness during the critical spring-to-summer transition, creating a forecasting gap. This study introduces the concept of tropical interbasin interactions, known to enhance seasonal predictability for late-spring precipitation in the southern plains. Novel climate model experiments highlight contributions from the tropical Pacific and Atlantic, offering a promising predictability that potentially surpasses the limitations of ENSO-based predictions. These outcomes hold the potential for developing operational forecasts of late-spring precipitation anomalies in the southern plains, enabling proactive risk management.

Chikamoto, Yoshimitsu↗

DOE OSTI2025

Bayesian Optimized Deep Ensemble for Uncertainty Quantification of Deep Neural Networks: a System Safety Case Study on Sodium Fast Reactor Thermal Stratification Modeling

Deep neural networks (DNNs) are increasingly important to scientific computing and engineering system simulations. Accurate uncertainty quantification (UQ) for DNNs is critical in safety-sensitive engineering domains. Traditional Deep Ensemble (DE) methods, while easy to implement, frequently suffer from poorly calibrated uncertainty estimates and limited predictive accuracy due to reliance on fixed architectures with varied weight initializations. To address these issues, we introduce a workflow that combines Bayesian Optimization (BO) and DE. The workflow is modular, scalable, and integrates parallel BO initialized with Sobol sequences to individually optimize the hyperparameters of each ensemble member. This method enhances ensemble diversity, improves predictive accuracy, and provides reliable uncertainty estimates. We evaluate the proposed BODE approach in a sodium fast reactor thermal stratification modeling case study, where we used a densely connected convolutional neural network to predict turbulent viscosity during the reactor transient with consideration of data noise. We benchmark its performance against several optimization approaches, including baseline deep ensemble, evolutionary algorithm-optimized ensemble, ensemble formed via random search combined with greedy selection, and a BO ensemble using random initialization. Here, our results demonstrate superior performance of the developed BODE approach. In noise-free scenarios, BODE notably reduces incorrect aleatoric uncertainty and significantly enhances predictive accuracy. Under conditions of 5% and 10% Gaussian noise, BODE adaptively quantifies uncertainty proportional to data noise, achieving up to an 80% reduction in root mean square error compared to baseline methods and producing well-calibrated prediction intervals.

Bayesian optimization↗

DOE OSTI2026

Surface Observations From Atmospheric Radiation Measurement Sites Constrain the Anthropogenic Contribution to Cloud Droplet Number

Uncertainty in anthropogenic forcing driven by aerosol-cloud interactions (aci) limits our ability to infer the sensitivity of the Earth system to forcing from historical records. The driver of aci is the change in cloud droplet number concentration (N d ) due to changes in aerosol serving as cloud condensation nuclei (CCN). Here, we combine a perturbed parameter ensemble run in a global Earth system model with observations of CCN and single-layer-cloud N d at surface sites in the Azores, the Southern Great Plains, and Ascension Island to provide a constraint on the anthropogenic contribution to present-day N d . These observational lines of evidence constrain the preindustrial to present-day change in N d to be between 11 and 43 cm −3 . This is consistent with the upper end of some previous estimates but has a higher minimum perturbation, pointing to a stronger historical aerosol cooling.

ARM↗

DOE OSTI2025

Evaluation of historical precipitation interannual variability in CMIP6 over the United States

Interannual precipitation variability profoundly influences society via its effects on agriculture, water resources, infrastructure, and disaster risks. In this study, we use daily in situ precipitation observations from the global historical climatology network-daily (GHCN-D) to assess the ability of 21 Coupled Model Intercomparison Project Phase 6 (CMIP6) models, including the 50-member fifth-generation Canadian Earth System Model single model initial-condition large ensemble (CanESM5_SMILE), to realistically simulate historical interannual precipitation variability trends within 17 regions of the contiguous United States (CONUS). We assess how accurately the CMIP6 simulations align with observational data across annual, summer, and winter periods, focusing on four key hydrometeorological metrics, including interannual precipitation variability, relative interannual precipitation variability (coefficient of variation), annual mean precipitation, and annual wet day frequency. Our findings reveal that CMIP6 ensemble members generally reproduce the spatial patterns of observed trends in annual mean precipitation. In most regions, models agree well with the signs of observed changes in annual mean precipitation, though discrepancies in trend magnitude are evident. Further, observed trends in winter mean precipitation broadly exhibit a spatial pattern similar to that of the observed annual mean. However, analysis of the CanESM5_SMILE shows that trends in precipitation variability may primarily be the result of model-simulated internal variability, suggesting caution in interpreting multi-model single-realization ensemble results. Challenges in accurately simulating interannual precipitation variability underscore the need for ongoing model refinement and validation to enhance climate projections, especially in regions vulnerable to extreme precipitation events.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Quantum chaos on edge

Recently, the physics of many-body quantum chaotic systems close to their ground states has come under intensified scrutiny. Such studies are motivated by the emergence of model systems exhibiting chaotic fluctuations throughout the entire spectrum [the Sachdev-Ye-Kitaev (SYK) model being a renowned representative] as well as by the physics of holographic principles, which likewise unfold close to ground states. Interpreting the edge of the spectrum as a quantum critical point, here we combine a wide range of analytical and numerical methods to the identification and comprehensive description of two different universality classes: the near edge physics of “sparse” and the near edge of “dense” chaotic systems. The distinction lies in the ratio between the number of a system's random parameters and its Hilbert space dimension, which is exponentially small or algebraically small in the sparse and dense case, respectively. Notable representatives of the two classes are generic chaotic many-body models (sparse) and invariant random matrix ensembles or chaotic gravitational systems (dense). While the two families share identical spectral correlations at energy scales comparable to the level spacing, the density of states and its fluctuations near the edge are different. Considering the SYK model as a representative of the sparse class, we apply a combination of field theory and exact diagonalization to a detailed discussion of its edge spectrum. Conversely, Jackiw-Teitelboim gravity is our reference model for the dense class, where an analysis of the gravitational path integral and random matrix theory reveal universal differences to the sparse class, whose implications for the construction of holographic principles we discuss. Published by the American Physical Society 2024

Altland, Alexander (ORCID:0000000229914805)↗

DOE OSTI2025

Development and evaluation of a new 4DEnVar-based weakly coupled ocean data assimilation system in E3SMv2

The development, implementation, and evaluation of a new weakly coupled ocean data assimilation (WCODA) system for the fully coupled Energy Exascale Earth System Model version 2 (E3SMv2) utilizing the four-dimensional ensemble variational (4DEnVar) method are presented in this study. The 4DEnVar method, based on the dimension-reduced projection four-dimensional variational (DRP-4DVar) approach, replaces the adjoint model with the ensemble technique, thereby reducing computational demands. Monthly mean ocean temperature and salinity data from the EN4.2.1 reanalysis are integrated into the ocean component of E3SMv2 from 1950 to 2021 with the goal of providing realistic initial conditions for decadal predictions and predictability studies. The performance of the WCODA system is assessed using various metrics, including the reduction rate of the cost function, root mean square error (RMSE) differences, correlation differences, and model biases. Results indicate that the WCODA system effectively assimilates the reanalysis data into the climate model, consistently achieving negative reduction rates of the cost function and notable improvements in RMSE and correlation across various ocean layers and regions. Significant enhancements are observed in the upper ocean layers across the majority of global ocean regions, particularly in the north Atlantic, north Pacific, and Indian Ocean. Model biases in sea surface temperature and salinity are also substantially reduced. For sea surface temperature, cold biases in the north Pacific and north Atlantic are diminished by about 1–2 °C, and warm biases in the Southern Ocean are corrected by approximately 1.5–2.5 °C. In terms of salinity, improvements are observed with bias reductions of about 0.5–1 psu in the north Atlantic and north Pacific and up to 1.5 psu in parts of the Southern Ocean. The ultimate goal of the WCODA system is to advance the predictive capabilities of E3SM for subseasonal to decadal climate predictions, thereby supporting research on strategic energy-sector policies and planning.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2024

Revealing the role of redox reaction selectivity and mass transfer in current–voltage predictions for ensembles of photocatalysts

Photocatalysts are conceptually simple reaction units where nanoscale semiconductors integrated with catalysts drive a pair of redox reactions on illumination. However, the proximity of reaction sites performing cathodic and anodic reactions poses dire challenges to realize large light-to-fuel conversion efficiencies. In this study, a powerful, yet straightforward, equivalent-circuit detail-balance modeling framework is developed and applied to evaluate the performance of photocatalytic systems featuring multiple light absorbers. Specifically, low bandgap iridium-doped strontium titanate is modeled as a Z-scheme photocatalyst to achieve desirable hydrogen evolution and iron-based redox shuttle oxidation reactions. Our model has unique capabilities to simulate competing redox reactions and address mass-transfer limitations. In a significant departure from state-of-the-art circuit models, our study develops tools to perform load-line analyses by incorporating a net electrochemical load curve that includes both desired and competing redox reactions. Consequently, reaction selectivity is predicted from equivalent circuit models for photocatalytic and photoelectrochemical systems. Our investigation into ensembles comprised of multiple, semi-transparent light absorbers reveals their potential to outperform a single, optically thick light absorber, particularly when operated under mass-transfer-limited conditions. However, this outcome hinges on minimizing mass-transfer rates of select redox species to prevent undesired reactions of hydrogen oxidation and/or redox shuttle reduction. Our findings demonstrate that reaction selectivity can be achieved by tuning asymmetry in redox species mass-transfer even with perfectly symmetric electrocatalytic charge-transfer coefficients. The influences of various kinetic, mass-transfer, and thermodynamic parameters are explored to offer crucial insights for synthesis of the next-generation of photocatalysts and selective coatings, and reactor designs.

25 ENERGY STORAGE↗

DOE OSTI2025

Huge ensembles – Part 1: Design of ensemble weather forecasts using spherical Fourier neural operators

Abstract. Simulating low-likelihood high-impact extreme weather events in a warming world is a significant and challenging task for current ensemble forecasting systems. While these systems presently use up to 100 members, larger ensembles could enrich the sampling of internal variability. They may capture the long tails associated with climate hazards better than traditional ensemble sizes. Due to computational constraints, it is infeasible to generate huge ensembles (comprised of 1000–10 000 members) with traditional, physics-based numerical models. In this two-part paper, we replace traditional numerical simulations with machine learning (ML) to generate hindcasts of huge ensembles. In Part 1, we construct an ensemble weather forecasting system based on spherical Fourier neural operators (SFNOs), and we discuss important design decisions for constructing such an ensemble. The ensemble represents model uncertainty through perturbed-parameter techniques, and it represents initial condition uncertainty through bred vectors, which sample the fastest-growing modes of the forecast. Using the European Centre for Medium-Range Weather Forecasts Integrated Forecasting System (IFS) as a baseline, we develop an evaluation pipeline composed of mean, spectral, and extreme diagnostics. With large-scale, distributed SFNOs with 1.1 billion learned parameters, we achieve calibrated probabilistic forecasts. As the trajectories of the individual members diverge, the ML ensemble mean spectra degrade with lead time, consistent with physical expectations. However, the individual ensemble members' spectra stay constant with lead time. Therefore, these members simulate realistic weather states during the rollout, and the ML ensemble passes a crucial spectral test in the literature. The IFS and ML ensembles have similar extreme forecast indices, and we show that the ML extreme weather forecasts are reliable and discriminating. These diagnostics ensure that the ensemble can reliably simulate the time evolution of the atmosphere, including low-likelihood high-impact extremes. In Part 2, we generate a huge ensemble initialized each day in summer 2023, and we characterize the simulations of extremes.

Mahesh, Ankur↗