Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Coupled Data Assimilation for Integrated Earth System Analysis and Prediction: Goals, Challenges, and Recommendations

The purpose of this report is to identify fundamental issues for coupled data assimilation (CDA), such as gaps in science and limitations in forecasting systems, in order to provide guidance to the World Meteorological Organization (WMO) on how to facilitate more rapid progress internationally. Coupled Earth system modeling provides the opportunity to extend skillful atmospheric forecasts beyond the traditional two-week barrier by extracting skill from low-frequency state components such as the land, ocean, and sea ice. More generally, coupled models are needed to support seamless prediction systems that span timescales from weather, subseasonal to seasonal (S2S), multiyear, and decadal. Therefore, initialization methods are needed for coupled Earth system models, either applied to each individual component (called Weakly Coupled Data Assimilation - WCDA) or applied the coupled Earth system model as a whole (called Strongly Coupled Data Assimilation - SCDA). Using CDA, in which model forecasts and potentially the state estimation are performed jointly, each model domain benefits from observations in other domains either directly using error covariance information known at the time of the analysis (SCDA), or indirectly through flux interactions at the model boundaries (WCDA). Because the non-atmospheric domains are generally under-observed compared to the atmosphere, CDA provides a significant advantage over single-domain analyses. Next, we provide a synopsis of goals, challenges, and recommendations to advance CDA: Goals: (a) Extend predictive skill beyond the current capability of NWP (e.g. as demonstrated by improving forecast skill scores), (b) produce physically consistent initial conditions for coupled numerical prediction systems and reanalyses (including consistent fluxes at the domain interfaces), (c) make best use of existing observations by allowing observations from each domain to influence and improve the full earth system analysis, (d) develop a robust observation-based identification and understanding of mechanisms that determine the variability of weather and climate, (e) identify critical weaknesses in coupled models and the earth observing system, (f) generate full-field estimates of unobserved or sparsely observed variables, (g) improve the estimation of the external forcings causing changes to climate, (h) transition successes from idealized CDA experiments to real-world applications. Challenges: (a) Modeling at the interfaces between interacting components of coupled Earth system models may be inadequate for estimating uncertainty or error covariances between domains, (b) current data assimilation methods may be insufficient to simultaneously analyze domains containing multiple spatiotemporal scales of interest, (c) there is no standardization of observation data or their delivery systems across domains, (d) the size and complexity of many large-scale coupled Earth system models makes it is difficult to accurately represent uncertainty due to model parameters and coupling parameters, (e) model errors lead to local biases that can transfer between the different Earth system components and lead to coupled model biases and long-term model drift, (e) information propagation across model components with different spatiotemporal scales is extremely complicated, and must be improved in current coupled modeling frameworks, (h) there is insufficient knowledge on how to represent evolving errors in non-atmospheric model components (e.g. as sea ice, land and ocean) on the timescales of NWP.

CDA↗

Distortion Representation of Forecast Errors for Model Skill Assessment and Objective Analysis

We completed the formulation of the smoothness penalty functional this past quarter. We used a simplified procedure for estimating the statistics of the FCA solution spectral coefficients from the results of the unconstrained, low-truncation FCA (stopping criterion) solutions. During the current reporting period we have completed the calculation of GEOS-2 model-equivalent brightness temperatures for the 6.7 micron and 11 micron window channels used in the GOES imagery for all 10 cases from August 1999. These were simulated using the AER-developed Optimal Spectral Sampling (OSS) model.

Hoffman, Ross N.↗

GEOS-5 Seasonal Forecast System: ENSO Prediction Skill and Bias

The GEOS-5 AOGCM known as S2S-1.0 has been in service from June 2012 through January 2018 (Borovikov et al. 2017). The atmospheric component of S2S-1.0 is Fortuna-2.5, the same that was used for the Modern-Era Retrospective Analysis for Research and Applications (MERRA), but with adjusted parameterization of moist processes and turbulence. The ocean component is the Modular Ocean Model version 4 (MOM4). The sea ice component is the Community Ice CodE, version 4 (CICE). The land surface model is a catchment-based hydrological model coupled to the multi-layer snow model. The AGCM uses a Cartesian grid with a 1 deg × 1.25 deg horizontal resolution and 72 hybrid vertical levels with the upper most level at 0.01 hPa. OGCM nominal resolution of the tripolar grid is 1/2 deg, with a meridional equatorial refinement to 1/4 deg. In the coupled model initialization, selected atmospheric variables are constrained with MERRA. The Goddard Earth Observing System integrated Ocean Data Assimilation System (GEOS-iODAS) is used for both ocean state and sea ice initialization. SST, T and S profiles and sea ice concentration were assimilated.

GEOS-↗

Dynamical Forecasts of Tropical Terrestrial Carbon Fluxes with the NASA S2S Retrospective Forecast System

Recent advances in the ability to predict climate anomalies at sub-seasonal to seasonal (S2S) timescales allow us to explore the possibility of forecasting carbon flux anomalies. Although carbon flux forecasting is a relatively new concept, it is potentially beneficial as it can help us better understand global and regional land-atmosphere carbon feedbacks associated with climate variations and can provide guidance for future field mission design. Here we evaluate the skill of forecasted terrestrial carbon anomalies generated from meteorological anomalies produced with the NASA Global Modeling and Assimilation Office (GMAO) S2S forecast system. We focus here on three representative time periods (the most recent 2015-2016 El Nino, 2011 La Nina, and 2014 as a neutral year), with each corresponding 9-month forecast comprising four ensemble members initialized in the preceding December. The meteorological variables produced by the GMAO forecast system were bias-corrected using a climatology derived from the Modern Era Retrospective analysis for Research and Applications, version 2 (MERRA-2) before being used to drive a suite of offline simulations with the NASA Catchment-CN terrestrial biosphere model, a model that computes water-energy-carbon dynamics. Forecasts are evaluated by comparing against satellite-driven estimates of gross primary production (GPP) and inverse model estimates of net carbon flux that incorporate satellite carbon dioxide measurements. We find that the restrospectively predicted carbon fluxes in the tropics reasonably reproduce the signs and magnitudes of the observed anomalies between the 2015-2016 El Nino and the 2011 La Nina for both net flux and GPP. For instance, for the El Nino period, the magnitude of the forecasted negative GPP anomaly in the South American tropics (which undergoes anomalously warm and dry conditions) agrees with the observed GPP anomaly at leads of up to three or four months. Overall, this study demonstrates potential skill in the forecast of biospheric carbon fluxes a few months in advance, a capability that could contribute to attribution studies focusing on carbon flux variations and support innovative observation strategies in the future.

Lee, Eunjee↗

Persistence and predictability in a perfect model

A realistic two-level GCM is used to examine the relationship between predictability and persistence. Predictability is measured by the average divergence of ensembles of solutions starting from perturbed initial conditions, and persistence is defined in terms of the autocorrelation function based on a single long-term model integration. The average skill of the dynamical forecasts is compared with the skill of simple persistence-based statistical forecasts. For initial errors comparable in magnitude to present-day analysis errors, the statistical forecast loses all skill after about one week, reflecting the lifetime of the lowest frequency fluctuations in the model. Large ensemble mean dynamical forecasts would be expected to remain skillful for about 3 wk. The disparity between the skill of the statistical and dynamical forecasts is greater for the higher frequency modes, which have little memory beyond 1 d, yet remain predictable for about 2 wk. The results are analyzed in terms of two characteristic time scales.

Schubert, Siegfried D.↗

Skill of Mesoscale Models in Forecasting Springtime Macrophysical Cloud Properties at the Savannah River Site in the Southeastern US

Predicting boundary layer clouds is important for the accurate modeling of pollutant dispersion. Higher resolution mesoscale models would be expected to produce better forecasts of cloud properties that affect dispersion. Using ceilometer observations, we assess the skill of two operational mesoscale models (RAMS and WRF) to forecast cloud base altitude and cloud fraction at the Savannah River Site in the southeastern US during the springtime. Verifications were performed at small spatial and temporal scales necessary for dispersion modeling. Both models were unreliable with a 50% (RAMS) and a 46% (WRF) rate of predicting clouds observed by the ceilometer which led to low cloud fraction predictions. Results indicated that WRF better predicted daytime cloud bases from convection that occurred frequently later in the period and RAMS better predicted nighttime cloud bases. Using root mean squared error (RMSE) to score the forecast periods also highlighted this diurnal dichotomy, with WRF scores better during the day and RAMS scores better at night. Analysis of forecast errors revealed divergent model cloud base biases—WRF low and RAMS high. A hybrid solution which weighs more heavily the RAMS nighttime forecasts and WRF daytime forecasts will likely provide the best prediction of cloud properties for dispersion.

54 ENVIRONMENTAL SCIENCES↗

Boreal Winter Predictions with the GEOS-2 GCM: The Role of Boundary Forcing and Initial Conditions

Ensembles of atmospheric General Circulation Model (GCM) seasonal forecasts and long-term simulations (1980-94) are analyzed to assess the controlling influences of boundary forcing and memory of the initial conditions. Both the forecasts and simulations are carried out with version 2 of the Goddard Earth Observing System (GEOS-2) GCM forced with observed sea surface temperatures (SSTs). While much of the focus is on the seasonal time scale (January- March) and the Pacific North American (PNA) region, we also present results for other regions, shorter time scales, and other known modes of variability in the northern hemisphere extratropics. Forecasts of indices of some of the key large-scale modes of variability show that there is considerable variability in skill between different regions of the Northern Hemisphere. The eastern North Atlantic region has the poorest long lead forecast skill showing no skill beyond about 10 days. Skillful seasonal forecasts are primarily confined to the wave-like ENSO response emanating from the tropical Pacific. In the Northern Hemisphere, this is associated with the well-known Pacific/North American (PNA) pattern. Memory of the initial conditions is the major factor leading to skillful extratropical forecasts of lead time less than one month, while SST forcing is the only factor at the seasonal time scale. SST forcing contributes to skillful forecasts at sub- seasonal time scales only over the PNA region. The GEOS-2 GCM produces average (1980-94) signal to noise ratios which are less than one everywhere in the extratropics, except for the subtropical Pacific where they approach 1.5. When confined to the ENSO years, the maximum signal to noise ratios occur in the PNA region where they exceed three. An assessment of the sampling distribution of the forecasts suggests the model's ENSO response is very likely too weak. These results show some sensitivity to the uncertainties in the estimates of the SST forcing fields. In the North Pacific region, the sensitivity to SST forcing manifests itself primarily as changes in the variability of the PNA response, underscoring the need for an ensemble approach to the seasonal prediction problem.

Chang, Yehui↗

Skillful multiyear predictions of ocean acidification in the California Current System

The California Current System (CCS) sustains economically valuable fisheries and is particularly vulnerable to ocean acidification, due to its natural upwelling of carbon-enriched waters that generate corrosive conditions for local ecosystems. Here we use a novel suite of retrospective, initialized ensemble forecasts with an Earth system model (ESM) to predict the evolution of surface pH anomalies in the CCS. We show that the forecast system skillfully predicts observed surface pH variations a year in advance over a naive forecasting method, with the potential for skillful prediction up to five years in advance. Skillful predictions of surface pH are mainly derived from the initialization of dissolved inorganic carbon anomalies that are subsequently transported into the CCS. Our results demonstrate the potential for ESMs to provide skillful predictions of ocean acidification on large scales in the CCS. Initialized ESMs could also provide boundary conditions to improve high-resolution regional forecasting systems.

54 ENVIRONMENTAL SCIENCES↗

The Use of Red Green Blue Air Mass Imagery to Investigate the Role of Stratospheric Air in a Non-convective Wind Event

Non-convective wind events commonly occur with passing extratropical cyclones and have significant societal and economic impacts. Since non-convective winds often occur in the absence of specific phenomena such as a thunderstorm, tornado, or hurricane, the public are less likely to heed high wind warnings and continue daily activities. Thus non-convective wind events result in as many fatalities as straight line thunderstorm winds. One physical explanation for non-convective winds includes tropopause folds. Improved model representation of stratospheric air and associated non-convective wind events could improve non-convective wind forecasts and associated warnings. In recent years, satellite data assimilation has improved skill in forecasting extratropical cyclones; however errors still remain in forecasting the position and strength of extratropical cyclones as well as the tropopause folding process. The goal of this study is to determine the impact of assimilating satellite temperature and moisture retrieved profiles from hyperspectral infrared (IR) sounders (i.e. Atmospheric Infrared Sounder (AIRS), Cross-track Infrared and Microwave Sounding Suite (CrIMSS), and Infrared Atmospheric Sounding Interferometer (IASI)) on the model representation of the tropopause fold and an associated high wind event that impacted the Northeast United States on 09 February 2013. Model simulations using the Advanced Research Weather Research and Forecasting Model (ARW) were conducted on a 12-km grid with cycled data assimilation mimicking the operational North American Model (NAM). The results from the satellite assimilation run are compared to a control experiment (without hyperspectral IR retrievals), Modern Era-Retrospective Analysis for Research and Applications (MERRA) reanalysis, and Rapid Refresh analyses.

Berndt, E. B.↗

The Impact of the Assimilation of Hyperspectral Infrared Retrieved Profiles on Advanced Weather and Research Model Simulations of a Non-Convective Wind Event

Non-convective wind events commonly occur with passing extratropical cyclones and have significant societal and economic impacts. Since non-convective winds often occur in the absence of specific phenomena such as a thunderstorm, tornado, or hurricane, the public are less likely to heed high wind warnings and continue daily activities. Thus non-convective wind events result in as many fatalities as straight line thunderstorm winds. One physical explanation for non-convective winds includes tropopause folds. Improved model representation of stratospheric air and associated non-convective wind events could improve non-convective wind forecasts and associated warnings. In recent years, satellite data assimilation has improved skill in forecasting extratropical cyclones; however errors still remain in forecasting the position and strength of extratropical cyclones as well as the tropopause folding process. The goal of this study is to determine the impact of assimilating satellite temperature and moisture retrieved profiles from hyperspectral infrared (IR) sounders (i.e. Atmospheric Infrared Sounder (AIRS), Cross-track Infrared and Microwave Sounding Suite (CrIMSS), and Infrared Atmospheric Sounding Interferometer (IASI)) on the model representation of the tropopause fold and an associated high wind event that impacted the Northeast United States on 09 February 2013. Model simulations using the Advanced Research Weather Research and Forecasting Model (ARW) were conducted on a 12-km grid with cycled data assimilation mimicking the operational North American Model (NAM). The results from the satellite assimilation run are compared to a control experiment (without hyperspectral IR retrievals), Modern Era-Retrospective Analysis for Research and Applications (MERRA) reanalysis, and Rapid Refresh analyses.

Berndt, Emily↗

Impact of the Assimilation of Hyperspectral Infrared Profiles on Advanced Weather and Research Model Simulations of a Non-Convective Wind Event

Non-convective wind events commonly occur with passing extratropical cyclones and have significant societal and economic impacts. Since non-convective winds often occur in the absence of specific phenomena such as a thunderstorm, tornado, or hurricane, the public are less likely to heed high wind warnings and continue daily activities. Thus non-convective wind events result in as many fatalities as straight line thunderstorm winds. One physical explanation for non-convective winds includes tropopause folds. Improved model representation of stratospheric air and associated non-convective wind events could improve non-convective wind forecasts and associated warnings. In recent years, satellite data assimilation has improved skill in forecasting extratropical cyclones; however errors still remain in forecasting the position and strength of extratropical cyclones as well as the tropopause folding process. The goal of this study is to determine the impact of assimilating satellite temperature and moisture retrieved profiles from hyperspectral infrared (IR) sounders (i.e. Atmospheric Infrared Sounder (AIRS), Cross-track Infrared and Microwave Sounding Suite (CrIMSS), and Infrared Atmospheric Sounding Interferometer (IASI)) on the model representation of the tropopause fold and an associated high wind event that impacted the Northeast United States on 09 February 2013. Model simulations using the Advanced Research Weather Research and Forecasting Model (ARW) were conducted on a 12-km grid with cycled data assimilation mimicking the operational North American Model (NAM). The results from the satellite assimilation run are compared to a control experiment (without hyperspectral IR retrievals), North American Regional Reanalysis (NARR) reanalysis, and Rapid Refresh analyses.

Berndt, Emily B.↗

Impact of the Assimilation of Hyperspectral Infrared Retrieved Profiles on Advanced Weather and Research Model Simulations of a Non-Convective Wind Event

Non-convective wind events commonly occur with passing extratropical cyclones and have significant societal and economic impacts. Since non-convective winds often occur in the absence of specific phenomena such as a thunderstorm, tornado, or hurricane, the public are less likely to heed high wind warnings and continue daily activities. Thus non-convective wind events result in as many fatalities as straight line thunderstorm winds. One physical explanation for non-convective winds includes tropopause folds. Improved model representation of stratospheric air and associated non-convective wind events could improve non-convective wind forecasts and associated warnings. In recent years, satellite data assimilation has improved skill in forecasting extratropical cyclones; however errors still remain in forecasting the position and strength of extratropical cyclones as well as the tropopause folding process. The goal of this study is to determine the impact of assimilating satellite temperature and moisture retrieved profiles from hyperspectral infrared (IR) sounders (i.e. Atmospheric Infrared Sounder (AIRS), Cross-track Infrared and Microwave Sounding Suite (CrIMSS), and Infrared Atmospheric Sounding Interferometer (IASI)) on the model representation of the tropopause fold and an associated high wind event that impacted the Northeast United States on 09 February 2013. Model simulations using the Advanced Research Weather Research and Forecasting Model (ARW) were conducted on a 12-km grid with cycled data assimilation mimicking the operational North American Model (NAM). The results from the satellite assimilation run are compared to a control experiment (without hyperspectral IR retrievals), Modern Era-Retrospective Analysis for Research and Applications (MERRA) reanalysis, and Rapid Refresh analyses.

Berndt, E. B.↗

Impact of the Assimilation of Hyperspectral Infrared Retrieved Profiles on Advanced Weather and Research Model Simulations of a Non-Convective Wind Event

Non-convective wind events commonly occur with passing extratropical cyclones and have significant societal and economic impacts. Since non-convective winds often occur in the absence of specific phenomena such as a thunderstorm, tornado, or hurricane, the public are less likely to heed high wind warnings and continue daily activities. Thus non-convective wind events result in as many fatalities as straight line thunderstorm winds. One physical explanation for non-convective winds includes tropopause folds. Improved model representation of stratospheric air and associated non-convective wind events could improve non-convective wind forecasts and associated warnings. In recent years, satellite data assimilation has improved skill in forecasting extratropical cyclones; however errors still remain in forecasting the position and strength of extratropical cyclones as well as the tropopause folding process. The goal of this study is to determine the impact of assimilating satellite temperature and moisture retrieved profiles from hyperspectral infrared (IR) sounders (i.e. Atmospheric Infrared Sounder (AIRS), Cross-track Infrared and Microwave Sounding Suite (CrIMSS), and Infrared Atmospheric Sounding Interferometer (IASI)) on the model representation of the tropopause fold and an associated high wind event that impacted the Northeast United States on 09 February 2013. Model simulations using the Advanced Research Weather Research and Forecasting Model (ARW) were conducted on a 12-km grid with cycled data assimilation mimicking the operational North American Model (NAM). The results from the satellite assimilation run are compared to a control experiment (without hyperspectral IR retrievals), 32-km North American Regional Reanalysis (NARR) interpolated to a 12-km grid, and 13-km Rapid Refresh analyses.

Berndt, E. B.↗

Drought Prediction for Socio-Cultural Stability Project

The primary objective of this project is to answer the question: "Can existing, linked infrastructures be used to predict the onset of drought months in advance?" Based on our work, the answer to this question is "yes" with the qualifiers that skill depends on both lead-time and location, and especially with the associated teleconnections (e.g., ENSO, Indian Ocean Dipole) active in a given region season. As part of this work, we successfully developed a prototype drought early warning system based on existing/mature NASA Earth science components including the Goddard Earth Observing System Data Assimilation System Version 5 (GEOS-5) forecasting model, the Land Information System (LIS) land data assimilation software framework, the Catchment Land Surface Model (CLSM), remotely sensed terrestrial water storage from the Gravity Recovery and Climate Experiment (GRACE) and remotely sensed soil moisture products from the Aqua/Advanced Microwave Scanning Radiometer - EOS (AMSR-E). We focused on a single drought year - 2011 - during which major agricultural droughts occurred with devastating impacts in the Texas-Mexico region of North America (TEXMEX) and the Horn of Africa (HOA). Our results demonstrate that GEOS-5 precipitation forecasts show skill globally at 1-month lead, and can show up to 3 months skill regionally in the TEXMEX and HOA areas. Our results also demonstrate that the CLSM soil moisture percentiles are a goof indicator of drought, as compared to the North American Drought Monitor of TEXMEX and a combination of Famine Early Warning Systems Network (FEWS NET) data and Moderate Resolution Imaging Spectrometer (MODIS)'s Normalizing Difference Vegetation Index (NDVI) anomalies over HOA. The data assimilation experiments produced mixed results. GRACE terrestrial water storage (TWS) assimilation was found to significantly improve soil moisture and evapotransportation, as well as drought monitoring via soil moisture percentiles, while AMSR-E soil moisture assimilation produced marginal benefits. We carried out 1-3 month lead-time forecast experiments using GEOS-5 forecasts as input to LIS/CLSM. Based on these forecast experiments, we find that the expected skill in GEOS-5 forecasts from 1-3 months is present in the soil moisture percentiles used to indicate drought. In the case of the HOA drought, the failure of the long rains in April appears in the February 1, March 1 and April 1 initialized forecasts, suggesting that for this case, drought forecasting would have provided some advance warning about the drought conditions observed in 2011. Three key recommendations for follow-up work include: (1) carry out a comprehensive analysis of droughts observed over the entire period of record for GEOS-5 forecasts; (2) continue to analyze the GEOS-5 forecasts in HOA stratifying by anomalies in long and short rains; and (3) continue to include GRACE TWS, Soil Moisture/Ocean Salinity (SMOS) and the upcoming NASA Soil Moisture Active/Passive (SMAP) soil moisture products in a routine activity building on this prototype to further quantify the benefits for drought assessment and prediction.

Peters-Lidard, Christa↗

Contribution of Soil Moisture Information to Streamflow Prediction in the Snowmelt Season: A Continental-Scale Analysis

In areas dominated by winter snowcover, the prediction of streamflow during the snowmelt season may benefit from three pieces of information: (i) the accurate prediction of weather variability (precipitation, etc.) leading up to and during the snowmelt season, (ii) estimates of the amount of snow present during the winter season, and (iii) estimates of the amount of soil moisture underlying the snowpack during the winter season. The importance of accurate meteorological predictions and wintertime snow estimates is obvious. The contribution of soil moisture to streamflow prediction is more subtle yet potentially very important. If the soil is dry below the snowpack, a significant fraction of the snowmelt may be lost to streamflow and potential reservoir storage, since it may infiltrate the soil instead for later evaporation. Such evaporative losses are presumably smaller if the soil below the snowpack is wet. In this paper, we use a state-of-the-art land surface model to quantify the contribution of wintertime snow and soil moisture information -- both together and separately -- to skill in forecasting springtime streamflow. We find that soil moisture information indeed contributes significantly to streamflow prediction skill.

Reichle, Rolf↗

Seasonal Forecasting of the Quasi-Biennial Oscillation

The ability to seasonally forecast the Quasi-Biennial Oscillation (QBO) was examined using NASA S2S (Sub-seasonal to Seasonal), 9-month, retrospective forecasts. Validation of these forecasts showed that the S2S retrospective QBO forecasts improved skill in predicting the QBO amplitude and phase over a simple QBO phase propagation model at forecast lead times of 1 to 3 months. Results from an initial assessment of whether more accurate QBO forecasts can improve Northern Hemisphere winter sea level pressure forecasts showed no significant forecast improvement at a 1-month lead time, indicating the need for improved stratosphere-troposphere QBO coupling metrics and pathway identification. Overall, these results suggest that future improvements in representing the QBO in global models can increase the ensemble fraction of valid 1 to 3 month QBO forecasts and potentially extend useful QBO forecasts beyond 3 months.

Coy, Lawrence↗

Impacts of NASA's Earth Observations on Subseasonal and Seasonal Forecasts

NASA's suite of Earth-observing satellites provides a unique view of many processes on Earth, with relevance on timescales ranging from hours to weeks and even years. NASA's observations span all parts of the Earth system: atmospheric, ocean, land and cryosphere, and include physical, chemical and biological components. This presentation explores use of NASA observations in extended-range prediction, from many days to months, using the Goddard Earth Observing System (GEOS) assimilation and predictive modeling capabilities. The skill of a weather forecast is linked to the fidelity of the initialization process (data assimilation) and the realistic representation of "fast" physical processes in the model. At longer time horizons, the slower "feedback" processes in the Earth System begin to take a more prominent role in the accuracy of the forecast. Simultaneously, forecast-skill attribution transitions away from feature-based metrics that emphasize smaller scales (e.g., representations of fronts and vortices) to metrics that emphasize the statistical distributions of large-scale features (e.g., ENSO diagnostics and teleconnections). This presentation will summarize studies performed using the GEOS-S2S (subseasonal to seasonal) system that explore the impacts of NASA observations on the fidelity of the forecasts. The GEOS-S2S system is configured for the atmosphere-ocean-land-ice model and is initialized using in-situ and space-based observations, including atmospheric aerosols and ozone which are not typically analyzed in such systems. The GEOS-S2S model routinely includes aerosol feedbacks, which systematically impact the realism of the forecasts, providing a first example of how suitable NASA observations impact the performance of the GEOS-S2S system. Studies in which a stratospheric chemistry module is activated in the GEOS-S2S system allow the impacts of ozone radiative feedbacks to be isolated. Space-based observations of sea-surface temperature and altimetry are routinely analyzed for the initialization of the GEOS-S2S system; recent advances allow the use of NASA's sea-surface salinity data, which are shown to impact the long-range skill of the forecasts.

Pawson, Steven↗

Analyzing and Exploring Training Recipes for Large-Scale Transformer-Based Weather Prediction

Abstract The rapid rise of deep learning (DL) in numerical weather prediction (NWP) has led to a proliferation of models which forecast atmospheric variables with comparable or superior skill than traditional physics-based NWP. However, among these leading DL models, there is a wide variance in both the training settings and architecture used. Further, the lack of thorough ablation studies makes it hard to discern which components are most critical to success. In this work, we show that it is possible to attain high forecast skill even with relatively off-the-shelf architectures, simple training procedures, and moderate compute budgets. Specifically, we train a minimally modified Swin Transformer V2 (SwinV2) on ERA5 data and find that it attains superior skill in terms of mean-square errors of deterministic forecasts when compared against the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS). Almost all DL–NWP systems share a core set of hyperparameters and design decisions. To aid and expedite future DL–NWP research, we present an in-depth, systematic exploration of different loss functions, model sizes and depths, patch sizes, and multistep training objectives. We also examine the model performance with metrics beyond the typical accuracy (ACC) and RMSE and investigate how the performance scales with model size. Through our open-source code, scoring pipelines, and models, we share our findings on key aspects of the training pipeline. These ablations reduce the necessity for expensive hyperparameter tuning and lower the barrier to entry for future DL–NWP research. Significance Statement This study investigates the potential of using large-scale transformer-based models for weather prediction, showing that it is possible to achieve high forecast accuracy with simpler, off-the-shelf architectures. By training a minimally modified SwinV2 transformer on ERA5 data, we show that the model achieves competitive forecast skill in terms of mean-square error for key variables, outperforming the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS) at all lead times. Our findings suggest that effective training strategies, such as multistep fine-tuning and channel-weighted losses, significantly enhance the model’s performance. However, we also highlight that these improvements come with trade-offs in other areas, such as ensemble spread and high-frequency spatial detail. This work highlights the promise of deep learning in improving weather forecasts, which could lead to better preparedness and response to weather events, ultimately benefiting society by providing more reliable weather predictions.

Willard, Jared D. [Lawrence Berkeley National Labo↗