Results for “model forecasting” — Page 22

DOE OSTI2025

Analyzing and Exploring Training Recipes for Large-Scale Transformer-Based Weather Prediction

Abstract The rapid rise of deep learning (DL) in numerical weather prediction (NWP) has led to a proliferation of models which forecast atmospheric variables with comparable or superior skill than traditional physics-based NWP. However, among these leading DL models, there is a wide variance in both the training settings and architecture used. Further, the lack of thorough ablation studies makes it hard to discern which components are most critical to success. In this work, we show that it is possible to attain high forecast skill even with relatively off-the-shelf architectures, simple training procedures, and moderate compute budgets. Specifically, we train a minimally modified Swin Transformer V2 (SwinV2) on ERA5 data and find that it attains superior skill in terms of mean-square errors of deterministic forecasts when compared against the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS). Almost all DL–NWP systems share a core set of hyperparameters and design decisions. To aid and expedite future DL–NWP research, we present an in-depth, systematic exploration of different loss functions, model sizes and depths, patch sizes, and multistep training objectives. We also examine the model performance with metrics beyond the typical accuracy (ACC) and RMSE and investigate how the performance scales with model size. Through our open-source code, scoring pipelines, and models, we share our findings on key aspects of the training pipeline. These ablations reduce the necessity for expensive hyperparameter tuning and lower the barrier to entry for future DL–NWP research. Significance Statement This study investigates the potential of using large-scale transformer-based models for weather prediction, showing that it is possible to achieve high forecast accuracy with simpler, off-the-shelf architectures. By training a minimally modified SwinV2 transformer on ERA5 data, we show that the model achieves competitive forecast skill in terms of mean-square error for key variables, outperforming the European Centre for Medium-Range Weather Forecasts’ Integrated Forecasting System (IFS) at all lead times. Our findings suggest that effective training strategies, such as multistep fine-tuning and channel-weighted losses, significantly enhance the model’s performance. However, we also highlight that these improvements come with trade-offs in other areas, such as ensemble spread and high-frequency spatial detail. This work highlights the promise of deep learning in improving weather forecasts, which could lead to better preparedness and response to weather events, ultimately benefiting society by providing more reliable weather predictions.

Willard, Jared D. [Lawrence Berkeley National Labo↗

DOE OSTI2022

Effect of data assimilation in the Polar WRF with 3DVAR on the prediction of radiation, heat flux, cloud, and near surface atmospheric variables over Svalbard

Although the Polar Weather Research and Forecasting (PWRF) model has been developed for polar environments, simulations of atmospheric states in the polar region still have large uncertainties. Therefore, the effects of data assimilation (DA) to improve forecasts in the polar region were investigated for September 2017 using PWRF and the three-dimensional variational (3DVAR) DA method. The experiments without DA and those with DA assimilating only conventional observations and both conventional observations and satellite radiance data were performed. The forecasts from all experiments both without and with DA underestimated (overestimated) the downward longwave (shortwave) radiation flux due to the underestimation of the amount of Arctic clouds. When satellite radiance data (i.e., the Advanced Microwave Sounding Unit-A (AMSU-A) and Microwave Humidity Sounder (MHS)) were assimilated in addition to conventional observations in the PWRF, the distribution and amount of water vapor became closer to observations, which improves cloud liquid water forecasts. Therefore, when both conventional observations and radiance data were assimilated, the 25–30 h forecast errors of the downward longwave and shortwave radiation fluxes and sensible and latent heat fluxes decreased by 12.7%, 8.1%, 3.2%, and 7.8% with the WSM5 scheme and by 17.1%, 4.7%, 2.5%, and 3.1% with the 2-moment Morrison scheme, respectively, compared to those in the experiments without DA. The forecast errors of the 10 m wind and 2 m temperature with DA were smaller than those without DA at most observation stations. Therefore, the uncertainties of the Arctic forecasts in the PWRF decreased when using DA. To further improve Arctic forecasts, the assimilation of various additional satellite data is necessary.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Model: Year-Long Reforecast, Extended Forecast, Coldstart type ICBC, Domain 01

The primary purpose of WFIP2 Model Development Team is to improve existing numerical weather prediction models in a manner that leads to improved wind forecasts in regions of complex terrain. Improvements in the models will come through better understanding of the physics associated with the wind flow in and around the wind plant across a range of temporal and spatial scales, which will be gained through WFIP2’s observational field study and analysis.

17 WIND ENERGY↗

DOE OSTI2023

Model: Year-Long Reforecast, Extended Forecast, Coldstart type ICBC, Domain 02

The primary purpose of WFIP2 Model Development Team is to improve existing numerical weather prediction models in a manner that leads to improved wind forecasts in regions of complex terrain. Improvements in the models will come through better understanding of the physics associated with the wind flow in and around the wind plant across a range of temporal and spatial scales, which will be gained through WFIP2’s observational field study and analysis.

17 WIND ENERGY↗

DOE OSTI2022

A Machine‐Learning‐Assisted Stochastic Cloud Population Model as a Parameterization of Cumulus Convection

Abstract A machine‐learning‐assisted stochastic cloud population model is coupled with the Advanced Research Weather Research and Forecasting (WRF) model to represent fluctuations in the cloud‐base mass flux associated with the life cycles and interactions among cumulus convection cells. In this cloud population model, the size distribution and the associated cloud‐base mass flux of the convective cells are related to their previous state and to the change in the total convective area via a transition function. The convective area tendency in turn is assumed to depend on the cloud‐base mass flux that is resolved by the host WRF model. The transition function is represented by a single hidden‐layer neural network trained by the evolution of convective cell size distributions in a 1‐km grid‐spacing WRF simulation run over the Australian Monsoon region. At every grid point of the host model, the cloud population model predicts the cell size and cloud‐base mass flux distributions from which a random sample of cells is fed to an entraining parcel model that calculates precipitation as well as the associated liquid water potential temperature and total moisture tendencies. These tendencies are averaged over the cells and provided to the host model. Several regional simulations are performed over tropical and midlatitude domains to test this as a potential approach to scale‐aware parameterization. It is shown that such an approach could be a new promising path to simulating realistic precipitation statistics and propagation of precipitation associated with the Madden‐Julian Oscillation while maintaining realistic depictions of the diurnal cycle over both land and ocean.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2026

FFTSF: Revisiting Sub-Seasonal Streamflow Forecasting with Simple Feedforward Network

Accurate short-to-subseasonal streamflow forecasts are vital for water management, including flood preparedness, drought mitigation, hydropower scheduling, and ecosystem protection. However, extending a forecast beyond a few days remains challenging due to complexity of hydrological processes. While recent self-attention based transformer architectures such as iTransformer have gained traction in time-series forecasting, these models suffer from several critical limitations: (1) significant computational overhead that scales quadratically with sequence length, (2) vulnerability to overfitting on limited hydrological datasets, (3) degraded performance on long-horizon forecasts due to attention decay, and (4) excessive architectural complexity that hampers interpretability and operational deployment. In this study, we propose a simple Feedforward Time Series Forecasting (FFTSF) network that directly addresses these limitations through its lightweight architecture and long-range forecasting capabilities. We evaluate FFTSF across 178 USGS stream gauges spanning diverse climate regimes by forecasting lead times of 1-, 7-, 14-, and 30-days. Our results demonstrate that FFTSF achieves competitive performance at short lead times (NSE of 0.778 for 1-day forecasts) while substantially outperforming complex baselines at longer forecast period, achieving the highest NSE (0.271) at 30-day forecasts with greater robustness and stability. For 30-day forecasts, FFTSF achieves a 71% improvement over NLinear, 57% improvement over DLinear and 12% improvement over the computationally intensive iTransformer while requiring fewer computational resources. Our findings reveal that architectural complexity is not necessary for hydrological forecasting, demonstrating that well-designed simple models can outperform attention mechanisms for subseasonal streamflow forecasting. The computational efficiency and consistent long-range performance of FFTSF make it suitable for water management applications where reliable extended forecasts are essential.

Krishnan Kutty Ambika, Anukesh [ORNL] (ORCID:00000↗

DOE OSTI2020

A Robust Segmented Mixed Effect Regression Model for Baseline Electricity Consumption Forecasting

Renewable energy production has been surging around the world in recent years. To mitigate the increasing uncertainty and intermittency of the renewable generation, proactive demand response algorithms and programs are proposed and developed to further improve the utilization of load flexibility and increase the efficiency of power system operation. One of the biggest challenges to efficient control and operation of demand response resources is how to forecast the baseline electricity consumption and estimate the load impact from demand response resources accurately. In this paper, we propose a mixed effect segmented regression model and a new robust estimate for forecasting the baseline electricity consumption in Southern California, USA, by combining the ideas of random effect regression model, segmented regression model, and the least trimmed squares estimate. Since the log-likelihood of the considered model is not differentiable at breakpoints, we propose a new backfitting algorithm to estimate the unknown parameters. The estimation performance of the new estimation procedure has been demonstrated with both simulation studies and the real data application for the electric load baseline forecasting in Southern California.

42 ENGINEERING↗

DOE OSTI2025

Urban weather modeling using WRF: linking physical assumptions, code implementation, and observational needs

The Weather Research and Forecasting (WRF) model includes urban schemes that simulate the influence of urban surfaces on the atmosphere using parameterizations for flux, and radiative exchanges. Three core schemes – the Bulk urban parameterization, Single-Layer Urban Canopy Model (SLUCM), and Multi-Layer Urban Canopy Model (MLUCM) – represent increasing levels of complexity. Although the parameterizations within these urban schemes are described in the literature, their specific implementation remains poorly documented, thus slowing down model development efforts. This manuscript provides a roadmap to the three urban schemes in WRF version 4.5.2, presenting equations using the same symbols as in the model code, along with references to code lines, and including graphics and explanations that connect the code to its physical foundations. Our thorough review of the urban parameterizations implemented in WRF version 4.5.2 highlighted a handful of parameters that may introduce discontinuities in simulations: (i) in the SLUCM, a 1 mm h −1 rain rate threshold is employed to switch between two minimum moisture availability parameterizations, thus impacting latent heat flux calculations; (ii) in the SLUCM a threshold is used to partition shortwave radiation into direct and diffuse components; (iii) in all three urban schemes, the bulk Richardson number is employed to select the similarity function, which influences the vertical distribution of heat and momentum. We also identified a highly simplified treatment of the radiative balance on roof surfaces. The implications of these simplifications can be assessed through targeted observations across relevant conditions, including varying precipitation rates, cloud cover, and transitions between stability regimes. Furthermore, the widespread application of the Monin-Obukhov similarity theory in these urban schemes warrants model evaluation under highly stable and unstable conditions and in heterogeneous urban settings with variable land cover and building heights on scales finer than model resolution. To address these challenges, we offer guidance on observational strategies, emphasizing the need for multi-parametric measurements to capture potential compensating biases and multi-height measurements that align with the levels where quantities are diagnostic and prognosed in the model (i.e., the lowest atmospheric level of the WRF model). Finally, our inspection of the code revealed implementation bugs that have now been corrected in WRF versions 4.6.0 and 4.6.1. Sensitivity tests over the Atlanta urban area show that these corrections affect surface temperatures, underscoring the importance of performing rigorous documentation and verification of the implementation of parameterizations in model code.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2022

Calibration of cloud and aerosol related parameters for solar irradiance forecasts in WRF-solar

Model parameters are a major source of uncertainty in numerical weather prediction. Recently, the Weather Research and Forecasting model with Solar extensions (WRF-Solar) has been upgraded by enhancing the treatment of sub-grid scale cloud and aerosols with augmentations of a sub-grid scale cloud scheme (CLD3) and an upgraded aerosol-aware Thompson-Eidhammer scheme (TE14). However, the value of model parameters associated with these parameterizations are assigned based on limited measurements or theoretical calculations. Calibrating the most sensitive parameters has the potential to improve solar irradiance predictions. Here, we adopted a multiobjective surrogate-based optimization (SBO) framework to calibrate nine parameters used in CLD3 and TE14 that lead to the largest sensitivity in simulated irradiance. The normalized mean-absolute-error (NMAE) of global horizontal irradiance (GHI) and direct normal irradiance (DNI) are minimized by calibrating WRF-Solar over two regions including the Southern Great Plains (SGP) and Central California, in order to focus on parameter calibration under cloudy conditions with different aerosol loading. The results show that generalized linear model (GLM)-based surrogate models approximate physical models well, particularly when the third order and three-way interaction terms are considered. The SBO framework efficiently searches the parameter space for optimal solutions with less computational costs than directly calibrating the physical model. We first calibrate CLD3 parameters over the less-polluted SGP region. Optimized CLD3 parameters alone result in NMAE reduction by 14% for the site-mean and up to 33% for individual cases over the SGP region. With further calibration of TE14 parameters over the Central California during active fire periods, the optimized parameters lead to over 20% reductions of NMAE. Our investigation reveals, however, that optimizing TE14 has a limited impact on irradiance simulations under less-polluted conditions in the SGP.

14 SOLAR ENERGY↗

DOE OSTI2022

Model: 10-Day Retrospective, HRRR, Config 01, Forecast Domain 01

The primary purpose of WFIP2 Model Development Team is to improve existing numerical weather prediction models in a manner that leads to improved wind forecasts in regions of complex terrain. Improvements in the models will come through better understanding of the physics associated with the wind flow in and around the wind plant across a range of temporal and spatial scales, which will be gained through WFIP2’s observational field study and analysis.

17 WIND ENERGY↗

DOE OSTI2022

Model: 10-Day Retrospective, HRRR, Config 01, Forecast Domain 02

The primary purpose of WFIP2 Model Development Team is to improve existing numerical weather prediction models in a manner that leads to improved wind forecasts in regions of complex terrain. Improvements in the models will come through better understanding of the physics associated with the wind flow in and around the wind plant across a range of temporal and spatial scales, which will be gained through WFIP2’s observational field study and analysis.

17 WIND ENERGY↗

DOE OSTI2022

Model: 10-Day Retrospective, RAP, Config 02, Forecast Domain 01

The primary purpose of WFIP2 Model Development Team is to improve existing numerical weather prediction models in a manner that leads to improved wind forecasts in regions of complex terrain. Improvements in the models will come through better understanding of the physics associated with the wind flow in and around the wind plant across a range of temporal and spatial scales, which will be gained through WFIP2’s observational field study and analysis.

17 WIND ENERGY↗

DOE OSTI2022

Model: 10-Day Retrospective, HRRR, Config 02, Forecast Domain 01

The primary purpose of WFIP2 Model Development Team is to improve existing numerical weather prediction models in a manner that leads to improved wind forecasts in regions of complex terrain. Improvements in the models will come through better understanding of the physics associated with the wind flow in and around the wind plant across a range of temporal and spatial scales, which will be gained through WFIP2’s observational field study and analysis.

17 WIND ENERGY↗

DOE OSTI2022

Model: 10-Day Retrospective, HRRR, Config 02, Forecast Domain 02

The primary purpose of WFIP2 Model Development Team is to improve existing numerical weather prediction models in a manner that leads to improved wind forecasts in regions of complex terrain. Improvements in the models will come through better understanding of the physics associated with the wind flow in and around the wind plant across a range of temporal and spatial scales, which will be gained through WFIP2’s observational field study and analysis.

17 WIND ENERGY↗

DOE OSTI2022

Model: 10-Day Retrospective, RAP, Config 01, Forecast Domain 01

The primary purpose of WFIP2 Model Development Team is to improve existing numerical weather prediction models in a manner that leads to improved wind forecasts in regions of complex terrain. Improvements in the models will come through better understanding of the physics associated with the wind flow in and around the wind plant across a range of temporal and spatial scales, which will be gained through WFIP2’s observational field study and analysis.

17 WIND ENERGY↗

DOE OSTI2022

Coupling localized Noah-MP-Crop model with the WRF model improved dynamic crop growth simulation across Northeast China

Croplands play a critical role in regulating the energy and moisture exchanges between the land surface and atmosphere. However, the interactions between cropland and climate are usually poorly represented due to a lack of detailed representation in crop types and field management. Here, we coupled the Noah-MP-Crop model with the state-of-the-art Weather Research and Forecasting (WRF) model to explore and evaluate the crop growth dynamics in response to climate variations across Northeast China. The default parameters of the crop model were not exactly suitable for the agricultural ecosystems in Northeast China. The detailed cropland distribution, and crop phenology parameters including growing degree days (GDD) and planting (harvesting) date were first created using multi-source remote sensing products and reanalysis data, and was then successfully used to simulate the growth and yield for corn and soybean and associated energy exchanges. We also optimized and calibrated other crop parameters using the time-series of the Moderate Resolution Imaging Spectroradiometer (MODIS) land surface products. The modified crop model substantially improved the simulation of crop growth, plant physiology, and biomass accumulation for both corn and soybean. Coupling the localized dynamic crop model into the WRF led to considerable decreases in the simulated mean-absolute-errors (MAEs) and biases of the leaf area index, evapotranspiration, and gross primary production compared with the MODIS observed values. Compared with the statistical yield from each province, the modified crop model underestimated the corn yield from 11.1% to 48.6%, whereas overestimated the soybean yield from 16.5% to 162.6%.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Vertical Structure and Ice Production Processes of Shallow Convective Postfrontal Clouds over the Southern Ocean in MARCUS. Part II: Modeling Study

Abstract Part I of this series presented a detailed overview of postfrontal mixed-phase clouds observed during the Measurements of Aerosols, Radiation, and Clouds over the Southern Ocean (MARCUS) field campaign. In Part II, we focus on a multiday (23–26 February 2018) case with the aim of understanding ice production as well as model sensitivity to ice process parameterizations using the Weather Research and Forecasting (WRF) Model. The control simulation with the Predicted Particle Properties (P3) microphysics scheme underestimates the ice content and overestimates the supercooled liquid water content, contrary to the bias common in global climate models. The simulations targeted at ice production processes show negligible sensitivity to cloud droplet number concentrations. Further, neither increasing ice nuclei particle (INP) concentrations to an unrealistic level nor adjusting it to MARCUS field estimations alone guarantees more ice production in the model. However, the simulated clouds are found to be highly sensitive to the implementation of immersion freezing, the thresholding of condensation/deposition freezing initiation, and the rime splintering process. By increasing immersion freezing of cloud droplets, relaxing thresholds for condensation/deposition freezing, or removing rime splintering thresholds, the model significantly improves its performance in producing ice. The relaxation of the immersion freezing temperature threshold to the observed cloud-top temperature suggests an in-cloud seeder–feeder mechanism. The results of this work call for an increase in observations of INP, especially over the remote Southern Ocean and at relatively high temperatures, and measurements of ice particle size distributions to better constrain ice nucleating processes in models.

Meteorology & Atmospheric Sciences↗

DOE OSTI2025

An Alternative Ensemble Streamflow Prediction Approach Using Improved Subseasonal Precipitation Forecasts from the North America Multi-Model Ensemble Phase II

In this article, streamflow forecasting at a subseasonal time scale (10–30 days into the future) is important for various human activities. The ensemble streamflow prediction (ESP) is a widely applied technique for subseasonal streamflow forecasting. However, ESP’s reliance on the randomly resampled historical precipitation limits its predictive capability. Available dynamical subseasonal precipitation forecasts provide an alternative to the randomly resampled precipitation in ESP. Prior studies found the predictive performance of raw subseasonal precipitation forecast is limited in many regions such as the central south of the United States, which raises questions about its effectiveness in assisting streamflow forecasting. To further assess the hydrologic applicability of dynamical subseasonal precipitation forecasts, we test the subseasonal precipitation forecast from North America Multi-Model Ensemble Phase II (NMME-2) at four watersheds in the central south region of the United States. The subseasonal precipitation forecasts are postprocessed with bias correction and spatial disaggregation (BCSD) to correct bias and improve spatial resolution before replacing the randomly resampled precipitation in ESP for streamflow predictions. The performance of the resulting streamflow predictions is benchmarked with ESP. Evaluation is conducted using Kling–Gupta Efficiency (KGE), continuous ranked probability score (CRPS), probability of detection (POD), false alarm ratios (FARs), as well as reliability diagrams. Our results suggest that BCSD-corrected subseasonal precipitation forecasts lead to overall improved streamflow predictions due to added skills in winter and spring. Our results also suggest that BCSD-corrected subseasonal precipitation forecasts lead to improved predictions on the occurrence of high-percentile streamflow values above 75%. Overall, BCSD-corrected subseasonal precipitation has shown promising performance, highlighting its potential broader applications for river and flood forecasting.

54 ENVIRONMENTAL SCIENCES↗