Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Attribution of North American Subseasonal Precipitation Prediction Skill

The skill of NOAA’s official monthly U.S. precipitation forecasts (issued in the middle of the prior month) has historically been low, having shown modest skill over the southern United States, but little or no skill over large portions of the central United States. The goal of this study is to explain the seasonal and regional variations of the North American subseasonal (weeks 3–6) precipitation skill, specifically the reasons for its successes and its limitations. The performances of multiple recent-generation model reforecasts over 1999–2015 in predicting precipitation are compared to uninitialized simulation skill using the atmospheric component of the forecast systems. This parallel analysis permits attribution of precipitation skill to two distinct sources: one due to slowly evolving ocean surface boundary states and the other to faster time-scale initial atmospheric weather states. A strong regionality and seasonality in precipitation forecast performance is shown to be analogous to skill patterns dictated by boundary forcing constraints alone. The correspondence is found to be especially high for the North American pattern of the maximum monthly skill that is achieved in the reforecast. The boundary forcing of most importance originates from tropical Pacific SST influences, especially those related to El Niño–Southern Oscillation. Furthermore, we discuss physical constraints that may limit monthly precipitation skill and interpret the performance of existing models in the context of plausible upper limits.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

The MOSAiC Distributed Network: Observing the coupled Arctic system with multidisciplinary, coordinated platforms

Central Arctic properties and processes are important to the regional and global coupled climate system. The Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) Distributed Network (DN) of autonomous ice-tethered systems aimed to bridge gaps in our understanding of temporal and spatial scales, in particular with respect to the resolution of Earth system models. By characterizing variability around local measurements made at a Central Observatory, the DN covers both the coupled system interactions involving the ocean-ice-atmosphere interfaces as well as three-dimensional processes in the ocean, sea ice, and atmosphere. The more than 200 autonomous instruments (“buoys”) were of varying complexity and set up at different sites mostly within 50 km of the Central Observatory. During an exemplary midwinter month, the DN observations captured the spatial variability of atmospheric processes on sub-monthly time scales, but less so for monthly means. They show significant variability in snow depth and ice thickness, and provide a temporally and spatially resolved characterization of ice motion and deformation, showing coherency at the DN scale but less at smaller spatial scales. Ocean data show the background gradient across the DN as well as spatially dependent time variability due to local mixed layer sub-mesoscale and mesoscale processes, influenced by a variable ice cover. The second case (May–June 2020) illustrates the utility of the DN during the absence of manually obtained data by providing continuity of physical and biological observations during this key transitional period. We show examples of synergies between the extensive MOSAiC remote sensing observations and numerical modeling, such as estimating the skill of ice drift forecasts and evaluating coupled system modeling. The MOSAiC DN has been proven to enable analysis of local to mesoscale processes in the coupled atmosphere-ice-ocean system and has the potential to improve model parameterizations of important, unresolved processes in the future.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

The WRF-Solar Ensemble Prediction System: Development, Test, and Validation

Providing reliable probabilistic solar radiation information is needed to improve management of the uncertainty and variability of solar generation. Thus, guidance on how to develop skillful and accurate ensemble forecasts is essential and it will ultimately contribute to integration of high amounts of solar energy on the grid. A team from the National Renewable Energy Laboratory and the National Center for Atmospheric Research had been collaborating to develop the WRF-Solar ensemble prediction system (WRF-Solar EPS) in the past three years to produce probabilistic solar irradiance forecasts and better predict solar energy by quantifying forecast uncertainty. The WRF-Solar EPS basically generates ensemble members for solar irradiance based on stochastic perturbations to provide intraday and day-ahead probabilistic forecasts. This study will present main research steps in developing the WRF-Solar EPS including: (a) tangent linear analysis for identifying key input variables of six WRF-Solar modules significantly related to predicting of cloud and solar irradiance, (b) combining stochastic perturbation technique with the WRF-Solar model, and (c) ensemble calibration method to decrease error and uncertainty of ensemble-based solar forecasts. The capability of WRF-Solar EPS is now updated to the most recent version of standard WRF model. This presentation will summarize comprehensive results from the evaluation of forecasts against the National Solar Radiation Data Base as well as ground-measured observations. Moreover, we will introduce the user's guide for WRF-Solar EPS (e.g., parameters to configure stochastic perturbations) and future extension of this research.

day-ahead forecast↗
DOE OSTI2025

“Godzilla,” the Extreme African Dust Event of June 2020: Origins, Transport, and Impact on Air Quality in the Greater Caribbean Basin

In June 2020, the tropical Atlantic and the Caribbean Basin were affected by a series of African dust outbreaks unprecedented in size and intensity. These events, informally named “Godzilla,” coincided with CALIMA, a large field campaign, offering a rare opportunity to assess the impact of African dust on air quality in the Greater Caribbean Basin. Network measurements of respirable particles (i.e., PM 10 and PM 2.5 ) showed that dust significantly degraded regional air quality and increased the risk to public health in the Caribbean, the southern United States, northern South America, and Central America. CALIMA examined the meteorological context of Godzilla dust events over North Africa and how these conditions might relate to the greatly increased dust emissions and enhanced transport to the Americas. Godzilla was linked to strong pressure anomalies over West Africa, resulting in a large-scale geostrophic wind anomaly at 700 hPa over North Africa. We used surface-based and columnar measurements to test the performance of two frequently used aerosol forecast models: the NASA Goddard Earth Observing System (GEOS) and Weather Research and Forecasting Model coupled with Chemistry (WRF-Chem) models. The models showed some skills but differed substantially between their forecasts, suggesting large uncertainties in these forecasts that are critical for issuing early warnings of health-threatening dust events. Our results demonstrate the value of an integrated approach in characterizing the spatial and temporal variability of African dust transport and assessing its impact on regional air quality. Future studies are needed to improve models and to track the long-term changes in dust transport from Africa under a changing climate.

Aerosols/particulates↗
DOE OSTI2024

Winter precipitation predictability in Central Southwest Asia and its representation in seasonal forecast systems

In Central Southwest Asia (CSWA; 22°N to 40°N and 30°E to 70°E), winter (November to February) precipitation contributes up to 70% of the annual mean, but substantial interannual variations exist. Dynamical models exhibit subpar predictability in this region, but the limits of their skills are not well established. Here, we identify the tropical and extratropical forcings that explain ~75% of area-averaged seasonal variability in CSWA winter precipitation. Tropical forcing comes from the indirect El Niño-Southern Oscillation (ENSO) pathway, the leading mode of tropical Indian Ocean precipitation variability. This mode is coupled with ENSO-related Pacific Ocean sea surface temperature variability. A direct ENSO influence on CSWA does not extend beyond its Indian Ocean connection. Extratropical forcing comes from a large-scale mode of internal atmospheric variability. The spatial structure, variability of tropical forcing, and teleconnection with CSWA winter precipitation are skillfully depicted in two seasonal forecasting systems: the fifth-generation seasonal forecasting system (SEAS5) and Seamless System for Prediction and Earth System Research (SPEAR). Extratropical forcing’s spatial structure is also produced skillfully in the two modelling systems; however, the representation of its interannual variability and teleconnection requires improvement. While SEAS5 displays skill in representing extratropical forcing influence on CSWA winter precipitation and marginal skill in reproducing interannual variability, SPEAR has negligible ability in both areas. Consequently, these models have limited predictive skills over CSWA in winter. While improvements in representing extratropical forcing may be inherently limited as it arises from internal atmospheric variability, further research is needed to establish its predictability limits fully.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Value of Information and Data Management Platform Promoting Modern Data Analysis Utilization. STTR Phase I, Final Technical Report

The immense growth in weather and river sensor data availability along with increases in computational power and algorithmic sophistication have enabled the widespread application of physical, machine learning, and artificial intelligence algorithms to river forecasting. The forecasts produced by widely varying model approaches are inherently limited in different ways, such as by the number and quality of training observations, producing biased predictions that achieve optimal skill only over specific ranges of weather and river conditions. Thus, despite the growing availability and new sources of forecasts, hydropower owners cannot fully leverage the information because they lack an effective mechanism to determine the “best” forecast for given conditions or objectives. Tools are needed to consolidate forecast information, demonstrate skill, and extract optimal forecast guidance from the range of possibilities. Such tools will increase uptake and beneficial use of the growing wealth of forecast information, and lead to improved operating decisions, optimal power generation, and enhanced system value. This research proposes to improve the value of forecasts by developing a broadly accessible verification framework and applying machine learning techniques to identify the ‘best’ forecast from an ensemble of sources given the current weather, river, and operating conditions.

13 HYDRO ENERGY↗
DOE OSTI2023

Machine Learning for Daily Forecasts of Arctic Sea Ice Motion: An Attribution Assessment of Model Predictive Skill

Physics-based simulations of Arctic sea ice are highly complex, involving transport between different phases, length scales, and time scales. Resultantly, numerical simulations of sea ice dynamics have a high computational cost and model uncertainty. We employ data-driven machine learning (ML) to make predictions of sea ice motion. The ML models are built to predict present-day sea ice velocity given present-day wind velocity and previous-day sea ice concentration and velocity. Models are trained using reanalysis winds and satellite-derived sea ice properties. We compare the predictions of three different models: persistence (PS), linear regression (LR), and a convolutional neural network (CNN). We quantify the spatiotemporal variability of the correlation between observations and the statistical model predictions. Additionally, we analyze model performance in comparison to variability in properties related to ice motion (wind velocity, ice velocity, ice concentration, distance from coast, bathymetric depth) to understand the processes related to decreases in model performance. Results indicate that a CNN makes skillful predictions of daily sea ice velocity with a correlation up to 0.81 between predicted and observed sea ice velocity, while the LR and PS implementations exhibit correlations of 0.78 and 0.69, respectively. The correlation varies spatially and seasonally: lower values occur in shallow coastal regions and during times of minimum sea ice extent. LR parameter analysis indicates that wind velocity plays the largest role in predicting sea ice velocity on 1-day time scales, particularly in the central Arctic. Regions where wind velocity has the largest LR parameter are regions where the CNN has higher predictive skill than the LR.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Saharan Dust Transport Predictability Utilizing a Subseasonal Experiment (SubX) Model

Prediction of Saharan dust customarily requires complex aerosols models and observations. A previous study of the Miami, Florida dust record in conjunction to reanalysis data discovered a possible source of subseasonal predictability using a dust-transport-efficiency (DTE) index. Development of the Subseasonal Forecast Experiment (SubX) has expanded global forecast products; producing multi-model ensemble forecasts out to 45 days. Retrospective forecast data from the Community Climate System Model version 4.0 (CCSM4) is used in direct comparison to National Centers for Environmental Prediction (NCEP) reanalysis to evaluate the CCSM4 subseasonal forecast and DTE index prediction skill of weekly dust variability. Successful prediction of weekly dust transport using the DTE index is variable year-to-year. The DTE most successfully predicts dust when there is high variability in the tropical winds, likely due to a fluctuating subtropical high, and is not dependent on the overall mean flow or total dust mass transported. The CCSM4 SubX retrospective forecast well represents North Atlantic meteorology out to week-3 in both mean flow and variability. Dust transport can be predicted using the DTE index and CCSM4 SubX retrospective forecasts at week-1 leads to the same success as contemporaneous NCEP reanalysis.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Performance Evaluation of Weather@home2 Simulations over West African Region

Weather and climate forecasting, using climate models, have become essential tools and life-savers in the West African region; in spite of the fact that climate models do not fully comply with attributes of forecast qualities—RASAP: reliability, association, skill, accuracy, and precision. The objective of this paper is to quantitatively evaluate, in comparison to CRU and ERA5 datasets, the RASAP compliance-level of the weather@home2 modeling system (w@h2). Findings from some statistical evaluations show that, to a moderately significant extent, w@h2 model provides useful information during the monsoon seasons; skills to capture the Little Dry Season over the Guinea zone; predictive skills for the onset season; ability to reproduce all the annual characteristics of the surface maximum air temperature over the region; as well as skill to detect heat waves that usually ravage West Africa during the boreal spring. The model displays traces of attributes that are needed for seasonal climate predictions and applications. Deficiencies in the quantitative reproducibility point to the facts that the model does provide a reliability akin to that of regional climate models. This paper further furnishes a prospective user with information on whether the model might be “useful or not” for a particular application.

West Africa↗
DOE OSTI2021

Teleconnections of the Quasi–Biennial Oscillation in a multi–model ensemble of QBO–resolving models

The quasi-biennial oscillation (QBO) dominates the interannual variability of the tropical stratosphere and influences other regions of the atmosphere. The high predictability of the QBO implies that its teleconnections could lead to in-creased skill of seasonal and decadal forecasts provided the relevant mechanisms are accurately represented in models. Here modelling and sampling uncertainties of QBO teleconnections are examined using a multi-model ensemble of QBO-resolving atmospheric general circulation models that have carried out a set of coordinated experiments as part of the Stratosphere-troposphere Processes And their Role in Climate (SPARC) QBO initiative (QBOi). During Northern Hemisphere winter the stratospheric polar vortex in most of these models strengthens when the QBO near 50 hPa is westerly and weakens when it is easterly, consistent with, but weaker than, the observed response. These weak responses are likely due to model errors, such as systematically weak QBO amplitudes near 50 hPa, affecting the teleconnection. The teleconnection to the North Atlantic Oscillation is less well captured overall, but of similar strength to the observed signal in the few models that do show it. Furthermore, the models do not show clear evidence of a QBO teleconnection to the Northern Hemisphere Pacific sector subtropical jet.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

LDRD-2022-00112: Machine Learning for Weather Forecasting

Given its location relative to the coast, seabreezes pass over the Savannah River Site (SRS) fairly often, usually overnight, with consequent effects on site meteorology. Similar to our previous work with fog, we have applied machine learning (ML) to the problem of forecasting seabreeze passage onsite, using as input i) meteorological observations and ii) weather model forecasts.The two ML techniques we applied both demonstrated skill, especially when compared to a simple forecast that uses the predicted land-sea temperature gradient as a predictor.

WERTH, DAVID W.↗
DOE OSTI2023

A New Paradigm for Observing and Modeling of Air-Sea Interactions to Advance Earth System Prediction

The protection of people, property, and environmental resources from extreme weather, seasonal patterns, and climate change drives the need for predictions of weather, ocean, and climate patterns that have skill and value at timescales longer than traditional 1-10-day forecasts, including outlooks spanning weeks to decades. Advancing Earth System Prediction (ESP) skill at this range of timescales requires improved observations, understanding, and modeling of the processes in the ocean boundary layer, the atmospheric boundary layer, and their interface. A new way of referring to this coupled system is the Air-Sea Transition Zone (ASTZ). The report that follows is framed by the paradigm that the ASTZ is a single entity that regulates the flow of energy and matter between the ocean and the atmosphere. The ASTZ is thus the medium through which the ocean and atmosphere respond to and influence one another across their often disparate scales of variability. ASTZ modeling, observing, and understanding needs are particularly acute because very few measurements exist over oceans, and even fewer span the entire ASTZ, even though oceans cover 70% of Earth’s surface and are the source of most of the rain and snow that falls on both the land and the oceans.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Seasonal variability and predictability of monsoon precipitation in Southern Africa

Rainfed agriculture is the mainstay of economies across Southern Africa (SA), where most precipitation is received during the austral summer monsoon. This study aims to further our understanding of monsoon precipitation predictability over SA. We use three natural climate forcings, El Niño–Southern Oscillation, Indian Ocean Dipole (IOD), and the Indian Ocean Precipitation Dipole (IOPD)—the dominant precipitation variability mode—to construct an empirical model that exhibits significant skill over SA during monsoon in explaining precipitation variability and in forecasting it with a five-month lead. While most explained precipitation variance (50%–75%) comes from contemporaneous IOD and IOPD, preconditioning all three forcings is key in predicting monsoon precipitation with a zero to five-month lead. Seasonal forecasting systems accurately represent the interplay of the three forcings but show varying skills in representing their teleconnection over SA. This makes them less effective at predicting monsoon precipitation than the empirical model.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

An Alternative Ensemble Streamflow Prediction Approach Using Improved Subseasonal Precipitation Forecasts from the North America Multi-Model Ensemble Phase II

In this article, streamflow forecasting at a subseasonal time scale (10–30 days into the future) is important for various human activities. The ensemble streamflow prediction (ESP) is a widely applied technique for subseasonal streamflow forecasting. However, ESP’s reliance on the randomly resampled historical precipitation limits its predictive capability. Available dynamical subseasonal precipitation forecasts provide an alternative to the randomly resampled precipitation in ESP. Prior studies found the predictive performance of raw subseasonal precipitation forecast is limited in many regions such as the central south of the United States, which raises questions about its effectiveness in assisting streamflow forecasting. To further assess the hydrologic applicability of dynamical subseasonal precipitation forecasts, we test the subseasonal precipitation forecast from North America Multi-Model Ensemble Phase II (NMME-2) at four watersheds in the central south region of the United States. The subseasonal precipitation forecasts are postprocessed with bias correction and spatial disaggregation (BCSD) to correct bias and improve spatial resolution before replacing the randomly resampled precipitation in ESP for streamflow predictions. The performance of the resulting streamflow predictions is benchmarked with ESP. Evaluation is conducted using Kling–Gupta Efficiency (KGE), continuous ranked probability score (CRPS), probability of detection (POD), false alarm ratios (FARs), as well as reliability diagrams. Our results suggest that BCSD-corrected subseasonal precipitation forecasts lead to overall improved streamflow predictions due to added skills in winter and spring. Our results also suggest that BCSD-corrected subseasonal precipitation forecasts lead to improved predictions on the occurrence of high-percentile streamflow values above 75%. Overall, BCSD-corrected subseasonal precipitation has shown promising performance, highlighting its potential broader applications for river and flood forecasting.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

A Practical Probabilistic Benchmark for AI Weather Models

Since the weather is chaotic, it is necessary to forecast an ensemble of future states. Recently, multiple AI weather models have emerged claiming breakthroughs in deterministic skill. Unfortunately, it is hard to fairly compare ensembles of AI forecasts because variations in ensembling methodology become confounding and the baseline data volume is immense. We address this by scoring lagged initial condition ensembles—whereby an ensemble can be constructed from a library of deterministic hindcasts. This allows the first parameter‐free intercomparison of leading AI weather models' probabilistic skill against an operational baseline. Lagged ensembles of the two leading AI weather models, GraphCast and Pangu, perform similarly even though the former outperforms the latter in deterministic scoring. These results are elaborated upon by sensitivity tests showing that commonly used multiple time‐step loss functions damage ensemble calibration.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Quantifying sources of subseasonal prediction skill in CESM2

Abstract Subseasonal prediction fills the gap between weather forecasts and seasonal outlooks. There is evidence that predictability on subseasonal timescales comes from a combination of atmosphere, land, and ocean initial conditions. Predictability from the land is often attributed to slowly varying changes in soil moisture and snowpack, while predictability from the ocean is attributed to sources such as the El Niño Southern Oscillation. Here we use a set of subseasonal reforecast experiments with CESM2 to quantify the respective roles of atmosphere, land, and ocean initial conditions on subseasonal prediction skill over land. These reveal that the majority of prediction skill for global surface temperature in weeks 3–4 comes from the atmosphere, while ocean initial conditions become important after week 4, especially in the Tropics. In the CESM2 subseasonal prediction system, the land initial state does not contribute to surface temperature prediction skill in weeks 3–6 and climatological land conditions lead to higher skill, disagreeing with our current understanding. However, land-atmosphere coupling is important in week 1. Subseasonal precipitation prediction skill also comes primarily from the atmospheric initial condition, except for the Tropics, where after week 4 the ocean state is more important.

Richter, Jadwiga H. (ORCID:0000000170480781)↗
DOE OSTI2022

Subseasonal Earth System Prediction with CESM2

Abstract Prediction systems to enable Earth system predictability research on the subseasonal time scale have been developed with the Community Earth System Model, version 2 (CESM2) using two configurations that differ in their atmospheric components. One system uses the Community Atmosphere Model, version 6 (CAM6) with its top near 40 km, referred to as CESM2(CAM6). The other employs the Whole Atmosphere Community Climate Model, version 6 (WACCM6) whose top extends to ∼140 km, and it includes fully interactive tropospheric and stratospheric chemistry [CESM2(WACCM6)]. Both systems are utilized to carry out subseasonal reforecasts for the 1999–2020 period following the Subseasonal Experiment’s (SubX) protocol. Subseasonal prediction skill from both systems is compared to those of the National Oceanic and Atmospheric Administration CFSv2 and European Centre for Medium-Range Weather Forecasts (ECMWF) operational models. CESM2(CAM6) and CESM2(WACCM6) show very similar subseasonal prediction skill of 2-m temperature, precipitation, the Madden–Julian oscillation, and North Atlantic Oscillation to its previous version and to the NOAA CFSv2 model. Overall, skill of CESM2(CAM6) and CESM2(WACCM6) is a little lower than that of the ECMWF system. In addition to typical output provided by subseasonal prediction systems, CESM2 reforecasts provide comprehensive datasets for predictability research of multiple Earth system components, including three-dimensional output for many variables, and output specific to the mesosphere and lower-thermosphere (MLT) region from CESM2(WACCM6). It is shown that sudden stratosphere warming events, and the associated variability in the MLT, can be predicted ∼10 days in advance. Weekly real-time forecasts and reforecasts with CESM2(CAM6) and CESM2(WACCM6) are freely available. Significance Statement We describe here the design and prediction skill of two subseasonal prediction systems based on two configurations of the Community Earth System Model, version 2 (CESM2): CESM2 with the Community Atmosphere Model, version 6 [CESM2(CAM6)] and CESM 2 with Whole Atmosphere Community Climate Model, version 6 [CESM2(WACCM6)] as its atmospheric component. These two systems provide a foundation for community-model based subseasonal prediction research. The CESM2(WACCM6) system provides a novel capability to explore the predictability of the stratosphere, mesosphere, and lower thermosphere. Both CESM2(CAM6) and CESM2(WACCM6) demonstrate subseasonal surface prediction skill comparable to that of the NOAA CFSv2 model, and a little lower than that of the ECMWF forecasting system. CESM2 reforecasts provide a comprehensive dataset for predictability research of multiple aspects of the Earth system, including the whole atmosphere up to 140 km, land, and sea ice. Weekly real-time forecasts, reforecasts, and models are publicly available.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

CMIP6 skill at predicting interannual to multi-decadal summer monsoon precipitation variability

Monsoons affect the economy, agriculture, and human health of two thirds of the world’s population. Therefore, predicting variations in monsoon precipitation is societally important. We explore the ability of climate models from the sixth phase of the Climate Model Intercomparison Project to predict summer monsoon precipitation variability by using hindcasts from the Decadal Climate Prediction Project (Component A). The multi-model ensemble-mean shows significant skill at predicting summer monsoon precipitation from one year to 6–9 years ahead. However, this skill is dependent on the model, monsoon domain, and lead-time. In general, the skill of the multi-model ensemble-mean prediction is low in year 1 but increases for longer-lead times and is largely consistent with externally forced changes. The best captured region is northern Africa for the 2–5 and 6–9 year forecast lead times. In contrast, there is no significant skill using the ensemble-mean over East and South Asia and, furthermore, there is significant spread in skill among models for these domains. By sub-sampling the ensemble we show that the difference in skill between models is tied to the simulation of the externally forced response over East and South Asia, with models with a more skilful forced response capable of better predictions. A further contribution is from skilful prediction of Pacific Ocean temperatures for the South Asian summer monsoon at longer lead-times. Therefore, these results indicate that predictions of the East and South Asian monsoons could be significantly improved.

54 ENVIRONMENTAL SCIENCES↗