Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

“Godzilla,” the Extreme African Dust Event of June 2020: Origins, Transport, and Impact on Air Quality in the Greater Caribbean Basin

In June 2020, the tropical Atlantic and the Caribbean Basin were affected by a series of African dust outbreaks unprecedented in size and intensity. These events, informally named “Godzilla,” coincided with CALIMA, a large field campaign, offering a rare opportunity to assess the impact of African dust on air quality in the Greater Caribbean Basin. Network measurements of respirable particles (i.e., PM 10 and PM 2.5 ) showed that dust significantly degraded regional air quality and increased the risk to public health in the Caribbean, the southern United States, northern South America, and Central America. CALIMA examined the meteorological context of Godzilla dust events over North Africa and how these conditions might relate to the greatly increased dust emissions and enhanced transport to the Americas. Godzilla was linked to strong pressure anomalies over West Africa, resulting in a large-scale geostrophic wind anomaly at 700 hPa over North Africa. We used surface-based and columnar measurements to test the performance of two frequently used aerosol forecast models: the NASA Goddard Earth Observing System (GEOS) and Weather Research and Forecasting Model coupled with Chemistry (WRF-Chem) models. The models showed some skills but differed substantially between their forecasts, suggesting large uncertainties in these forecasts that are critical for issuing early warnings of health-threatening dust events. Our results demonstrate the value of an integrated approach in characterizing the spatial and temporal variability of African dust transport and assessing its impact on regional air quality. Future studies are needed to improve models and to track the long-term changes in dust transport from Africa under a changing climate.

Aerosols/particulates↗
DOE OSTI2024

Winter precipitation predictability in Central Southwest Asia and its representation in seasonal forecast systems

In Central Southwest Asia (CSWA; 22°N to 40°N and 30°E to 70°E), winter (November to February) precipitation contributes up to 70% of the annual mean, but substantial interannual variations exist. Dynamical models exhibit subpar predictability in this region, but the limits of their skills are not well established. Here, we identify the tropical and extratropical forcings that explain ~75% of area-averaged seasonal variability in CSWA winter precipitation. Tropical forcing comes from the indirect El Niño-Southern Oscillation (ENSO) pathway, the leading mode of tropical Indian Ocean precipitation variability. This mode is coupled with ENSO-related Pacific Ocean sea surface temperature variability. A direct ENSO influence on CSWA does not extend beyond its Indian Ocean connection. Extratropical forcing comes from a large-scale mode of internal atmospheric variability. The spatial structure, variability of tropical forcing, and teleconnection with CSWA winter precipitation are skillfully depicted in two seasonal forecasting systems: the fifth-generation seasonal forecasting system (SEAS5) and Seamless System for Prediction and Earth System Research (SPEAR). Extratropical forcing’s spatial structure is also produced skillfully in the two modelling systems; however, the representation of its interannual variability and teleconnection requires improvement. While SEAS5 displays skill in representing extratropical forcing influence on CSWA winter precipitation and marginal skill in reproducing interannual variability, SPEAR has negligible ability in both areas. Consequently, these models have limited predictive skills over CSWA in winter. While improvements in representing extratropical forcing may be inherently limited as it arises from internal atmospheric variability, further research is needed to establish its predictability limits fully.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2014

Development of Super Ensemble-Based Aviation Turbulence Guidance (SEATG) for Air Traffic Management

A new method for forecasting turbulence is developed and evaluated using the high resolution weather model and in situ turbulence observations from commercial aircraft. The new method is an ensemble of various turbulence metrics from multiple time-lagged ensemble forecasts created using a sequence of four procedures. These include weather modeling, calculation of turbulence metrics, mapping the metrics into a common turbulence-scale, and production of final forecast. The new method uses similar methodology as current operational turbulence forecast with three improvements. First, it uses a higher resolution ((delta)x = 3 km) weather model to capture cloud resolving scale phenomena. Second, it computes the metrics for multiple forecasts that are combined at the same valid time resulting in a time-lagged ensemble of multiple turbulence metrics. Finally, it provides both deterministic and probabilistic turbulence forecasts. Results show the new forecasts match well with observed radar reflectivity along a surface front as well as convectively induced turbulence outside the clouds on research period. Overall performance skill of the new turbulence forecast compared with the observed EDR data during the research period is superior to any single turbulence metric. The probabilistic turbulence forecast is used in an example air traffic management application for creating a wind-optimal route considering turbulence information. The wind-optimal route passing through areas of 50% potential for moderate-or-greater turbulence and the lateral turbulence avoidance routes starting from three different waypoints along the wind-optimal route from Los Angeles international airport to John F. Kennedy international airport are calculated using different turbulence forecasts. This example shows additional flight time is required to avoid potential turbulence encounters.

modeling↗
NASA NTRS2007

Weather Research and Forecasting Model Sensitivity Comparisons for Warm Season Convective Initiation

Mesoscale weather conditions can significantly affect the space launch and landing operations at Kennedy Space Center (KSC) and Cape Canaveral Air Force Station (CCAFS). During the summer months, land-sea interactions that occur across KSC and CCAFS lead to the formation of a sea breeze, which can then spawn deep convection. These convective processes often last 60 minutes or less and pose a significant challenge to the forecasters at the National Weather Service (NWS) Spaceflight Meteorology Group (SMG). The main challenge is that a "GO" forecast for thunderstorms and precipitation at the Shuttle Landing Facility is required at the 90 minute deorbit decision for End Of Mission (EOM) and at the 30 minute Return To Launch Site (RTLS) decision. Convective initiation, timing, and mode also present a forecast challenge for the NWS in Melbourne, FL (MLB). The NWS MLB issues such tactical forecast information as Terminal Aerodrome Forecasts (TAF5), Spot Forecasts for fire weather and hazardous materials incident support, and severe/hazardous weather Watches, Warnings, and Advisories. Lastly, these forecasting challenges can also affect the 45th Weather Squadron (45 WS), which provides comprehensive weather forecasts for shuttle launch, as well as ground operations, at KSC and CCAFS. The need for accurate mesoscale model forecasts to aid in their decision making is crucial. This study specifically addresses the skill of different model configurations in forecasting warm season convective initiation. Numerous factors influence the development of convection over the Florida peninsula. These factors include sea breezes, river and lake breezes, the prevailing low-level flow, and convergent flow due to convex coastlines that enhance the sea breeze. The interaction of these processes produces the warm season convective patterns seen over the Florida peninsula. However, warm season convection remains one of the most poorly forecast meteorological parameters. To determine which configuration options are best to address this specific forecast concern, the Weather Research and Forecasting (WRF) model, which has two dynamical cores - the Advanced Research WRF (ARW) and the Non-hydrostatic Mesoscale Model (NMM) was employed. In addition to the two dynamical cores, there are also two options for a "hot-start" initialization of the WRF model - the Local Analysis and Prediction System (LAPS; McGinley 1995) and the Advanced Regional Prediction System (ARPS) Data Analysis System (ADAS; Brewster 1996). Both LAPS and ADAS are 3- dimensional weather analysis systems that integrate multiple meteorological data sources into one consistent analysis over the user's domain of interest. This allows mesoscale models to benefit from the addition of highresolution data sources. Having a series of initialization options and WRF cores, as well as many options within each core, provides SMG and MLB with considerable flexibility as well as challenges. It is the goal of this study to assess the different configurations available and to determine which configuration will best predict warm season convective initiation.

Watson, Leela R.↗
NASA NTRS2020

Tree Rings and Observations Suggest No Stable Cycles In Sierra Nevada Cool‐Season Precipitation

California's water resources rely heavily on cool‐season (November–March) precipitation in the Sierra Nevada. Interannual variability is highly volatile and seasonal forecasting has little to no skill, making water management particularly challenging. Over 1902–2020, Sierra Nevada cool‐season precipitation totals exhibited significant 2.2‐ and 13–15‐year cycles, accounting for approximately 40% of total variability and perhaps signifying potential as seasonal forecasting tools. However, the underlying climate dynamics are not well understood and it is unclear whether these cycles are stable over the long‐term. We use tree rings to reconstruct Sierra Nevada cool‐season precipitation back to 1400. The reconstruction is skillful, accounting for 55–74% of observed variability and capturing the 20th‐century 2.2‐ and 13–15‐year cycles. Prior to 1900, the reconstruction indicates no other century‐long periods of significant spectral power in the 2.2‐ or 13–15‐year bands. The reconstruction does indicate significant cyclicity over other extended periods of several decades or longer, however, with dominant periodicities in the ranges of 2.1–2.7 and 3.5–8 years. The late 1700s through 1800s exhibited the highest‐amplitude cycles in the reconstruction, with periodicities of 2.4 and 5.7–7.4 years. The reconstruction should serve to caution against extrapolating the observed 2.2‐ and 13–15‐year cycles to guide future expectations. On the other hand, observations and the reconstruction suggest that interannual variability of Sierra Nevada cool‐season precipitation is not a purely white noise process and research should aim to diagnose the dynamical drivers of extended periods of cyclicity in this critical natural resource.

Paleoclimate↗
DOE OSTI2021

Value of Information and Data Management Platform Promoting Modern Data Analysis Utilization. STTR Phase I, Final Technical Report

The immense growth in weather and river sensor data availability along with increases in computational power and algorithmic sophistication have enabled the widespread application of physical, machine learning, and artificial intelligence algorithms to river forecasting. The forecasts produced by widely varying model approaches are inherently limited in different ways, such as by the number and quality of training observations, producing biased predictions that achieve optimal skill only over specific ranges of weather and river conditions. Thus, despite the growing availability and new sources of forecasts, hydropower owners cannot fully leverage the information because they lack an effective mechanism to determine the “best” forecast for given conditions or objectives. Tools are needed to consolidate forecast information, demonstrate skill, and extract optimal forecast guidance from the range of possibilities. Such tools will increase uptake and beneficial use of the growing wealth of forecast information, and lead to improved operating decisions, optimal power generation, and enhanced system value. This research proposes to improve the value of forecasts by developing a broadly accessible verification framework and applying machine learning techniques to identify the ‘best’ forecast from an ensemble of sources given the current weather, river, and operating conditions.

13 HYDRO ENERGY↗
DOE OSTI2023

Machine Learning for Daily Forecasts of Arctic Sea Ice Motion: An Attribution Assessment of Model Predictive Skill

Physics-based simulations of Arctic sea ice are highly complex, involving transport between different phases, length scales, and time scales. Resultantly, numerical simulations of sea ice dynamics have a high computational cost and model uncertainty. We employ data-driven machine learning (ML) to make predictions of sea ice motion. The ML models are built to predict present-day sea ice velocity given present-day wind velocity and previous-day sea ice concentration and velocity. Models are trained using reanalysis winds and satellite-derived sea ice properties. We compare the predictions of three different models: persistence (PS), linear regression (LR), and a convolutional neural network (CNN). We quantify the spatiotemporal variability of the correlation between observations and the statistical model predictions. Additionally, we analyze model performance in comparison to variability in properties related to ice motion (wind velocity, ice velocity, ice concentration, distance from coast, bathymetric depth) to understand the processes related to decreases in model performance. Results indicate that a CNN makes skillful predictions of daily sea ice velocity with a correlation up to 0.81 between predicted and observed sea ice velocity, while the LR and PS implementations exhibit correlations of 0.78 and 0.69, respectively. The correlation varies spatially and seasonally: lower values occur in shallow coastal regions and during times of minimum sea ice extent. LR parameter analysis indicates that wind velocity plays the largest role in predicting sea ice velocity on 1-day time scales, particularly in the central Arctic. Regions where wind velocity has the largest LR parameter are regions where the CNN has higher predictive skill than the LR.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1985

Medium range forecasting: The experience of ECMWF

The results of five years of operational medium-range forecasts at ECMWF is discussed. It is shown that a considerable improvement in predictive skill has taken place, resulting in more accurate forecasts and an extension in time of useful predictive skill. For the Northern Hemisphere extratropics, the improvement in skill during the winter season is about three days for the 500-mb geopotential compared to the very first experiments in the early 1970s. Three are large geographical and temporal variations in the performance of the model, as well as large-scale errors of a systematic nature. Numerical experiments have indicated great sensitivity to the representation of orography and to tropical forcing.

Bengtsson, L.↗
DOE OSTI2021

Saharan Dust Transport Predictability Utilizing a Subseasonal Experiment (SubX) Model

Prediction of Saharan dust customarily requires complex aerosols models and observations. A previous study of the Miami, Florida dust record in conjunction to reanalysis data discovered a possible source of subseasonal predictability using a dust-transport-efficiency (DTE) index. Development of the Subseasonal Forecast Experiment (SubX) has expanded global forecast products; producing multi-model ensemble forecasts out to 45 days. Retrospective forecast data from the Community Climate System Model version 4.0 (CCSM4) is used in direct comparison to National Centers for Environmental Prediction (NCEP) reanalysis to evaluate the CCSM4 subseasonal forecast and DTE index prediction skill of weekly dust variability. Successful prediction of weekly dust transport using the DTE index is variable year-to-year. The DTE most successfully predicts dust when there is high variability in the tropical winds, likely due to a fluctuating subtropical high, and is not dependent on the overall mean flow or total dust mass transported. The CCSM4 SubX retrospective forecast well represents North Atlantic meteorology out to week-3 in both mean flow and variability. Dust transport can be predicted using the DTE index and CCSM4 SubX retrospective forecasts at week-1 leads to the same success as contemporaneous NCEP reanalysis.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2020

Prediction skill of the 2012 U.S. Great Plains flash drought in Subseasonal Experiment (SubX) models

Rapid-onset droughts, known as flash droughts, can have devastating impacts on agriculture, water resources, and ecosystems. The ability to predict flash droughts in advance would greatly enhance our preparation for them and potentially mitigate their impacts. Here, we investigate the prediction skill of the extreme 2012 flash drought over the U.S. Great Plains at subseasonal lead times (3 weeks or more in advance) in global forecast systems participating in the Subseasonal Experiment (SubX). An additional comprehensive set of subseasonal hindcasts with NASA’s GEOS model, a SubX model with relatively high prediction skill, was performed to investigate the separate contributions of atmospheric and land initial conditions to flash drought prediction skill. The results show that the prediction skill of the SubX models is quite variable. While skillful predictions are restricted to within the first two forecast weeks in most models, skill is considerably better (3-4 weeks or more) for certain models and initialization dates. The enhanced prediction skill is found to originate from two robust sources: 1) accurate soil moisture initialization once dry soil conditions are established, and 2) the satisfactory representation of quasi-stationary cross-Pacific Rossby wave trains that lead to the rapid intensification of flash droughts. Evidence is provided that the importance of soil moisture initialization applies more generally to central U.S. summer flash droughts. Our results corroborate earlier findings that accurate soil moisture initialization is important for skillful subseasonal forecasts and highlight the need for additional research on the sources and predictability of drought-inducing quasi-stationary atmospheric circulation anomalies.

Anthony M DeAngelis↗
DOE OSTI2025

Performance Evaluation of Weather@home2 Simulations over West African Region

Weather and climate forecasting, using climate models, have become essential tools and life-savers in the West African region; in spite of the fact that climate models do not fully comply with attributes of forecast qualities—RASAP: reliability, association, skill, accuracy, and precision. The objective of this paper is to quantitatively evaluate, in comparison to CRU and ERA5 datasets, the RASAP compliance-level of the weather@home2 modeling system (w@h2). Findings from some statistical evaluations show that, to a moderately significant extent, w@h2 model provides useful information during the monsoon seasons; skills to capture the Little Dry Season over the Guinea zone; predictive skills for the onset season; ability to reproduce all the annual characteristics of the surface maximum air temperature over the region; as well as skill to detect heat waves that usually ravage West Africa during the boreal spring. The model displays traces of attributes that are needed for seasonal climate predictions and applications. Deficiencies in the quantitative reproducibility point to the facts that the model does provide a reliability akin to that of regional climate models. This paper further furnishes a prospective user with information on whether the model might be “useful or not” for a particular application.

West Africa↗
NASA NTRS2019

Evaluation of the Impacts of Biomass Burning Aerosols on the NASA GEOS Sub-Seasonal Climate Forecasts

Emission sources of trace gases and aerosol particles in the South American (SA)and African (Af) continents have a strong seasonal and space variability associated with the extensive vegetation fires activities. In both continents, during the austral winter, the fires affect mainly tropical forest and savannah-type biomes and are mostly associated with deforestation and agricultural/pasture land management. Smoke aerosol particles, on average, contribute to at least 90% of the total aerosol optical depth (AOD) in the visible spectrum in the case of the South America regional smoke. Smoke aerosols also act as cloud condensation nuclei affecting cloud microphysics properties and therefore, changing the radiation budget, hydrological cycle and global circulation patterns over disturbed areas (Kaufman, 1995; Rosenfeld, 1999; Andreae,et al., 2004; Koren et al., 2004, Zhang, 2008; Ott et al., 2010; Randles et al., 2013). This study aims to evaluate and quantify the impact of including a comprehensive emission field of biomass burning aerosol on the performance of a seasonal climate forecast system, not only regarding the AOD itself but mainly on the meteorological state variable (e.g., precipitation and temperature). To address the questions put above, we designed two numerical experiments: 1- named"AERO_CTL" which applies the Quick Fire Emissions Dataset (QFED) emissions estimated with intra-diurnal variation (hereafter, BBE), and 2- named "AERO_CLM" where the sourcee mission is based on a climatology of the QFED emissions, with only monthly variation(hereafter, BBCLIM). Hindcast simulations were produced using the Goddard Earth ObservingSystem global circulation model, version 5, sub-seasonal to seasonal (GEOS5-S2S) system with a nominal spatial resolution of 56km (Rienecker et al., 2008). In both experiments, the aerosol feedbacks from cloud developments and radiation interactions were accounted. The two experiments consisted of 4 members each and ran from June to November spanning over the years 2000 to 2015. Model performance was evaluated by calculating statistical metrics on the mean area of SA and Af. Our results demonstrated that the skill model in predicting AOD is significantly improve when BBE source emission is applied over SA, but not over the Afcontinent. Over SA, the correlation between the AERO_CTL model configuration and MERRA-2 is 0.93 (R2= 0.86, RMS=0.02, BIAS=0.01), while the AERO_CLM model presents a value of0.81 (R2= 0.65, RMS=0.04, BIAS=0.06). However, the AERO_CTL experiment better represents the inter-annual variability of the AOS in both regions. The gain of the skill in predicting the AOD by the AERO_CTL experiment is also seen in some meteorological variables. We observed an increase in the model skill in predicting the 2-meter temperature and precipitation of up to 0.3 for the AERO_CTL experiment in comparison to the AERO_CLM. AERO_CLM. According to the analyzed hindcast, we inferred that representing the BBE more realistically implies in a significant gain of skills in the seasonal climate forecasting over SA and Af continents.

Aerosol↗
DOE OSTI2021

Teleconnections of the Quasi–Biennial Oscillation in a multi–model ensemble of QBO–resolving models

The quasi-biennial oscillation (QBO) dominates the interannual variability of the tropical stratosphere and influences other regions of the atmosphere. The high predictability of the QBO implies that its teleconnections could lead to in-creased skill of seasonal and decadal forecasts provided the relevant mechanisms are accurately represented in models. Here modelling and sampling uncertainties of QBO teleconnections are examined using a multi-model ensemble of QBO-resolving atmospheric general circulation models that have carried out a set of coordinated experiments as part of the Stratosphere-troposphere Processes And their Role in Climate (SPARC) QBO initiative (QBOi). During Northern Hemisphere winter the stratospheric polar vortex in most of these models strengthens when the QBO near 50 hPa is westerly and weakens when it is easterly, consistent with, but weaker than, the observed response. These weak responses are likely due to model errors, such as systematically weak QBO amplitudes near 50 hPa, affecting the teleconnection. The teleconnection to the North Atlantic Oscillation is less well captured overall, but of similar strength to the observed signal in the few models that do show it. Furthermore, the models do not show clear evidence of a QBO teleconnection to the Northern Hemisphere Pacific sector subtropical jet.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1988

Assessment of recent resolution and parameterization changes in the GLA fourth order GCM

The Goddard Laboratory for Atmospheres' fourth-order GCM is under evaluation for the impact on model integrations of enhanced horizontal and vertical resolution, as well as the effects of such novel parameterization schemes as that of gravity-wave-drag, the Arakawa-Schubert (1974) cumulus parameterization, and an explicitly-resolved planetary boundary layer. While the doubling of the GMC's horizontal resolution to 2 deg in latitude and 2.5 deg in longitude has improved the model's predictive skill for 6-7 day forecasts, systematic errors associated with the model's climate drift lead to a deterioration in predictions for longer forecasts.

Helfand, H. M.↗
NASA NTRS2002

Predictability Associated with Land Surface Moisture States: Studies with the NSIPP System

Hydrologists have long speculated that soil moisture information can be used to increase skill in monthly to seasonal forecast systems. For this to be true, though, three conditions must be satisfied: (1) an imposed initial soil moisture anomaly in the forecast system must have some memory, so that it persists into the forecast period; (2) the modeled atmosphere must respond in a predictable way to the persisted anomaly; and (3) the forecast model must correctly represent both the soil moisture memory and the atmospheric response as they occur in nature. In this short paper, we review some recent work at NSIPP (NASA Seasonal-to-Interannual Prediction Project) that addresses all three conditions.

Koster, R. D.↗
NASA NTRS2013

The North American Multi-Model Ensemble (NMME): Phase-1 Seasonal to Interannual Prediction, Phase-2 Toward Developing Intra-Seasonal Prediction

The recent US National Academies report "Assessment of Intraseasonal to Interannual Climate Prediction and Predictability" was unequivocal in recommending the need for the development of a North American Multi-Model Ensemble (NMME) operational predictive capability. Indeed, this effort is required to meet the specific tailored regional prediction and decision support needs of a large community of climate information users. The multi-model ensemble approach has proven extremely effective at quantifying prediction uncertainty due to uncertainty in model formulation, and has proven to produce better prediction quality (on average) then any single model ensemble. This multi-model approach is the basis for several international collaborative prediction research efforts, an operational European system and there are numerous examples of how this multi-model ensemble approach yields superior forecasts compared to any single model. Based on two NOAA Climate Test Bed (CTB) NMME workshops (February 18, and April 8, 2011) a collaborative and coordinated implementation strategy for a NMME prediction system has been developed and is currently delivering real-time seasonal-to-interannual predictions on the NOAA Climate Prediction Center (CPC) operational schedule. The hindcast and real-time prediction data is readily available (e.g., http://iridl.ldeo.columbia.edu/SOURCES/.Models/.NMME/) and in graphical format from CPC (http://origin.cpc.ncep.noaa.gov/products/people/wd51yf/NMME/index.html). Moreover, the NMME forecast are already currently being used as guidance for operational forecasters. This paper describes the new NMME effort, presents an overview of the multi-model forecast quality, and the complementary skill associated with individual models.

NOAA CPC↗
NASA NTRS2015

An Overview of Production and Validation of the SMAP Passive Soil Moisture Product

The Soil Moisture Active Passive (SMAP) mission is an L-band mission scheduled for launch in Jan. 2015. The SMAP instruments consist of a radar and a radiometer to obtain complementary information from space for soil moisture and freeze/thaw state research and applications. By utilizing novel designs in antenna construction, retrieval algorithms, and acquisition hardware, SMAP provides a capability for global mapping of soil moisture and freeze/thaw state with unprecedented accuracy, resolution, and coverage. This improvement in hydrosphere state measurement is expected to advance our understanding of the processes that link the terrestrial water, energy and carbon cycles, improve our capability in flood prediction and drought monitoring, and enhance our skills in weather and climate forecast. For swath-based soil moisture measurement, SMAP generates three operational geophysical data products: (1) the radiometer-only soil moisture product (L2_SM_P) posted at 36-kilometer resolution, (2) the radar-only soil moisture product (L2_SM_A) posted at 3-kilometers resolution, and (3) the radar-radiometer combined soil moisture product (L2_SM_AP) posted at 9-kilometers resolution. Each product draws on the strengths of the underlying sensor(s) and plays a unique role in hydroclimatological and hydrometeorological applications. A full suite of SMAP data products is given in Table 1.

passive microwave↗