Search NASA⌕ Search

SEARCH · Search NASA

Results for “Prediction skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 343 records · Page 19
All sourcesNASA NTRSDOE OSTI
NASA NTRS1998

Distortion Representation of Forecast Errors for Model Skill Assessment and Objective Analysis

We proposed a novel characterization of errors for numerical weather predictions. A general distortion representation allows for the displacement and amplification or bias correction of forecast anomalies. Characterizing and decomposing forecast error in this way has several important applications, including the model assessment application and the objective analysis application. In this project, we have focused on the assessment application, restricted to a realistic but univariate 2-dimensional situation. Specifically, we study the forecast errors of the sea level pressure (SLP), the 500 hPa geopotential height, and the 315 K potential vorticity fields for forecasts of the short and medium range. The forecasts are generated by the Goddard Earth Observing System (GEOS) data assimilation system with and without ERS-1 scatterometer data. A great deal of novel work has been accomplished under the current contract. In broad terms, we have developed and tested an efficient algorithm for determining distortions. The algorithm and constraints are now ready for application to larger data sets to be used to determine the statistics of the distortion as outlined above, and to be applied in data analysis by using GEOS water vapor imagery to correct short-term forecast errors.

Hoffman, Ross N.↗
DOE OSTI2023

LDRD-2022-00112: Machine Learning for Weather Forecasting

Given its location relative to the coast, seabreezes pass over the Savannah River Site (SRS) fairly often, usually overnight, with consequent effects on site meteorology. Similar to our previous work with fog, we have applied machine learning (ML) to the problem of forecasting seabreeze passage onsite, using as input i) meteorological observations and ii) weather model forecasts.The two ML techniques we applied both demonstrated skill, especially when compared to a simple forecast that uses the predicted land-sea temperature gradient as a predictor.

WERTH, DAVID W.↗
NASA NTRS1998

Efficient Methods to Assimilate Satellite Retrievals Based on Information Content: Suboptimal Retrieval Assimilation - Part 2

One of the outstanding problems in data assimilation has been and continues to be how best to utilize satellite data while balancing the tradeoff between accuracy and computational cost. A number of weather prediction centers have recently achieved remarkable success in improving their forecast skill by changing the method by which satellite data are assimilated into the forecast model from the traditional approach of assimilating retrievals to the direct assimilation of radiances in a variational framework. The operational implementation of such a substantial change in methodology involves a great number of technical details, e.g., pertaining to quality control procedures, systematic error correction techniques, and tuning of the statistical parameters in the analysis algorithm. Although there are clear theoretical advantages to the direct radiance assimilation approach, it is not obvious at all to what extent the improvements that have been obtained so far can be attributed to the change in methodology, or to various technical aspects of the implementation. The issue is of interest because retrieval assimilation retains many practical and logistical advantages which may become even more significant in the near future when increasingly high-volume data sources become available. The central question we address here is: how much improvement can we expect from assimilating radiances rather than retrievals, all other things being equal? We compare the two approaches in a simplified one-dimensional theoretical framework, in which problems related to quality control and systematic error correction are conveniently absent. By assuming a perfect radiative transfer model and perfect knowledge of radiance and background error covariances, we are able to formulate a nonlinear local error analysis for each assimilation method. Direct radiance assimilation is optimal in this idealized context, while the traditional method of assimilating retrievals is suboptimal because it ignores the cross-covariances between background errors and retrieval errors. We show that interactive retrieval assimilation (where the same background used for assimilation is also used in the retrieval step) is equivalent to direct assimilation of radiances with suboptimal analysis weights. We illustrate and extend these theoretical arguments with several one-dimensional assimilation experiments, where we estimate vertical atmospheric profiles using simulated data from both the High-resolution InfraRed Sounder 2 (HIRS2) and the future Atmospheric InfraRed Sounder (AIRS).

Joiner, J.↗
NASA NTRS2017

GEOS S2S-2_1: GMAO's New High Resolution Seasonal Prediction System

A new version of the modeling and analysis system used to produce sub-seasonal to seasonal forecasts has just been released by the NASA Goddard Global Modeling and Assimilation Office. The new version runs at higher atmospheric resolution (approximately 12 degree globally), contains a substantially improved model description of the cryosphere, and includes additional interactive earth system model components (aerosol model). In addition, the Ocean data assimilation system has been replaced with a Local Ensemble Transform Kalman Filter. Here will describe the new system, along with the plans for the future (GEOS S2S-3_0) which will include a higher resolution ocean model and more interactive earth system model components (interactive vegetation, biomass burning from fires). We will also present results from a free-running coupled simulation with the new system and results from a series of retrospective seasonal forecasts. Results from retrospective forecasts show significant improvements in surface temperatures over much of the northern hemisphere and a much improved prediction of sea ice extent in both hemispheres. The precipitation forecast skill is comparable to previous S2S systems, and the only trade off is an increased double ITCZ, which is expected as we go to higher atmospheric resolution.

Molod, Andrea↗
NASA NTRS2001

Prediction of Coronal Mass Ejections From Vector Magnetograms: Quantitative Measures as Predictors

We derived two quantitative measures of an active region's global nonpotentiality from the region's vector magnetogram, 1) the net current (I(sub N)), and 2) the length of strong-shear, strong-field main neutral line (Lss), and used these two measures in a pilot study of the CME productivity of 4 active regions. We compared the global nonpotentiality measures to the active regions' CME productivity determined from GOES and Yohkoh/SXT observations. We found that two of the active regions were highly globally nonpotential and were CME productive, while the other two active regions had little global nonpotentiality and produced no CMEs. At the Fall 2000 AGU, we reported on an expanded study (12 active regions and 17 magnetograms) in which we evaluated four quantitative global measures of an active region's magnetic field and compared these measures with the CME productivity. The four global measures (all derived from MSFC vector magnetograms) included our two previous measures (I(sub N) and L(sub ss)) as well as two new ones, the total magnetic flux (PHI) (a measure of an active region's size), and the normalized twist (alpha (bar)= muIN/PHI). We found that the three quantitative measures of global nonpotentiality (I(sub N), L(sub ss), alpha (bar)) were all well correlated (greater than 99% confidence level) with an active region's CME productivity within plus or minus 2 days of the day of the magnetogram. We will now report on our findings of how good our quantitative measures are as predictors of active-region CME productivity, using only CMEs that occurred after the magnetogram. We report the preliminary skill test of these quantitative measures as predictors. We compare the CME prediction success of our quantitative measures to the CME prediction success based on an active region's past CME productivity. We examine the cases of the handful of false positive and false negatives to look for improvements to our predictors. This work is funded by NSF through the Space Weather Program and by NASA through the Solar Physics Supporting Research and Technology Program.

Falconer, D. A.↗
NASA NTRS1981

Weather and climate

Highlights of recent progress and the directions of future advances in the application of space observations to weather and climate are reviewed. In mesometeorology and severe storms, satellite stereography of cloud topography and temperature profiling from GOES-VAS promise dramatic developments in both nowcasting and prediction. In global weather, the initial results from the year long Global Weather Experiment conclusively demonstrate the enhanced forecast skill emanating from the use of satellite data, especially cloud track winds and temperature profiles. In climate, empirical studies and numerical experiments point to the feasibility of useful climate predictions on monthly and seasonal time scales. They also indicate the kinds of surface boundary conditions to which climate is sensitive and which need to be observed from space.

Atlas, D.↗
NASA NTRS2011

Teleconnection, Regime Shift, and Predictability of Climate Extremes: A Case Study for the Russian Heat Wave and Pakistan Flood in Summer 2010

In this talk, we present observational evidence showing that the two major extremes events of the summer of 2010, i.e., the Russian heat wave and the Pakistan flood were physically connected. We find that the Pakistan flood was contributed by a series of unusually heavy rain events over the upper Indus River Basin in July-August. The rainfall regimes shifted from an episodic heavy rain regime in mid-to-late July to a steady heavy rain regime in August. An atmospheric Rossby wave associated with the development of the Russian heat wave was instrumental in spurring the episodic rain events , drawing moisture from the Bay of Bengal and the northern Arabian Sea. The steady rain regime was maintained primarily by monsoon moisture surges from the deep tropics. From experiments with the GEOS-5 forecast system, we assess the predictability of the heavy rain events associated with the Pakistan flood. Preliminary results indicate that there are significantly higher skills in the rainfall forecasts during the episodic heavy rain events in July, compared to the steady rain period in early to mid-August. The change in rainfall predictability may be related to scale interactions between the extratropics and the tropics resulting in a modulation of rainfall predictability by the circulation regimes.

Lau, W. K.↗
NASA NTRS2015

Sea Ice Outlook for September 2015 June Report - NASA Global Modeling and Assimilation Office

The recent decline in perennial sea ice cover in Arctic Ocean is a topic of enormous scientific interest and has relevance to a broad variety of scientific disciplines and human endeavors including biological and physical oceanography, atmospheric circulation, high latitude ecology, the sustainability of indigenous communities, commerce, and resource exploration. A credible seasonal prediction of sea ice extent would be of substantial use to many of the stakeholders in these fields and may also reveal details on the physical processes that result in the current trends in the ice cover. Forecasts are challenging due in part to limitations in the polar observing network, the large variability in the climate system, and an incomplete knowledge of the significant processes. Nevertheless it is a useful to understand the current capabilities of high latitude seasonal forecasting and identify areas where such forecasts may be improved. Since 2008 the Arctic Research Consortium of the United States (ARCUS) has conducted a seasonal forecasting contest in which the average Arctic sea ice extent for the month of September (the month of the annual extent minimum) is predicted from available forecasts in early June, July, and August. The competition is known as the Sea Ice Outlook (SIO) but recently came under the auspices of the Sea Ice Prediction Network (SIPN), and multi-agency funded project to evaluate the SIO. The forecasts are submitted based on modeling, statistical, and heuristic methods. Forecasts of Arctic sea ice extent from the GMAO are derived from seasonal prediction system of the NASA Goddard Earth Observing System model, version 5 (GEOS 5) coupled atmosphere and ocean general circulation model (AOGCM). The projections are made in order to understand the relative skill of the forecasting system and to determine the effects of future improvements to the system. This years prediction is for a September average Arctic ice extent of 5.030.41 million km2.

SIPN↗
NASA NTRS2014

Seasonal Drought Prediction in East Africa: Can National Multi-Model Ensemble Forecasts Help?

The increasing food and water demands of East Africa's growing population are stressing the region's inconsistent water resources and rain-fed agriculture. As recently as in 2011 part of this region underwent one of the worst famine events in its history. Timely and skillful drought forecasts at seasonal scale for this region can inform better water and agro-pastoral management decisions, support optimal allocation of the region's water resources, and mitigate socio-economic losses incurred by droughts. However seasonal drought prediction in this region faces several challenges. Lack of skillful seasonal rainfall forecasts; the focus of this presentation, is one of those major challenges. In the past few decades, major strides have been taken towards improvement of seasonal scale dynamical climate forecasts. The National Centers for Environmental Prediction's (NCEP) National Multi-model Ensemble (NMME) is one such state-of-the-art dynamical climate forecast system. The NMME incorporates climate forecasts from 6+ fully coupled dynamical models resulting in 100+ ensemble member forecasts. Recent studies have indicated that in general NMME offers improvement over forecasts from any single model. However thus far the skill of NMME for forecasting rainfall in a vulnerable region like the East Africa has been unexplored. In this presentation we report findings of a comprehensive analysis that examines the strength and weakness of NMME in forecasting rainfall at seasonal scale in East Africa for all three of the prominent seasons for the region. (i.e. March-April-May, July-August-September and October-November- December). Simultaneously we also describe hybrid approaches; that combine statistical approaches with NMME forecasts; to improve rainfall forecast skill in the region when raw NMME forecasts lack in skill.

Shukla, Shraddhanand↗
NASA NTRS2015

Seasonal Drought Prediction in East Africa: Can National Multi-Model Ensemble Forecasts Help?

The increasing food and water demands of East Africa's growing population are stressing the region's inconsistent water resources and rain-fed agriculture. As recently as in 2011 part of this region underwent one of the worst famine events in its history. Timely and skillful drought forecasts at seasonal scale for this region can inform better water and agro-pastoral management decisions, support optimal allocation of the region's water resources, and mitigate socio-economic losses incurred by droughts. However seasonal drought prediction in this region faces several challenges. Lack of skillful seasonal rainfall forecasts; the focus of this presentation, is one of those major challenges. In the past few decades, major strides have been taken towards improvement of seasonal scale dynamical climate forecasts. The National Centers for Environmental Prediction's (NCEP) National Multi-model Ensemble (NMME) is one such state-of-the-art dynamical climate forecast system. The NMME incorporates climate forecasts from 6+ fully coupled dynamical models resulting in 100+ ensemble member forecasts. Recent studies have indicated that in general NMME offers improvement over forecasts from any single model. However thus far the skill of NMME for forecasting rainfall in a vulnerable region like the East Africa has been unexplored. In this presentation we report findings of a comprehensive analysis that examines the strength and weakness of NMME in forecasting rainfall at seasonal scale in East Africa for all three of the prominent seasons for the region. (i.e. March-April-May, July-August-September and October-November- December). Simultaneously we also describe hybrid approaches; that combine statistical approaches with NMME forecasts; to improve rainfall forecast skill in the region when raw NMME forecasts lack in skill.

Shukla, Shraddhanand↗
DOE OSTI2025

Combining Observations and Models: A Review of the CARDAMOM Framework for Data‐Constrained Terrestrial Ecosystem Modeling

The rapid increase in the volume and variety of terrestrial biosphere observations (i.e., remote sensing data and in situ measurements) offers a unique opportunity to derive ecological insights, refine process‐based models, and improve forecasting for decision support. However, despite their potential, ecological observations have primarily been used to benchmark process‐based models, as many past and current models lack the capability to directly integrate observations and their associated uncertainties for parameterization. In contrast, data assimilation frameworks such as the CARbon DAta MOdel fraMework (CARDAMOM) and its suite of process‐based models, known as the Data Assimilation Linked Ecosystem Carbon Model (DALEC), are specifically designed for model‐data fusion. This review, motivated by a recent CARDAMOM community workshop, examines the development and applications of CARDAMOM, with an emphasis on its role in advancing ecosystem process understanding. CARDAMOM employs a Bayesian approach, using a Markov Chain Monte Carlo algorithm to enable data‐driven calibration of DALEC parameters and initial states (i.e., carbon pool sizes) through observation operators. CARDAMOM's unique ability to retrieve localized model process parameters from diverse datasets—ranging from in situ measurements to global satellite observations—makes it a highly flexible tool for analyzing spatially variable ecosystem responses to environmental change. However, assimilating these data also presents challenges, including data quality issues that propagate into model skill, as well as trade‐offs between model complexity, parameter equifinality, and predictive performance. We discuss potential solutions to these challenges, such as reducing parameter equifinality by incorporating new observations. This review also offers community recommendations for incorporating emerging datasets, integrating machine learning techniques, strengthening collaboration with remote sensing, field, and modeling communities, and expanding CARDAMOM's relevance for localized ecosystem monitoring and decision‐making. CARDAMOM enables a deep, mechanistic understanding of terrestrial ecosystem dynamics that cannot be achieved through empirical analyses of observational datasets or weakly constrained models alone.

Bayesian inference↗
DOE OSTI2022

Exploratory Precipitation Metrics: Spatiotemporal Characteristics, Process-Oriented, and Phenomena-Based

Abstract Precipitation sustains life and supports human activities, making its prediction one of the most societally relevant challenges in weather and climate modeling. Limitations in modeling precipitation underscore the need for diagnostics and metrics to evaluate precipitation in simulations and predictions. While routine use of basic metrics is important for documenting model skill, more sophisticated diagnostics and metrics aimed at connecting model biases to their sources and revealing precipitation characteristics relevant to how model precipitation is used are critical for improving models and their uses. This paper illustrates examples of exploratory diagnostics and metrics including 1) spatiotemporal characteristics metrics such as diurnal variability, probability of extremes, duration of dry spells, spectral characteristics, and spatiotemporal coherence of precipitation; 2) process-oriented metrics based on the rainfall–moisture coupling and temperature–water vapor environments of precipitation; and 3) phenomena-based metrics focusing on precipitation associated with weather phenomena including low pressure systems, mesoscale convective systems, frontal systems, and atmospheric rivers. Together, these diagnostics and metrics delineate the multifaceted and multiscale nature of precipitation, its relations with the environments, and its generation mechanisms. The metrics are applied to historical simulations from phases 5 and 6 of the Coupled Model Intercomparison Project. Models exhibit diverse skill as measured by the suite of metrics, with very few models consistently ranked as top or bottom performers compared to other models in multiple metrics. Analysis of model skill across metrics and models suggests possible relationships among subsets of metrics, motivating the need for more systematic analysis to understand model biases for informing model development.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1988

Lagged average predictions in a predictability experiment

Lagged average predictions are examined here within the context of an idealized predictability experiment. Lagged predictions contribute to making better forecasts than the forecasts obtained from using only the latest initial state. Analytic models suggest that lagged predictions contribute the greatest amount when the error growth rates are small. Little dependence upon the magnitude of the intial error is found if the growth rates remain constant. It is also shown how lagged average forecasts can be used to predict the error. Discriminating forecasts made only when the error is predicted to be small are shown to have much better than average skill.

Roads, John O.↗
NASA NTRS2015

Simultaneous Radar and Satellite Data Storm-Scale Assimilation Using an Ensemble Kalman Filter Approach for 24 May 2011

Assimilating high-resolution radar reflectivity and radial velocity into convection-permitting numerical weather prediction models has proven to be an important tool for improving forecast skill of convection. The use of satellite data for the application is much less well understood, only recently receiving significant attention. Since both radar and satellite data provide independent information, combing these two sources of data in a robust manner potentially represents the future of high-resolution data assimilation. This research combines Geostationary Operational Environmental Satellite 13 (GOES-13) cloud water path (CWP) retrievals with Weather Surveillance Radar-1988 Doppler (WSR-88D) reflectivity and radial velocity to examine the impacts of assimilating each for a severe weather event occurring in Oklahoma on 24 May 2011. Data are assimilated into a 3-km model using an ensemble adjustment Kalman filter approach with 36 members over a 2-h assimilation window between 1800 and 2000 UTC. Forecasts are then generated for 90 min at 5-min intervals starting at 1930 and 2000 UTC. Results show that both satellite and radar data are able to initiate convection, but that assimilating both spins up a storm much faster. Assimilating CWP also performs well at suppressing spurious precipitation and cloud cover in the model as well as capturing the anvil characteristics of developed storms. Radar data are most effective at resolving the 3D characteristics of the core convection. Assimilating both satellite and radar data generally resulted in the best model analysis and most skillful forecast for this event.

Jones, Thomas A.↗
NASA NTRS2024

Investigating the Strength and Variability of El Niño Southern Oscillation Teleconnections to Hydroclimate and Maize Yields in Southern and East Africa

The state of the El Niño Southern Oscillation (ENSO) is critical for seasonal climate forecasts, but recent events diverged substantially from expectations in many regions, including Sub-Saharan Africa where seasonal forecasts are critical tools for addressing food security. Here, we evaluate 39 years (1982–2020) of data on hydroclimate, leaf area index, and maize yields to investigate the strength of ENSO teleconnections in southern and East Africa. Teleconnections to precipitation, soil moisture, and leaf area index are generally stronger during ENSO phases that cause drought conditions (El Niño in southern Africa and La Niña in East Africa), with seasonality that aligns well with the maize growing seasons. Within maize growing areas, however, ENSO teleconnections to hydroclimate and vegetation are generally weaker compared to the broader geographic regions, especially in East Africa. There is also little evidence that the magnitude of the ENSO event affects the hydroclimate or vegetation response in these maize regions. Maize yields in Kenya, Malawi, South Africa, and Zimbabwe all correlate significantly with hydroclimate and leaf area index, with South Africa and Zimbabwe showing the strongest and most consistent yield responses to ENSO events. Our results highlight the chain of causality from El Niño and La Niña forcing of regional anomalies in hydroclimate to vegetation health and maize yields in southern and East Africa. The large spread across individual ENSO events, however, underscores the limitations of this climate mode for seasonal climate prediction in the region, and the importance of finding additional sources of skill for improving climate and yield forecasts.

El Niño Southern Oscillation↗
DOE OSTI2024

Seasonal variability and predictability of monsoon precipitation in Southern Africa

Rainfed agriculture is the mainstay of economies across Southern Africa (SA), where most precipitation is received during the austral summer monsoon. This study aims to further our understanding of monsoon precipitation predictability over SA. We use three natural climate forcings, El Niño–Southern Oscillation, Indian Ocean Dipole (IOD), and the Indian Ocean Precipitation Dipole (IOPD)—the dominant precipitation variability mode—to construct an empirical model that exhibits significant skill over SA during monsoon in explaining precipitation variability and in forecasting it with a five-month lead. While most explained precipitation variance (50%–75%) comes from contemporaneous IOD and IOPD, preconditioning all three forcings is key in predicting monsoon precipitation with a zero to five-month lead. Seasonal forecasting systems accurately represent the interplay of the three forcings but show varying skills in representing their teleconnection over SA. This makes them less effective at predicting monsoon precipitation than the empirical model.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2017

Skillful Spring Forecasts of September Arctic Sea Ice Extent Using Passive Microwave Data

In this study, we demonstrate skillful spring forecasts of detrended September Arctic sea ice extent using passive microwave observations of sea ice concentration (SIC) and melt onset (MO). We compare these to forecasts produced using data from a sophisticated melt pond model, and find similar to higher skill values, where the forecast skill is calculated relative to linear trend persistence. The MO forecasts shows the highest skill in March-May, while the SIC forecasts produce the highest skill in June-August, especially when the forecasts are evaluated over recent years (since 2008). The high MO forecast skill in early spring appears to be driven primarily by the presence and timing of open water anomalies, while the high SIC forecast skill appears to be driven by both open water and surface melt processes. Spatial maps of detrended anomalies highlight the drivers of the different forecasts, and enable us to understand regions of predictive importance. Correctly capturing sea ice state anomalies, along with changes in open water coverage appear to be key processes in skillfully forecasting summer Arctic sea ice.

melt onset↗
NASA NTRS2002

Predictability Associated with Land Surface Moisture States: Studies with the NSIPP System

Hydrologists have long speculated that soil moisture information can be used to increase skill in monthly to seasonal forecast systems. For this to be true, though, three conditions must be satisfied: (1) an imposed initial soil moisture anomaly in the forecast system must have some memory, so that it persists into the forecast period; (2) the modeled atmosphere must respond in a predictable way to the persisted anomaly; and (3) the forecast model must correctly represent both the soil moisture memory and the atmospheric response as they occur in nature. In this short paper, we review some recent work at NSIPP (NASA Seasonal-to-Interannual Prediction Project) that addresses all three conditions.

Koster, R. D.↗