Search NASA⌕ Search

SEARCH · Search NASA

Results for “Prediction skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Improved Predictability of the Indian Ocean Dipole Using a Stochastic Dynamical Model Compared to the North American Multimodel Ensemble Forecast

This study assesses the predictive skill of eight North American Multimodel Ensemble (NMME) models in predicting the Indian Ocean dipole (IOD). We find that the forecasted ensemble-mean IOD–El Niño–Southern Oscillation (ENSO) relationship deteriorates away from the observed relationship with increasing lead time, which might be one reason that limits the IOD predictive skill in coupled models. We are able to improve the IOD predictive skill using a recently developed stochastic dynamical model (SDM) forced by forecasted ENSO conditions. The results are consistent with the previous result that operational IOD predictability beyond persistence at lead times beyond one season is mostly controlled by ENSO predictability and the signal-to-noise ratio of the Indo-Pacific climate system. The multimodel ensemble (MME) investigated here is found to be of superior skill compared to each individual model at most lead times. Importantly, the skill of the SDM IOD predictions forced with forecasted ENSO conditions were either similar or better than those of the MME IOD forecasts. Moreover, the SDM forced with observed ENSO conditions exhibits significantly higher IOD prediction skill than the MME at longer lead times, suggesting the large potential skill increase that could be achieved by improving operational ENSO forecasts. We find that both cold and warm biases of the predicted Niño-3.4 index may cause false alarms of negative and positive IOD events, respectively, in NMME models. Many false alarms for IOD forecasts at lead times longer than one season in the original forecasts disappear or are significantly reduced in the SDM forced by forecasted ENSO conditions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Evaluating skill in predicting the Interdecadal Pacific Oscillation in initialized decadal climate prediction hindcasts in E3SMv1 and CESM1 using two different initialization methods and a small set of start years

Abstract It is a daunting challenge to conduct initialized hindcasts with enough ensemble members and associated start years to form a drifted climatology from which to compute the anomalies necessary to quantify the skill of the hindcasts when compared to observations. This limits the ability to experiment with case studies and other applications where only a few initial years are needed. Here we run a set of hindcasts with CESM1 and E3SMv1 using two different initialization methods for a limited set of start years and use the respective uninitialized free-running historical simulations to form the model climatologies. Since the drifts from the observed initial states in the hindcasts toward the uninitialized model state are large and rapid, after a few years the drifted initialized models approach the uninitialized model climatological errors. Therefore, hindcasts from the limited start years can use the uninitialized climatology to represent the drifted model states after about lead year 3, providing a means to compute forecast anomalies in the absence of a large hindcast sample. There is comparable skill for predicting spatial patterns of multi-year Pacific sea surface temperature anomalies in the domain of the Interdecadal Pacific Oscillation using this method compared to the conventional methodology with a large hindcast data set, though there is a model dependence to the drifts in the two initialization methods.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

CMIP6 skill at predicting interannual to multi-decadal summer monsoon precipitation variability

Monsoons affect the economy, agriculture, and human health of two thirds of the world’s population. Therefore, predicting variations in monsoon precipitation is societally important. We explore the ability of climate models from the sixth phase of the Climate Model Intercomparison Project to predict summer monsoon precipitation variability by using hindcasts from the Decadal Climate Prediction Project (Component A). The multi-model ensemble-mean shows significant skill at predicting summer monsoon precipitation from one year to 6–9 years ahead. However, this skill is dependent on the model, monsoon domain, and lead-time. In general, the skill of the multi-model ensemble-mean prediction is low in year 1 but increases for longer-lead times and is largely consistent with externally forced changes. The best captured region is northern Africa for the 2–5 and 6–9 year forecast lead times. In contrast, there is no significant skill using the ensemble-mean over East and South Asia and, furthermore, there is significant spread in skill among models for these domains. By sub-sampling the ensemble we show that the difference in skill between models is tied to the simulation of the externally forced response over East and South Asia, with models with a more skilful forced response capable of better predictions. A further contribution is from skilful prediction of Pacific Ocean temperatures for the South Asian summer monsoon at longer lead-times. Therefore, these results indicate that predictions of the East and South Asian monsoons could be significantly improved.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

Extreme Precipitation in the Southern US Great Plains in the Spring of 2015: Mechanisms and Prediction

During May of 2015, the southern US Great Plains and adjacent Gulf Coast region experienced more than twice the long-term mean precipitation, making it the wettest May since 1895. We investigate the physical mechanisms associated with this event using a suite of large-ensemble regional replay AGCM simulations from the NASA-GEOS model. In these simulations, certain regions of the globe are constrained to closely follow observations while the remainder of the domain is free running, allowing for the isolation of the remote regions that were important for the event. Preliminary analysis provides evidence that the extreme southern US precipitation was linked in part to positive precipitation anomalies in the central and eastern tropical Pacific via a wave train, which ultimately caused anomalous moisture flux from the Gulf of Mexico. An analysis of Subseasonal Experiment (SubX) model output was conducted to explore the subseasonal prediction skill of the event. Several models are able the predict the presence of positive precipitation anomalies in or near the southern US at lead times exceeding 10 days, albeit with errors in the locations and magnitude of the heaviest precipitation anomalies. A more thorough investigation with version 2 of NASA’s GEOS-S2S model shows that the prediction skill stems from the model’s ability to reasonably predict the positive tropical Pacific precipitation anomalies and the initiation of the Rossby wave train that is believed to be linked to the event. The potential causes for limitations in the prediction skill of this event will be explored.

Great Plains↗
DOE OSTI2022

Subseasonal Earth System Prediction with CESM2

Abstract Prediction systems to enable Earth system predictability research on the subseasonal time scale have been developed with the Community Earth System Model, version 2 (CESM2) using two configurations that differ in their atmospheric components. One system uses the Community Atmosphere Model, version 6 (CAM6) with its top near 40 km, referred to as CESM2(CAM6). The other employs the Whole Atmosphere Community Climate Model, version 6 (WACCM6) whose top extends to ∼140 km, and it includes fully interactive tropospheric and stratospheric chemistry [CESM2(WACCM6)]. Both systems are utilized to carry out subseasonal reforecasts for the 1999–2020 period following the Subseasonal Experiment’s (SubX) protocol. Subseasonal prediction skill from both systems is compared to those of the National Oceanic and Atmospheric Administration CFSv2 and European Centre for Medium-Range Weather Forecasts (ECMWF) operational models. CESM2(CAM6) and CESM2(WACCM6) show very similar subseasonal prediction skill of 2-m temperature, precipitation, the Madden–Julian oscillation, and North Atlantic Oscillation to its previous version and to the NOAA CFSv2 model. Overall, skill of CESM2(CAM6) and CESM2(WACCM6) is a little lower than that of the ECMWF system. In addition to typical output provided by subseasonal prediction systems, CESM2 reforecasts provide comprehensive datasets for predictability research of multiple Earth system components, including three-dimensional output for many variables, and output specific to the mesosphere and lower-thermosphere (MLT) region from CESM2(WACCM6). It is shown that sudden stratosphere warming events, and the associated variability in the MLT, can be predicted ∼10 days in advance. Weekly real-time forecasts and reforecasts with CESM2(CAM6) and CESM2(WACCM6) are freely available. Significance Statement We describe here the design and prediction skill of two subseasonal prediction systems based on two configurations of the Community Earth System Model, version 2 (CESM2): CESM2 with the Community Atmosphere Model, version 6 [CESM2(CAM6)] and CESM 2 with Whole Atmosphere Community Climate Model, version 6 [CESM2(WACCM6)] as its atmospheric component. These two systems provide a foundation for community-model based subseasonal prediction research. The CESM2(WACCM6) system provides a novel capability to explore the predictability of the stratosphere, mesosphere, and lower thermosphere. Both CESM2(CAM6) and CESM2(WACCM6) demonstrate subseasonal surface prediction skill comparable to that of the NOAA CFSv2 model, and a little lower than that of the ECMWF forecasting system. CESM2 reforecasts provide a comprehensive dataset for predictability research of multiple aspects of the Earth system, including the whole atmosphere up to 140 km, land, and sea ice. Weekly real-time forecasts, reforecasts, and models are publicly available.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

A Bayesian Deep Learning Approach to Near-Term Climate Prediction

Since model bias and associated initialization shock are serious shortcomings that reduce prediction skills in state-of-the-art decadal climate prediction efforts, we pursue a complementary machine-learning-based approach to climate prediction. The example problem setting we consider consists of predicting natural variability of the North Atlantic sea surface temperature on the interannual timescale in the pre-industrial control simulation of the Community Earth System Model. While previous works have considered the use of recurrent networks such as convolutional LSTMs and reservoir computing networks in this and other similar problem settings, we currently focus on the use of feedforward convolutional networks. In particular, we find that a feedforward convolutional network with a Densenet architecture is able to outperform a convolutional LSTM in terms of predictive skill. Next, we go on to consider a probabilistic formulation of the same network based on Stein variational gradient descent and find that in addition to providing useful measures of predictive uncertainty, the probabilistic (Bayesian) version improves on its deterministic counterpart in terms of predictive skill. Finally, we characterize the reliability of the ensemble of machine learning models obtained in the probabilistic setting by using analysis tools developed in the context of ensemble numerical weather prediction.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Predictability of the early summer surface air temperature over Western South Asia

Variability of the Surface Air Temperature (SAT) over the Western South Asia (WSA) region leads to frequent heatwaves during the early summer (May-June) season. The present study uses the European Centre for Medium-Range Weather Forecast’s fifth-generation seasonal prediction system, SEAS5, from 1981 to 2022 based on April initial conditions (1-month lead) to assess the SAT predictability during early summer season. The goal is to evaluate the SEAS5’s ability to predict the El Niño-Southern Oscillation (ENSO) related interannual variability and predictability of the SAT over WSA, which is mediated through upper-level (200-hPa) geopotential height anomalies. This teleconnection leads to anomalously warm surface conditions over the region during the negative ENSO phase, as observed in the reanalysis and SEAS5. We evaluate SEAS5 prediction skill against two observations and three reanalyses datasets. The SEAS5 SAT prediction skill is higher with high spatial resolution observations and reanalysis datasets compared to the ones with low-resolution. Overall, SEAS5 shows reasonable skill in predicting SAT and its variability over the WSA region. Moreover, the predictability of SAT during La Niña is comparable to El Niño years over the WSA region.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1990

On the level of skill in predicting maximum sunspot number - A comparative study of single variate and bivariate precursor techniques

The level of skill in predicting the size of the sunspot cycle is investigated for the two types of precursor techniques, single variate and bivariate fits, both applied to cycle 22. The present level of growth in solar activity is compared to the mean level of growth (cycles 10-21) and to the predictions based on the precursor techniques. It is shown that, for cycle 22, both single variate methods (based on geomagnetic data) and bivariate methods suggest a maximum amplitude smaller than that observed for cycle 19, and possibly for cycle 21. Compared to the mean cycle, cycle 22 is presently behaving as if it were a +2.6 sigma cycle (maximum amplitude of about 225), which means that either it will be the first cycle not to be reliably predicted by the combined precursor techniques or its deviation relative to the mean cycle will substantially decrease over the next 18 months.

Wilson, Robert M.↗
DOE OSTI2020

Mesoscale to Microscale Simulations over Complex Terrain with the Immersed Boundary Method in the Weather Research and Forecasting Model

Improvements to the Weather Research and Forecasting (WRF) Model are made to enable multiscale simulations over highly complex terrain with dynamically downscaled boundary conditions from the mesoscale to the microscale. Over steep terrain, the WRF Model develops numerical errors that are due to grid deformation of the terrain-following coordinates. An alternative coordinate system, the immersed boundary method (IBM), has been implemented into WRF, allowing for simulations over highly complex terrain; however, the new coordinate system precluded nesting within mesoscale simulations using WRF’s native terrain-following coordinates. Here, the immersed boundary method and WRF’s grid-nesting framework are modified to seamlessly work together. This improved framework for the first time allows for large-eddy simulation over complex (urban) terrain with IBM to be nested within a typical mesoscale WRF simulation. Simulations of the Joint Urban 2003 field campaign in Oklahoma City, Oklahoma, are performed using a multiscale five-domain nested configuration, spanning horizontal grid resolutions from 6 km to 2 m. These are compared with microscale-only simulations with idealized lateral boundary conditions and with observations of wind speed/direction and SF 6 concentrations from a controlled release from intensive observation period 3. The multiscale simulation, which is configured independent of local observations, shows similar model skill predicting wind speed/direction and improved skill predicting SF 6 concentrations when compared with the idealized simulations, which require use of observations to set mean flow conditions. Use of this improved multiscale framework shows promise for enabling large-eddy simulation over highly complex terrain with dynamically downscaled boundary conditions from mesoscale models.

42 ENGINEERING↗
NASA NTRS2020

Monthly Difference in the Boreal Winter El Niño Precipitation Response over North America: Insights into Why January Is More Difficult to Predict than February

This study explores the monthly difference in the prediction skill of the ENSO response in boreal winter over North America reported in earlier studies. This monthly difference in the prediction skill is also revealed in atmosphere-ocean coupled and uncoupled NASA GEOS-5 model. Observational features of the ENSO response each month are analyzed using Modern-Era Retrospective analysis for Research and Applications version 2 (MERRA-2) data.The results show that the prediction skill of the temperature and precipitation anomalies associated with the ENSO response over the western North America tends to be greater in February whereas lower in January. Coupled and uncoupled models both put negative geopotential height anomaly over the northeast Pacific to the west of observation in January, causing that the precipitation anomalies to be off the coast instead of the coast. This discrepancy between observation and model is minimal in February. West coast precipitation anomalies are shown to be sensitive to the location of this anomalous height anomaly, but the precipitation response all the southern tier of states appear less sensitive to errors in the zonal wind response.

Lim, Young-Kwon↗
DOE OSTI2020

Subseasonal prediction with and without a well-represented stratosphere in CESM1

There is a growing demand for understanding sources of predictability on subseasonal to seasonal (S2S) time scales. Predictability at subseasonal time scales is believed to come from processes varying slower than the atmosphere such as soil moisture, snowpack, sea ice, and ocean heat content. The stratosphere as well as tropospheric modes of variability can also provide predictability at subseasonal time scales. Furthermore, the contributions of the above sources to S2S predictability are not well quantified. Here we evaluate the subseasonal prediction skill of the Community Earth System Model, version 1 (CESM1), in the default version of the model as well as a version with the improved representation of stratospheric variability to assess the role of an improved stratosphere on prediction skill. We demonstrate that the subseasonal skill of CESM1 for surface temperature and precipitation is comparable to that of operational models. We find that a better-resolved stratosphere improves stratospheric but not surface prediction skill for weeks 3–4.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2002

Prospects for Improved Forecasts of Weather and Short-Term Climate Variability on Subseasonal (2-Week to 2-Month) Times Scales

This workshop, held in April 2002, brought together various Earth Sciences experts to focus on the subseasonal prediction problem. While substantial advances have occurred over the last few decades in both weather and seasonal prediction, progress in improving predictions on these intermediate time scales (time scales ranging from about two weeks to two months) has been slow. The goals of the workshop were to get an assessment of the "state of the art" in predictive skill on these time scales, to determine the potential sources of "untapped" predictive skill, and to make recommendations for a course of action that will accelerate progress in this area. One of the key conclusions of the workshop was that there is compelling evidence for predictability at forecast lead times substantially longer than two weeks. Tropical diabatic heating and soil wetness were singled out as particularly important processes affecting predictability on these time scales. Predictability was also linked to various low-frequency atmospheric "phenomena" such as the annular modes in high latitudes (including their connections to the stratosphere), the Pacific/North American (PNA) pattern, and the Madden Julian Oscillation (MJO). The latter, in particular, was highlighted as a key source of untapped predictability in the tropics and subtropics, including the Asian and Australian monsoon regions.

Schubert, Siegfried↗
DOE OSTI2021

Reservoir Computing as a Tool for Climate Predictability Studies

Reduced-order dynamical models play a central role in developing our understanding of predictability of climate irrespective of whether we are dealing with the actual climate system or surrogate climate models. In this context, the linear inverse modeling (LIM) approach, by capturing a few essential interactions between dynamical components of the full system, has proven valuable in providing insights into predictability of the full system. We demonstrate that reservoir computing (RC), a form of learning suitable for systems with chaotic dynamics, provides an alternative nonlinear approach that improves on the predictive skill of the LIM approach. We do this in the example setting of predicting sea surface temperature in the North Atlantic in the preindustrial control simulation of a popular earth system model, the Community Earth System Model so that we can compare the performance of the new RC-based approach with the traditional LIM approach both when learning data are plentiful and when such data are more limited. The improved predictive skill of the RC approach over a wide range of conditions—larger number of retained EOF coefficients, extending well into the limited data regime, etc.—suggests that this machine-learning technique may have a use in climate predictability studies. While the possibility of developing a climate emulator—the ability to continue the evolution of the system on the attractor long after failing to be able to track the reference trajectory—is demonstrated in the Lorenz-63 system, it is suggested that further development of the RC approach may permit such uses of the new approach in more realistic predictability studies.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2000

An Assessment of the Predictability of Northern Winter Seasonal Means with the NSIPP 1 AGCM

This atlas assesses the predictability of January-February-March (JFM) means using version 1 of the NASA Seasonal-to-Interannual Prediction Project Atmospheric General Circulation Model (the NSIPP 1 AGCM). The AGCM is part of the NSIPP coupled atmosphere-land-ocean model. For these results, the atmosphere was run uncoupled from the ocean, but coupled with an interactive land model. The results are based on 20 ensembles of nine JFM hindcasts for the period 1980-1999, with sea surface temperature (SST) and sea ice specified from observations. The model integrations were started from initial atmospheric conditions (taken from NCEP/NCAR reanalyses) centered on December 15. The analysis focuses on 200 mb height, precipitation, surface temperature, and sea-level pressure. The results address issues of both predictability and forecast skill. Various signal-to-noise measures are computed to demonstrate the potential for skillful prediction on seasonal time scales under the assumption of a perfect model and perfectly known oceanic boundary forcings. The results show that the model produces a realistic ENSO response in both the tropics and extratropics.

Suarez, Max J.↗
NASA NTRS2002

The GEOS Retrospective Data Assimilation System: The 6-hour lag case

The fixed-lag Kalman smoother (FLKS) has been proposed as a framework to construct data assimilation procedures capable of producing high-quality climate research datasets. Fixed-lag Kalman smoother-based systems, referred to as retrospective data assimilation systems, are an extension to three-dimensional filtering procedures with the added capability of incorporating observations not only in the past and present time of the estimate, but also at future times. A variety of simplifications are necessary to render retrospective assimilation procedures practical. In this article, we present an FLKS-based retrospective data assimilation system implementation for the Goddard Earth Observing System (GOES) Data Assimilation System (DAS). The practicality of this implementation comes from the practicality of its underlying (filter) analysis system, i.e., the physical-space statistical analysis system (PSAS). The behavior of two schemes is studied here. The first retrospective analysis (RA) scheme is designed simply to update the regular PSAS analyses with observations available at times ahead of the regular analysis times. Although our GEOS DAS implementation is general, results are only presented for when observations 6-hours ahead of the analysis time are used to update the PSAS analyses and thereby to calculate the so-called lag-1 retrospective analyses. Consistency tests for this RA scheme show that the lag-1 retrospective analyses indeed have better 6-hour predictive skills than the predictions from the regular analyses. This motivates the introduction of the second retrospective analysis scheme which, at each analysis time, uses the 6-hour retrospective analysis to replace the first-guess normally used in the PSAS analysis, and therefore allows the calculation of a revised (filter) PSAS analysis. Since in this scheme the lag-1 retrospective analyses influence the filter results, this procedure is referred to as the retrospective-based iterative analysis (RIA) scheme. Results from the RIA scheme indicate its potential for improving the overall quality of the assimilation.

Zhu, Yan-Qiu↗
NASA NTRS2015

Revisiting the Potential of Melt Pond Fraction as a Predictor for the Seasonal Arctic Sea Ice Extent Minimum

The rapid change in Arctic sea ice in recent decades has led to a rising demand for seasonal sea ice prediction. A recent modeling study that employed a prognostic melt pond model in a stand-alone sea ice model found that September Arctic sea ice extent can be accurately predicted from the melt pond fraction in May. Here we show that satellite observations show no evidence of predictive skill in May. However, we find that a significantly strong relationship (high predictability) first emerges as the melt pond fraction is integrated from early May to late June, with a persistent strong relationship only occurring after late July. Our results highlight that late spring to mid summer melt pond information is required to improve the prediction skill of the seasonal sea ice minimum. Furthermore, satellite observations indicate a much higher percentage of melt pond formation in May than does the aforementioned model simulation, which points to the need to reconcile model simulations and observations, in order to better understand key mechanisms of melt pond formation and evolution and their influence on sea ice state.

sea ice↗
DOE OSTI2023

Assessing decadal variability of subseasonal forecasts of opportunity using explainable AI

Abstract Identifying predictable states of the climate system allows for enhanced prediction skill on the generally low-skill subseasonal timescale via forecasts with higher confidence and accuracy, known as forecasts of opportunity. This study takes a neural network approach to explore decadal variability of subseasonal predictability, particularly during forecasts of opportunity. Specifically, this work quantifies subseasonal prediction skill provided by the tropics within the Community Earth System Model Version 2 (CESM2) Large Ensemble and assesses how this skill evolves on decadal timescales. Utilizing the networks’ confidence and explainable artificial intelligence, physically meaningful sources of predictability associated with periods of enhanced skill are identified. Using these networks, we find that tropically-driven subseasonal predictability varies on decadal timescales during forecasts of opportunity. Further, we investigate the drivers of the low frequency modulation of the tropical-extratropical teleconnection and discuss the implications. Analysis is extended to ECMWF Reanalysis v5 data, revealing that the relationships learned within the CESM2-Large Ensemble holds in modern reanalysis data. These results indicate that the neural networks are capable of identifying predictable decadal states of the climate system within CESM2 that are useful for making confident, accurate subseasonal precipitation predictions in the real world.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1985

Medium range forecasting: The experience of ECMWF

The results of five years of operational medium-range forecasts at ECMWF is discussed. It is shown that a considerable improvement in predictive skill has taken place, resulting in more accurate forecasts and an extension in time of useful predictive skill. For the Northern Hemisphere extratropics, the improvement in skill during the winter season is about three days for the 500-mb geopotential compared to the very first experiments in the early 1970s. Three are large geographical and temporal variations in the performance of the model, as well as large-scale errors of a systematic nature. Numerical experiments have indicated great sensitivity to the representation of orography and to tropical forcing.

Bengtsson, L.↗