Search NASA⌕ Search

SEARCH · Search NASA

Results for “Prediction skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Predictive Skill of Deep Learning Models Trained on Limited Sequence Data

In this report we investigate the utility of one-dimensional convolutional neural network (CNN) models in epidemiological forecasting. Deep learning models, especially variants of recurrent neural networks (RNNs) have been studied for influenza forecasting, and have achieved higher forecasting skill compared to conventional models such as ARIMA models. In this study, we adapt two neural networks that employ one-dimensional temporal convolutional layers as a primary building block temporal convolutional networks and simple neural attentive meta-learner for epidemiological forecasting and test them with influenza data from the US collected over 2010-2019. We find that epidemiological forecasting with CNNs is feasible, and their forecasting skill is comparable to, and at times, superior to, RNNs. Thus CNNs and RNNs bring the power of nonlinear transformations to purely data-driven epidemiological models, a capability that heretofore has been limited to more elaborate mechanistic/compartmental disease models.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

GEOS-5 Seasonal Forecast System: ENSO Prediction Skill and Bias

The GEOS-5 AOGCM known as S2S-1.0 has been in service from June 2012 through January 2018 (Borovikov et al. 2017). The atmospheric component of S2S-1.0 is Fortuna-2.5, the same that was used for the Modern-Era Retrospective Analysis for Research and Applications (MERRA), but with adjusted parameterization of moist processes and turbulence. The ocean component is the Modular Ocean Model version 4 (MOM4). The sea ice component is the Community Ice CodE, version 4 (CICE). The land surface model is a catchment-based hydrological model coupled to the multi-layer snow model. The AGCM uses a Cartesian grid with a 1 deg × 1.25 deg horizontal resolution and 72 hybrid vertical levels with the upper most level at 0.01 hPa. OGCM nominal resolution of the tripolar grid is 1/2 deg, with a meridional equatorial refinement to 1/4 deg. In the coupled model initialization, selected atmospheric variables are constrained with MERRA. The Goddard Earth Observing System integrated Ocean Data Assimilation System (GEOS-iODAS) is used for both ocean state and sea ice initialization. SST, T and S profiles and sea ice concentration were assimilated.

GEOS-↗

Tropical Cyclones in the GEOS-S2S-2 Subseasonal Forecasts

This paper analyzes the climatology, prediction skill, and predictability of tropical cyclones (TCs) in NASA’s Global Earth Observing System Subseasonal to Seasonal (GEOS-S2S) forecast system version 2. GEOS reasonably simulates the number and spatial distribution of TCs compared to observations except in the Atlantic where the model simulates too few TCs due to low genesis rates in the Caribbean Sea and Gulf of Mexico. The environmental conditions, diagnosed through a genesis potential index, do not clearly explain model biases in the genesis rates, especially in the Atlantic. At the storm-scale, GEOS reforecasts replicate several key aspects of the thermodynamic and dynamic structure of observed TCs, such as a warm core and the secondary circulation. The model, however, fails to simulate an off-center eyewall when evaluating vertical velocity, precipitation and moisture. The analysis of prediction skill of TC genesis and occurrence shows that GEOS has comparable skill to other global models in WMO S2S archive and that its skill could be further improved by increasing the ensemble size. After calibration, GEOS forecasts are skillful in the Western North Pacific and Southern Indian Ocean up to 20 days in advance. A model-based predictability analysis demonstrates the importance of the Madden-Julian Oscillation (MJO) as a source of predictability of TC occurrence beyond the 14 day lead-time. Forecasts initialized under strong MJO conditions show evidence of predictability beyond week 3. However, due to model biases in the forecast distribution there are notable gaps between MJO-related prediction skill and predictability which require further study.

Jorge L. Garcia-Franco↗

Prediction and Predictability of the Madden Julian Oscillation in the NASA GEOS-5 Seasonal-to-Subseasonal System

In this study, we examine the prediction skill and predictability of the Madden Julian Oscillation (MJO) in a recent version of the NASA GEOS-5 atmosphere-ocean coupled model run at at 1/2 degree horizontal resolution. The results are based on a suite of hindcasts produced as part of the NOAA SubX project, consisting of seven ensemble members initialized every 5 days for the period 1999-2015. The atmospheric initial conditions were taken from the Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2), and the ocean and the sea ice were taken from a GMAO ocean analysis. The land states were initialized from the MERRA-2 land output, which is based on observation-corrected precipitation fields. We investigated the MJO prediction skill in terms of the bivariate correlation coefficient for the real-time multivariate MJO (RMM) indices. The correlation coefficient stays at or above 0.5 out to forecast lead times of 26-36 days, with a pronounced increase in skill for forecasts initialized from phase 3, when the MJO convective anomaly is located in the central tropical Indian Ocean. A corresponding estimate of the upper limit of the predictability is calculated by considering a single ensemble member as the truth and verifying the ensemble mean of the remaining members against that. The predictability estimates fall between 35-37 days (taken as forecast lead when the correlation reaches 0.5) and are rather insensitive to the initial MJO phase. The model shows slightly higher skill when the initial conditions contain strong MJO events compared to weak events, although the difference in skill is evident only from lead 1 to 20. Similar to other models, the RMM-index-based skill arises mostly from the circulation components of the index. The skill of the convective component of the index drops to 0.5 by day 20 as opposed to day 30 for circulation fields. The propagation of the MJO anomalies over the Maritime Continent does not appear problematic in the GEOS-5 hindcasts implying that the Maritime Continent predictability barrier may not be a major concern in this model. Finally, the MJO prediction skill in this version of GEOS-5 is superior to that of the current seasonal prediction system at the GMAO; this could be partly attributed to a slightly better representation of the MJO in the free running version of this model and partly to the improved atmospheric initialization from MERRA-2.

Achuthavarier, Deepthi↗

Skillful multiyear predictions of ocean acidification in the California Current System

The California Current System (CCS) sustains economically valuable fisheries and is particularly vulnerable to ocean acidification, due to its natural upwelling of carbon-enriched waters that generate corrosive conditions for local ecosystems. Here we use a novel suite of retrospective, initialized ensemble forecasts with an Earth system model (ESM) to predict the evolution of surface pH anomalies in the CCS. We show that the forecast system skillfully predicts observed surface pH variations a year in advance over a naive forecasting method, with the potential for skillful prediction up to five years in advance. Skillful predictions of surface pH are mainly derived from the initialization of dissolved inorganic carbon anomalies that are subsequently transported into the CCS. Our results demonstrate the potential for ESMs to provide skillful predictions of ocean acidification on large scales in the CCS. Initialized ESMs could also provide boundary conditions to improve high-resolution regional forecasting systems.

54 ENVIRONMENTAL SCIENCES↗

Assessment of Arctic and Antarctic Sea Ice Predictability in CMIP5 Decadal Hindcasts

This paper examines the ability of coupled global climate models to predict decadal variability of Arctic and Antarctic sea ice. We analyze decadal hindcasts/predictions of 11 Coupled Model Intercomparison Project Phase 5 (CMIP5) models. Decadal hindcasts exhibit a large multimodel spread in the simulated sea ice extent, with some models deviating significantly from the observations as the predicted ice extent quickly drifts away from the initial constraint. The anomaly correlation analysis between the decadal hindcast and observed sea ice suggests that in the Arctic, for most models, the areas showing significant predictive skill become broader associated with increasing lead times. This area expansion is largely because nearly all the models are capable of predicting the observed decreasing Arctic sea ice cover. Sea ice extent in the North Pacific has better predictive skill than that in the North Atlantic (particularly at a lead time of 3-7 years), but there is a reemerging predictive skill in the North Atlantic at a lead time of 6-8 years. In contrast to the Arctic, Antarctic sea ice decadal hindcasts do not show broad predictive skill at any timescales, and there is no obvious improvement linking the areal extent of significant predictive skill to lead time increase. This might be because nearly all the models predict a retreating Antarctic sea ice cover, opposite to the observations. For the Arctic, the predictive skill of the multi-model ensemble mean outperforms most models and the persistence prediction at longer timescales, which is not the case for the Antarctic. Overall, for the Arctic, initialized decadal hindcasts show improved predictive skill compared to uninitialized simulations, although this improvement is not present in the Antarctic.

sea ice↗