Five-day track forecast skills of WRF model for the western North Pacific tropical cyclones
Explore the source record for details and available documents.
54 ENVIRONMENTAL SCIENCES↗
SEARCH · Search NASA
Results for “forecast skill”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Skillful Seasonal Forecasts of Land Carbon Uptake in Northern Mid- and High Latitudes
Here we present a first look at the Gross Primary Production (GPP) forecast skill levels achievable with a state-of-the-art subseasonal-to-seasonal (S2S) forecast system. Using NASA’s retrospective S2S ensemble forecast in conjunction with a terrestrial biosphere model, and using an independent, remote sensing-based dataset for validation, we demonstrate an ability to accurately forecast spring-summer carbon uptake at multi-month leads. Averaged across mid-and high latitudes of the Northern Hemisphere land, the GPP forecast initialized on January 1 produces statistically significant skill through summer. The skill achieved, however, is spatially variable, with some regions appearing to extract skill from accurate forecasts of snowpack removal and others extracting skill from the initialization of carbon and nitrogen states. Our results reveal some heretofore unexplored facets of climate predictability and provide a look at what might be possible with future S2S forecast systems that are fully integrated with biogeochemical cycles.
Eunjee Lee↗
Machine learning for postprocessing ensemble streamflow forecasts
Skillful streamflow forecasts can inform decisions in various areas of water policy and management. We integrate numerical weather prediction ensembles, distributed hydrological model, and machine learning to generate ensemble streamflow forecasts at medium-range lead times (1–7 days). We demonstrate the application of machine learning as postprocessor for improving the quality of ensemble streamflow forecasts. Our results show that the machine learning postprocessor can improve streamflow forecasts relative to low-complexity forecasts (e.g., climatological and temporal persistence) as well as standalone hydrometeorological modeling and neural network. The relative gain in forecast skill from postprocessor is generally higher at medium-range timescales compared to shorter lead times; high flows compared to low–moderate flows, and the warm season compared to the cool ones. Overall, our results highlight the benefits of machine learning in many aspects for improving both the skill and reliability of streamflow forecasts.
54 ENVIRONMENTAL SCIENCES↗
An Observationally Trained Markov Model for MJO Propagation
A Markovian stochastic model is developed for studying the propagation of the Madden-Julian Oscillation (MJO). This model represents the daily changes in real time multivariate MJO (RMM) indices as random functions of their current state and background conditions. The probability distribution function of the RMM changes is obtained using a machine learning algorithm trained to maximize MJO forecast skills using observed daily indices of RMM and different modes of variability. Skillful forecasts are obtained for lead times between 8 and 27 days. Large ensemble simulations by the stochastic model show that with monsoonal changes in the background state, MJO propagation across the Maritime Continent (MC) is most likely to be disrupted in boreal spring and summer when MJO events propagate from favorable conditions over the Indian Ocean to unfavorable ones over the MC, and predictability is higher during spring and summer when MJO activity is away from the MC region.
54 ENVIRONMENTAL SCIENCES↗
Decadal Prediction Skill in the GEOS-5 Forecast System
A suite of decadal predictions has been conducted with the NASA Global Modeling and Assimilation Office's (GMAO's) GEOS-5 Atmosphere-Ocean general circulation model. The hind casts are initialized every December 1st from 1959 to 2010, following the CMIP5 experimental protocol for decadal predictions. The initial conditions are from a multivariate ensemble optimal interpolation ocean and sea-ice reanalysis, and from GMAO's atmospheric reanalysis, the modern-era retrospective analysis for research and applications. The mean forecast skill of a three-member-ensemble is compared to that of an experiment without initialization but also forced with observed greenhouse gases. The results show that initialization increases the forecast skill of North Atlantic sea surface temperature compared to the uninitialized runs, with the increase in skill maintained for almost a decade over the subtropical and mid-latitude Atlantic. On the other hand, the initialization reduces the skill in predicting the warming trend over some regions outside the Atlantic. The annual-mean Atlantic meridional overturning circulation index, which is defined here as the maximum of the zonally-integrated overturning stream function at mid-latitude, is predictable up to a 4-year lead time, consistent with the predictable signal in upper ocean heat content over the North Atlantic. While the 6- to 9-year forecast skill measured by mean squared skill score shows 50 percent improvement in the upper ocean heat content over the subtropical and mid-latitude Atlantic, prediction skill is relatively low in the sub-polar gyre. This low skill is due in part to features in the spatial pattern of the dominant simulated decadal mode in upper ocean heat content over this region that differ from observations. An analysis of the large-scale temperature budget shows that this is the result of a model bias, implying that realistic simulation of the climatological fields is crucial for skillful decadal forecasts.
Decadal Prediction↗
Decadal Prediction Skill in the GEOS-5 Forecast System
A suite of decadal predictions has been conducted with the NASA Global Modeling and Assimilation Office?s GEOS-5 Atmosphere-Ocean General Circulation Model (AOGCM). The hindcasts are initialized every December from 1959 to 2010 following the CMIP5 experimental protocol for decadal predictions. The initial conditions are from a multi-variate ensemble optimal interpolation ocean and sea-ice reanalysis, and from the atmospheric reanalysis (MERRA, the Modern-Era Retrospective Analysis for Research and Applications) generated using the GEOS-5 atmospheric model. The forecast skill of a three-member-ensemble mean is compared to that of an experiment without initialization but forced with observed CO2. The results show that initialization acts to increase the forecast skill of Northern Atlantic SST compared to the uninitialized runs, with the increase in skill maintained for almost a decade over the subtropical and mid-latitude Atlantic. The annual-mean Atlantic Meridional Overturning Circulation (AMOC) index is predictable up to a 5-year lead time, consistent with the predictable signal in upper ocean heat content over the Northern Atlantic. While the skill measured by Mean Squared Skill Score (MSSS) shows 50% improvement up to 10-year lead forecast over the subtropical and mid-latitude Atlantic, however, prediction skill is relatively low in the subpolar gyre, due in part to the fact that the spatial pattern of the dominant simulated decadal mode in upper ocean heat content over this region appears to be unrealistic. An analysis of the large-scale temperature budget shows that this is the result of a model bias, implying that realistic simulation of the climatological fields is crucial for skillful decadal forecasts.
Ham, Yoo-Geun↗
Skillful Spring Forecasts of September Arctic Sea Ice Extent Using Passive Microwave Data
In this study, we demonstrate skillful spring forecasts of detrended September Arctic sea ice extent using passive microwave observations of sea ice concentration (SIC) and melt onset (MO). We compare these to forecasts produced using data from a sophisticated melt pond model, and find similar to higher skill values, where the forecast skill is calculated relative to linear trend persistence. The MO forecasts shows the highest skill in March-May, while the SIC forecasts produce the highest skill in June-August, especially when the forecasts are evaluated over recent years (since 2008). The high MO forecast skill in early spring appears to be driven primarily by the presence and timing of open water anomalies, while the high SIC forecast skill appears to be driven by both open water and surface melt processes. Spatial maps of detrended anomalies highlight the drivers of the different forecasts, and enable us to understand regions of predictive importance. Correctly capturing sea ice state anomalies, along with changes in open water coverage appear to be key processes in skillfully forecasting summer Arctic sea ice.
melt onset↗
The GLACE-2 Experiment
A major motivation for the study of the coupled land-atmosphere system is the idea that soil moisture anomalies may affect future meteorological variables through their effects on future surface energy and water budgets. If true, the accurate initialization of soil moisture in a subseasonal or seasonal forecast system may improve forecast skill, making the forecast products more valuable to society. The Global Land-Atmosphere Coupling Experiment (GLACE-2) project is examining, with a wide variety of models, the degree to which subseasonal (out to two months) precipitation and air temperature forecasts improve through the realistic initialization of soil moisture. For the first time ever, a global consensus should emerge regarding the value of land initialization for forecasts, perhaps motivating national forecast centers to make full use of land moisture initialization in their operations. Participants in GLACE-2 perform two series of forecasts, each consisting of 100 2-month forecast ensembles (10 members per ensemble) covering ten boreal spring and summer start-dates in each of the years 1986-1995. Series 1 utilizes realistic land surface state initialization, provided through a decadal offline simulation using realistic meteorological forcing, as provided by the Global Soil Wetness Project - Phase 2 (GSWP-2), a research activity of the Global Land-Atmosphere System Study (GLASS) of GEWEX. Series 2 is identical to Series 1 in every way except for the fact that it does not benefit from realistic land state initialization. Through the comparison of Series 1 and 2, we isolate the impact of land initialization on the forecasts. Optional extensions to these base runs include forecasts covering additional years, using alternative meteorological forcing for the land initialization. To date, GLACE-2 has garnered participation from eleven modeling groups, covering 13 atmospheric models. Analysis of available results is already well underway, both at the individual modeling institutions and at the NASA Goddard Space Flight Center, which is coordinating the project. Analysis focuses on two elements of the forecast problem: (i) the quantification of model-specific "predictability" (i.e., the degree to which simulated atmospheric chaos will foil a forecast, even under the assumption of"perfect" model physics, initialization data, and validation data) and its decay with time; and (ii) the quantification of forecast skill, determined through a comparison of predicted precipitation and air temperature against observations. Indeed, the specific contribution of land initialization to both these elements is isolated through a comparison of the Series 1 and 2 forecasts. We examine the two elements at four different forecast leads: 1-15, 16-30, 31-45, and 46-60 days. Statistics-based approaches for enhancing skill (essentially using observational statistics to reduce the impact of the models' climatic biases) are also tested. In the present talk, we provide an update of progress in GLACE-2, featuring quantifications of predictability and forecast skill for a number of the participating models and providing a "first look" at the desired consensus view of land impacts on subseasonal forecasts.
Koster, Randal↗
Experiments with a three-dimensional statistical objective analysis scheme using FGGE data
A three-dimensional (3D), multivariate, statistical objective analysis scheme (referred to as optimum interpolation or OI) has been developed for use in numerical weather prediction studies with the FGGE data. Some novel aspects of the present scheme include: (1) a multivariate surface analysis over the oceans, which employs an Ekman balance instead of the usual geostrophic relationship, to model the pressure-wind error cross correlations, and (2) the capability to use an error correlation function which is geographically dependent. A series of 4-day data assimilation experiments are conducted to examine the importance of some of the key features of the OI in terms of their effects on forecast skill, as well as to compare the forecast skill using the OI with that utilizing a successive correction method (SCM) of analysis developed earlier. For the three cases examined, the forecast skill is found to be rather insensitive to varying the error correlation function geographically. However, significant differences are noted between forecasts from a two-dimensional (2D) version of the OI and those from the 3D OI, with the 3D OI forecasts exhibiting better forecast skill. The 3D OI forecasts are also more accurate than those from the SCM initial conditions. The 3D OI with the multivariate oceanic surface analysis was found to produce forecasts which were slightly more accurate, on the average, than a univariate version.
Baker, Wayman E.↗
Evaluation and Assimilation of Cloud Cleared Radiances for AIRS in GEOS-5
The use of clear (cloud-free) channels for AIRS in GEOS-5 had shown positive impact on forecast skills in both hemispheres. However, improvements in forecast skills due to the assimilation of AIRS data are less impressive since the number of assimilated channels from AIRS is much larger than that from other Infrared sounders such as HIRS-3 onboard NOAA 15-17 satellites. This limitation of AIRS radiance data to improve the forecast skill is mainly due to the fact that channels capable of peaking below clouds are not used in the assimilation and yet those have highest vertical resolving capability of AIRS instrument are concentrated in the lower troposphere. On average, the percentage of AIRS footprints completely clear for all channels is less than 10%. The percentage of assimilated AIRS channel radiances however ranges from 100% for channels peaking in the upper stratosphere, above the cloud, to no more that 5% in the lower atmosphere due to cloud contamination. Our current ability to model and predict clouds accurately in global model, and to fully characterize and parameterize optical properties of cloud particles in radiative transfer model are the two major obstacles prohibiting us to use cloudy radiance directly in the assimilation. To further improve forecast skill using AIRS data, we ought to use the channels peaking below the clouds in the troposphere, which can be accomplished by assimilating cloud-cleared radiance. The cloud-cleared radiance data for AIRS used in this study were obtained from optimal cloud clearing procedures developed by researchers at CIMSS of University of Wisconsin at Madison to retrieve clear column radiances for all AIRS channels by collocating multi-band MODIS IR clear radiance observations with the AIRS cloudy radiances on a single footprint basis. Two adjacent AIRS cloudy footprints are used to retrieve one AIRS cloud-cleared radiance spectrum and no background information (first guess) is needed. To assimilate the cloud-cleared radiance data, the errors of the cloud-cleared radiances need to be addressed. The details of convolving AIRS radiances with MODIS spectral response function and comparison with MODIS-measured cloud-free radiance will be presented. The range of errors of cloud-cleared radiances for AIRS using collocated MODIS clear and near-by AIRS clear data will be shown. The NASA. global data assimilation model, GEOS-5, is used to evaluate and assimilate the cloud-cleared radiance for AIRS. The residues between the cloud-cleared brightness temperature and the simulated brightness temperature from background (i.e., OMFs) will be investigated. The quality control procedures will be documented based on error estimation and the OMFs. Finally, the impacts between assimilation of clear channel radiances and cloud-cleared radiances will be addressed.
Liu, Hui-chun↗
Operational maize yield forecasts for Sub-Saharan Africa using Earth observation data and machine learning
Food insecurity continues to grow in Sub-Saharan Africa (SSA). In 2019, chronically malnourished people numbered nearly 240 million, or 20% of the population in SSA. Globally, numerous efforts have been made to anticipate potential droughts, crop conditions, and food shortages to foster improved food insecurity early warning and risk management. To support this goal, we develop an Earth Observation (EO) and machine-learning-based operational, subnational maize yield forecast system and evaluate its out-of-sample forecast skills during the growing seasons for Kenya, Somalia, Malawi, and Burkina Faso. In general, forecast skills improve substantially during the vegetative growth period (VP) and gradually during the reproductive development period (RP). Thus, mid-season assessment can provide effective early warning months before harvest. Skillful forecasts (Nash Sutcliffe Efficiency (NSE) > 0.6 and Mean Absolute Percentage Error (MAPE) < 20%) appear approximately two dekads after the VP; for example, they appear in May in Kenya and Somalia, January in Malawi, and July in Burkina Faso.
Donghoon Lee↗
The predictive skill of convolutional neural networks models for disease forecasting
In this paper we investigate the utility of one-dimensional convolutional neural network (CNN) models in epidemiological forecasting. Deep learning models, in particular variants of recurrent neural networks (RNNs) have been studied for ILI (Influenza-Like Illness) forecasting, and have achieved a higher forecasting skill compared to conventional models such as ARIMA. In this study, we adapt two neural networks that employ one-dimensional temporal convolutional layers as a primary building block—temporal convolutional networks and simple neural attentive meta-learners—for epidemiological forecasting. We then test them with influenza data from the US collected over 2010-2019. We find that epidemiological forecasting with CNNs is feasible, and their forecasting skill is comparable to, and at times, superior to, plain RNNs. Thus CNNs and RNNs bring the power of nonlinear transformations to purely data-driven epidemiological models, a capability that heretofore has been limited to more elaborate mechanistic/compartmental disease models.
59 BASIC BIOLOGICAL SCIENCES↗
An Assessment of the Skill of GEOS-5 Seasonal Forecasts
The seasonal forecast skill of the NASA Global Modeling and Assimilation Office coupled global climate model (CGCM) is evaluated based on an ensemble of 9-month lead forecasts for the period 1993 to 2010. The results from the current version (V2) of the CGCM consisting of the GEOS-5 AGM coupled to the MOM4 ocean model are compared with those from an earlier version (V1) in which the AGCM (the NSIPP model) was coupled to the Poseidon Ocean Model. It was found that the correlation skill of the Sea Surface Temperature (SST) forecasts is generally better in V2, especially over the sub-tropical and tropical central and eastern Pacific, Atlantic, and Indian Ocean. Furthermore, the improvement in skill in V2 mainly comes from better forecasts of the developing phase of ENSO from boreal spring to summer. The skill of ENSO forecasts initiated during the boreal winter season, however, shows no improvement in terms of correlation skill, and is in fact slightly worse in terms of root mean square error (RMSE). The degradation of skill is found to be due to an excessive ENSO amplitude. For V1, the ENSO amplitude is too strong in forecasts starting in boreal spring and summer, which causes large RMSE in the forecast. For V2, the ENSO amplitude is slightly stronger than that in observations and V1 for forecasts starting in boreal winter season. An analysis of the terms in the SST tendency equation, shows that this is mainly due to an excessive zonal advective feedback. In addition, V2 forecasts that are initiated during boreal winter season, exhibit a slower phase transition of El Nino, which is consistent with larger amplitude of ENSO after the ENSO peak season. It is found that this is due to weak discharge of equatorial Warm Water Volume (WWV). In both observations and V1, the discharge of equatorial WWV leads the equatorial geostrophic easterly current so as to damp the El Nino starting in January. This process is delayed by about 2 months in V2 due to the slower phase transition of the equatorial zonal current from westerly to easterly.
GMAO↗
Evaluation of Subseasonal-to-Seasonal (S2S) precipitation forecast from the North American Multi-Model ensemble phase II (NMME-2) over the contiguous U.S.
The second phase of the North America Multi-Model Ensemble (NMME-2) provides globally available Subseasonal-to-Seasonal (S2S) precipitation forecasts with a daily resolution. The S2S precipitation forecasts are getting increasing attention for their potentials in providing hydrometeorological forcing information for water resources planning at an extended range. However, the forecast skills of many existing S2S forecast products will significantly decrease when the lead time increases, hindering their applicability for watershed-scale hydrologic modeling. Therefore, forecast validation and large-scale evaluation are of great importance for water resources planning and hydrological applications. In this study, we comprehensively evaluate the S2S precipitation forecasts from the NMME-2 dataset over the contiguous United States (CONUS) and during the study period from 1982 to 2011. Three aspects of precipitation forecast capabilities are compared and analyzed: bias, skill scores, and the ability to predict extreme precipitation events. The Parameter-elevation Regressions on Independent Slopes Model (PRISM) is used as ground truth reference. Differs from other regional forecast validation study, we further examined and analyzed the dependences of NMME-2 precipitation forecast skills according to different seasonality, geographical locations, and lead times. Results show that the forecast biases are not sensitive to lead times but are seasonally dependent of all NMME-2 models. Overestimations are found in the Western U.S. in cooler seasons while underestimations are observed in the central regions of the U.S. in warmer seasons. The forecast skill of all individual NMME-2 models generally decreases as increases of lead times. The simple model averaging (SMA) of five NMME-2 models demonstrates a higher forecast skill than any individual NMME-2 models. Spatially, the highest forecast skill scores are observed at coastal areas in the Western U.S. with an one-week lead time. As compared to the historical resampled forecasts, NMME-2 also shows better performance in predicting extreme precipitation events above 99% percentiles and below 1% percentiles with higher probability of detections and lower false alarm ratios. Finally, the obtained results suggest the great potentials of NMME-2 precipitation forecasts in assisting ensemble hydrologic forecasts at the S2S scale over the CONUS.
54 ENVIRONMENTAL SCIENCES↗
Seasonal Prediction with the GEOS GCM
A number of ensembles of seasonal forecasts have recently been completed as part of NASA's Seasonal to Interannual Prediction Project (NSIPP). The focus is on the extratropical response of the atmosphere to observed SST anomalies during boreal winter. Each prediction consists of nine forecasts starting from slightly different initial conditions. Forecasts are done for every winter from 1981 to 1995 using Version 2 of the GEOS GCM. Comparisons with six long-term integrations (1978-1995) using the same model are used to separate the contributions of initial and boundary conditions to forecast skill. The forecasts also allow us to isolate the SSt forced response (the signal) from the atmosphere's natural variability (the noise).
Suarez, Max↗
Two Topics in Seasonal Streamflow Forecasting: Soil Moisture Initialization Error and Precipitation Downscaling
Continental-scale offline simulations with a land surface model are used to address two important issues in the forecasting of large-scale seasonal streamflow: (i) the extent to which errors in soil moisture initialization degrade streamflow forecasts, and (ii) the extent to which the downscaling of seasonal precipitation forecasts, if it could be done accurately, would improve streamflow forecasts. The reduction in streamflow forecast skill (with forecasted streamflow measured against observations) associated with adding noise to a soil moisture field is found to be, to first order, proportional to the average reduction in the accuracy of the soil moisture field itself. This result has implications for streamflow forecast improvement under satellite-based soil moisture measurement programs. In the second and more idealized ("perfect model") analysis, precipitation downscaling is found to have an impact on large-scale streamflow forecasts only if two conditions are met: (i) evaporation variance is significant relative to the precipitation variance, and (ii) the subgrid spatial variance of precipitation is adequately large. In the large-scale continental region studied (the conterminous United States), these two conditions are met in only a somewhat limited area.
Koster, Randal↗
Investigation of the Potential Saturation of Information from Global Navigation Satellite System Radio Occultation Observations with an Observing System Simulation Experiment
The potential impact of large numbers of Global Navigation Satellite System radio occultation (GNSS-RO) observations on numerical weather prediction is investigated using a global observing system simulation experiment (OSSE). The hybrid four-dimensional ensemble variational Gridpoint Statistical Interpolation (GSI) data assimilation system and Global Earth Observing System (GEOS) model are used to ingest up to 100,000 GNSS-RO soundings per day in addition to the current suite of conventional and radiance data. Analysis quality, forecast skill, and forecast sensitivity to observation impact are examined with differing quantities of additional GNSS-RO profiles. It is found that saturation of information from additional RO soundings has not been reached with 100,000 soundings per day. There are some indications of suboptimal performance of the GSI in handling GNSS-RO observations particularly in the middle and lower tropospheric extratropics.
GNSS-RO↗
Status of the NASA GMAO Observing System Simulation Experiment
An Observing System Simulation Experiment (OSSE) is a pure modeling study used when actual observations are too expensive or difficult to obtain. OSSEs are valuable tools for determining the potential impact of new observing systems on numerical weather forecasts and for evaluation of data assimilation systems (DAS). An OSSE has been developed at the NASA Global Modeling and Assimilation Office (GMAO, Errico et al 2013). The GMAO OSSE uses a 13-month integration of the European Centre for Medium- Range Weather Forecasts 2005 operational model at T511/L91 resolution for the Nature Run (NR). Synthetic observations have been updated so that they are based on real observations during the summer of 2013. The emulated observation types include AMSU-A, MHS, IASI, AIRS, and HIRS4 radiance data, GPS-RO, and conventional types including aircraft, rawinsonde, profiler, surface, and satellite winds. The synthetic satellite wind observations are colocated with the NR cloud fields, and the rawinsondes are advected during ascent using the NR wind fields. Data counts for the synthetic observations are matched as closely as possible to real data counts, as shown in Figure 2. Errors are added to the synthetic observations to emulate representativeness and instrument errors. The synthetic errors are calibrated so that the statistics of observation innovation and analysis increments in the OSSE are similar to the same statistics for assimilation of real observations, in an iterative method described by Errico et al (2013). The standard deviations of observation minus forecast (xo-H(xb)) are compared for the OSSE and real data in Figure 3. The synthetic errors include both random, uncorrelated errors, and an additional correlated error component for some observational types. Vertically correlated errors are included for conventional sounding data and GPS-RO, and channel correlated errors are introduced to AIRS and IASI (Figure 4). HIRS, AMSU-A, and MHS have a component of horizontally correlated error. The forecast model used by the GMAO OSSE is the Goddard Earth Observing System Model, Version 5 (GEOS-5) with Gridpoint Statistical Interpolation (GSI) DAS. The model version has been updated to v. 5.13.3, corresponding to the current operational model. Forecasts are run on a cube-sphere grid with 180 points along each edge of the cube (approximately 0.5 degree horizontal resolution) with 72 vertical levels. The DAS is cycled at 6-hour intervals, with 240 hour forecasts launched daily at 0000 UTC. Evaluation of the forecasting skill for July and August is currently underway. Prior versions of the GMAO OSSE have been found to have greater forecasting skill than real world forecasts. It is anticipated that similar forecast skill will be found in the updated OSSE.
OSSE↗