Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Model Forecast Skill and Sensitivity to Initial Conditions in the Seasonal Sea Ice Outlook

We explore the skill of predictions of September Arctic sea ice extent from dynamical models participating in the Sea Ice Outlook (SIO). Forecasts submitted in August, at roughly 2 month lead times, are skillful. However, skill is lower in forecasts submitted to SIO, which began in 2008, than in hindcasts (retrospective forecasts) of the last few decades. The multimodel mean SIO predictions offer slightly higher skill than the single-model SIO predictions, but neither beats a damped persistence forecast at longer than 2 month lead times. The models are largely unsuccessful at predicting each other, indicating a large difference in model physics and/or initial conditions. Motivated by this, we perform an initial condition sensitivity experiment with four SIO models, applying a fixed −1 m perturbation to the initial sea ice thickness. The significant range of the response among the models suggests that different model physics make a significant contribution to forecast uncertainty.

Arctic Sea↗

Evaluating NMME Seasonal Forecast Skill for use in NASA SERVIR Hub Regions

The U.S. National Multi-Model Ensemble seasonal forecasting system is providing hindcast and real-time data streams to be used in assessing and improving seasonal predictive capacity. The coupled forecasts have numerous potential applications, both national and international in scope. The NASA / USAID SERVIR project, which leverages satellite and modeling-based resources for environmental decision making in developing nations, is focusing on the evaluation of NMME forecasts specifically for use in driving applications models in hub regions including East Africa, the Hindu Kush- Himalayan (HKH) region and Mesoamerica. A prerequisite for seasonal forecast use in application modeling (e.g. hydrology, agriculture) is bias correction and skill assessment. Efforts to address systematic biases and multi-model combination in support of NASA SERVIR impact modeling requirements will be highlighted. Specifically, quantilequantile mapping for bias correction has been implemented for all archived NMME hindcasts. Both deterministic and probabilistic skill estimates for raw, bias-corrected, and multi-model ensemble forecasts as a function of forecast lead will be presented for temperature and precipitation. Complementing this statistical assessment will be case studies of significant events, for example, the ability of the NMME forecasts suite to anticipate the 2010/2011 drought in the Horn of Africa and its relationship to evolving SST patterns.

Roberts, J. Brent↗

Improving Forecast Skill by Assimilation of AIRS Cloud Cleared Radiances RiCC

ECMWF, NCEP, and GMAO routinely assimilate radiosonde and other in-situ observations along with satellite IR and MW Sounder radiance observations. NCEP and GMAO use the NCEP GSI Data Assimilation System (DAS).GSI DAS assimilates AIRS, CrIS, IASI channel radiances Ri on a channel-by-channel, case-by-case basis, only for those channels i thought to be unaffected by cloud cover. This test excludes Ri for most tropospheric sounding channels under partial cloud cover conditions. AIRS Version-6 RiCC is a derived quantity representative of what AIRS channel i would have seen if the AIRS FOR were cloud free. All values of RiCC have case-by-case error estimates RiCC associated with them. Our experiments present to the GSI QCd values of AIRS RiCC in place of AIRS Ri observations. GSI DAS assimilates only those values of RiCC it thinks are cloud free. This potentially allows for better coverage of assimilated QCd values of RiCC as compared to Ri.

Forecast Skill↗

An evaluation of the real-time tropical cyclone forecast skill of the Navy Operational Global Atmospheric Prediction System in the western North Pacific

The paper evaluates the meteorological quality and operational utility of the Navy Operational Global Atmospheric Prediction System (NOGAPS) in forecasting tropical cyclones. It is shown that the model can provide useful predictions of motion and formation on a real-time basis in the western North Pacific. The meterological characteristics of the NOGAPS tropical cyclone predictions are evaluated by examining the formation of low-level cyclone systems in the tropics and vortex structure in the NOGAPS analysis and verifying 72-h forecasts. The adjusted NOGAPS track forecasts showed equitable skill to the baseline aid and the dynamical model. NOGAPS successfully predicted unusual equatorward turns for several straight-running cyclones.

Fiorino, Michael↗

Synoptic scale forecast skill and systematic errors in the MASS 2.0 model

The synoptic scale performance characteristics of MASS 2.0 are determined by comparing filtered 12-24 hr model forecasts to same-case forecasts made by the National Meteorological Center's synoptic-scale Limited-area Fine Mesh model. Characteristics of the two systems are contrasted, and the analysis methodology used to determine statistical skill scores and systematic errors is described. The overall relative performance of the two models in the sample is documented, and important systematic errors uncovered are presented.

Koch, S. E.↗

Sensitivity of mesoscale-model forecast skill to some initial-data characteristics, data density, data position, analysis procedure and measurement error

The effects of horizontal and vertical data resolution, data density, data location, different objective analysis algorithms, and measurement error on mesoscale-forecast accuracy are studied with observing-system simulation experiments. Domain-averaged errors are shown to generally decrease with time. It is found that the vertical distribution of error growth depends on the initial vertical distribution of the error itself. Larger gravity-inertia wave noise is produced in forecasts with coarser vertical data resolution. The use of a low vertical resolution observing system with three data levels leads to more forecast errors than moderate and high vertical resolution observing systems with 8 and 14 data levels. Also, with poor vertical resolution in soundings, the initial and forecast errors are not affected by the horizontal data resolution.

Warner, Thomas T.↗

Improving Forecast Skill by Assimilation of Quality-controlled AIRS Temperature Retrievals under Partially Cloudy Conditions

The National Aeronautics and Space Administration (NASA) Atmospheric Infrared Sounder (AIRS) on board the Aqua satellite has been long recognized as an important contributor towards the improvement of weather forecasts. At this time only a small fraction of the total data produced by AIRS is being used by operational weather systems. In fact, in addition to effects of thinning and quality control, the only AIRS data assimilated are radiance observations of channels unaffected by clouds. Observations in mid-lower tropospheric sounding AIRS channels are assimilated primarily under completely clear-sky conditions, thus imposing a very severe limitation on the horizontal distribution of the AIRS-derived information. In this work it is shown that the ability to derive accurate temperature profiles from AIRS observations in partially cloud-contaminated areas can be utilized to further improve the impact of AIRS observations in a global model and forecasting system. The analyses produced by assimilating AIRS temperature profiles obtained under partial cloud cover result in a substantially colder representation of the northern hemisphere lower midtroposphere at higher latitudes. This temperature difference has a strong impact, through hydrostatic adjustment, in the midtropospheric geopotential heights, which causes a different representation of the polar vortex especially over northeastern Siberia and Alaska. The AIRS-induced anomaly propagates through the model's dynamics producing improved 5-day forecasts.

Reale, O.↗

Forecast skill of a high-resolution real-time mesoscale model designed for weather support of operations at Kennedy Space Center and Cape Canaveral Air Station

NASA funded Mesoscale Environmental Simulations and Operations (MESO), Inc. to develop a version of the Mesoscale Atmospheric Simulation System (MASS). The model has been modified specifically for short-range forecasting in the vicinity of KSC/CCAS. To accomplish this, the model domain has been limited to increase the number of horizontal grid points (and therefore grid resolution) and the model' s treatment of precipitation, radiation, and surface hydrology physics has been enhanced to predict convection forced by local variations in surface heat, moisture fluxes, and cloud shading. The objective of this paper is to (1) provide an overview of MASS including the real-time initialization and configuration for running the data pre-processor and model, and (2) to summarize the preliminary evaluation of the model's forecasts of temperature, moisture, and wind at selected rawinsonde station locations during February 1994 and July 1994. MASS is a hydrostatic, three-dimensional modeling system which includes schemes to represent planetary boundary layer processes, surface energy and moisture budgets, free atmospheric long and short wave radiation, cloud microphysics, and sub-grid scale moist convection.

Taylor, Gregory E.↗

Recent Advances in Improvement of Forecast Skill and Understanding Climate Processes Using AIRS Version-5 Products

AIRS/AMSU is the state of the art infrared and microwave atmospheric sounding system flying aboard EOS Aqua. These observations, covering the period September 2002 until the present, have been analyzed using the AIRS Science Team Version-5 retrieval algorithm. AIRS is a high spectral resolution infrared grating spectrometer with spect,ral coverage from 650 per centimeter extending to 2660 per centimeter, with low noise and a spectral resolving power of 2400. A brief overview of the AIRS Version-5 retrieval procedure will be presented, including the AIRS channels used in different steps in the retrieval process. Many researchers have used these products to make significant advances in both climate and weather applications. Recent significant results of these experiments will be presented, including results showing that 1) assimilation of AIRS Quality Controlled temperature profiles into a General Circulation Model (GCM) significantly improves the ability to predict storm tracks of intense precipitation events; and 2) anomaly time-series of Outgoing Longwave Radiation (OLR) computed using AIRS sounding products closely match those determined from the CERES instrument, and furthermore explain that the phenomenon that global and especially tropical mean OLR have been decreasing since September 2002 is a result of El Nino/La Nina oscillations during this period.

Susskind, Joel↗

Skillful Seasonal Forecasts of Land Carbon Uptake in Northern Mid- and High Latitudes

Here we present a first look at the Gross Primary Production (GPP) forecast skill levels achievable with a state-of-the-art subseasonal-to-seasonal (S2S) forecast system. Using NASA’s retrospective S2S ensemble forecast in conjunction with a terrestrial biosphere model, and using an independent, remote sensing-based dataset for validation, we demonstrate an ability to accurately forecast spring-summer carbon uptake at multi-month leads. Averaged across mid-and high latitudes of the Northern Hemisphere land, the GPP forecast initialized on January 1 produces statistically significant skill through summer. The skill achieved, however, is spatially variable, with some regions appearing to extract skill from accurate forecasts of snowpack removal and others extracting skill from the initialization of carbon and nitrogen states. Our results reveal some heretofore unexplored facets of climate predictability and provide a look at what might be possible with future S2S forecast systems that are fully integrated with biogeochemical cycles.

Eunjee Lee↗

Decadal Prediction Skill in the GEOS-5 Forecast System

A suite of decadal predictions has been conducted with the NASA Global Modeling and Assimilation Office's (GMAO's) GEOS-5 Atmosphere-Ocean general circulation model. The hind casts are initialized every December 1st from 1959 to 2010, following the CMIP5 experimental protocol for decadal predictions. The initial conditions are from a multivariate ensemble optimal interpolation ocean and sea-ice reanalysis, and from GMAO's atmospheric reanalysis, the modern-era retrospective analysis for research and applications. The mean forecast skill of a three-member-ensemble is compared to that of an experiment without initialization but also forced with observed greenhouse gases. The results show that initialization increases the forecast skill of North Atlantic sea surface temperature compared to the uninitialized runs, with the increase in skill maintained for almost a decade over the subtropical and mid-latitude Atlantic. On the other hand, the initialization reduces the skill in predicting the warming trend over some regions outside the Atlantic. The annual-mean Atlantic meridional overturning circulation index, which is defined here as the maximum of the zonally-integrated overturning stream function at mid-latitude, is predictable up to a 4-year lead time, consistent with the predictable signal in upper ocean heat content over the North Atlantic. While the 6- to 9-year forecast skill measured by mean squared skill score shows 50 percent improvement in the upper ocean heat content over the subtropical and mid-latitude Atlantic, prediction skill is relatively low in the sub-polar gyre. This low skill is due in part to features in the spatial pattern of the dominant simulated decadal mode in upper ocean heat content over this region that differ from observations. An analysis of the large-scale temperature budget shows that this is the result of a model bias, implying that realistic simulation of the climatological fields is crucial for skillful decadal forecasts.

Decadal Prediction↗

Decadal Prediction Skill in the GEOS-5 Forecast System

A suite of decadal predictions has been conducted with the NASA Global Modeling and Assimilation Office?s GEOS-5 Atmosphere-Ocean General Circulation Model (AOGCM). The hindcasts are initialized every December from 1959 to 2010 following the CMIP5 experimental protocol for decadal predictions. The initial conditions are from a multi-variate ensemble optimal interpolation ocean and sea-ice reanalysis, and from the atmospheric reanalysis (MERRA, the Modern-Era Retrospective Analysis for Research and Applications) generated using the GEOS-5 atmospheric model. The forecast skill of a three-member-ensemble mean is compared to that of an experiment without initialization but forced with observed CO2. The results show that initialization acts to increase the forecast skill of Northern Atlantic SST compared to the uninitialized runs, with the increase in skill maintained for almost a decade over the subtropical and mid-latitude Atlantic. The annual-mean Atlantic Meridional Overturning Circulation (AMOC) index is predictable up to a 5-year lead time, consistent with the predictable signal in upper ocean heat content over the Northern Atlantic. While the skill measured by Mean Squared Skill Score (MSSS) shows 50% improvement up to 10-year lead forecast over the subtropical and mid-latitude Atlantic, however, prediction skill is relatively low in the subpolar gyre, due in part to the fact that the spatial pattern of the dominant simulated decadal mode in upper ocean heat content over this region appears to be unrealistic. An analysis of the large-scale temperature budget shows that this is the result of a model bias, implying that realistic simulation of the climatological fields is crucial for skillful decadal forecasts.

Ham, Yoo-Geun↗

Skillful Spring Forecasts of September Arctic Sea Ice Extent Using Passive Microwave Data

In this study, we demonstrate skillful spring forecasts of detrended September Arctic sea ice extent using passive microwave observations of sea ice concentration (SIC) and melt onset (MO). We compare these to forecasts produced using data from a sophisticated melt pond model, and find similar to higher skill values, where the forecast skill is calculated relative to linear trend persistence. The MO forecasts shows the highest skill in March-May, while the SIC forecasts produce the highest skill in June-August, especially when the forecasts are evaluated over recent years (since 2008). The high MO forecast skill in early spring appears to be driven primarily by the presence and timing of open water anomalies, while the high SIC forecast skill appears to be driven by both open water and surface melt processes. Spatial maps of detrended anomalies highlight the drivers of the different forecasts, and enable us to understand regions of predictive importance. Correctly capturing sea ice state anomalies, along with changes in open water coverage appear to be key processes in skillfully forecasting summer Arctic sea ice.

melt onset↗

The GLACE-2 Experiment

A major motivation for the study of the coupled land-atmosphere system is the idea that soil moisture anomalies may affect future meteorological variables through their effects on future surface energy and water budgets. If true, the accurate initialization of soil moisture in a subseasonal or seasonal forecast system may improve forecast skill, making the forecast products more valuable to society. The Global Land-Atmosphere Coupling Experiment (GLACE-2) project is examining, with a wide variety of models, the degree to which subseasonal (out to two months) precipitation and air temperature forecasts improve through the realistic initialization of soil moisture. For the first time ever, a global consensus should emerge regarding the value of land initialization for forecasts, perhaps motivating national forecast centers to make full use of land moisture initialization in their operations. Participants in GLACE-2 perform two series of forecasts, each consisting of 100 2-month forecast ensembles (10 members per ensemble) covering ten boreal spring and summer start-dates in each of the years 1986-1995. Series 1 utilizes realistic land surface state initialization, provided through a decadal offline simulation using realistic meteorological forcing, as provided by the Global Soil Wetness Project - Phase 2 (GSWP-2), a research activity of the Global Land-Atmosphere System Study (GLASS) of GEWEX. Series 2 is identical to Series 1 in every way except for the fact that it does not benefit from realistic land state initialization. Through the comparison of Series 1 and 2, we isolate the impact of land initialization on the forecasts. Optional extensions to these base runs include forecasts covering additional years, using alternative meteorological forcing for the land initialization. To date, GLACE-2 has garnered participation from eleven modeling groups, covering 13 atmospheric models. Analysis of available results is already well underway, both at the individual modeling institutions and at the NASA Goddard Space Flight Center, which is coordinating the project. Analysis focuses on two elements of the forecast problem: (i) the quantification of model-specific "predictability" (i.e., the degree to which simulated atmospheric chaos will foil a forecast, even under the assumption of"perfect" model physics, initialization data, and validation data) and its decay with time; and (ii) the quantification of forecast skill, determined through a comparison of predicted precipitation and air temperature against observations. Indeed, the specific contribution of land initialization to both these elements is isolated through a comparison of the Series 1 and 2 forecasts. We examine the two elements at four different forecast leads: 1-15, 16-30, 31-45, and 46-60 days. Statistics-based approaches for enhancing skill (essentially using observational statistics to reduce the impact of the models' climatic biases) are also tested. In the present talk, we provide an update of progress in GLACE-2, featuring quantifications of predictability and forecast skill for a number of the participating models and providing a "first look" at the desired consensus view of land impacts on subseasonal forecasts.

Koster, Randal↗