Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS1987

Forecasting forecast skill

It is shown that it is possible to predict the skill of numerical weather forecasts - a quantity which is variable from day to day and region to region. This has been accomplished using as predictor the dispersion (measured by the average correlation) between members of an ensemble of forecasts started from five different analyses. The analyses had been previously derived for satellite-data-impact studies and included, in the Northern Hemisphere, moderate perturbations associated with the use of different observing systems. When the Northern Hemisphere was used as a verification region, the prediction of skill was rather poor. This is due to the fact that such a large area usually contains regions with excellent forecasts as well as regions with poor forecasts, and does not allow for discrimination between them. However, when regional verifications were used, the ensemble forecast dispersion provided a very good prediction of the quality of the individual forecasts.

Kalnay, Eugenia↗
NASA NTRS2009

Improving Forecast Skill by Assimilation of Quality Controlled AIRS Version 5 Temperature Soundings

The AIRS Science Team Version 5 retrieval algorithm has been finalized and is now operational at the Goddard DAAC in the processing (and reprocessing) of all AIRS data. The AIRS Science Team Version 5 retrieval algorithm contains two significant improvements over Version 4: 1) Improved physics allows for use of AIRS observations in the entire 4.3 micron CO2 absorption band in the retrieval of temperature profile T(p) during both day and night. Tropospheric sounding 15 micron CO2 observations are now used primarily in the generation of cloud cleared radiances R(sub i). This approach allows for the generation of accurate values of R(sub i) and T(p) under most cloud conditions. 2) Another very significant improvement in Version 5 is the ability to generate accurate case-by-case, level-by-level error estimates for the atmospheric temperature profile, as well as for channel-by-channel error estimates for R(sub i). These error estimates are used for Quality Control of the retrieved products. We have conducted forecast impact experiments assimilating AIRS temperature profiles with different levels of Quality Control using the NASA GEOS-5 data assimilation system. Assimilation of Quality Controlled T(p) resulted in significantly improved forecast skill compared to that obtained from analyses obtained when all data used operationally by NCEP, except for AIRS data, is assimilated. We also conducted an experiment assimilating AIRS radiances uncontaminated by clouds, as done operationally by ECMWF and NCEP. Forecast resulting from assimilated AIRS radiances were of poorer quality than those obtained assimilating AIRS temperatures.

Susskind, Joel↗
NASA NTRS2010

Use of Quality Controlled AIRS Temperature Soundings to Improve Forecast Skill

AIRS was launched on EOS Aqua on May 4, 2002, together with AMSU-A and HSB, to form a next generation polar orbiting infrared and microwave atmospheric sounding system. The primary products of AIRS/AMSU-A are twice daily global fields of atmospheric temperature-humidity profiles, ozone profiles, sea/land surface skin temperature, and cloud related parameters including OLR. Also included are the clear column radiances used to derive these products which are representative of the radiances AIRS would have seen if there were no clouds in the field of view. All products also have error estimates. The sounding goals of AIRS are to produce 1 km tropospheric layer mean temperatures with an rms error of 1K, and layer precipitable water with an rms error of 20 percent, in cases with up to 90 percent effective cloud cover. The products are designed for data assimilation purposes for the improvement of numerical weather prediction, as well as for the study of climate and meteorological processes. With regard to data assimilation, one can use either the products themselves or the clear column radiances from which the products were derived. The AIRS Version 5 retrieval algorithm is now being used operationally at the Goddard DISC in the routine generation of geophysical parameters derived from AIRS/AMSU data. A major innovation in Version 5 is the ability to generate case-by-case level-by-level error estimates for retrieved quantities and clear column radiances, and the use of these error estimates for Quality Control. The temperature profile error estimates are used to determine a case-by-case characteristic pressure pbest, down to which the profile is considered acceptable for data assimilation purposes. The characteristic pressure p(sub best) is determined by comparing the case dependent error estimate (delta)T(p) to the threshold values (Delta)T(p). The AIRS Version 5 data set provides error estimates of T(p) at all levels, and also profile dependent values of pbest based on use of a Standard profile dependent threshold (Delta)T(p). These Standard thresholds were designed as a compromise between optimal use for data assimilation purposes, which requires highest accuracy (tighter Quality Control), and climate purposes, which requires more spatial coverage (looser Quality Control). Subsequent research using Version 5 sounding and error estimates showed that tighter Quality Control performs better for data assimilation proposes, while looser Quality Control better spatial coverage) performs better for climate purposes. We conducted a number of data assimilation experiments using the NASA GEOS-5 Data Assimilation System as a step toward finding an optimum balance of spatial coverage and sounding accuracy with regard to improving forecast skill. The model was run at a horizontal resolution of 0.5 degree latitude x 0.67 degree longitude with 72 vertical levels. These experiments were run during four different seasons, each using a different year. The AIRS temperature profiles were presented to the GEOS-5 analysis as rawinsonde profiles, and the profile error estimates (delta)T(p) were used as the uncertainty for each measurement in the data assimilation process.

Susskind, Joel↗
NASA NTRS1983

Stratospheric wind errors, initial states and forecast skill in the GLAS general circulation model

Relations between stratospheric wind errors, initial states and 500 mb skill are investigated using the GLAS general circulation model initialized with FGGE data. Erroneous stratospheric winds are seen in all current general circulation models, appearing also as weak shear above the subtropical jet and as cold polar stratospheres. In this study it is shown that the more anticyclonic large-scale flows are correlated with large forecast stratospheric winds. In addition, it is found that for North America the resulting errors are correlated with initial state jet stream accelerations while for East Asia the forecast winds are correlated with initial state jet strength. Using 500 mb skill scores over Europe at day 5 to measure forecast performance, it is found that both poor forecast skill and excessive stratospheric winds are correlated with more anticyclonic large-scale flows over North America. It is hypothesized that the resulting erroneous kinetic energy contributes to the poor forecast skill, and that the problem is caused by a failure in the modeling of the stratospheric energy cycle in current general circulation models independent of vertical resolution.

Tenenbaum, J.↗
NASA NTRS2015

Model Forecast Skill and Sensitivity to Initial Conditions in the Seasonal Sea Ice Outlook

We explore the skill of predictions of September Arctic sea ice extent from dynamical models participating in the Sea Ice Outlook (SIO). Forecasts submitted in August, at roughly 2 month lead times, are skillful. However, skill is lower in forecasts submitted to SIO, which began in 2008, than in hindcasts (retrospective forecasts) of the last few decades. The multimodel mean SIO predictions offer slightly higher skill than the single-model SIO predictions, but neither beats a damped persistence forecast at longer than 2 month lead times. The models are largely unsuccessful at predicting each other, indicating a large difference in model physics and/or initial conditions. Motivated by this, we perform an initial condition sensitivity experiment with four SIO models, applying a fixed −1 m perturbation to the initial sea ice thickness. The significant range of the response among the models suggests that different model physics make a significant contribution to forecast uncertainty.

Arctic Sea↗
NASA NTRS2013

Evaluating NMME Seasonal Forecast Skill for use in NASA SERVIR Hub Regions

The U.S. National Multi-Model Ensemble seasonal forecasting system is providing hindcast and real-time data streams to be used in assessing and improving seasonal predictive capacity. The coupled forecasts have numerous potential applications, both national and international in scope. The NASA / USAID SERVIR project, which leverages satellite and modeling-based resources for environmental decision making in developing nations, is focusing on the evaluation of NMME forecasts specifically for use in driving applications models in hub regions including East Africa, the Hindu Kush- Himalayan (HKH) region and Mesoamerica. A prerequisite for seasonal forecast use in application modeling (e.g. hydrology, agriculture) is bias correction and skill assessment. Efforts to address systematic biases and multi-model combination in support of NASA SERVIR impact modeling requirements will be highlighted. Specifically, quantilequantile mapping for bias correction has been implemented for all archived NMME hindcasts. Both deterministic and probabilistic skill estimates for raw, bias-corrected, and multi-model ensemble forecasts as a function of forecast lead will be presented for temperature and precipitation. Complementing this statistical assessment will be case studies of significant events, for example, the ability of the NMME forecasts suite to anticipate the 2010/2011 drought in the Horn of Africa and its relationship to evolving SST patterns.

Roberts, J. Brent↗
NASA NTRS2015

Improving Forecast Skill by Assimilation of AIRS Cloud Cleared Radiances RiCC

ECMWF, NCEP, and GMAO routinely assimilate radiosonde and other in-situ observations along with satellite IR and MW Sounder radiance observations. NCEP and GMAO use the NCEP GSI Data Assimilation System (DAS).GSI DAS assimilates AIRS, CrIS, IASI channel radiances Ri on a channel-by-channel, case-by-case basis, only for those channels i thought to be unaffected by cloud cover. This test excludes Ri for most tropospheric sounding channels under partial cloud cover conditions. AIRS Version-6 RiCC is a derived quantity representative of what AIRS channel i would have seen if the AIRS FOR were cloud free. All values of RiCC have case-by-case error estimates RiCC associated with them. Our experiments present to the GSI QCd values of AIRS RiCC in place of AIRS Ri observations. GSI DAS assimilates only those values of RiCC it thinks are cloud free. This potentially allows for better coverage of assimilated QCd values of RiCC as compared to Ri.

Forecast Skill↗
NASA NTRS1993

An evaluation of the real-time tropical cyclone forecast skill of the Navy Operational Global Atmospheric Prediction System in the western North Pacific

The paper evaluates the meteorological quality and operational utility of the Navy Operational Global Atmospheric Prediction System (NOGAPS) in forecasting tropical cyclones. It is shown that the model can provide useful predictions of motion and formation on a real-time basis in the western North Pacific. The meterological characteristics of the NOGAPS tropical cyclone predictions are evaluated by examining the formation of low-level cyclone systems in the tropics and vortex structure in the NOGAPS analysis and verifying 72-h forecasts. The adjusted NOGAPS track forecasts showed equitable skill to the baseline aid and the dynamical model. NOGAPS successfully predicted unusual equatorward turns for several straight-running cyclones.

Fiorino, Michael↗
DOE OSTI2023

Multi-decadal variation of ENSO forecast skill since the late 1800s

Diagnosing El Niño-Southern Oscillation (ENSO) predictability within operational forecast models is hindered by computational expense and the need for initialization with three-dimensional fields generated by global data assimilation. We instead examine multi-year ENSO predictability since the late 1800s using the model-analog technique, which has neither limitation. We first draw global coupled model states from pre-industrial control simulations, from the Coupled Model Intercomparison Project Phase 6, that are chosen to initially match observed monthly sea surface temperature and height anomalies in the Tropics. Their subsequent 36-month model evolution are the hindcasts, whose 20th century ENSO skill is comparable to twice-yearly hindcasts generated by a state-of-the-art European operational forecasting system. Despite the so-called spring predictability barrier, present throughout the record, there is substantial second-year ENSO skill, especially after 1960. Overall, ENSO exhibited notably high values of both amplitude and skill towards the end of the 19th century, and again in recent decades.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1985

Synoptic scale forecast skill and systematic errors in the MASS 2.0 model

The synoptic scale performance characteristics of MASS 2.0 are determined by comparing filtered 12-24 hr model forecasts to same-case forecasts made by the National Meteorological Center's synoptic-scale Limited-area Fine Mesh model. Characteristics of the two systems are contrasted, and the analysis methodology used to determine statistical skill scores and systematic errors is described. The overall relative performance of the two models in the sample is documented, and important systematic errors uncovered are presented.

Koch, S. E.↗
NASA NTRS1989

Sensitivity of mesoscale-model forecast skill to some initial-data characteristics, data density, data position, analysis procedure and measurement error

The effects of horizontal and vertical data resolution, data density, data location, different objective analysis algorithms, and measurement error on mesoscale-forecast accuracy are studied with observing-system simulation experiments. Domain-averaged errors are shown to generally decrease with time. It is found that the vertical distribution of error growth depends on the initial vertical distribution of the error itself. Larger gravity-inertia wave noise is produced in forecasts with coarser vertical data resolution. The use of a low vertical resolution observing system with three data levels leads to more forecast errors than moderate and high vertical resolution observing systems with 8 and 14 data levels. Also, with poor vertical resolution in soundings, the initial and forecast errors are not affected by the horizontal data resolution.

Warner, Thomas T.↗
NASA NTRS2007

Improving Forecast Skill by Assimilation of Quality-controlled AIRS Temperature Retrievals under Partially Cloudy Conditions

The National Aeronautics and Space Administration (NASA) Atmospheric Infrared Sounder (AIRS) on board the Aqua satellite has been long recognized as an important contributor towards the improvement of weather forecasts. At this time only a small fraction of the total data produced by AIRS is being used by operational weather systems. In fact, in addition to effects of thinning and quality control, the only AIRS data assimilated are radiance observations of channels unaffected by clouds. Observations in mid-lower tropospheric sounding AIRS channels are assimilated primarily under completely clear-sky conditions, thus imposing a very severe limitation on the horizontal distribution of the AIRS-derived information. In this work it is shown that the ability to derive accurate temperature profiles from AIRS observations in partially cloud-contaminated areas can be utilized to further improve the impact of AIRS observations in a global model and forecasting system. The analyses produced by assimilating AIRS temperature profiles obtained under partial cloud cover result in a substantially colder representation of the northern hemisphere lower midtroposphere at higher latitudes. This temperature difference has a strong impact, through hydrostatic adjustment, in the midtropospheric geopotential heights, which causes a different representation of the polar vortex especially over northeastern Siberia and Alaska. The AIRS-induced anomaly propagates through the model's dynamics producing improved 5-day forecasts.

Reale, O.↗
NASA NTRS1994

Forecast skill of a high-resolution real-time mesoscale model designed for weather support of operations at Kennedy Space Center and Cape Canaveral Air Station

NASA funded Mesoscale Environmental Simulations and Operations (MESO), Inc. to develop a version of the Mesoscale Atmospheric Simulation System (MASS). The model has been modified specifically for short-range forecasting in the vicinity of KSC/CCAS. To accomplish this, the model domain has been limited to increase the number of horizontal grid points (and therefore grid resolution) and the model' s treatment of precipitation, radiation, and surface hydrology physics has been enhanced to predict convection forced by local variations in surface heat, moisture fluxes, and cloud shading. The objective of this paper is to (1) provide an overview of MASS including the real-time initialization and configuration for running the data pre-processor and model, and (2) to summarize the preliminary evaluation of the model's forecasts of temperature, moisture, and wind at selected rawinsonde station locations during February 1994 and July 1994. MASS is a hydrostatic, three-dimensional modeling system which includes schemes to represent planetary boundary layer processes, surface energy and moisture budgets, free atmospheric long and short wave radiation, cloud microphysics, and sub-grid scale moist convection.

Taylor, Gregory E.↗
NASA NTRS2012

Recent Advances in Improvement of Forecast Skill and Understanding Climate Processes Using AIRS Version-5 Products

AIRS/AMSU is the state of the art infrared and microwave atmospheric sounding system flying aboard EOS Aqua. These observations, covering the period September 2002 until the present, have been analyzed using the AIRS Science Team Version-5 retrieval algorithm. AIRS is a high spectral resolution infrared grating spectrometer with spect,ral coverage from 650 per centimeter extending to 2660 per centimeter, with low noise and a spectral resolving power of 2400. A brief overview of the AIRS Version-5 retrieval procedure will be presented, including the AIRS channels used in different steps in the retrieval process. Many researchers have used these products to make significant advances in both climate and weather applications. Recent significant results of these experiments will be presented, including results showing that 1) assimilation of AIRS Quality Controlled temperature profiles into a General Circulation Model (GCM) significantly improves the ability to predict storm tracks of intense precipitation events; and 2) anomaly time-series of Outgoing Longwave Radiation (OLR) computed using AIRS sounding products closely match those determined from the CERES instrument, and furthermore explain that the phenomenon that global and especially tropical mean OLR have been decreasing since September 2002 is a result of El Nino/La Nina oscillations during this period.

Susskind, Joel↗