Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

The Role of Model and Initial Condition Error in Numerical Weather Forecasting Investigated with an Observing System Simulation Experiment

A series of experiments that explore the roles of model and initial condition error in numerical weather prediction are performed using an observing system simulation experiment (OSSE) framework developed at the National Aeronautics and Space Administration Global Modeling and Assimilation Office (NASA/GMAO). The use of an OSSE allows the analysis and forecast errors to be explicitly calculated, and different hypothetical observing networks can be tested with ease. In these experiments, both a full global OSSE framework and an 'identical twin' OSSE setup are utilized to compare the behavior of the data assimilation system and evolution of forecast skill with and without model error. The initial condition error is manipulated by varying the distribution and quality of the observing network and the magnitude of observation errors. The results show that model error has a strong impact on both the quality of the analysis field and the evolution of forecast skill, including both systematic and unsystematic model error components. With a realistic observing network, the analysis state retains a significant quantity of error due to systematic model error. If errors of the analysis state are minimized, model error acts to rapidly degrade forecast skill during the first 24-48 hours of forward integration. In the presence of model error, the impact of observation errors on forecast skill is small, but in the absence of model error, observation errors cause a substantial degradation of the skill of medium range forecasts.

Model Error↗

Medium range lagged average forecasts

In this work, the application of the lagged average forecasting (LAF) technique to operational forecasts of the ECMWF is reported. The ECMWF data consist of two 100-day samples of 10-day forecasts of 500-mb geopotential height for winter 1980/81 and summer 1981. the LAF ensemble includes the latest operational forecast, and also forecast for the same verification time started one or more days earlier than the latest one. The focus is on the following two issues: (1) does ensemble averaging improve forecast skill and (2) is the dispersion of the ensemble useful in predicting forecast skill. The LAF technique was used to produce 3, 5, 7, 8, and 9 day forecasts of the 500-mb height field. The results show that the statistically filtered LAF is a marked improvment upon the operational forecast after 5 days. It is found that on a global scale, forecast skill is weakly correlated with the dispersion of the ensemble, as measured by the rms difference between the operational forecast and the statistically filtered LAF.

Dalcher, Amnon↗

Effects of data selection on the assimilation of AIRS data

The Atmospheric InfraRed Sounder (AIRS), flying aboard NASA's Earth Observing System (EOS) Aqua satellite with the Advanced Microwave Sounding Unit-A (AMSU-A), has been providing data for use in numerical weather prediction (NWP) and data assimilation systems (DAS) for over three years. The full AIRS data set is currently not transmitted in near-real-time (NRT) to the NWP centers. Instead, data sets with reduced spatial and spectral information are produced and made available in NRT. In this paper, we evaluate the use of different channel selections and error specifications. We achieved significant positive impact from the Aqua AIRS/AMSU-A combination in both hemispheres during our experimental time period of January 2003. The best results were obtained using a set of 156 channels that did not include any in the 6.7micron water vapor band. The latter have a large influence on both temperature and humidity analyses. If observation and background errors are not properly specified, the partitioning of temperature and humidity information from these channels will not be correct, and this can lead to a degradation in forecast skill. We found that changing the specified channel errors had a significant effect on the amount of data that entered into the analysis as a result of quality control thresholds that are related to the errors. However, changing the channel errors within a relatively small window did not significantly impact forecast skill with the 155 channel set. We also examined the effects of different types of spatial data reduction on assimilated data sets and NWP forecast skill. Whether we picked the center or the warmest AIRS pixel in a 3x3 array affected the amount of data ingested by the analysis but had a negligible impact on the forecast skill.

Joiner, Joanna↗

Lightning Initiation Forecasting: An Operational Dual-Polarimetric Radar Technique

The objective of this NASA MSFC and NOAA CSTAR funded study is to develop and test operational forecast algorithms for the prediction of lightning initiation utilizing the C-band dual-polarimetric radar, UAHuntsville's Advanced Radar for Meteorological and Operational Research (ARMOR). Although there is a rich research history of radar signatures associated with lightning initiation, few studies have utilized dual-polarimetric radar signatures (e.g., Z(sub dr) columns) and capabilities (e.g., fuzzy-logic particle identification [PID] of precipitation ice) in an operational algorithm for first flash forecasting. The specific goal of this study is to develop and test polarimetric techniques that enhance the performance of current operational radar reflectivity based first flash algorithms. Improving lightning watch and warning performance will positively impact personnel safety in both work and leisure environments. Advanced warnings can provide space shuttle launch managers time to respond appropriately to secure equipment and personnel, while they can also provide appropriate warnings for spectators and players of leisure sporting events to seek safe shelter. Through the analysis of eight case dates, consisting of 35 pulse-type thunderstorms and 20 non-thunderstorm case studies, lightning initiation forecast techniques were developed and tested. The hypothesis is that the additional dual-polarimetric information could potentially reduce false alarms while maintaining high probability of detection and increasing lead-time for the prediction of the first lightning flash relative to reflectivity-only based techniques. To test the hypothesis, various physically-based techniques using polarimetric variables and/or PID categories, which are strongly correlated to initial storm electrification (e.g., large precipitation ice production via drop freezing), were benchmarked against the operational reflectivity-only based approaches to find the best compromise between forecast skill and lead-time. Forecast skill is determined by statistical analysis of probability of detection (POD), false alarm ratio (FAR), Operational Utility Index (OUI), and critical success index (CSI).

Woodard, Crystal J.↗

Assimilation of Quality Controlled AIRS Temperature Profiles using the NCEP GFS

We have previously conducted a number of data assimilation experiments using AIRS Version-5 quality controlled temperature profiles as a step toward finding an optimum balance of spatial coverage and sounding accuracy with regard to improving forecast skill. The data assimilation and forecast system we used was the Goddard Earth Observing System Model , Version-5 (GEOS-5) Data Assimilation System (DAS), which represents a combination of the NASA GEOS-5 forecast model with the National Centers for Environmental Prediction (NCEP) operational Grid Point Statistical Interpolation (GSI) global analysis scheme. All analyses and forecasts were run at a 0.5deg x 0.625deg spatial resolution. Data assimilation experiments were conducted in four different seasons, each in a different year. Three different sets of data assimilation experiments were run during each time period: Control; AIRS T(p); and AIRS Radiance. In the "Control" analysis, all the data used operationally by NCEP was assimilated, but no AIRS data was assimilated. Radiances from the Aqua AMSU-A instrument were also assimilated operationally by NCEP and are included in the "Control". The AIRS Radiance assimilation adds AIRS observed radiance observations for a select set of channels to the data set being assimilated, as done operationally by NCEP. In the AIRS T(p) assimilation, all information used in the Control was assimilated as well as Quality Controlled AIRS Version-5 temperature profiles, i.e., AIRS T(p) information was substituted for AIRS radiance information. The AIRS Version-5 temperature profiles were presented to the GSI analysis as rawinsonde profiles, assimilated down to a case-by-case appropriate pressure level p(sub best) determined using the Quality Control procedure. Version-5 also determines case-by-case, level-by-level error estimates of the temperature profiles, which were used as the uncertainty of each temperature measurement. These experiments using GEOS-5 have shown that forecasts resulting from analyses using the AIRS T(p) assimilation system were superior to those from the Radiance assimilation system, both with regard to global 7 day forecast skill and also the ability to predict storm tracks and intensity.

Susskind, Joel↗

Isolating the Impacts of Soil Moisture Initialization on Land Carbon Fluxes at the Sub-Seasonal to Seasonal Scale

Soil moisture, through its impact on transpiration, plays a significant role in controlling the productivity of terrestrial vegetation. Initial soil moisture conditions in a seasonal forecast may therefore affect the forecast of land carbon uptake. Here we investigate the relative impacts of soil moisture initialization and carbon reservoir initialization on forecasts of land carbon fluxes at the sub-seasonal to seasonal (S2S) scale. The bias-corrected, retrospective meteorology of NASA Global Modeling and Assimilation Office (GMAO)’s S2S ensemble forecast was used to force the stand-alone Catchment-CN model and thereby estimate terrestrial carbon responses out to nine lead months. Our results show that soil moisture initialization is a major contributor (approximately 44%) to the high global carbon uptake forecast skill seen during the first three lead months. The carbon reservoir initialization explains roughly another half of the monthly carbon forecast skill during this period and becomes relatively more important at longer leads (while the overall forecast skill decreases after the 3 lead month), suggesting a slower but longer-lasting influence of carbon reservoir initialization on carbon fluxes. Our results highlight the significance of a good soil moisture initialization for improved forecasts of carbon fluxes at leads of several months, further support for the usefulness of assimilating the satellite based soil moisture information into terrestrial biosphere models and of a short term carbon forecast to understand current events with often a lag in the availability of flux estimates.

Land carbon↗

Open Source Evaluation Framework for Solar Forecasting

The Solar Forecast Arbiter is an open-source evaluation framework for solar forecasting. The framework enables evaluations of solar irradiance, solar power, and net-load forecasts that are impartial, repeatable and auditable. The Solar Forecast Arbiter addresses stakeholder-informed use cases including evaluation of forecast skill, comparisons to reference data sets, private forecast trials, and evaluation of probabilistic forecast skill. The framework includes a data validation toolkit, reference data sources, data privacy protocols, and benchmark forecast capabilities for intra-hour and day ahead forecast horizons. Reports and metrics communicate the relative merits of the test and benchmark forecasts. The reports are created from standardized templates and include graphics for qualitatively evaluating deterministic and probabilistic forecasts and standard metrics for quantitatively evaluating forecasts. The Solar Forecast Arbiter is designed to support all solar forecasting stakeholders, including Solar Forecasting 2 Topic Area 2 and Topic Area 3 teams.

14 SOLAR ENERGY↗

Analysis and forecast intercomparisons using the FGGE SOP-1 data base

The First GARP Global Experiment (FGGE) data base has provided the research community with the most complete global coverage of meteorological informaiton since measurements were first taken. It is important to understand the characteristics of the FGGE data base in terms of its accuracy and representativeness compared to the true state of the atmosphere. The uncertainty associated with the initial conditions used in a numerical model plays a significant role in subsequent error growth as shown by predictability theory. The ultimate limit of forecast skill is directly related to the initial uncertainty. The accuracy of analyses using FGGE data base coupled with the errors due to modeling imperfections determines the present skill of numerical models. An estimte of initial uncertainty is determined by examining differences in several FGGE analyses. The estimate is then used to determine an ultimate limit of forecast skill from derived predictability error growth rates. Several different calculations of predictability error growth are also compared. Finally, present-day forecast skill using FGGE analyses is contrasted to the estimates of ultimate skill, and the partition of model error versus initial uncertainty is discussed.

Baumhefner, D. P.↗

Ensemble Canonical Correlation Prediction of Seasonal Precipitation Over the United States: Raising the Bar for Dynamical Model Forecasts

This paper presents preliminary results of an ensemble canonical correlation (ECC) prediction scheme developed at the Climate and Radiation Branch, NASA/Goddard Space Flight Center for determining the potential predictability of regional precipitation, and for climate downscaling studies. The scheme is tested on seasonal hindcasts of anomalous precipitation over the continental United States using global sea surface temperature (SST) for 1951-2000. To maximize the forecast skill derived from SST, the world ocean is divided into non-overlapping sectors. The canonical SST modes for each sector are used as the predictor for the ensemble hindcasts. Results show that the ECC yields a substantial (10-25%) increase in prediction skills for all the regions of the US in every season compared to traditional CCA prediction schemes. For the boreal winter, the tropical Pacific contributes the largest potential predictability to precipitation in the southwestern and southeastern regions, while the North Pacific and the North Atlantic are responsible to the enhanced forecast skills in the Pacific Northwest, the northern Great Plains and Ohio Valley. Most importantly, the ECC increases skill for summertime precipitation prediction and substantially reduces the spring predictability barrier over all the regions of the US continent. Besides SST, the ECC is designed with the flexibility to include any number of predictor fields, such as soil moisture, snow cover and additional local observations. The enhanced ECC forecast skill provides a new benchmark for evaluating dynamical model forecasts.

Lau, William K. M.↗

Skillful Multi‐Month Predictions of Ecosystem Stressors in the Surface and Subsurface Ocean

Abstract Anthropogenic carbon emissions and associated climate change are driving rapid warming, acidification, and deoxygenation in the ocean, which increasingly stress marine ecosystems. On top of long‐term trends, short term variability of marine stressors can have major implications for marine ecosystems and their management. As such, there is a growing need for predictions of marine ecosystem stressors on monthly, seasonal, and multi‐month timescales. Previous studies have demonstrated the ability to make reliable predictions of the surface ocean physical and biogeochemical state months to years in advance, but few studies have investigated forecast skill of multiple stressors simultaneously or assessed the forecast skill below the surface. Here, we use the Community Earth System Model (CESM) Seasonal to Multiyear Large Ensemble (SMYLE) along with novel observation‐based biogeochemical and physical products to quantify the predictive skill of dissolved inorganic carbon (DIC), dissolved oxygen, and temperature in the surface and subsurface ocean. CESM SMYLE demonstrates high physical and biogeochemical predictive skill multiple months in advance in key oceanic regions and frequently outperforms persistence forecasts. We find up to 10 months of skillful forecasts, with particularly high skill in the Northeast Pacific (Gulf of Alaska and California Current Large Marine Ecosystems) for temperature, surface DIC, and subsurface oxygen. Our findings suggest that dynamical marine ecosystem prediction could support actionable advice for decision making.

Environmental Sciences & Ecology↗

Data Assimilation Experiments using Quality Controlled AIRS Version 5 Temperature Soundings

The AIRS Science Team Version 5 retrieval algorithm has been finalized and is now operational at the Goddard DAAC in the processing (and reprocessing) of all AlRS data. Version 5 contains accurate case-by-case error estimates for most derived products, which are also used for quality control. We have conducted forecast impact experiments assimilating AlRS quality controlled temperature profiles using the NASA GEOS-5 data assimilation system, consisting of the NCEP GSI analysis coupled with the NASA FVGCM. Assimilation of quality controlled temperature profiles resulted in significantly improved forecast skill in both the Northern Hemisphere and Southern Hemisphere Extra-Tropics, compared to that obtained from analyses obtained when all data used operationally by NCEP except for AlRS data is assimilated. Experiments using different Quality Control thresholds for assimilation of AlRS temperature retrievals showed that a medium quality control threshold performed better than a tighter threshold, which provided better overall sounding accuracy; or a looser threshold, which provided better spatial coverage of accepted soundings. We are conducting more experiments to further optimize this balance of spatial coverage and sounding accuracy from the data assimilation perspective. In all cases, temperature soundings were assimilated well below cloud level in partially cloudy cases. The positive impact of assimilating AlRS derived atmospheric temperatures all but vanished when only AIRS stratospheric temperatures were assimilated. Forecast skill resulting from assimilation of AlRS radiances uncontaminated by clouds, instead of AlRS temperature soundings, was only slightly better than that resulting from assimilation of only stratospheric AlRS temperatures. This reduction in forecast skill is most likely the result of significant loss of tropospheric information when only AIRS radiances unaffected by clouds are used in the data assimilation process.

Susskind, Joel↗

Predicting spring phenology in deciduous broadleaf forests: NEON phenology forecasting community challenge

Accurate models are important to predict how global climate change will continue to alter plant phenology and near-term ecological forecasts can be used to iteratively improve models and evaluate predictions that are made a priori. The Ecological Forecasting Initiative's National Ecological Observatory Network (NEON) Forecasting Challenge, is an open challenge to the community to forecast daily greenness values, measured through digital images collected by the PhenoCam Network at NEON sites before the data are collected. For the first round of the challenge, which is presented here, we forecasted canopy greenness throughout the spring at eight deciduous broadleaf sites to investigate when, where, and for what model type phenology forecast skill is highest. A total of 192,536 predictions were submitted, representing eighteen models, including a persistence and a day of year mean null models. We found that overall forecast skill was highest when forecasting earlier in the greenup curve compared to the end, for shorter lead times, for sites that greened up earlier, and when submitting forecasts during times other than near budburst. The models based on day of year historical mean had the highest predictive skill across the challenge period. In this first round of the challenge, by synthesizing across forecasts, we started to elucidate what factors affect the predictive skill of near-term phenology forecasts.

54 ENVIRONMENTAL SCIENCES↗

An ensemble data assimilation modeling system for operational outdoor microalgae growth forecasting

Microalgae have received increasing attention as a potential feedstock for biofuel or biobased products. Forecasting the microalgae growth is beneficial for managers in planning pond operations and harvesting decisions. This study proposed a biomass forecasting system comprised of the Huesemann Algae Biomass Growth Model (BGM), the Modular Aquatic Simulation System in Two Dimensions (MASS2), ensemble data assimilation (DA), and numerical weather prediction Global Ensemble Forecast System (GEFS) ensemble meteorological forecasts. The novelty of this study is to seek the use of ensemble DA to improve both BGM and MASS2 model initial conditions with the assimilation of biomass and water temperature measurements and consequently improve short-term biomass forecasting skills. This study introduces the theory behind the proposed integrated biomass forecasting system, with an application undertaken in pseudo-real-time in three outdoor ponds cultured with Chlorella sorokiniana in Delhi, California, United States. Results from all three case studies demonstrate that the biomass forecasting system improved the short-term (i.e., 7-day) biomass forecasting skills by about 60% on average, comparing to forecasts without using the ensemble DA method. Given the satisfactory performances achieved in this study, it is probable that the integrated BGM-MASS2-DA forecasting system can be used operationally to inform managers in making pond operation and harvesting planning decisions.

59 BASIC BIOLOGICAL SCIENCES↗

Theoretical Modeling for Numerical Weather Prediction

The goal is to utilize predictability theory and numerical experimentation to identify and understand some of the dynamical processes which must be modeled more realistically if large-scale numerical weather predictions are to be improved. The emphasis is on the use of relatively simple models to exlore the properties of physically comprehensive general circulation models (GCM's). A global linear quasi-geostrophic model and the Goddard Laboratory for Atmospheric Sciences (GLAS) GCM were used to investigate several mechanisms which are responsible for the decay of large-scale forecast skill in mid-latitude numerical weather predictions. Five-day forecasts for an ensemble of cases were made using First GARP Global Experiment data. It was found that forecast skill depends crucially on the specification of the stationary forcing. A lack of stationary forcing leads to spurious westwad propagation of the ultralong waves. Forecasts made with stationary forcings derived from climatological data are superior to those using forcings inferred from observations immediately preceding the forecast period. Interhemispheric forecast differences were analyzed, and the model errors were compared to errors of a simple persistence-damped-to-climatology scheme and to errors of the GLAS GCM.

Somerville, R. C. J.↗

Winter Precipitation in North America and the Pacific-North America Pattern in GEOS-S2Sv2 Seasonal Hindcast

Reliable prediction of precipitation remains one of the most pivotal and complex challenges in seasonal forecasting. Previous studies show that various large-scale climate modes, such as ENSO, PNA and NAO play significant role in winter precipitation variability over the Northern America. The influences are most pronounced in years of strong indices of such climate modes. This study evaluates model bias, predictability and forecast skills of monthly winter precipitation in GEOS5-S2S 2.0 retrospective forecast from 1981 to 2016, with emphasis on the forecast skill of precipitation over North America during the extreme events of ENSO, PNA and NAO by applying EOF and composite analysis.

Li, Zhao↗

Toward Integrated Seasonal Predictions of Land and Ocean Carbon Flux: Lessons from the 2015-16 El Nino

Seasonal forecasts made by coupled atmosphere-ocean general circulation models (GCMs) are increasingly able to provide skillful forecasts of climate anomalies. At some centers, the capabilities of these models are being expanded to represent carbon-climate feedbacks including ocean biogeochemistry (OB), terrestrial biosphere (TB) interactions, and fires. These advances raise the question of whether such models can support skillful forecasts of carbon fluxes.Here, we examine whether land and ocean carbon flux anomalies associated with the 2015-16 El Nino could have been predicted months in advance. This El Nino was noteworthy for the magnitude of the ocean temperature perturbation, the skill with which this perturbation was predicted, and the extensive satellite observations that can be used to track its impact. We explore this topic using NASA's Goddard Earth Observing System (GEOS) model, which routinely produces an ensemble of seasonal climate forecasts, and a suite of offline dynamical and statistical models that estimate carbon flux processes. Using GEOS forecast fields from 2015-16 to force flux model hindcasts shows that these models are able to reproduce significant features observed by satellites. Specifically, OB hindcasts are able to predict anomalies in chlorophyll distributions with lead times of 3-4 months. The ability of TB hindcasts to reproduce NDVI anomalies is driven by the skill of the climate forecast, which is greatest at short lead times over tropical landmasses. Statistical fire forecasts driven by ocean climate indices are able to predict burned area in the tropics with lead times of 3-12 months. We also integrate the ocean and land hindcast fluxes into the GEOS GCM to examine the magnitude of the atmospheric carbon dioxide anomaly and compare with satellite and ground-based observations.While seasonal forecasting remains an active area of research, these results demonstrate that forecasts of carbon flux processes can support a variety of applications, potentially allowing scientists to understand carbon-climate feedbacks as they happen and to capitalize on more flexible satellite technologies that allow areas of interest to be targeted with lead times of weeks to months. We also provide a first glimpse at the spring 2019 carbon forecast using the GEOS-based forecasting system.

Ott, L.↗

Forecasting Remote Atmospheric Responses to Decadal Kuroshio Stability Transitions

Based on observational estimates and global ocean eddy-resolving coupled retrospective initialized predictions, we show that Kuroshio Extension variability affects rainfall variability along the west coast of North America. We show that the teleconnection between the current undulations and downstream rainfall can lead to improved subseasonal to seasonal predictions of precipitation over California, and we demonstrate that capturing these teleconnections requires coupled systems with sufficient ocean resolution (i.e., eddy-resolving), especially over time scales longer than one season. The improved forecast skill is diagnosed in terms of 35 years of retrospective initialized ensemble forecasts with an ocean eddy-resolving and an ocean eddy-parameterized coupled model. Not only does the ocean eddy-resolving model show sensitivity to Kuroshio Extension variability in terms of western North America precipitation, but the ocean eddy-resolving forecasts also show improved forecast skill compared to the ocean eddy-parameterized model. Additionally, the ocean eddy-parameterized coupled model shows no sensitivity to Kuroshio Extension variability. We also find near-decadal variability associated with a progression of a lower-tropospheric height dipole around the North Pacific and how these height anomalies lead to wind-driven Rossby waves that affect the eddy activity in the Kuroshio Extension with a time lag on the order of four years. This decadal-scale variability (~10 years) opens the possibility of multiyear predictability of western North American rainfall.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Recent Theoretical Advances in Analysis of AIRS/AMSU Sounding Data

AIRS was launched on EOS Aqua on May 4,2002, together with AMSU-A and HSB, to form a next generation polar orbiting infrared and microwave atmospheric sounding system. This paper describes the AIRS Science Team Version 5.0 retrieval algorithm. Starting in early 2007, the Goddard DAAC will use this algorithm to analyze near real time AIRS/AMSU observations. These products are then made available to the scientific community for research purposes. The products include twice daily measurements of the Earth's three dimensional global temperature, water vapor, and ozone distribution as well as cloud cover. In addition, accurate twice daily measurements of the earth's land and ocean temperatures are derived and reported. Scientists use this important set of observations for two major applications. They provide important information for climate studies of global and regional variability and trends of different aspects of the earth's atmosphere. They also provide information for researchers to improve the skill of weather forecasting. A very important new product of the AIRS Version 5 algorithm is accurate case-by-case error estimates of the retrieved products. This heightens their utility for use in both weather and climate applications. These error estimates are also used directly for quality control of the retrieved products. Version 5 also allows for accurate quality controlled AIRS only retrievals, called "Version 5 AO retrievals" which can be used as a backup methodology if AMSU fails. Examples of the accuracy of error estimates and quality controlled retrieval products of the AIRS/AMSU Version 5 and Version 5 AO algorithms are given, and shown to be significantly better than the previously used Version 4 algorithm. Assimilation of Version 5 retrievals are also shown to significantly improve forecast skill, especially when the case-by-case error estimates are utilized in the data assimilation process.

Susskind, Joel↗