Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Skillful Forecasts of Basic Hydrological Quantities Through the Application of SMAP-Based Soil Moisture Retrievals

The top five centimeters of soil lie at the interface between the atmosphere and land; hydrological variations in the atmosphere communicate themselves to the land largely through this layer, and vice-versa. The estimates of near-surface soil moisture provided by the SMAP mission are thus central to studies of hydrological variability. In fact, recent analyses show that the hydrological variability captured in the SMAP soil moisture retrievals can be parlayed into useful hydrological predictions at various leads (weekly out to seasonal). Specifically, at a given location, using the antecedent time series of SMAP Level 2 soil moisture retrievals up to the start of a forecast, skillful predictions can be made of surface soil moisture anomalies at a 1-week lead, of evapotranspiration stress anomalies at a ~1 month lead, and of streamflow anomalies at a multi-month lead. The skill is derived in part from soil moisture memory (along with the interpretation of deeper soil moisture from the surface measurements) and from joint analyses, outside the forecast period, of the SMAP retrievals with existing observational hydrological datasets.

soil moisture retrievals↗

Windows of Opportunity for Skillful Forecasts Subseasonal to Seasonal and Beyond

There is high demand and a growing expectation for predictions of environmental conditions that go beyond 0–14-day weather forecasts with outlooks extending to one or more seasons and beyond. This is driven by the needs of the energy, water management, and agriculture sectors, to name a few. There is an increasing realization that, unlike weather forecasts, prediction skill on longer time scales can leverage specific climate phenomena or conditions for a predictable signal above the weather noise. Currently, it is understood that these conditions are intermittent in time and have spatially heterogeneous impacts on skill, hence providing strategic windows of opportunity for skillful forecasts. Research points to such windows of opportunity, including El Niño or La Niña events, active periods of the Madden–Julian oscillation, disruptions of the stratospheric polar vortex, when certain large-scale atmospheric regimes are in place, or when persistent anomalies occur in the ocean or land surface. Gains could be obtained by increasingly developing prediction tools and metrics that strategically target these specific windows of opportunity. Across the globe, reevaluating forecasts in this manner could find value in forecasts previously discarded as not skillful. Users’ expectations for prediction skill could be more adequately met, as they are better aware of when and where to expect skill and if the prediction is actionable. Given that there is still untapped potential, in terms of process understanding and prediction methodologies, it is safe to expect that in the future forecast opportunities will expand. Process research and the development of innovative methodologies will aid such progress.

Annarita Mariotti↗

Impact of Land Surface Initialization Approach on Subseasonal Forecast Skill: a Regional Analysis in the Southern Hemisphere

The authors use a sophisticated coupled land-atmosphere modeling system for a Southern Hemisphere subdomain centered over southeastern Australia to evaluate differences in simulation skill from two different land surface initialization approaches. The first approach uses equilibrated land surface states obtained from offline simulations of the land surface model, and the second uses land surface states obtained from reanalyses. The authors find that land surface initialization using prior offline simulations contribute to relative gains in subseasonal forecast skill. In particular, relative gains in forecast skill for temperature of 10%-20% within the first 30 days of the forecast can be attributed to the land surface initialization method using offline states. For precipitation there is no distinct preference for the land surface initialization method, with limited gains in forecast skill irrespective of the lead time. The authors evaluated the asymmetry between maximum and minimum temperatures and found that maximum temperatures had the largest gains in relative forecast skill, exceeding 20% in some regions. These results were statistically significant at the 98% confidence level at up to 60 days into the forecast period. For minimum temperature, using reanalyses to initialize the land surface contributed to relative gains in forecast skill, reaching 40% in parts of the domain that were statistically significant at the 98% confidence level. The contrasting impact of the land surface initialization method between maximum and minimum temperature was associated with different soil moisture coupling mechanisms. Therefore, land surface initialization from prior offline simulations does improve predictability for temperature, particularly maximum temperature, but with less obvious improvements for precipitation and minimum temperature over southeastern Australia.

Precipitation↗

Seasonal Forecasting Skill for the High Mountain Asia Region in the Goddard Earth Observing System

Seasonal variability of the global hydrologic cycle directly impacts human activities, including hazard assessment and mitigation, agricultural decisions, and water resources management. This is particularly true across the High Mountain Asia (HMA) region, where availability of water resources can change depending on local seasonality of the hydrologic cycle. Forecasting the atmospheric states and surface conditions, including hydrometeorological relevant variables, at subseasonal-to-seasonal (S2S) lead times of weeks-to-months is an area of active research and development. NASA’s 15 Goddard Earth Observing System (GEOS) S2S prediction system has been developed with this research goal in mind. Here, we benchmark the forecast skill of GEOS-S2S (version 2) hydrometeorological forecasts at 1-3 month lead times in the HMA region, including a portion of the Indian Subcontinent, during the retrospective forecast period, 1981-2016. To assess forecast skill, we evaluate 2-m air temperature, total precipitation, fractional snow cover, snow water equivalent, surface soil moisture, and terrestrial water storage forecasts against the Modern-Era Retrospective analysis for Research and 20 Applications, Version 2 (MERRA-2) and independent reanalysis data, satellite observations, and data fusion products. Anomaly correlation is highest when the forecasts are evaluated against MERRA-2 and particularly in variables with long memory in the climate system, likely due to similar initial conditions and model architecture used in GEOS-S2S and MERRA-2. When compared to MERRA-2, results for the 1-month forecast skill range from anomaly correlation of R anom =0.18 for precipitation to R anom =0.62 for soil moisture. Anomaly correlations are consistently lower when forecasts are 25 evaluated against independent observations; results for the 1-month forecast skill range from R anom =0.13 for snow water equivalent to R anom =0.24 for fractional snow cover. We find that, generally, hydrometeorological forecast skill is dependent on the forecast lead time, the memory of the variable within the physical system, and the validation dataset used. Overall, these results benchmark the GEOS-S2S system’s ability to forecast HMA hydrometeorology.

GEOS↗

Seasonal forecasting skill for the High Mountain Asia region in the Goddard Earth Observing System

Seasonal variability of the global hydrologic cycle directly impacts human activities, including hazard assessment and mitigation, agricultural decisions, and water resources management. This is particularly true across the High Mountain Asia (HMA) region, where availability of water resources can change depending on local seasonality of the hydrologic cycle. Forecasting the atmospheric states and surface conditions, including hydrometeorologically relevant variables, at subseasonal-to-seasonal (S2S) lead times of weeks to months is an area of active research and development. NASA's Goddard Earth Observing System (GEOS) S2S prediction system has been developed with this research goal in mind. Here, we benchmark the forecast skill of GEOS-S2S (version 2) hydrometeorological forecasts at 1–3-month lead times in the HMA region, including a portion of the Indian subcontinent, during the retrospective forecast period, 1981–2016. To assess forecast skill, we evaluate 2 m air temperature, total precipitation, fractional snow cover, snow water equivalent, surface soil moisture, and terrestrial water storage forecasts against the Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) and independent reanalysis data, satellite observations, and data fusion products. Anomaly correlation is highest when the forecasts are evaluated against MERRA-2 and particularly in variables with long memory in the climate system, likely due to the similar initial conditions and model architecture used in GEOS-S2S and MERRA-2. When compared to MERRA-2, results for the 1-month forecast skill range from an anomaly correlation of R anom =0.18 for precipitation to R anom =0.62 for soil moisture. Anomaly correlations are consistently lower when forecasts are evaluated against independent observations; results for the 1-month forecast skill range from R anom =0.13 for snow water equivalent to R anom =0.24 for fractional snow cover. We find that, generally, hydrometeorological forecast skill is dependent on the forecast lead time, the memory of the variable within the physical system, and the validation dataset used. Overall, these results benchmark the GEOS-S2S system's ability to forecast HMA hydrometeorology.

54 ENVIRONMENTAL SCIENCES↗

Relating CMIP5 Model Biases to Seasonal Forecast Skill in the Tropical Pacific

Abstract We examine links between tropical Pacific mean state biases and El Niño/Southern Oscillation forecast skill, using model‐analog hindcasts of sea surface temperature (SST; 1961–2015) and precipitation (1979–2015) at leads of 0–12 months, generated by 28 different models from the fifth phase of the Coupled Model Intercomparison Project (CMIP5). Model‐analog forecast skill has been demonstrated to match or even exceed traditional assimilation‐initialized forecast skill in a given model. Models with the most realistic mean states and interannual variability for SST, precipitation, and 10‐m zonal winds in the equatorial Pacific also generate the most skillful precipitation forecasts in the central equatorial Pacific and the best SST forecasts at 6‐month or longer leads. These results show direct links between model climatological biases and seasonal forecast errors, demonstrating that model‐analog hindcast skill—that is, how well a model can capture the observed evolution of tropical Pacific anomalies—is an informative El Niño/Southern Oscillation metric for climate simulations.

Ding, Hui↗

Improving 7-Day Forecast Skill by Assimilation of Retrieved AIRS Temperature Profiles

We conducted a new set of Data Assimilation Experiments covering the period January 1 to February 29, 2016 using the GEOS-5 DAS. Our experiments assimilate all data used operationally by GMAO (Control) with some modifications. Significant improvement in Global and Southern Hemisphere Extra-tropical 7-day forecast skill was obtained when: We assimilated AIRS Quality Controlled temperature profiles in place of observed AIRS radiances, and also did not assimilate CrISATMS radiances, nor did we assimilate radiosonde temperature profiles or aircraft temperatures. This new methodology did not improve or degrade 7-day Northern Hemispheric Extra-tropical forecast skill. We are conducting experiments aimed at further improving of Northern Hemisphere Extra-tropical forecast skill.

AIRS Temperature Profiles↗

The Influence of Observation Errors on Analysis Error and Forecast Skill Investigated with an Observing System Simulation Experiment

The Global Modeling and Assimilation Office (GMAO) observing system simulation experiment (OSSE) framework is used to explore the response of analysis error and forecast skill to observation quality. In an OSSE, synthetic observations may be created that have much smaller error than real observations, and precisely quantified error may be applied to these synthetic observations. Three experiments are performed in which synthetic observations with magnitudes of applied observation error that vary from zero to twice the estimated realistic error are ingested into the Goddard Earth Observing System Model (GEOS-5) with Gridpoint Statistical Interpolation (GSI) data assimilation for a one-month period representing July. The analysis increment and observation innovation are strongly impacted by observation error, with much larger variances for increased observation error. The analysis quality is degraded by increased observation error, but the change in root-mean-square error of the analysis state is small relative to the total analysis error. Surprisingly, in the 120 hour forecast increased observation error only yields a slight decline in forecast skill in the extratropics, and no discernable degradation of forecast skill in the tropics.

Observation Error↗

Assimilation of AERONET and MODIS AOT Observations Using Variational and Ensemble Data Assimilation Methods and Its Impact on Aerosol Forecasting Skill

Data assimilation of Aerosol Robotic Network (AERONET) and Moderate Resolution Imaging Spectroradiometer (MODIS) aerosol optical thickness (AOT) for aerosol forecasting was tested within the Navy Aerosol Analysis Prediction System (NAAPS) framework, using variational and ensemble data assimilation methods. Navy aerosol forecasting currently makes use of a deterministic NAAPS simulation coupled to Navy Variational Data Assimilation System for aerosol optical depth, a two-dimensional variational data assimilation system, for MODIS AOT assimilation. An ensemble version of NAAPS (ENAAPS) coupled to an ensemble adjustment Kalman filter (EAKF) from the Data Assimilation Research Testbed was recently developed, allowing for a range of data assimilation and forecasting experiments to be run with deterministic NAAPS and ENAAPS. The main findings are that the EAKF, with its flow-dependent error covariances, makes better use of sparse observations such as AERONET AOT. Assimilating individual AERONET observations in the two-dimensional variational system can increase the analysis errors when observations are located in high AOT gradient regions. By including AERONET with MODIS AOT assimilation, the magnitudes of peak aerosol events (AOT> 1) were better captured with improved temporal variability, especially in India and Asia where aerosol prediction is a challenge. Assimilating AERONET AOT with MODIS had little impact on the 24 h forecast skill compared to MODIS assimilation only, but differences were found downwind of AERONET sites. The 24 h forecast skill was approximately the same for forecasts initialized with analyses from AERONET AOT assimilation alone compared to MODIS assimilation, particularly in regions where the AERONET network is dense; including the United States and Europe, indicating that AERONET could serve as a backup observation network for over-land synoptic-scale aerosol events.

Rubin, Juli I.↗

The Contribution of Soil Moisture Information to Forecast Skill: Two Studies

This talk briefly describes two recent studies on the impact of soil moisture information on hydrological and meteorological prediction. While the studies utilize soil moisture derived from the integration of large-scale land surface models with observations-based meteorological data, the results directly illustrate the potential usefulness of satellite-derived soil moisture information (e.g., from SMOS and SMAP) for applications in prediction. The first study, the GEWEX- and ClIVAR-sponsored GLACE-2 project, quantifies the contribution of realistic soil moisture initialization to skill in subseasonal forecasts of precipitation and air temperature (out to two months). The multi-model study shows that soil moisture information does indeed contribute skill to the forecasts, particularly for air temperature, and particularly when the initial local soil moisture anomaly is large. Furthermore, the skill contributions tend to be larger where the soil moisture initialization is more accurate, as measured by the density of the observational network contributing to the initialization. The second study focuses on streamflow prediction. The relative contributions of snow and soil moisture initialization to skill in streamflow prediction at seasonal lead, in the absence of knowledge of meteorological anomalies during the forecast period, were quantified with several land surface models using uniquely designed numerical experiments and naturalized streamflow data covering mUltiple decades over the western United States. In several basins, accurate soil moisture initialization is found to contribute significant levels of predictive skill. Depending on the date of forecast issue, the contributions can be significant out to leads of six months. Both studies suggest that improvements in soil moisture initialization would lead to increases in predictive skill. The relevance of SMOS and SMAP satellite-based soil moisture information to prediction are discussed in the context of these studies.

Koster, Randal↗

A case study of the sensitivity of forecast skill to data and data analysis techniques

A series of experiments have been conducted to examine the sensitivity of forecast skill to various data and data analysis techniques for the 0000 GMT case of January 21, 1979. These include the individual components of the FGGE observing system, the temperatures obtained with different satellite retrieval methods, and the method of vertical interpolation between the mandatory pressure analysis levels and the model sigma levels. It is found that NESS TIROS-N infrared retrievals seriously degrade a rawinsonde-only analysis over land, resulting in a poorer forecast over North America. Less degradation in the 72-hr forecast skill at sea level and some improvement at 500 mb is noted, relative to the control with TIROS-N retrievals produced with a physical inversion method which utilizes a 6-hr forecast first guess. NESS VTPR oceanic retrievals lead to an improved forecast over North America when added to the control.

Baker, W. E.↗

Improving Forecast Skill by Assimilation of AIRS Temperature Soundings

AIRS was launched on EOS Aqua on May 4, 2002, together with AMSU-A and HSB, to form a next generation polar orbiting infrared and microwave atmospheric sounding system. The primary products of AIRS/AMSU-A are twice daily global fields of atmospheric temperature-humidity profiles, ozone profiles, sea/land surface skin temperature, and cloud related parameters including OLR. The AIRS Version 5 retrieval algorithm, is now being used operationally at the Goddard DISC in the routine generation of geophysical parameters derived from AIRS/AMSU data. A major innovation in Version 5 is the ability to generate case-by-case level-by-level error estimates delta T(p) for retrieved quantities and the use of these error estimates for Quality Control. We conducted a number of data assimilation experiments using the NASA GEOS-5 Data Assimilation System as a step toward finding an optimum balance of spatial coverage and sounding accuracy with regard to improving forecast skill. The model was run at a horizontal resolution of 0.5 deg. latitude X 0.67 deg longitude with 72 vertical levels. These experiments were run during four different seasons, each using a different year. The AIRS temperature profiles were presented to the GEOS-5 analysis as rawinsonde profiles, and the profile error estimates delta (p) were used as the uncertainty for each measurement in the data assimilation process. We compared forecasts analyses generated from the analyses done by assimilation of AIRS temperature profiles with three different sets of thresholds; Standard, Medium, and Tight. Assimilation of Quality Controlled AIRS temperature profiles significantly improve 5-7 day forecast skill compared to that obtained without the benefit of AIRS data in all of the cases studied. In addition, assimilation of Quality Controlled AIRS temperature soundings performs better than assimilation of AIRS observed radiances. Based on the experiments shown, Tight Quality Control of AIRS temperature profile performs best on the average from the perspective of improving Global 7 day forecast skill.

Susskind, Joel↗

Evaluating precipitation, streamflow, and inundation forecasting skills during extreme weather events: A case study for an urban watershed

Integrated forecasting systems for precipitation, streamflow, and floodplain inundation are of critical importance in mitigating the impacts of destructive floods caused by extreme weather events. However, the skills of streamflow and floodplain inundation forecasts derived from various Quantitative Precipitation Forecasts (QPF) require a greater level of understanding. In this paper, a set of QPF developed by the National Weather Service (NWS) were used to drive a flood modeling system obtained utilizing offline coupling of a physics-based distributed hydrological model, the Distributed Hydrology Soil and Vegetation Model (DHSVM), and a hydrodynamic model, the Two-dimensional Runoff Inundation Toolkit for Operational Needs (TRITON). This flood modeling system was used to produce forecasts of streamflow and floodplain inundation maps during three major flood events in the Brays Bayou Watershed (Houston, Texas, USA) for a range of QPF durations (6–72 h). Then, to investigate the effects of increasing QPF durations on the forecasts, the forecasting skills of precipitation, streamflow, and floodplain inundation were quantified. The results show that: 1) QPF skills for more intense and sustained events such as hurricanes and tropical storms are higher than for shorter, less intense events; 2) while QPF and streamflow forecasting skills decrease as QPF durations increase, inundation forecasts under longer QPF durations (24 or 72 h) show higher skills; 3) extending the maximum QPF duration in operational hydrologic modeling from 24 h (under normal circumstances) to 72 h (for extreme events) may increase the skills of long lead time forecasts for large-scale events like Hurricane Harvey.

54 ENVIRONMENTAL SCIENCES↗

Investigation of Coupled Land-Atmosphere Carbon Dynamics and Seasonal Carbon Forecast Skill

In this talk, I will present recent efforts to explore coupled land-atmosphere carbon dynamics and carbon cycle predictability. First, the impact of a regional drought on land and atmospheric carbon was studied by imposing an idealized spring drought in coupled land‐atmosphere ensemble simulations. Through drought-induced impact on remote meteorology, the drought alters land’s productivity not only in the drought area but also in the adjacent areas. The atmospheric CO2 anomalies extend to an area up to three times of that of the imposed drought, which suggests that atmospheric transport needs to be considered in the interpretation of drought‐induced carbon anomalies. Increase in column‐averaged monthly CO2 by the imposed drought is at the edge of the uncertainty from single soundings of current greenhouse gas observing satellites. Secondly, the seasonal carbon forecast skill was explored using NASA’s subseasonal-to-seasonal (S2S) ensemble forecast and a terrestrial biosphere model. The result demonstrates an ability to accurately predict spring-summer carbon uptake at multi-month leads in the Northern Hemisphere mid- and high latitude land. The skill appears to be achieved by accurate forecasts of snow removal timing as well as proper initialization of carbon and nitrogen states. Additionally, I will briefly discuss other ongoing research activities to improve hydrometeorological prediction by integrating biogeochemical processes, to evaluate forecast skill of wildfire, and to apply subseasonal forecasts to water resources management.

Eunjee Lee↗

Exploring Coupled Land-Atmosphere Carbon Dynamics and Seasonal Carbon Forecast Skill

Terrestrial biosphere is an integral part of the climate system and plays a vital role in controlling the dynamics of the Earth’s carbon cycle. In this talk, I will present recent efforts to explore coupled land-atmosphere carbon dynamics and seasonal carbon cycle predictability. First, by imposing an idealized spring drought in coupled land‐atmosphere ensemble simulations, we investigated the impact of a regional drought on land and atmospheric carbon. Through the drought-induced impact on remote meteorology, the capability of the land’s carbon uptake is altered in both the drought area and the adjacent areas. The induced anomalies of the atmospheric CO2 extend to an area up to three times of that of the imposed drought, which suggests that atmospheric transport needs to be considered in the interpretation of the drought impact on carbon anomalies. Increase in column‐averaged monthly CO2 is at the edge of the uncertainty from single soundings of current greenhouse gas observing satellites. Secondly, the seasonal carbon forecast skill was explored using NASA’s subseasonal-to-seasonal (S2S) ensemble forecast and terrestrial biosphere model. The result demonstrates an ability to accurately predict spring-summer carbon uptake in the Northern Hemisphere mid and high latitude land at multi-month leads. The prediction skill appears to be achieved by accurate forecasts of snow removal timing, which provides a latent predictability to the forecast system, and by proper initialization of carbon and nitrogen states. Additionally, I will briefly discuss other ongoing research to improve hydrometeorological prediction by integrating biogeochemical processes, to evaluate forecast skill of wildfire carbon, and to apply subseasonal forecasts to water resources management.

Eunjee Lee↗

Sensitivity of Forecast Skill to Different Objective Analysis Schemes

Numerical weather forecasts are characterized by rapidly declining skill in the first 48 to 72 h. Recent estimates of the sources of forecast error indicate that the inaccurate specification of the initial conditions contributes substantially to this error. The sensitivity of the forecast skill to the initial conditions is examined by comparing a set of real-data experiments whose initial data were obtained with two different analysis schemes. Results are presented to emphasize the importance of the objective analysis techniques used in the assimilation of observational data.

Baker, W. E.↗

Forecast skill impact of drifting buoys in the Southern Hemisphere

Two analyses are performed to evaluate the effect of drift buoys and the FGGE's special observing system (SOS) on forecasting. The FGGE analysis utilizes all level II-b conventional and special data, and the Nosat analysis employs only surface and conventional upper air data. Twelve five-day forecasts are produced from these data. An additional experiment utilizing the FGGE data base minus buoys data, and the Nosat data base including buoys data is being conducted. The forecasts are compared and synoptic evaluation of the effect of buoys data is described. The results reveal that the FGGE data base with the SOS significantly improves forecasting in the Southern Hemisphere and the loss of buoys data does not have a great effect on forecasting. The Nosat data has less impact on forecasting; however, the addition of buoys data provides an improvement in forecast skills.

Kalnay, E.↗

Five-day track forecast skills of WRF model for the western North Pacific tropical cyclones

In this study, the characteristics of simulated tropical cyclones (TCs) over the western North Pacific by a regional model (the WRF Model) are verified. We utilize 12-km horizontal grid spacing, and simulations are integrated for 5 days from model initialization. A total of 125 forecasts are divided into five clusters through the k-means clustering method. The TCs in the cluster 1 and 2 (group 1), which includes many TCs moving northward in the subtropical region, generally have larger track errors than for TCs in cluster 3 and 4 (group 2). The optimal steering vector is used to examine the difference in the track forecast skill between these two groups. The bias in the steering vector between the model and analysis data is found to be more substantial for group 1 TCs than group 2 TCs. The larger steering vector difference for group 1 TCs indicates that environmental fields tend to be poorly simulated in group 1 TC cases. Furthermore, the residual terms, including the storm-scale process, asymmetric convection distribution, or beta-related effect, are also larger for group 1 TCs than group 2 TCs. Therefore, it is probable that the large track forecast error for group 1 TCs is a result of unreasonable simulations of environmental wind fields and residual processes in the midlatitudes.

54 ENVIRONMENTAL SCIENCES↗