Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

The effect of increased horizontal resolution on synoptic forecasts with the GISS model of the global atmosphere

The improved horizontal resolution global circulation model in question has a horizontal spacing of 2.5 deg latitude by 3 deg longitude for a resolution of about 250 km in midlatitude. This paper reports on experiments to determine the improvements in forecasting skill and in initial conditions that were made possible by the ultrafine resolution and ultrafine assimilation. The size of the improvement in skill score when the ultrafine model is used for forecasting and assimilation was so large that 60-hour forecasts with the ultrafine model had as good a skill score as the 48-hour forecasts with the fine model. Synoptic evaluations confirmed that ultrafine model forecasts are better than the fine model forecasts.

Quirk, W. J.↗

Incorrect computation of Madden-Julian oscillation prediction skill

The Madden–Julian oscillation (MJO) is a major tropical weather system and one of the largest sources of predictability for subseasonal-to-seasonal weather forecasts. Skillful prediction of the MJO has been a highly active area of research due to its large socio-economic impacts. Silini et al., herein S21, developed a machine learning model to predict the MJO, which they claimed to have an MJO prediction skill of 26–27 days over all seasons and 45 days for December–February (DJF) winter. If true, this would make the skill of their model competitive with that of the state-of-the-art dynamical MJO prediction systems at 20–35 days. However, here we show that the MJO prediction was calculated incorrectly in S21, which spuriously increased the performance of their model. Correctly computed skill of their model was substantially lower than that reported in S21; the skill for all seasons drops to 11–12 days and the skill for forecasts initialized during DJF drops to 15 days. Our findings clarify that the S21 machine learning model is not competitive with state-of-the-art numerical weather prediction models in predicting the MJO.

54 ENVIRONMENTAL SCIENCES↗

Contribution of Meteorological Downscaling to Skill and Precision of Seasonal Drought Forecasts

Research in meteorological prediction on sub-seasonal to seasonal (S2S) timescales has seen growth in recent years. Concurrent with this, demand for seasonal drought forecasting has risen. While there is obvious synergy between these fields, S2S meteorological forecasting has typically focused on low resolution global models, while the development of drought can be sensitive to the local expression of weather anomalies and their interaction with local surface properties and processes. This suggests that downscaling might play an important role in the application of meteorological S2S forecasts to skillful forecasting of drought. Here, we apply the Generalized Analog Regression Downscaling (GARD) algorithm to downscale meteorological hindcasts from the NASA Goddard Earth Observing System (GEOS) global S2S forecast system. Downscaled meteorological fields are then applied to drive offline simulations with the Catchment Land Surface Model (CLSM) to forecast United States Drought Monitor (USDM) style drought indicators derived from simulated surface hydrology variables. We compare the representation of drought in these downscaled hindcasts to hindcasts that are not downscaled, using the North American Land Data Assimilation System Phase 2 (NLDAS-2) dataset as an observational reference. We find that downscaling using GARD improves hindcasts of temperature and temperature anomalies, but the results for precipitation are mixed and generally small. Overall, GARD downscaling led to improved hindcast skill for total drought across the Contiguous United States (CONUS), and improvements were greatest for extreme (D3) and exceptional (D4) drought categories.

Ryan A Zamora↗

Scale-Dependent Value of QPF for Real-Time Streamflow Forecasting

Incorporating rainfall forecasts into a real-time streamflow forecasting system extends the forecast lead time. Since quantitative precipitation forecasts (QPFs) are subject to substantial uncertainties, questions arise on the trade-off between the time horizon of the QPF and the accuracy of the streamflow forecasts. This study explores the problem systematically, exploring the uncertainties associated with QPFs and their hydrologic predictability. The focus is on scale dependence of the trade-off between the QPF time horizon, basin-scale, space-time scale of the QPF, and streamflow forecasting accuracy. To address this question, the study first performs a comprehensive independent evaluation of the QPFs at 140 U.S. Geological Survey (USGS) monitored basins with a wide range of spatial scales (~10 – 40,000 km 2 ) over the state of Iowa in the Midwestern United States. The study uses High-Resolution Rapid Refresh (HRRR) and Global Forecasting System (GFS) QPFs for short and medium-range forecasts, respectively. Using Multi-Radar Multi-Sensor (MRMS) quantitative precipitation estimate (QPE) as a reference, the results show that the rainfall-to-rainfall QPF errors are scale-dependent. The results from the hydrologic forecasting experiment show that both QPFs illustrate clear value for real-time streamflow forecasting at longer lead times in the short- to medium-range relative to the no-rain streamflow forecast. The value of QPFs for streamflow forecasting is particularly apparent for basin sizes below 1,000 km 2 . The space-time scale, or reference time t r ) (ratio of forecast lead time to basin travel time) ~ 1 depicts the largest streamflow forecasting skill with a systematic decrease in forecasting accuracy for t r > 1.

54 ENVIRONMENTAL SCIENCES↗

Impact of Assimilating Cloud-Cleared and Adaptively Thinned Infrared Hyperspectral Data on Tropical Cyclones in a Global Data Assimilation and Forecast Framework

A simple adaptive thinning methodology for Atmospheric Infrared Sounder (AIRS), Cross-track Infrared Sounder (CrIS) and Infrared Atmospheric Sounding Interferometer (IASI) radiances is evaluated through a combination of Observing System Experiments (OSEs) and adjoint methodologies. In addition, the impact of cloud-cleared radiances for AIRS is also evaluated. The OSEs are performed with the NASA Goddard Earth Observing System (GEOS, version 5) data assimilation and forecast model. The adaptive strategy uses a denser coverage in a moving domain centered around tropical cyclones (TCs), sparser everywhere else.The OSEs consist of three sets of data assimilation runs that cover the period from September 1st to 10 November 2014, with the first 20 days discarded for spin-up. All sets assimilate conventional and satellite observations used operationally. In addition, one ingests clear-sky AIRS, CrIS, and IASI radiances at different densities, another AIRS cloud-cleared radiances, and CrIS and IASI clear-sky radiances, and the third adaptively thinned AIRS, CrIS and IASI radiances. Daily 10-day forecasts are initialized from all these analyses and evaluated with focus on TCs over the Atlantic and the Pacific.Evidence is provided that this simple TC-centered adaptive radiance thinning strategy, in full agreement with previous theoretical studies, increases the global forecast skill and improves tropical cyclone representation and intensity forecast. In addition, the impact of AIRS cloud-cleared radiances is demonstrated to be particularly strong on TCs. The implications are that cloud-cleared radiances, if thinned more aggressively than the currently used clear-sky radiances, could be operationally used with large gain in TC forecasting and no loss of global skill.

Reale, Oreste↗

Assessment of Satellite Sea Surface Salinity Products Using a Coupled ENSO Prediction Model

Much work has gone into revising and updating algorithms for converting satellite-measured radiances to useful ocean variables like sea surface salinity (e.g. SMOS - Boutin et al., 2017, SMAP - Fore et al., 2016 and Aquarius - Meissner et al., 2018). As part of our Ocean Salinity Science Team work, we utilize an intermediate-complexity air/sea coupled model as a transfer function to test if more mature satellite SSS model algorithms actually improve ENSO forecast skill. For initialization of the coupled forecast, we demonstrate that the positive impact of SSS assimilation is brought about by surface freshening near the eastern edge of the western Pacific warm pool and density changes that lead to shallower mixed layer between 10S-5N. In addition, salting near the ITCZ leads to a deepening of the mixed layer and thermocline near 8N. These patterns together provide the background state to amplify equatorial Kelvin waves and improve ENSO hindcasts (Hackert et al., 2019). Here we extend this work to compare the impact of various pairs of original and improved satellite SSS algorithms. For instance we compare SMAP V4.1 with the latest, SMAP V4.2, to see what impact algorithm improvements may have on ENSO forecasts. SSS observations are tested on seasonal to interannual variability of tropical Indo-Pacific Ocean dynamics as well as on dynamical ENSO forecasts by initializing twelve-month forecasts for each month of available data. All experiments assimilate satellite sea level (SL), sea surface temperature (SST), and in situ subsurface temperature and salinity observations (Tz, Sz). Additionally various satellite, blended, and in-situ SSS products are assimilated. We find that including satellite SSS significantly improves Niño3.4 sea surface temperature anomaly validation, more mature SSS model algorithms are generally improving ENSO forecasts over time, and more satellite SSS data coverage helps to extend useful forecasts.

Ocean↗

High resolution assimilation of multiple satellite retrievals with emissions adjustment to improve air quality forecasting with WRF-Chem/DART

We will present results from medium (15km, 6hr cycling) and high (4 km, 6 hr cycling) spatiotemporal resolution applications of the WRF-Chem/DART ensemble, regional, air quality (AQ) forecast/assimilation system.The medium-resolution setup is applied to the Discover AQ/Front Range Air Pollution and Photochemistry Experiment (FRAPPE) domain from July 14 to July 29, 2014. The high-resolution setup is applied to a Colorado domain from July 14 to July 29, 2020. For the FRAPPE application, we assimilate MOPITT CO; IASI CO;MODIS AOD; OMI O3, NO2; and AirNow CO, O3, NO2, SO2, PM10, and PM2.5. For the Colorado application, we assimilate the same MOPITT, MODIS, and AirNow constituents as in the FRAPPE application and TROPOMI CO, O3, NO2; and synthetic TEMPO O3and NO2. WRF-Chem/DART integrates the Weather Research and Forecast (WRF) model with on-line chemistry (WRF-Chem) into the Data Assimilation Research Testbed (DART). It assimilates AirNow CO, O3, NO2, SO2, PM10, and PM2.5 measurements, MOPITT CO; IASI CO, O3; OMI O3, NO2, SO2; TROPOMI CO, O3, NO2, SO2; MODIS AOD; and synthetic TEMPO O3 and NO2 total/partial column and/or profile retrievals.WRF-Chem/DART uses: (i) the state augmentation method for adjusting emissions; (ii) state-space localization; and (iii) a near-real time scripting system. We use the medium-resolution FRAPPE application to demonstrate the incremental benefits from assimilating OMI observations with emissions adjustment and the high-resolution Colorado application to demonstrate the incremental benefits from assimilating syntheticTEMPO observations with emissions adjustment. For both applications, we expect that: (i) assimilating chemical observations will increaseAQ forecast skill; (ii) including emissions adjustment will increase forecast skill/predictability; and (iii) including assimilation of synthetic TEMPO observations will further increase forecast skill/predictability.

High resolution↗

GMAO Seasonal Forecast Ensemble Exploration

GMAO Sub/Seasonal prediction system (S2S) has recently been upgraded. A complete set (1981-2016) of 9-months hindcasts for the previous and current versions (S2S-1.0 and S2S-2.1 respectively) allows for the evaluation of the forecast skill and a study of various characteristics of the ensemble forecasts in particular. We compared the intra-seasonal, interannual and intra-ensemble SST variability of the two systems against the observed. Focusing on the ENSO SST indices, we analyzed the consistency of the forecasts ensembles by studying rank histograms and comparing the ensemble spread with the standard error of the estimate.The S2S-2.1 ensemble appears to be more consistent with observations in Niño1+2 region compared to S2S-1.0, while in the central equatorial Pacific ocean this measure is comparably good for both systems. The S2S-1.0 system tends to be under dispersive, while the new system is under dispersive only at very short lead times, but tends to be over dispersive at long leads and for forecasts verifying in spring in Niño 3.4 region.Overall, the new system has greater skill in predicting ENSO. The evaluation techniques tested here will be applied for testing of the next generation sub/seasonal forecast system under development.

Borovikov, Anna↗

Evaluation of adjoint-based observation impacts as a function of forecast length using an Observing System Simulation Experiment

Adjoints of numerical weather prediction models may be employed for Forecast Sensitivity to Observation (FSO) in order to monitor the contribution of ingested observation data on short-term forecast skill. However, the calculation of short-term forecast error is difficult due to the lack of a truly independent dataset for verification. In an Observing System Simulation Experiment framework, the Nature Run is able to provide a true and complete verification dataset and allows accurate evaluation of short term forecast errors. In this work, an OSSE developed at the National Aeronautics and Space Administration Global Modeling and Assimilation Office is used to explore the impact of observational data on forecasts in the 6 to 48 hour range. An adjoint of the Global Earth Observing System model is employed to compare the observation impacts estimated using both self-analysis verification and the true Nature Run verification. Self-analysis verification is found to inflate the estimated forecast error growth during the early forecast period, resulting in overestimations of observation impacts, particularly in the 6-12 hour forecast range. By 48 hours, the self-analysis verification estimates of forecast error and observation impacts more closely match the true values. The fraction of beneficial observations is also overinflated at short forecast times when self-analysis verification is used. The progression of impacts of an individual observation or data type depends on the character of the growth of the initial condition error that each observation affects.

numerical weather prediction↗

Using Historical Precipitation, Temperature, and Runoff Observations to Evaluate Evaporation Formulations in Land Surface Models

Key to translating soil moisture memory into subseasonal precipitation and air temperature forecast skill is a realistic treatment of evaporation in the forecast system used - in particular, a realistic treatment of how evaporation responds to variations in soil moisture. The inherent soil moisture-evaporation relationships used in today's land surface models (LSMs), however, arguably reflect little more than guesswork given the lack of evaporation and soil moisture data at the spatial scales represented by regional and global models. Here we present a new approach for evaluating this critical aspect of LSMs. Seasonally averaged precipitation is used as a proxy for seasonally-averaged soil moisture, and seasonally-averaged air temperature is used as a proxy for seasonally-averaged evaporation (e.g., more evaporative cooling leads to cooler temperatures)~ the relationship between historical precipitation and temperature measurements accordingly mimics in certain important ways nature's relationship between soil moisture and evaporation. Additional information on the relationship is gleaned from joint analysis of precipitation and streamflow measurements. An experimental framework that utilizes these ideas to guide the development of an improved soil moisture-evaporation relationship is described and demonstrated.

Koster, Randal D.↗

Development, Validation, and Application of OSSEs at NASA-GMAO

The GMAO OSSE framework has two general classes of applications. One is to estimate the potential improvements to weather forecasting and analysis by using new proposed instruments that are not as yet built or deployed. This exploits the simulated nature of the OSSE. The other is to assess various aspects of the GMAO data assimilation system. This exploits the availability of truth provided by the OSSE. Two examples of the first class of application will be offered. One concerns deployment of constellations of passive MW sounders on small CUBESATs placed in very low orbits. The other concern is increasing the frequency of radiosonde observations to 4-times daily at all current stations. Several examples of the second class will also be presented. One is an estimation of analysis error characteristics. Another is a comparison between covariances directly determined from explicitly known background errors and those estimated by computing differences between lagged forecasts using the NMC-method prior to tuning. A third is a comparison of effects of model and observation errors on analysis and forecast skill. The last is an examination of spectra of forecast errors in a study of predictability. This latter is an ongoing study.

OSSE↗

Development and Testing of the Variable Vertical Resolution Fourth Order GCM

The vertical coordinate of the Fourth Order Model has been generalized so that the model can now run with an arbitrary number of vertical layers and so that the thicknesses of these layers can be arbitrarily specified (in the sigma coordinate). This Variable Vertical Resolution (VVR) version of the Fourth Order Model will soon replace the current production model. To assess the skill of the VVR model, it has been run with 9 equally spaced layers and compared with the current production model. In two Northern Hemispheric winter cases and one summer case, the two models were virtually identical in forecast skill for 6 to 7 days. After that the VVR model was slightly better in the winter cases and the production model was slightly better in the summer case. The only exception to this was that after 2 days the production model gave slightly more skillful 500 mb forecasts in the tropics for the summer case.

Helfand, H. M.↗

Predictability and empirical dynamics of fisheries time series in the North Pacific

Previous studies have documented a strong relationship between marine ecosystems and large-scale modes of sea surface height (SSH) and sea surface temperature (SST) variability in the North Pacific such as the Pacific Decadal Oscillation and the North Pacific Gyre Oscillation. In the central and western North Pacific along the Kuroshio-Oyashio Extension (KOE), the expression of these modes in SSH and SST is linked to the propagation of long oceanic Rossby waves, which extend the predictability of the climate system to ~3 years. Using a multivariate physical-biological linear inverse model (LIM) we explore the extent to which this physical predictability leads to multi-year prediction of dominant fishery indicators inferred from three datasets (i.e., estimated biomasses, landings, and catches). We find that despite the strong autocorrelation in the fish indicators, the LIM adds dynamical forecast skill beyond persistence up to 5-6 years. By performing a sensitivity analysis of the LIM forecast model, we find that two main factors are essential for extending the dynamical predictability of the fishery indicators beyond persistence. The first is the interaction of the fishery indicators with the SST/SSH of the North and tropical Pacific. The second is the empirical relationship among the fisheries time series. This latter component reflects stock-stock interactions as well as common technological and human socioeconomic factors that may influence multiple fisheries and are captured in the training of the LIM. These results suggest that empirical dynamical models and machine learning algorithms, such as the LIM, provide an alternative and promising approach for forecasting key ecological indicators beyond the skill of persistence.

60 APPLIED LIFE SCIENCES↗

Evaluation of an open forecasting challenge to assess skill of West Nile virus neuroinvasive disease prediction

Abstract Background West Nile virus (WNV) is the leading cause of mosquito-borne illness in the continental USA. WNV occurrence has high spatiotemporal variation, and current approaches to targeted control of the virus are limited, making forecasting a public health priority. However, little research has been done to compare strengths and weaknesses of WNV disease forecasting approaches on the national scale. We used forecasts submitted to the 2020 WNV Forecasting Challenge, an open challenge organized by the Centers for Disease Control and Prevention, to assess the status of WNV neuroinvasive disease (WNND) prediction and identify avenues for improvement. Methods We performed a multi-model comparative assessment of probabilistic forecasts submitted by 15 teams for annual WNND cases in US counties for 2020 and assessed forecast accuracy, calibration, and discriminatory power. In the evaluation, we included forecasts produced by comparison models of varying complexity as benchmarks of forecast performance. We also used regression analysis to identify modeling approaches and contextual factors that were associated with forecast skill. Results Simple models based on historical WNND cases generally scored better than more complex models and combined higher discriminatory power with better calibration of uncertainty. Forecast skill improved across updated forecast submissions submitted during the 2020 season. Among models using additional data, inclusion of climate or human demographic data was associated with higher skill, while inclusion of mosquito or land use data was associated with lower skill. We also identified population size, extreme minimum winter temperature, and interannual variation in WNND cases as county-level characteristics associated with variation in forecast skill. Conclusions Historical WNND cases were strong predictors of future cases with minimal increase in skill achieved by models that included other factors. Although opportunities might exist to specifically improve predictions for areas with large populations and low or high winter temperatures, areas with high case-count variability are intrinsically more difficult to predict. Also, the prediction of outbreaks, which are outliers relative to typical case numbers, remains difficult. Further improvements to prediction could be obtained with improved calibration of forecast uncertainty and access to real-time data streams (e.g. current weather and preliminary human cases). Graphical Abstract

54 ENVIRONMENTAL SCIENCES↗

Uncertainty of Observation Impact Estimation in an Adjoint Model Investigated with an Observing System Simulation Experiment

Adjoint models are often used to estimate the impact of different observations on short-term forecast skill. A common difficulty with the evaluation of short term forecast quality is the choice of verification fields. The use of self-analysis fields for verification is typical but incestuous, and introduces uncertainty due to biases and errors in the analysis field. In this study, an observing system simulation experiment (OSSE) is used to explore the uncertainty in adjoint model estimations of observation impact. The availability of the true state for verification in the OSSE framework in the form of the Nature Run allows calculation of the observation impact without the uncertainties present in self-analysis verification. These impact estimates are compared to estimates calculated using self-analysis verification. The Global Earth Observing System version 5 (GEOS-5) forecast model with Gridpoint Statistical Interpolation (GSI) is used with the National Aeronautics and Space Administration Global Modeling and Assimilation Office (NASA/GMAO) OSSE capability. The adjoint model includes moist processes, with total wet energy selected as the norm for evaluation of observation impacts. The results show that there are measurable but small discrepancies in the adjoint model estimation of observation impact. In general, observations of temperature and winds tend to have overestimated impacts with self-analysis verification, while observations of humidity and moisture-affected observations tend to have underestimated impacts. The small magnitude of the differences in impact estimates supports the robustness of the adjoint method of estimating observation impacts.

N C Prive↗

Forecasting Global Fire Emissions on Subseasonal to Seasonal (S2S) Time Scales

Fire emissions of gases and aerosols alter atmospheric composition and have substantial impacts on climate, ecosystem function, and human health. Warming climate and human expansion in fire‐prone landscapes exacerbate fire impacts and call for more effective management tools. Here we developed a global fire forecasting system that predicts monthly emissions using past fire data and climate variables for lead times of 1 to 6 months. Using monthly fire emissions from the Global Fire Emissions Database (GFED) as the prediction target, we fit a statistical time series model, the Autoregressive Integrated Moving Average model with eXogenous variables (ARIMAX), in over 1,300 different fire regions. Optimized parameters were then used to forecast future emissions. The forecast system took into account information about region‐specific seasonality, long‐term trends, recent fire observations, and climate drivers representing both large‐scale climate variability and local fire weather. We cross‐validated the forecast skill of the system with different combinations of predictors and forecast lead times. The reference model, which combined endogenous and exogenous predictors with a 1 month forecast lead time, explained 52% of the variability in the global fire emissions anomaly, considerably exceeding the performance of a reference model that assumed persistent emissions during the forecast period. The system also successfully resolved detailed spatial patterns of fire emissions anomalies in regions with significant fire activity. This study bridges the gap between the efforts of near‐real‐time fire forecasts and seasonal fire outlooks and represents a step toward establishing an operational global fire, smoke, and carbon cycle forecasting system.

vapor pressure↗

Enabling the Assimilation of CrIS Shortwave Infrared Observations in Global NWP at NOAA. Part II: OSEs and Results

The assimilation of data from hyperspectral infrared sounders in global data assimilation systems has historically been focused on observations in the longwave infrared (LWIR) region of the spectrum (650-1100 cm−1), despite the often concurrent availability of measurements from the shortwave infrared (SWIR) region of the spectrum (2150-2550 cm−1), because issues (like solar effects) have generally prevented the assimilation of SWIR observations. Recent advances in radiative transfer models have worked to address some of the previous challenges in simulating SWIR observations, and the assimilation of SWIR data (e.g. from potential future small-satellites) is now a feasible prospect. Still, a better understanding of how these observations perform in a data assimilation system and impact resulting analyses and NWP forecasts is necessary. In this study, the value of SWIR observations in global NWP is assessed by assimilating SWIR observations from the Cross-track Infrared Sounder (CrIS) in NOAA’s Global Data Assimilation System (GDAS). The methodologies used to enable the assimilation of these observations, including the implementation of a scene-dependent observation error and the enhancement of quality control procedures, are discussed, as are the results of Observing System Experiments (OSEs) conducted to evaluate the impact of assimilating SWIR observations on forecast skill. The overall results show that SWIR assimilation produces similar forecast impacts to LWIR assimilation. The ability to demonstrate that the assimilation or SWIR observations in NWP is a realistic prospect may help to shape future constellations of small-satellites to serve as a beneficial complement to the current constellation if hyperspectral IR sounders.

Erin Jones↗

Novel Deep Learning Transformer Model for Short to Sub‐Seasonal Streamflow Forecast

Accurate short-to-subseasonal streamflow forecasts are becoming crucial for effective water management in an increasingly variable climate. However, streamflow forecast remains challenging over extended lead times, uncertainty in meteorological inputs, and increased frequency and variability in extreme weather and climate events. We implemented a Future Time Series Transformer (FutureTST) model for streamflow forecasting that separately integrates past meteorological and streamflow data while incorporating future weather conditions. FutureTST achieves a mean Nash-Sutcliffe Efficiency (NSE) of 0.82 to 0.67 for 1- to 30-day streamflow forecasts. Incorporating upstream streamflow information improved forecast accuracy by up to 10%. During real-time forecast, FutureTST maintains higher forecast skills of 9.03 for 1-day and 5.74 for 14-day forecasts. In contrast, calibrated process-based hydrological model forecasts become unreliable beyond a 4-day lead time. Our findings demonstrate the potential of FutureTST as a reliable streamflow forecasting tool that offers a valuable addition to operational flood monitoring systems and climate-resilient decision-making.

Ambika, Anukesh Krishnankutty [Oak Ridge National ↗