SEARCH · Search NASA

Results for “forecast skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

All sources NASA NTRS DOE OSTI

NASA NTRS2010

The Second Phase of the Global Land-Atmosphere Coupling Experiment (GLACE-2)

A major motivation for the study of the coupled land-atmosphere system is the idea that soil moisture anomalies may affect future meteorological variables through their effects on future surface energy and water budgets. If true, the accurate initialization of soil moisture in a subseasonal or seasonal forecast system may improve forecast skill, making the forecast products more valuable to society. The GLACE-2 project is examining, through a coordinated experiment using a wide variety of models, the degree to which subseasonal (out to two months) precipitation and air temperature forecasts improve through the realistic initialization of soil moisture. For the first time ever, a global consensus should emerge regarding the value of land initialization for forecasts, perhaps motivating national forecast centers to make full use of land moisture initialization in their operations

Koster, Randal D.↗

NASA NTRS2009

Integration of Weather Data into Airspace and Traffic Operations Simulation (ATOS) for Trajectory- Based Operations Research

Explicit integration of aviation weather forecasts with the National Airspace System (NAS) structure is needed to improve the development and execution of operationally effective weather impact mitigation plans and has become increasingly important due to NAS congestion and associated increases in delay. This article considers several contemporary weather-air traffic management (ATM) integration applications: the use of probabilistic forecasts of visibility at San Francisco, the Route Availability Planning Tool to facilitate departures from the New York airports during thunderstorms, the estimation of en route capacity in convective weather, and the application of mixed-integer optimization techniques to air traffic management when the en route and terminal capacities are varying with time because of convective weather impacts. Our operational experience at San Francisco and New York coupled with very promising initial results of traffic flow optimizations suggests that weather-ATM integrated systems warrant significant research and development investment. However, they will need to be refined through rapid prototyping at facilities with supportive operational users We have discussed key elements of an emerging aviation weather research area: the explicit integration of aviation weather forecasts with NAS structure to improve the effectiveness and timeliness of weather impact mitigation plans. Our insights are based on operational experiences with Lincoln Laboratory-developed integrated weather sensing and processing systems, and derivative early prototypes of explicit ATM decision support tools such as the RAPT in New York City. The technical components of this effort involve improving meteorological forecast skill, tailoring the forecast outputs to the problem of estimating airspace impacts, developing models to quantify airspace impacts, and prototyping automated tools that assist in the development of objective broad-area ATM strategies, given probabilistic weather forecasts. Lincoln Laboratory studies and prototype demonstrations in this area are helping to define the weather-assimilated decision-making system that is envisioned as a key capability for the multi-agency Next Generation Air Transportation System [1]. The Laboratory's work in this area has involved continuing, operations-based evolution of both weather forecasts and models for weather impacts on the NAS. Our experience has been that the development of usable ATM technologies that address weather impacts must proceed via rapid prototyping at facilities whose users are highly motivated to participate in system evolution.

Peters, Mark↗

NASA NTRS2019

Impact of GMI All-Sky Radiance Assimilation in the NASA GEOS Forecast System

The assimilation of cloud- and precipitation-affected ("all-sky") radiances has become an important focus of development at most numerical weather prediction centers. Efforts at the Global Modeling and Assimilation Office (GMAO) have focused on all-sky assimilation of GPM Microwave Imager (GMI) radiances, which became operational in the GEOS real-time production system in July 2018. Implementation of the all-sky capability required several upgrades to the GEOS hybrid 4D-EnVar assimilation infrastructure including the addition of control variables for cloud liquid, cloud ice, rain and snow, enhancements to the radiative transfer model, new hybrid background and observational error models, and modified quality control and bias correction procedures. This talk describes the impact of GMI all-sky radiance assimilation on GEOS analyses and forecasts as determined from examination of various metrics including statistics of background departures and analysis increments, forecast skill scores, and forecast sensitivity observation impact (FSOI) calculations. It is shown that in addition to the hydrometeors themselves, the initial wind, temperature and pressure fields all undergo significant dynamic adjustment in response to the analyzed cloud and precipitation features. Assimilation of GMI radiances leads to improved forecasts of lower tropospheric wind, temperature and humidity, especially in the tropics. The largest forecast improvements occur during the first 48 hours, with diminishing impact thereafter. However, combining GMI all-sky assimilation with improvements to the GEOS model physics as in the recent implementation of the real-time production system, extends these forecast improvements well in to the medium range. FSOI results based on a 24-hr moist global energy norm show that GMI radiances provide nearly uniform beneficial impact throughout the tropics, with more mixed impacts in the subtropics. While the overall impact of GMI is smaller than that of other, much more numerous microwave and hyperspectral infrared radiance types, its impact is among the largest of all radiance types on a per-observation basis.

Gelaro, Ron↗

NASA NTRS2024

Observing System Simulation Experiments Exploring Potential Spaceborne Deployment Options for a Differential Absorption Radar Measuring Marine Surface Pressures

A new technology for remote measurements of marine surface pressure has been proposed, employing a V-band differential absorption radar and a radiometric temperature sounder to calculate the total column atmospheric mass. Observing System Simulation Experiments (OSSEs) are performed to evaluate the potential impact of Spaceborne Marine Surface Pressure (SMSP) on Numerical Weather Prediction. These experiments build on prior efforts (Privé, McLinden, et al., 2023, https://doi.org/10.16993/tellusa.3254), but with an updated version of the OSSE framework and with more sophisticated simulation of the SMSP observations and a longer experiment period. Several different instrument configurations are compared, including both scanning and non-scanning orbits. SMSP impacts are calculated for analysis quality and forecast skill, and a forecast sensitivity observation impact tool is employed to place SMSP observations in context with the global observing network. The effects of rain contamination on observation quality are explored. Different magnitudes of simulated SMSP observation error are tested in the context of data assimilation to show the range of potential behaviors. Overall, SMSP observations are found to be most beneficial in the southern hemisphere extratropics, with statistically significant forecast improvements for the first 72 hr of the forecast. A constellation of four non-scanning SMSP satellites is found to outperform a single scanning instrument with a 250 km wide swath.

N C Prive↗

NASA NTRS2021

The Efficacy of Seasonal Terrestrial Water Storage Forecasts for Predicting Vegetation Activity Over Africa

Terrestrial water storage (TWS) provides important information on terrestrial hydroclimate and may have value for seasonal forecasting because of its strong persistence. We use the NASA Hydrological Forecast and Analysis System (NHyFAS) to investigate TWS forecast skill over Africa and assess its value for predicting vegetation activity from satellite estimates of leaf area index (LAI). Forecast skill is high over East and Southern Africa, extending up to 3–6 months in some cases, with more modest skill over West Africa. Highest skill generally occurs during the dry season or beginning of the wet season when TWS anomalies from the previous wet season are most likely to carry forward in time. In East Africa, this occurs prior to and during the transition into the spring “Long Rains” from January–March, while in Southern Africa this period of highest skill starts at the beginning of the dry season in April and extends through to the start of the wet season in October. TWS is highly and positively correlated with LAI, and a logistic regression model shows high cross-validation skill in predicting above or below normal LAI using TWS. Combining the LAI regression model with the NHyFAS forecasts, 1-month lead LAI predictions have high accuracy over East and Southern Africa, with reduced but significant skill at 3-month leads over smaller sub-regions. This highlights the potential value of TWS as an additional source of information for seasonal forecasts over Africa, with direct applications to some of the most vulnerable agricultural regions on the continent.

Terrestrial water shortage↗

NASA NTRS2012

Assessment of the APCC Coupled MME Suite in Predicting the Distinctive Climate Impacts of Two Flavors of ENSO during Boreal Winter

Forecast skill of the APEC Climate Center (APCC) Multi-Model Ensemble (MME) seasonal forecast system in predicting two main types of El Nino-Southern Oscillation (ENSO), namely canonical (or cold tongue) and Modoki ENSO, and their regional climate impacts is assessed for boreal winter. The APCC MME is constructed by simple composite of ensemble forecasts from five independent coupled ocean-atmosphere climate models. Based on a hindcast set targeting boreal winter prediction for the period 19822004, we show that the MME can predict and discern the important differences in the patterns of tropical Pacific sea surface temperature anomaly between the canonical and Modoki ENSO one and four month ahead. Importantly, the four month lead MME beats the persistent forecast. The MME reasonably predicts the distinct impacts of the canonical ENSO, including the strong winter monsoon rainfall over East Asia, the below normal rainfall and above normal temperature over Australia, the anomalously wet conditions across the south and cold conditions over the whole area of USA, and the anomalously dry conditions over South America. However, there are some limitations in capturing its regional impacts, especially, over Australasia and tropical South America at a lead time of one and four months. Nonetheless, forecast skills for rainfall and temperature over East Asia and North America during ENSO Modoki are comparable to or slightly higher than those during canonical ENSO events.

Jeong, Hye-In↗

NASA NTRS1987

Predictability in the extended range

This paper describes the results of extended range predictability experiments using an efficient two-level spherical quasi-geostrophic model. The experiments have an initial rms doubling time of about two days. This growth rate, along with an initial error of about one-half the initial error of present operational models, produces an rms error equal to the climatological rms error and a correlation of 0.5 on about day 12 of the forecast. On the largest scales, this limiting point is reached shortly thereafter. The error continues to grow at a decreasing rate until at about 30 days the forecast skill is extremely small and comparable to the skill of a persistence forecast. Various time averages at various lags are examined for skill in the extended range. Filters that weighted most strongly in the initial forecast days provide increased skill.

Roads, John O.↗

NASA NTRS2003

Atmospheric Soundings from AIRS/AMSU/HSB

AIRS was launched on EOS Aqua on May 5, 2002, together with AMSU A and HSB, to form a next generation polar orbiting infrared and microwave atmospheric sounding system. The primary products of AIRS/AMSU/HSB are twice daily global fields of atmospheric temperature-humidity profiles, ozone profiles, sea/land surface skin temperature, and cloud related parameters including OLR. The sounding goals of AIRS are to produce 1 km tropospheric layer mean temperatures with an RMS error of 1K, and 1 km layer precipitable water with an rms error of 1K, and 1 km layer precipitable water with an rms error of 20 percent, in cases with up to 80 percent cloud cover. The AIRS data products are significant for studying climate variability and change, as well as for use in initialization of General Circulation Models with the objective of improving analysis fields and subsequent forecast skill. Data assimilation experiments to evaluate the impact of AIRS retrievals on analysis and forecast skill are being conducted. Sample fields of parameters retrieved from AIRS/AMSU/HSB data will be presented and validated as a function of retrieved fractional cloud cover. Select fields will also be compared to those contained in the ECMWF analysis, done without the benefit of AIRS data, on both an instantaneous and monthly mean basis, to demonstrate information that AIRS can add to that already contained in the ECMWF analysis.

Susskind, Joel↗

NASA NTRS2004

Alternative Approaches to Land Initialization for Seasonal Precipitation and Temperature Forecasts

The seasonal prediction system of the NASA Global Modeling and Assimilation Office is used to generate ensembles of summer forecasts utilizing realistic soil moisture initialization. To derive the realistic land states, we drive offline the system's land model with realistic meteorological forcing over the period 1979-1993 (in cooperation with the Global Land Data Assimilation System project at GSFC) and then extract the state variables' values on the chosen forecast start dates. A parallel series of forecast ensembles is performed with a random (though climatologically consistent) set of land initial conditions; by comparing the two sets of ensembles, we can isolate the impact of land initialization on forecast skill from that of the imposed SSTs. The base initialization experiment is supplemented with several forecast ensembles that use alternative initialization techniques. One ensemble addresses the impact of minimizing climate drift in the system through the scaling of the initial conditions, and another is designed to isolate the importance of the precipitation signal from that of all other signals in the antecedent offline forcing. A third ensemble includes a more realistic initialization of the atmosphere along with the land initialization. The impact of each variation on forecast skill is quantified.

Koster, Randal↗

NASA NTRS2013

Soil Moisture Initialization Error and Subgrid Variability of Precipitation in Seasonal Streamflow Forecasting

Offline simulations over the conterminous United States (CONUS) with a land surface model are used to address two issues relevant to the forecasting of large-scale seasonal streamflow: (i) the extent to which errors in soil moisture initialization degrade streamflow forecasts, and (ii) the extent to which a realistic increase in the spatial resolution of forecasted precipitation would improve streamflow forecasts. The addition of error to a soil moisture initialization field is found to lead to a nearly proportional reduction in streamflow forecast skill. The linearity of the response allows the determination of a lower bound for the increase in streamflow forecast skill achievable through improved soil moisture estimation, e.g., through satellite-based soil moisture measurements. An increase in the resolution of precipitation is found to have an impact on large-scale streamflow forecasts only when evaporation variance is significant relative to the precipitation variance. This condition is met only in the western half of the CONUS domain. Taken together, the two studies demonstrate the utility of a continental-scale land surface modeling system as a tool for addressing the science of hydrological prediction.

Streamflow Prediction↗

DOE OSTI2024

Evaluation of FluSight influenza forecasting in the 2021–22 and 2022–23 seasons with a new target laboratory-confirmed influenza hospitalizations

Accurate forecasts can enable more effective public health responses during seasonal influenza epidemics. For the 2021–22 and 2022–23 influenza seasons, 26 forecasting teams provided national and jurisdiction-specific probabilistic predictions of weekly confirmed influenza hospital admissions for one-to-four weeks ahead. Forecast skill is evaluated using the Weighted Interval Score (WIS), relative WIS, and coverage. Six out of 23 models outperform the baseline model across forecast weeks and locations in 2021–22 and 12 out of 18 models in 2022–23. Averaging across all forecast targets, the FluSight ensemble is the 2nd most accurate model measured by WIS in 2021–22 and the 5th most accurate in the 2022–23 season. Forecast skill and 95% coverage for the FluSight ensemble and most component models degrade over longer forecast horizons. In this work we demonstrate that while the FluSight ensemble was a robust predictor, even ensembles face challenges during periods of rapid change.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2020

Predictive Skill of Deep Learning Models Trained on Limited Sequence Data

In this report we investigate the utility of one-dimensional convolutional neural network (CNN) models in epidemiological forecasting. Deep learning models, especially variants of recurrent neural networks (RNNs) have been studied for influenza forecasting, and have achieved higher forecasting skill compared to conventional models such as ARIMA models. In this study, we adapt two neural networks that employ one-dimensional temporal convolutional layers as a primary building block temporal convolutional networks and simple neural attentive meta-learner for epidemiological forecasting and test them with influenza data from the US collected over 2010-2019. We find that epidemiological forecasting with CNNs is feasible, and their forecasting skill is comparable to, and at times, superior to, RNNs. Thus CNNs and RNNs bring the power of nonlinear transformations to purely data-driven epidemiological models, a capability that heretofore has been limited to more elaborate mechanistic/compartmental disease models.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

DOE OSTI2021

Real-time ensemble microalgae growth forecasting with data assimilation

Accurate short-range (e.g., 7-day) microalgae growth forecasts will be beneficial for both production and harvesting of microalgae. This study developed an operational microalgae growth forecasting system with ensemble data assimilation (DA). The forecasting system was validated against observed Monoraphidium minutum 26B-AM growth in two outdoor pond cultures located in Mesa, Arizona, U.S. We first examined the relative roles of uncertainty in the meteorological forecast and initial conditions (i.e., algal concentration at the time of forecast) in the microalgae 7-day forecast and found initial conditions dominated the microalgae forecasting skill, suggesting the importance of implementing DA to improve initial condition characterization. To correct the systematic bias in biomass simulations, we developed a particle filter with bias estimation (PFBE) DA method to estimate biases and correct the model forecast. We found the DA forecasting system could improve the 7-day microalgae forecasting skill by about 85% on average compared to model forecasts without DA. These results suggest the potential accuracy of biomass growth forecasts may be sufficient to inform real-time operational decisions, such as harvesting planning, for commercial-scale microalgae production.

59 BASIC BIOLOGICAL SCIENCES↗

NASA NTRS1974

Short-range forecasts with the GISS model of the global atmosphere

Results of tests carried out during the period from December 1972 through January 1973 to determine the short-term forecasting accuracy of a multilevel numerical primitive-equation (PE) model of the global atmosphere developed at the Goddard Institute for Space Studies (GISS). Six 48-hr forecasts were carried out with the aid of this model, using nine vertical levels and a horizontal grid spacing of 4 deg in latitude and 5 deg in longitude for an effective grid point separation averaging slightly more than 400 km. Verification of forecast sea-level pressures, 1000-mb heights, and 500-mb heights, as well as 1000-mb and 500-mb vector geostrophic winds, shows that the model has forecast skill comparable to that of operational PE models. Based on the 36-hr evolution of 18 extratropical cyclones, the model forecasts exhibit a tendency toward underestimating their propagation speeds and overestimating their central pressures. Both deficiencies are attributed to inadequate horizontal grid resolution. Quantitative verification of forecast surface temperatures over the eastern United States shows a forecast skill equal to that achieved by combined dynamical-statistical procedures.

Druyan, L. M.↗

DOE OSTI2021

HAIMOS Ensemble Forecasts for Intra-day and Day- Ahead GHI, DNI and Ramps

The objective of this research is to develop a hybrid physics-based/data-driven forecast model to improve direct normal and global horizontal irradiance (DNI and GHI) prediction for horizons ranging from 1 to 72 hours. Project objectives also address key gaps in state-of-the-art solar forecasting: accurate probabilistic solar forecasts and the forecasting of large irradiance ramps (ramp onset and magnitude). The proposed model ensembles Numerical Weather Prediction (NWP) forecasts, determinist physics-based algorithms, and new-generation cloud cover products (high-resolution rapid refresh satellite images and Large Eddy Simulations). The result is the Hybrid Adaptive Input Model Objective Selection (HAIMOS) ensemble model. HAIMOS blends state of the art machine learning methodologies with physics-based models for cloud cover and cloud optical depth forecasts. The technical activities followed a two-pronged strategy. First, the preprocessing of data, the selection of inputs to the nonlinear approximators, the type of approximator and objective functions, and post-processing ensembling techniques included in HAIMOS were all optimized adaptively to find the best model for a specific goal (reduce DNI/GHI forecast error, improve the prediction of ramp onset, etc.). Second, a large effort was put in improving cloud identification and the forecast of cloud cover and cloud optical depth. To this end, new-generation cloud parametrization products were developed in this work. These include improved algorithms to assist in cloud identification, cloud classification and cloud parametrization from satellite images – three key factors in the accuracy of 1 to 6-hours irradiance forecasts and prediction of ramp onset. Furthermore, we also included cloud information extracted from high resolution rapid refresh satellite images (GOES-16) and Large Eddy Simulations (LES). LES was used to model the atmosphere in detail over locations of interest and produce cloud optical depth forecasts. Once these data streams were validated, they were used as input data to the HAIMOS forecast. The model was developed using data from several climatologically distinct locations with potential for high solar penetration. In the last year of the project, we conducted a validation campaign according to the guidelines stipulated by the Topic Area 1 project as described in the FOA. This effort brings, for the first time, proven machine-learning methodologies for generating state-of-the-art solar forecasts interweaved with detailed physics-based models for cloud detection, and cloud optical depth forecasts. HAIMOS will generate accurate irradiance probabilistic forecast to assist in reducing solar generation prediction error. Globally optimized solar forecast models are more likely to impact solar energy stakeholders. The goal of this project was to increase the state-of-the-art forecast skill from their present values of 10 to 35%. At the end of the project, we achieved between 30% and 50% forecast skill across a wide range of horizons for both GHI and DNI.

14 SOLAR ENERGY↗

DOE OSTI2023

GEFSv12 High- and Low-Skill Day-10 Tornado Forecasts

Abstract On average, modern numerical weather prediction forecasts for daily tornado frequency exhibit no skill beyond day 10. However, in this extended-range lead window, there are particular model cycles that have exceptionally high forecast skill for tornadoes because of their ability to correctly simulate the future synoptic pattern. Here, model initial conditions that produced a more skillful forecast for tornadoes over the United States were exploited while also highlighting potential causes for low-skill cycles within the Global Ensemble Forecasting System, version 12 (GEFSv12). There were 88 high-skill and 91 low-skill forecasts in which the verifying day-10 synoptic pattern for tornado conditions revealed a western U.S. thermal trough and an eastern U.S. thermal ridge, a favorable configuration for tornadic storm occurrence. Initial conditions for high skill forecasts tended to exhibit warmer sea surface temperatures throughout the tropical Pacific Ocean and Gulf of Mexico, an active Madden–Julian oscillation, and significant modulation of Earth-relative atmospheric angular momentum. Low-skill forecasts were often initialized during La Niña and negative Pacific decadal oscillation conditions. Significant atmospheric blocking over eastern Russia—in which the GEFSv12 overforecast the duration and characteristics of the downstream flow—was a common physical process associated with low-skill forecasts. This work helps to increase our understanding of the common causes of high- or low-skill extended-range tornado forecasts and could serve as a helpful tool for operational forecasters. Significance Statement This research provides a framework for the anticipation of a more (or less) skillful 10-day tornado forecast in an operational numerical weather prediction system. High-skill forecasts were associated with substantial tropical convection and warm sea surface temperature throughout the Pacific Ocean and Gulf of Mexico, whereas the underlying cause of low-skill forecasts were typically associated with a blocking anticyclone over eastern Russia. These findings are important because they permit increased or decreased confidence in a long-range forecast of tornado occurrence based on a dynamical prediction system.

Meteorology & Atmospheric Sciences↗

NASA NTRS1984

Forecasts of the 500 mb height using a dynamically oriented statistical model

The forecast skill of a simple dynamically inspired statistical model of the Northern Hemisphere 500 mb height field is evaluated in spectral and physical space for a variety of forecast lead times (1-32 days) and predictand averaging times (1-32 days). The model includes viscous damping, wave propagation, climatology and implicit stochastic forcing. The largest model skill was found for forecasts of the zonal flow and the largest waves. In general, the largest forecast skills were also associated with the largest forecast error, there being a slight geographic phase shift of the skill with respect to the error. Model skills for climate (time-averaged) forecasts are greater when using instantaneous rather than time averages to forecast time averages. Analysis of model errors suggests areas for improvement in representing forcing terms and model physics. However, the model error fields are largely 'white noise' which suggests that global forecast skills substantially larger than those obtained here are unlikely to be achieved by more sophisticated models.

Roads, J. O.↗

NASA NTRS2001

Assimilation of Cloud- and Land-Affected TOVS/ATOVS Level 1B Radiances in DAO's Next Generation Finite-Volume Data Assimilation System

The Physical-space/Finite-volume Data Assimilation System (fvDAS) is the next generation global atmospheric data assimilation system in development at the Data Assimilation Office (DAO) at NASA's Goddard Space Flight Center. It is based on a new finite-volume general circulation model jointly developed by NASA and NCAR, and on the Physical-Space Statistical Analysis System (PSAS) developed at the DAO. In this talk we will focus on the assimilation of data from the (Advanced) TIROS Operational Vertical Sounder (ATOVS), with emphasis on the impact of cloud- and land-affected level 1B radiances. Recently, it has been shown that the use of observations from satellite-borne microwave and infrared radiometers in data assimilation systems consistently increases forecast skill. Considerable effort has been expended over the past two decades, particularly with the (Advanced) TIROS Operational Vertical Sounder (ATOVS), to achieve this result. The positive impact on forecast skill has resulted from improvements in quality control algorithms, systematic error correction schemes, and more sophisticated data assimilation algorithms. Despite these advances, there are still many issues regarding the use of satellite data in data assimilation systems that remain unresolved. In particular, most operational centers still do not assimilate cloud- and land-affected TOVS data. In this study, we evaluate the impact of assimilating cloud-and land-affected TOVS/ATOVS level 1B data in DAO's next generation fvDAS, using a 1D variational scheme. We will discuss the impact of these data on both tropospheric and stratospheric forecasts, as well as on the general aspects of the earth climate system.

Joiner, J.↗