Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Short-lead seasonal precipitation forecast in northeastern Brazil using an ensemble of artificial neural networks

This study assesses the deterministic and probabilistic forecasting skill of a 1-month-lead ensemble of Artificial Neural Networks (EANN) based on low-frequency climate oscillation indices. The predictand is the February-April (FMA) rainfall in the Brazilian state of Ceará, which is a prominent subject in climate forecasting studies due to its high seasonal predictability. Additionally, the study proposes combining the EANN with dynamical models into a hybrid multi-model ensemble (MME). The forecast verification is carried out through a leave-one-out cross-validation based on 40 years of data. The EANN forecasting skill is compared with traditional statistical models and the dynamical models that compose Ceará’s operational seasonal forecasting system. A spatial comparison showed that the EANN was among the models with the smallest Root Mean Squared Error (RMSE) and Ranked Probability Score (RPS) in most regions. Moreover, the analysis of the area-aggregated reliability showed that the EANN is better calibrated than the individual dynamical models and has better resolution than Multinomial Logistic Regression for above-normal (AN) and below-normal (BN) categories. It is also shown that combining the EANN and dynamical models into a hybrid MME reduces the overconfidence of the extreme categories observed in a dynamically-based MME, improving the reliability of the forecasting system.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1999

1D Variational Assimilation of TOVS/ATOVS Level 1b Data

Recently, it has been shown that the use of observations from satellite-borne microwave and infrared radiometers in data assimilation systems consistently increases forecast skill. Considerable effort has been expended over the past two decades, particularly with the TIROS Operational Vertical Sounder (TOVS), to achieve this result. The positive impact on forecast skill has resulted from improvements in quality control algorithms, systematic error correction schemes, and data assimilation systems. Despite these recent advances, there are still many issues regarding the use of satellite data in data assimilation systems that remain unresolved. For example, at several centers, much of the TOVS data are not assimilated over land as a result of the difficulty in specifying the surface emissivity. In this study, we add the microwave surface emissivity to the state vector so that it is retrieved rather than specified by a model. The LDVAR temperature and humidity information is then assimilated interactively into the Goddard Earth Observing System - Data Assimilation System (GEOS-DAS). Results of 1DVAR assimilations with both TOVS and ATOVS will be shown. We will compare the results obtained with HIRS/MSU/SSU and HIRS/AMSU-A2.

Joiner, J.↗
NASA NTRS2008

The Super Tuesday Outbreak: Forecast Sensitivities to Single-Moment Microphysics Schemes

Forecast precipitation and radar characteristics are used by operational centers to guide the issuance of advisory products. As operational numerical weather prediction is performed at increasingly finer spatial resolution, convective precipitation traditionally represented by sub-grid scale parameterization schemes is now being determined explicitly through single- or multi-moment bulk water microphysics routines. Gains in forecasting skill are expected through improved simulation of clouds and their microphysical processes. High resolution model grids and advanced parameterizations are now available through steady increases in computer resources. As with any parameterization, their reliability must be measured through performance metrics, with errors noted and targeted for improvement. Furthermore, the use of these schemes within an operational framework requires an understanding of limitations and an estimate of biases so that forecasters and model development teams can be aware of potential errors. The National Severe Storms Laboratory (NSSL) Spring Experiments have produced daily, high resolution forecasts used to evaluate forecast skill among an ensemble with varied physical parameterizations and data assimilation techniques. In this research, high resolution forecasts of the 5-6 February 2008 Super Tuesday Outbreak are replicated using the NSSL configuration in order to evaluate two components of simulated convection on a large domain: sensitivities of quantitative precipitation forecasts to assumptions within a single-moment bulk water microphysics scheme, and to determine if these schemes accurately depict the reflectivity characteristics of well-simulated, organized, cold frontal convection. As radar returns are sensitive to the amount of hydrometeor mass and the distribution of mass among variably sized targets, radar comparisons may guide potential improvements to a single-moment scheme. In addition, object-based verification metrics are evaluated for their utility in gauging model performance and QPF variability.

Molthan, Andrew L.↗
NASA NTRS2001

Ensemble Cannonical Correlation Prediction of Seasonal Precipitation Over the US

This paper presents preliminary results of an ensemble cannonical correlation (ECC) prediction scheme developed at the Climate and Radiation Branch, NASA/Goddard Space Flight Center for determining the potential predictability of regional precipitation, and for climate downscaling studies. The scheme is tested on seasonal hindcasts of anomalous precipitation over the continental United States using global sea surface temperature (SST) for 1951-2000. To maximize the forecast skill derived from SST, the world ocean is divided into nonoverlapping sectors. The cannonical SST modes for each sector are used as the predictor for the ensemble hindcasts. Results show that the ECC yields a substantial (10-25%) increase in prediction skills for all regions of the US and for all seasonal compared to traditional CCA prediction schemes. For the boreal winter, the tropical Pacific contributes the largest potential predictability to precipitation in the southwestern and southeastern regions, while the North Pacific and the North Atlantic are responsible for enhanced forecast skills in the Pacific Northwest, the northern Great Plains and Ohio Valley. Most importantly, the ECC increases skill for summertime precipitation prediction and substantially reduced the spring predictability barrier over all regions of the US continent. Besides SST, the ECC is designed with the flexibility to include any number of predictor fields, such as soil moisture, snow cover and regional regional data. Moreover, the ECC forecasts can be applied to other climate subsystems and, in conjunction with further diagnostic or model studies will enables a better understanding of the dynamic links between climate variations and precipitation, not only for the US, but also for other regions of the world.

Lau, William K. M.↗
NASA NTRS1992

An analysis of simulated summer blocking episodes

A summer simulation using high-resolution Goddard Laboratory for Atmospheres GCM with realistic ocean surface temperatures has been able to generate persistent blocking events in Eurasia and the eastern Pacific during the 46-day period from July 1 to August 15, 1979. The generation of summer blocking episodes appears to be due at least partly to heating at the surface boundary over both the oceanic and continental areas. A control run with the SST climatology failed to produce such blockings in the late portion of the simulation. It is shown that there is considerable forecast skill in the area of the blocking circulations, particularly in the confluence area downstream. It appears that, with updated SSTs, simulation of realistic summer blocking episodes in the Northern Hemisphere is possible at least for a one-and-a-half month period, with a high forecast skill when the blocking pattern develops or is reinforced.

Kung, Ernest C.↗
NASA NTRS2009

Simulating the Effects of Irrigation over the U.S. in a Land Surface Model Based on Satellite Derived Agricultural Data

A novel method is introduced for integrating satellite derived irrigation data and high-resolution crop type information into a land surface model (LSM). The objective is to improve the simulation of land surface states and fluxes through better representation of agricultural land use. Ultimately, this scheme could enable numerical weather prediction (NWP) models to capture land-atmosphere feedbacks in managed lands more accurately and thus improve forecast skill. Here we show that application of the new irrigation scheme over the continental US significantly influences the surface water and energy balances by modulating the partitioning of water between the surface and the atmosphere. In our experiment, irrigation caused a 12% increase in evapotranspiration (QLE) and an equivalent reduction in the sensible heat flux (QH) averaged over all irrigated areas in the continental US during the 2003 growing season. Local effects were more extreme: irrigation shifted more than 100 W/m from QH to QLE in many locations in California, eastern Idaho, southern Washington, and southern Colorado during peak crop growth. In these cases, the changes in ground heat flux (QG), net radiation (RNET), evapotranspiration (ET), runoff (R), and soil moisture (SM) were more than 3 W/m(sup 2), 20 W/m(sup 2), 5 mm/day, 0.3 mm/day, and 100 mm, respectively. These results are highly relevant to continental- to global-scale water and energy cycle studies that, to date, have struggled to quantify the effects of agricultural management practices such as irrigation. Based on the results presented here, we expect that better representation of managed lands will lead to improved weather and climate forecasting skill when the new irrigation scheme is incorporated into NWP models such as NOAA's Global Forecast System (GFS).

Ozdogan, Mutlu↗
NASA NTRS2011

AIRS Impact on Analysis and Forecast of an Extreme Rainfall Event (Indus River Valley 2010) with a Global Data Assimilation and Forecast System

A set of data assimilation and forecast experiments are performed with the NASA Global data assimilation and forecast system GEOS-5, to compare the impact of different approaches towards assimilation of Advanced Infrared Spectrometer (AIRS) data on the precipitation analysis and forecast skill. The event chosen is an extreme rainfall episode which occurred in late July 11 2010 in Pakistan, causing massive floods along the Indus River Valley. Results show that the assimilation of quality-controlled AIRS temperature retrievals obtained under partly cloudy conditions produce better precipitation analyses, and substantially better 7-day forecasts, than assimilation of clear-sky radiances. The improvement of precipitation forecast skill up to 7 day is very significant in the tropics, and is caused by an improved representation, attributed to cloudy retrieval assimilation, of two contributing mechanisms: the low-level moisture advection, and the concentration of moisture over the area in the days preceding the precipitation peak.

Reale, O.↗
NASA NTRS2001

Error Estimation of An Ensemble Statistical Seasonal Precipitation Prediction Model

This NASA Technical Memorandum describes an optimal ensemble canonical correlation forecasting model for seasonal precipitation. Each individual forecast is based on the canonical correlation analysis (CCA) in the spectral spaces whose bases are empirical orthogonal functions (EOF). The optimal weights in the ensemble forecasting crucially depend on the mean square error of each individual forecast. An estimate of the mean square error of a CCA prediction is made also using the spectral method. The error is decomposed onto EOFs of the predictand and decreases linearly according to the correlation between the predictor and predictand. Since new CCA scheme is derived for continuous fields of predictor and predictand, an area-factor is automatically included. Thus our model is an improvement of the spectral CCA scheme of Barnett and Preisendorfer. The improvements include (1) the use of area-factor, (2) the estimation of prediction error, and (3) the optimal ensemble of multiple forecasts. The new CCA model is applied to the seasonal forecasting of the United States (US) precipitation field. The predictor is the sea surface temperature (SST). The US Climate Prediction Center's reconstructed SST is used as the predictor's historical data. The US National Center for Environmental Prediction's optimally interpolated precipitation (1951-2000) is used as the predictand's historical data. Our forecast experiments show that the new ensemble canonical correlation scheme renders a reasonable forecasting skill. For example, when using September-October-November SST to predict the next season December-January-February precipitation, the spatial pattern correlation between the observed and predicted are positive in 46 years among the 50 years of experiments. The positive correlations are close to or greater than 0.4 in 29 years, which indicates excellent performance of the forecasting model. The forecasting skill can be further enhanced when several predictors are used.

Shen, Samuel S. P.↗
NASA NTRS2012

The Second Phase of the Global Land Atmosphere Coupling Experiment (GLACE-2): Impact of Land Initialization on Subseasonal Forecasts

The recently-completed second phase of the Global Land-Atmosphere Coupling Experiment (GLACE-2) focused on quantifying, for boreal summer, the subseasonal (out to two months) forecast skill for precipitation and air temperature that can be derived from the realistic initialization of land surface states, notably soil moisture. An overview of the multi-institutional numerical experiment is described, along with a determination and characterization of multi-model "consensus" skill. The models show modest but significant land-derived skill in predicting air temperatures out to two months, especially where the rain gauge network is dense. Given that precipitation is the chief driver of soil moisture, and thereby assuming that rain gauge density is a reasonable proxy for the adequacy of the observational network contributing to soil moisture initialization, this result indeed highlights the potential contribution of enhanced observations to prediction. Land-derived precipitation forecast skill is much weaker than that for air temperature. The skill for predicting air temperature, and to some extent precipitation, increases with the magnitude of the initial soil moisture anomaly. GLACE-2 results are examined further to provide insight into the asymmetric impacts of wet and dry soil moisture initialization on skill.

Koster, Randal↗
DOE OSTI2020

The Impacts of Horizontal Grid Spacing and Cumulus Parameterization on Subseasonal Prediction in a Global Convection-Permitting Model

Monthlong simulations targeting four Madden–Julian oscillation events made with several global model configurations are verified against observations to assess the roles of grid spacing and convective parameterization on the representation of tropical convection and midlatitude forecast skill. Specifically, the performance of a global convection-permitting model (CPM) configuration with a uniform 3-km mesh is compared to that of a global 15-km mesh with and without convective parameterization, and of a variable-resolution “channel” simulation using 3-km grid spacing only in the tropics with a scale-aware convection scheme. It is shown that global 3-km simulations produce realistic tropical precipitation statistics, except for an overall wet bias and delayed diurnal cycle. The channel simulation performs similarly, although with an unrealistically higher frequency of heavy rain. The 15-km simulations with and without cumulus schemes produce too much light and heavy tropical precipitation, respectively. Without convection parameterization, the 15-km global model produces unrealistically abundant, short-lived, and intense convection throughout the tropics. Only the global CPM configuration is able to capture eastward-propagating Madden–Julian oscillation events, and the 15-km runs favor stationary or westward-propagating convection organized at the planetary scale. The global 3-km CPM exhibits the highest extratropical forecast skill aloft and at the surface, particularly during week 3 of each hindcast. Although more cases are needed to confirm these results, this study highlights many potential benefits of using global CPMs for subseasonal forecasting. Furthermore, results show that alternatives to global convection-permitting resolution—using coarser or spatially variable resolution—feature compromises that may reduce their predictive performance.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
NASA NTRS1992

Tropical intraseasonal oscillation and its prediction by the NMC operational model

Results are presented of an investigation of the tropical intraseasonal oscillation (ISO) and its impact on the extended-range forecast in the NMC operational model during Phase II (14 December 1986-31 March 1987) of the Dynamical Extended Range Forecast. Based on principal component analysis of the velocity potential and streamfunction, evidence was found of tropical-extratropical interaction associated with the ISO. The NMC model possess significant forecast skills for the principal streamfunction and velocity potential modes up to the first ten days. Results of the error growth analysis suggest that the principal modes of velocity potential have large errors comparable to the model random errors. By comparison, the initial errors in the streamfunction are much smaller. The error growth for both tropical and extratropical modes are found to be significantly suppressed during periods of strong ISO relative to periods of weak ISO. The increase in extratropical forecast skill is likely due to (1) the model's ability to better capture ISO signals in the tropics and (2) the increased coupling between the tropics and extratropics during periods of strong ISO.

Lau, K.-M.↗
NASA NTRS2015

Simultaneous Radar and Satellite Data Storm-Scale Assimilation Using an Ensemble Kalman Filter Approach for 24 May 2011

Assimilating high-resolution radar reflectivity and radial velocity into convection-permitting numerical weather prediction models has proven to be an important tool for improving forecast skill of convection. The use of satellite data for the application is much less well understood, only recently receiving significant attention. Since both radar and satellite data provide independent information, combing these two sources of data in a robust manner potentially represents the future of high-resolution data assimilation. This research combines Geostationary Operational Environmental Satellite 13 (GOES-13) cloud water path (CWP) retrievals with Weather Surveillance Radar-1988 Doppler (WSR-88D) reflectivity and radial velocity to examine the impacts of assimilating each for a severe weather event occurring in Oklahoma on 24 May 2011. Data are assimilated into a 3-km model using an ensemble adjustment Kalman filter approach with 36 members over a 2-h assimilation window between 1800 and 2000 UTC. Forecasts are then generated for 90 min at 5-min intervals starting at 1930 and 2000 UTC. Results show that both satellite and radar data are able to initiate convection, but that assimilating both spins up a storm much faster. Assimilating CWP also performs well at suppressing spurious precipitation and cloud cover in the model as well as capturing the anvil characteristics of developed storms. Radar data are most effective at resolving the 3D characteristics of the core convection. Assimilating both satellite and radar data generally resulted in the best model analysis and most skillful forecast for this event.

Jones, Thomas A.↗
NASA NTRSDate not supplied

Predictability of the Minimum Sea Ice Extent from Late Winter Fram Strait Ice Export: Model vs Observations

Late winter coastal divergence along the Eurasian coastline (referred to as the ice factory) – or the Fram Strait ice export, a proxy for coastal divergence in the ice factory – is a skillful predictor of the minimum sea ice extent (Williams et al., 2016; Brunette et al., 2018; Sesternikov and, 1979). Coastal divergence leads to the formation of coastal polynya where new ice grows but to a thickness that is not large enough to survive the following summer melt. This signal is then amplified by the ice albedo feedback and leads to more open water at the end of the summer melt season. In this thesis project, we will identify if this source of predictive skill in the seasonal forecast of the minimum sea ice extent is present in General Circulation Models, more precisely in the CESM2-LE, GISS-E2.1-G, GFDL FLOR-LE, CNRM-CM6-1 and the CanESM5. Since even small biases in the large-scale atmospheric circulation simulated by a model can short circuit this coupling between dominant modes of atmospheric variability (NAO and AO), coastal divergence along the Eurasian coastline, Fram Strait ice export and therefore seasonal forecasting skill of the model, failure to reproduce this coupling observed in the real Arctic will be used to identify biases in GCM. Preliminary results show that subtle changes in the large-scale atmospheric circulation leads to opposite statistical relationship between Fram Strait ice area export, coastal divergence along the Eurasian coastline, and seasonal predictability of the minimum sea ice extent both in the CESM2-LE and the GISS-E2.1-G models. Differences are linked with the partitioning between recirculation within the Beaufort Gyre, ice exported through Fram Strait and ridging north of the Canadian Arctic Archipelago.

Sea ice↗
DOE OSTI2020

Wind ramp events validation in NWP forecast models during the second Wind Forecast Improvement Project (WFIP2) using the Ramp Tool and Metric (RT&M)

The second Wind Forecast Improvement Project (WFIP2) is a multi-agency field campaign held in the Columbia Gorge area (October 2015 - March 2017). The main goal of the project is to understand and improve the forecast skill of numerical weather prediction (NWP) models in complex terrain, particularly beneficial for the wind energy industry. This region is well-known for its excellent wind resource. One of the biggest challenges for wind power production is the accurate forecasting of wind ramp events (large changes of generated power over short periods of time). Poor forecasting of the ramps requires large and sudden adjustments in conventional power generation, ultimately increasing the costs of power. A Ramp Tool and Metric (RT&M) was developed during the first WFIP experiment, held in the U.S. Great Plains (September 2011 - August 2012). The RT&M was designed to explicitly measure the skill of NWP models at forecasting wind ramp events. Here we apply the RT&M to 80-m (turbine hub-height) wind speeds measured by 19 sodars and 3 lidars, and to forecasts from the High Resolution Rapid Refresh (HRRR), 3-km, and from the High Resolution Rapid Refresh Nest (HRRRNEST), 750-m horizontal grid spacing, models. The diurnal and seasonal distribution of ramp events are analyzed, finding a noticeable diurnal variability for spring and summer but less for fall and especially winter. Also, winter has fewer ramps compared to the other seasons. The model skill at forecasting ramp events, including the impact of the modification to the model physical parameterizations, was finally investigated.

Djalalova, Irina V.↗
NASA NTRS1987

The effect of increased horizontal resolution on GLA Fourth Order model forecasts

A benchmark series of ten-day weather forecasts has been run with the GLA Fourth Order GCM with both a 4 deg latitude by 5 deg longitude resolution and a 2 deg latitude by 2.5 deg longitude resolution. Ensemble statistics of forecast skill and maps of systematic error fields have been generated for both resolutions. The enhanced resolution added 24 hours of useful predictive skill to the sea level pressure forecasts and 6 hours to the 500 mb height forecasts, but 5 to 6 days into the forecasts the advantage of the finer resolution was lost. The systematic error fields showed that by 8 days the 'climate drift' of the 2 x 2.5 deg forecasts had become pronounced and had caused the loss of predictive skill relative to the 4 x 5 deg forecasts. Additional results indicate that a gravity wave drag parameterization scheme might alleviate the climate drift problem.

Helfand, H. M.↗
NASA NTRS2003

A Global Aerosol Model Forecast for the ACE-Asia Field Experiment

We present the results of aerosol forecast during the Aerosol Characterization Experiment (ACE-Asia) field experiment in spring 2001, using the Georgia Tech/Goddard Global Ozone Chemistry Aerosol Radiation and Transport (GOCART) model and the meteorological forecast fields from the Goddard Earth Observing System Data Assimilation System (GEOS DAS). The aerosol model forecast provides direct information on aerosol optical thickness and concentrations, enabling effective flight planning, while feedbacks from measurements constantly evaluate the model, making successful model improvements. We verify the model forecast skill by comparing model predicted total aerosol extinction, dust, sulfate, and SO2 concentrations with those quantities measured by the C-130 aircraft during the ACE-Asia intensive operation period. The GEOS DAS meteorological forecast system shows excellent skills in predicting winds, relative humidity, and temperature for the ACE-Asia experiment area as well as for each individual flight, with skill scores usually above 0.7. The model is also skillful in forecast of pollution aerosols, with most scores above 0.5. The model correctly predicted the dust outbreak events and their trans-Pacific transport, but it constantly missed the high dust concentrations observed in the boundary layer. We attribute this missing dust source to the desertification regions in the Inner Mongolia Province in China, which have developed in recent years but were not included in the model during forecasting. After incorporating the desertification sources, the model is able to reproduce the observed high dust concentrations at low altitudes over the Yellow Sea. Two key elements for a successful aerosol model forecast are correct source locations that determine where the emissions take place, and realistic forecast winds and convection that determine where the aerosols are transported. We demonstrate that our global model can not only account for the large-scale intercontinental transport, but also produce the small-scale spatial and temporal variations that are adequate for aircraft measurements planning.

Chin, Mian↗