Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 433 records · Page 24

Skill in Retrievals

Retrieval Skill quantifies the ability of one retrieval from a sounder to be more accurate than the best forecast relative to another with the same of another sounder. This is summarized using a Retrieval Anomaly Skill Score (RASS) which is the cor (retrieved-background, truth-background) * sqrt(f), Where f is defined as the ratio of accepted to the possible retrievals. Charts show various features and comparisons of RASS to other methods of retrieval.

forecasting↗

Objective Lightning Forecasting at Kennedy Space Center/Cape Canaveral Air Force Station using Cloud-to-Ground Lightning Surveillance System Data

The 45th Weather Squadron (45 WS) forecasters at Cape Canaveral Air Force Station (CCAFS) in Florida include a probability of thunderstorm occurrence in their daily morning briefings. This information is used by personnel involved in determining the possibility of violating Launch Commit Criteria, evaluating Flight Rules for the Space Shuttle, and daily planning for ground operation activities on Kennedy Space Center (KSC)/CCAFS. Much of the current lightning probability forecast is based on a subjective analysis of model and observational data. The forecasters requested that a lightning probability forecast tool based on statistical analysis of historical warm-season (May - September) data be developed in order to increase the objectivity of the daily thunderstorm probability forecast. The tool is a set of statistical lightning forecast equations that provide a lightning occurrence probability for the day by 1100 UTC (0700 EDT) during the warm season. This study used 15 years (1989-2003) of warm season data to develop the objective forecast equations. The local CCAFS 1000 UTC sounding was used to calculate stability parameters for equation predictors. The Cloud-to-Ground Lightning Surveillance System (CGLSS) data were used to determine lightning occurrence for each day. The CGLSS data have been found to be more reliable indicators of lightning in the area than surface observations through local informal analyses. This work was based on the results from two earlier research projects. Everitt (1999) used surface observations and rawinsonde data to develop logistic regression equations that forecast the daily thunderstorm probability at CCAFS. The Everitt (1999) equations showed an improvement in skill over the Neumann-Pfeffer thunderstorm index (Neumann 1971), which uses multiple linear regression, and also persistence and climatology forecasts. Lericos et al. (2002) developed lightning distributions over the Florida peninsula based on specific flow regimes. The flow regimes were inferred from the average wind direction in the 1000-700 mb layer at Miami (MIA), Tampa (TBW), and Jacksonville (JAX), Florida, and the lightning data were from the National Lightning Detection Network. The results suggested that the daily flow regime may be an important predictor of lightning occurrence on KSC/CCAFS.

Lambert, Winifred↗

Sub/seasonal forecasts with a coupled interactive aerosol model in GEOS-S2S

The NASA/Goddard Subseasonal to Seasonal (GEOS-S2S) prediction model includes an interactive aerosol model that allows for prediction of aerosol optical depth (AOD) and PM2.5, as well as improved meteorological forecasts under certain conditions. A model intercomparison of the impact of interactive aerosol is under way, and results from retrospective forecasts with and without interactive aerosol were performed using GEOS-S2S as part of this intercomparison. Results from the GEOS-S2S system will be shown, demonstrating useful skill in AOD and PM2.5 and an example of the impact on a "forecast of opportunity". These results will serve as motivation for the participation of CESM in this interactive aerosol model intercomparison.

S2S↗

Huge ensembles – Part 2: Properties of a huge ensemble of hindcasts generated with spherical Fourier neural operators

Abstract. In Part 1, we created an ensemble based on spherical Fourier neural operators. As initial condition perturbations, we used bred vectors, and as model perturbations, we used multiple checkpoints trained independently from scratch. Based on diagnostics that assess the ensemble's physical fidelity, our ensemble has comparable performance to operational weather forecasting systems. However, it requires orders-of-magnitude fewer computational resources. Here in Part 2, we generate a huge ensemble (HENS), with 7424 members initialized each day of summer 2023. We enumerate the technical requirements for running huge ensembles at this scale. HENS precisely samples the tails of the forecast distribution and presents a detailed sampling of internal variability. HENS has two primary applications: (1) as a large dataset with which to study the statistics and drivers of extreme weather and (2) as a weather forecasting system. For extreme climate statistics, HENS samples events 4σ away from the ensemble mean. At each grid cell, HENS increases the skill of the most accurate ensemble member and enhances coverage of possible future trajectories. As a weather forecasting model, HENS issues extreme weather forecasts with better uncertainty quantification. It also reduces the probability of outlier events, in which the verification value lies outside the ensemble forecast distribution.

Mahesh, Ankur↗

Modulation of North Atlantic Polar Low Activity and Associated Flow Patterns by Sudden Stratospheric Warmings

Abstract Polar lows (PLs) are intense maritime mesoscale cyclones that can pose hazards to coastal communities and marine operation in the Arctic. This study examines the impacts of sudden stratospheric warmings (SSWs) on PL activity in the subarctic North Atlantic. The 20 days following SSWs are characterized by tropospheric circulation anomalies resembling the negative phase of the North Atlantic Oscillation. PL activity decreases significantly over the Labrador Sea, which can be attributed to the infrequent occurrence of low static stability and strong environmental baroclinicity, as well as reduced surface turbulent heat fluxes. These results suggest that a skillful prediction of SSWs can improve the extended-range forecast of PL activity over the Labrador Sea. For the Nordic seas, the results imply that the spatial structure of an SSW event is important for the PL modulation through different tropospheric circulation patterns. Situations with increased PL frequency in the Nordic seas are characterized by SSWs centered close to northern Greenland occurring over a smaller area, and a tropospheric response featuring enhanced cold-air outbreaks over the Norwegian Sea. Conversely, PL activity is suppressed over the Nordic seas when the SSW favors the formation of a tropospheric anticyclone above Greenland and Scandinavia. Significance Statement This study investigates the relationships between polar lows (PLs) and sudden stratospheric warmings (SSWs) over the subarctic North Atlantic. A better understanding of the effect of SSWs on PL development has the potential to improve extended-range forecasts of PLs. It is shown that SSWs are responsible for the significantly suppressed regional PL activity over the Labrador Sea, suggesting that SSWs can serve as a predictor for the extended-range forecast of PLs over this region. Following SSW events, the thermodynamic state of atmosphere becomes more stable over the Labrador Sea and hinders the convective development of PLs. For the northern Nordic seas, the impacts of SSWs on PL activity are sensitive to the spatial structure of stratospheric warming.

Chang, Chuan-Chieh↗

A simple diagnostic tool for the investigation of persistent phenomena with application to the summer 1980 U.S. heat wave

A simple and readily-computed index for diagnostic and numerical weather prediction studies of heat waves and other persistent anomalies has been developed. The index takes into account the two important factors of intensity and persistence and it is highly correlated to the surface air temperature on a variety of time-scales. The utilization of this index for investigating the severe, summer 1980 U.S. heat wave and drought results in an instructive description of the spatial and temporal development of the phenomenon. An assessment of the skill of the Goddard Laboratory for Atmospheres (GLA) model in forecasting the initiation and breakdown of the heat wave in terms of the index is also illustrated.

Wolfson, Noah↗

A New Ensemble Canonical Correlation Prediction Scheme for Seasonal Precipitation

Department of Mathematical Sciences, University of Alberta, Edmonton, Canada This paper describes the fundamental theory of the ensemble canonical correlation (ECC) algorithm for the seasonal climate forecasting. The algorithm is a statistical regression sch eme based on maximal correlation between the predictor and predictand. The prediction error is estimated by a spectral method using the basis of empirical orthogonal functions. The ECC algorithm treats the predictors and predictands as continuous fields and is an improvement from the traditional canonical correlation prediction. The improvements include the use of area-factor, estimation of prediction error, and the optimal ensemble of multiple forecasts. The ECC is applied to the seasonal forecasting over various parts of the world. The example presented here is for the North America precipitation. The predictor is the sea surface temperature (SST) from different ocean basins. The Climate Prediction Center's reconstructed SST (1951-1999) is used as the predictor's historical data. The optimally interpolated global monthly precipitation is used as the predictand?s historical data. Our forecast experiments show that the ECC algorithm renders very high skill and the optimal ensemble is very important to the high value.

Kim, Kyu-Myong↗

Predicting Hydrological Drought: Relative Contributions of Soil Moisture and Snow Information to Seasonal Streamflow Prediction Skill

in this study we examine how knowledge of mid-winter snow accumulation and soil moisture conditions contribute to our ability to predict streamflow months in advance. A first "synthetic truth" analysis focuses on a series of numerical experiments with multiple sophisticated land surface models driven with a dataset of observations-based meteorological forcing spanning multiple decades and covering the continental United States. Snowpack information by itself obviously contributes to the skill attained in streamflow prediction, particularly in the mountainous west. The isolated contribution of soil moisture information, however, is found to be large and significant in many areas, particularly in the west but also in region surrounding the Great Lakes. The results are supported by a supplemental, observations-based analysis using (naturalized) March-July streamflow measurements covering much of the western U.S. Additional forecast experiments using start dates that span the year indicate a strong seasonality in the skill contributions; soil moisture information, for example, contributes to kill at much longer leads for forecasts issued in winter than for those issued in summer.

Koster, R.↗

NASA's NMME-Based S2S Hydrologic Forecast System for Food Insecurity Early Warning in Southern Africa

In situ hydrologic monitoring over regions most susceptible to food insecurity can be a challenge in current times due to various socio-economic and political issues in combination with environmental factors such as ongoing famine or drought. Hydrologic monitoring and initializing forecasts based on remotely sensed and analyzed data can contribute significantly to early warning in such regions. Routine hydrologic forecasts, as provided by NASA’s Hydrologic Forecasting and Analysis System (NHyFAS), are a recent addition to early warning systems. A custom instance of NHyFAS, termed FLDAS-Forecast, is used by FEWS NET’s Land Data Assimilation System (FLDAS). The FLDAS-Forecast’s dynamic forecasting component was originally set up with Goddard Earth Observing System (GEOS) forecast inputs and has been recently expanded with precipitation forecast forcing from the North American Multi-Model Ensemble (NMME). This paper describes the improvements in seasonal hydrologic forecasts produced with this updated system. Evaluations in this study focus on soil moisture across southern Africa’s growing season. Soil moisture forecasts are benchmarked and evaluated relative to climatology-based forecasts and historic runs, which are driven by observation-based meteorological forcing fields, and they are verified with remotely sensed observations of soil moisture and vegetation. Through multiple deterministic and probabilistic skill assessments, we show that using the larger ensemble of NMME precipitation inputs in the forecast system results in higher quality hydrologic forecasts than are allowed by climatology- or GEOS-only-based forecasts. Further, the near-real-time NMME-based rootzone soil moisture forecasts were able to correctly predict developing drought conditions over southern Africa through late 2019 and into early 2020.

Hydrologic forecasts↗

Ultra-Short-Term Spatiotemporal Forecasting of Renewable Resources: An Attention Temporal Convolutional Network Based Approach

The rapid increase in the penetration of renewable energy resources characterized by high variability and uncertainty is bringing new challenges to the power system operation. To ensure the efficient and reliable operation of electric grid, an accurate and general short-term forecasting algorithm with interpretability is desired. Moreover, the extensive off-site information provided by the proliferation of new renewable plants stimulates the interests in the spatiotemporal forecasting. In this paper, an attention temporal convolutional network, which is built on stacked dilated causal convolutional networks and attention mechanisms, is proposed to perform the ultra-short-term spatiotemporal forecasting of renewable resources. Compared with the existing spatiotemporal forecasting methods, the presented model needs no domain knowledge and can be applied to different forecasting tasks such as solar generation and wind speed forecasting. Here, the attention mechanism improves the interpretability. The algorithm can be used to produce both point and probabilistic forecasts. Numerical results on the data sets from National Renewable Energy Laboratory show superior performance over five baselines, in terms of skill scores. Compared with the baselines, the average improvements of accuracy introduced by the proposed method for the point and probabilistic forecasting are 15.08% and 15.85%, respectively.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Experiments with the fourth order GISS general circulation model

The new GISS GCM with 4th order conservative horizontal finite difference is briefly described. A simple forecast performed with real initial data indicates a significant increase in skill with respect to standard 2nd order GISS GCM. The improvement is limited by other sources of errors, especially poor initial data and vertical truncation. It is estimated that with a 4th order - 200 km grid model, errors introduced by horizontal truncation will be negligible for about a week for most synoptic scales (wavelengths larger than 1000 km).

Kalnay-Rivas, E.↗

Multi-Scale Three-Dimensional Variational Data Assimilation System for Coastal Ocean Prediction

A multi-scale three-dimensional variational data assimilation system (MS-3DVAR) has been formulated and the associated software system has been developed for improving high-resolution coastal ocean prediction. This system helps improve coastal ocean prediction skill, and has been used in support of operational coastal ocean forecasting systems and field experiments. The system has been developed to improve the capability of data assimilation for assimilating, simultaneously and effectively, sparse vertical profiles and high-resolution remote sensing surface measurements into coastal ocean models, as well as constraining model biases. In this system, the cost function is decomposed into two separate units for the large- and small-scale components, respectively. As such, data assimilation is implemented sequentially from large to small scales, the background error covariance is constructed to be scale-dependent, and a scale-dependent dynamic balance is incorporated. This scheme then allows effective constraining large scales and model bias through assimilating sparse vertical profiles, and small scales through assimilating high-resolution surface measurements. This MS-3DVAR enhances the capability of the traditional 3DVAR for assimilating highly heterogeneously distributed observations, such as along-track satellite altimetry data, and particularly maximizing the extraction of information from limited numbers of vertical profile observations.

Li, Zhijin↗

Comparison of Selected Weather Translation Products

Weather is a primary contributor to the air traffic delays within the National Airspace System (NAS). At present, it is the individual decision makers who use weather information and assess its operational impact in creating effective air traffic management solutions. As a result, the estimation of the impact of forecast weather and the quality of ATM response relies on the skill and experience level of the decision maker. FAA Weather-ATM working groups have developed a Weather-ATM integration framework that consists of weather collection, weather translation, ATM impact conversion and ATM decision support. Some weather translation measures have been developed for hypothetical operations such as decentralized free flight, whereas others are meant to be relevant in current operations. This paper does comparative study of two different weather translation products relevant in current operations and finds that these products have strong correlation with each other. Given inaccuracies in prediction of weather, these differences would not be expected to be of significance in statistical study of a large number of decisions made with a look-ahead time of two hours or more.

Kulkarni, Deepak↗

Enhancing Extreme Precipitation Predictions With Dynamical Downscaling: A Convection‐Permitting Modeling Study in Texas and Oklahoma

Precipitation in the Southern Plains of the United States is relatively well depicted by the Community Earth System Model (CESM). However, despite its ability to capture seasonal mean precipitation anomalies, CESM consistently underestimates extreme pluvial and drought events, rendering it an insufficient tool for extending simulation lead times for exceptional events, such as the abnormally dry May 2011, which helped drive Texas into its worst period of drought in more than a century, and the abnormally wet May 2015, which led to widespread flooding in that state. Ensemble‐based regional climate experiments are completed for the two extreme years using Weather Research and Forecasting model (WRF) and downscaled from CESM. WRF simulations are at convection‐permitting grid resolution for improved physical representation of simulated precipitation over the Southern Great Plains. By integrating convection‐permitting models (CPMs) into each individual member of a CESM ocean data assimilation ensemble, this study demonstrates that high‐resolution dynamical downscaling can improve model skillfulness at capturing these two events and is thus a potentially useful tool for forecasting extremely high and extremely low precipitation events at subseasonal or even seasonal lead times.

54 ENVIRONMENTAL SCIENCES↗

A Bayesian Approach to Regional Decadal Predictability: Sparse Parameter Estimation in High-Dimensional Linear Inverse Models of High-Latitude Sea Surface Temperature Variability

Stochastic reduced models are an important tool in climate systems whose many spatial and temporal scales cannot be fully discretized or underlying physics may not be fully accounted for. One form of reduced model, the linear inverse model (LIM), has been widely used for regional climate predictability studies—typically focusing more on tropical or midlatitude studies. However, most LIM fitting techniques rely on point estimation techniques deriving from fluctuation–dissipation theory. In this methodological study we explore the use of Bayesian inference techniques for LIM parameter estimation of sea surface temperature (SST), to quantify the skillful decadal predictability of Bayesian LIM models at high latitudes. We show that Bayesian methods, when compared to traditional point estimation methods for LIM-type models, provide better calibrated probabilistic skill, while simultaneously providing better point estimates due to the regularization effect of the prior distribution in high-dimensional problems. We compare the effect of several priors, as well as maximum likelihood estimates, on 1) estimating parameter values on a perfect model experiment and 2) producing calibrated 1-yr SST anomaly forecast distributions using a preindustrial control run of the Community Earth System Model (CESM). Finally, we employ a host of probabilistic skill metrics to determine the extent to which an LIM can forecast SST anomalies at high latitudes. We find that the choice of prior distribution has an appreciable impact on estimation outcomes, and priors that emphasize physically relevant properties enhance the model’s ability to capture variability of SST anomalies.

54 ENVIRONMENTAL SCIENCES↗

Tropical Interbasin Interaction as Effective Predictors of Late-Spring Precipitation Variability in the Southern Great Plains

Abstract The southern Great Plains experience fluctuating precipitation extremes that significantly impact agriculture and water management. Despite ongoing efforts to enhance forecast accuracy, the underlying causes of these climatic phenomena remain inadequately understood. This study elucidates the relative influence of the tropical Pacific and Atlantic basins on April–May–June precipitation variability in this region. Our partial ocean assimilation experiments using the Community Earth System Model unveil the prominent role of interbasin interaction, with the Pacific and Atlantic contributing approximately 70% and 30%, respectively, to these interbasin contrasts. Our statistical analyses suggest that these tropical interbasin contrasts could serve as a more reliable indicator for late-spring precipitation anomalies than El Niño–Southern Oscillation. The conclusions are reinforced by analyses of seven climate forecasting systems within the North American Multi-Model Ensemble, offering an optimistic outlook for enhancing real-time forecasting of late-spring precipitation in the southern plains. However, the current predictive skills of the interbasin contrasts across the prediction systems are hindered by the lower predictability of the tropical Atlantic Ocean, pointing to the need for future research to refine climate prediction models further. Significance Statement Agriculture and infrastructure in the southern plains face challenges from severe late-spring precipitation extremes. Traditional predictors like El Niño–Southern Oscillation (ENSO) lose effectiveness during the critical spring-to-summer transition, creating a forecasting gap. This study introduces the concept of tropical interbasin interactions, known to enhance seasonal predictability for late-spring precipitation in the southern plains. Novel climate model experiments highlight contributions from the tropical Pacific and Atlantic, offering a promising predictability that potentially surpasses the limitations of ENSO-based predictions. These outcomes hold the potential for developing operational forecasts of late-spring precipitation anomalies in the southern plains, enabling proactive risk management.

Chikamoto, Yoshimitsu↗

Evaluating skill in predicting the Interdecadal Pacific Oscillation in initialized decadal climate prediction hindcasts in E3SMv1 and CESM1 using two different initialization methods and a small set of start years

Abstract It is a daunting challenge to conduct initialized hindcasts with enough ensemble members and associated start years to form a drifted climatology from which to compute the anomalies necessary to quantify the skill of the hindcasts when compared to observations. This limits the ability to experiment with case studies and other applications where only a few initial years are needed. Here we run a set of hindcasts with CESM1 and E3SMv1 using two different initialization methods for a limited set of start years and use the respective uninitialized free-running historical simulations to form the model climatologies. Since the drifts from the observed initial states in the hindcasts toward the uninitialized model state are large and rapid, after a few years the drifted initialized models approach the uninitialized model climatological errors. Therefore, hindcasts from the limited start years can use the uninitialized climatology to represent the drifted model states after about lead year 3, providing a means to compute forecast anomalies in the absence of a large hindcast sample. There is comparable skill for predicting spatial patterns of multi-year Pacific sea surface temperature anomalies in the domain of the Interdecadal Pacific Oscillation using this method compared to the conventional methodology with a large hindcast data set, though there is a model dependence to the drifts in the two initialization methods.

54 ENVIRONMENTAL SCIENCES↗

Using Convolutional Neural Network to Emulate Seasonal Tropical Cyclone Activity

Abstract It has been widely recognized that tropical cyclone (TC) genesis requires favorable large‐scale environmental conditions. Based on these linkages, numerous efforts have been made to establish an empirical relationship between seasonal TC activities and large‐scale environmental favorability in a quantitative way, which lead to conceptual functions such as the TC genesis index. However, due to the limited amount of reliable TC observations and complexity of the climate system, a simple analytic function may not be an accurate portrait of the empirical relationship between TCs and their ambiences. In this research, we use convolution neural networks (CNNs) to disentangle this complex relationship. To circumvent the limited amount of seasonal TC observation records, we implement transfer‐learning technique to train ensemble of CNNs first on suites of high‐resolution climate model simulations with realistic seasonal TC activities and large‐scale environmental conditions, and then on a state‐of‐the‐art reanalysis from 1950 to 2019. The trained CNNs can well reproduce the historical TC records and yields significant seasonal prediction skills when the large‐scale environmental inputs are provided by operational climate forecasts. Furthermore, by inputting the ensemble CNNs with 20th century reanalysis products and Phase 6 of the Coupled Model Intercomparison Project (CMIP6) simulations, we investigated TC variability and its changes in the past and future climates. Specifically, our ensemble CNNs project a decreasing trend of global mean TC activity in the future warming scenario, which is consistent with our future projections using high‐resolution climate model.

Meteorology & Atmospheric Sciences↗