Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast skill”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 361 records · Page 20

Enhancing Short-Range Weather Forecasts through Temporal Variation Encoding: A Multiperiod Embedding Approach

Machine learning (ML) techniques have emerged as promising approaches to improve regional weather forecast accuracy and reliability through data-driven methods. We propose a novel ML-based weather forecasting model, the Multiperiod Embed Net (MPENet). A key distinguishing feature of MPENet is its explicit utilization of the inherent cyclic nature in weather dynamics, unlike the autoregressive strategies commonly used in other ML weather forecasting approaches. Critical cyclic structures are identified via Fourier analyses of dynamic time series. Cyclicity in the convolutional representation is achieved by transforming one-dimensional time series of meteorological variables into two-dimensional tensors based on identified periods. This approach enables the model to leverage intrinsic weather patterns, enhancing regional forecast performance. To demonstrate the effectiveness of MPENet, we conduct a comparative analysis with Nvidia’s FourCastNet. Both models are trained on High-Resolution Rapid Refresh (HRRR) data from 2015 to 2022, over a 192 km × 192 km region in Tennessee. The comparisons are performed locally at two specific locations known to have different weather dynamics due to orographic effects: Crossville, on the relatively flat Cumberland Plateau with fewer topographic airflow disruptions, and Oak Ridge, in the ridge-and-valley region, where airflow is heavily influenced by surrounding valleys and mountains. Our results indicate that FourCastNet achieves strong accuracy at very short lead times, while MPENet maintains competitive skill and shows advantages in capturing temporal evolution over longer periods. Cross-correlation analyses of MPENet and FourCastNet predictions with the HRRR data suggest that encoding critical cyclicity into the network architecture leads to improvements in the forecasting skill.

Artificial intelligence↗

Using a Simple Water Balance Framework to Quantify the Impact of Soil Moisture Initialization on Subseasonal Evapotranspiration and Air Temperature Forecasts

Past studies have shown that accurate soil moisture initialization can contribute significant skill to near-surface air temperature (T2M) forecasts at subseasonal leads. The mechanisms by which soil moisture contributes such skill are examined here with a simple water balance-based model that captures the essence of soil moisture behavior in a state-of-the-art subseasonal-to-seasonal (S2S) forecasting system. The simple model successfully transforms initial soil moisture contents into average “forecasted” ET values at 16-30 day lead that agree well, during summer, with the values forecasted by the full NASA GEOS S2S system, indicating that soil moisture initialization dominates over forecasted meteorology in determining ET fluxes at subseasonal leads. When the simple model’s ET anomalies are interpreted in terms of T2M anomalies, a similar conclusion is reached for T2M: soil moisture initialization explains much (about 50% in the eastern half of the continental US) of the T2M anomalies produced by the full GEOS S2S system at 16-30 day lead, and the T2M forecasts produced by the simple model capture about half of the skill attained by the full system. The simple model’s framework is particularly conducive to an analysis of uncertainty in forecasts. Drier soils are generally found to induce larger uncertainty in ET (and thus T2M) forecasts, a result linked to the functional form relating ET to soil moisture in the simple model and verified by an analysis of the ensemble spreads within the forecasts produced by the full GEOS S2S system

Randal D Koster↗

New framework for benchmarking decadal predictions leveraging the PCMDI Metric Package with interactive visualization

Reliable climate predictions across multiple timescales are increasingly critical as climate-related risks continue to rise. With the growing number and diversity of climate prediction systems, systematic intercomparison has become essential. Here, we present a comprehensive evaluation framework based on the PCMDI Metric Package to assess the performance of multiple decadal climate prediction systems. Unlike uninitialized simulations, initialized predictions exhibit bias and predictive skill that evolve with forecast lead time. To address this, we introduce (1) model-by-lead-time portrait plots, which efficiently summarize metrics of global temperature, precipitation, and Arctic/Antarctic sea-ice extent, and (2) an HTML-based interactive visualization platform that provides detailed regional and seasonal diagnostics of model bias, skill scores, and ensemble spread for each model and lead time. Comparisons with uninitialized simulations further quantify the relative impacts of initialization and external forcing on prediction skill. The proposed framework provides a scalable and transparent approach for multi-model climate prediction assessments and can be readily extended to a wide range of operational and research forecasting systems.

54 ENVIRONMENTAL SCIENCES↗

Asymmetry in Subseasonal Surface Air Temperature Forecast Error with Respect to Soil Moisture Initialization

Soil moisture (W) helps control evapotranspiration (ET), and ET variations can in turn have a distinct impact on 2-m air temperature (T2M), given that increases in evaporative cooling encourage reduced temperatures. Soil moisture is accordingly linked to T2M, and realistic soil moisture initialization has, in previous studies, been shown to improve the skill of subseasonal T2M forecasts. The relationship between soil moisture and evapotranspiration, however, is distinctly nonlinear, with ET tending to increase with soil moisture in drier conditions and to be insensitive to soil moisture variations in wetter conditions. Here, through an extensive analysis of subseasonal forecasts produced with a state-of-the-art seasonal forecast system, this nonlinearity is shown to imprint itself on T2M forecast error in the conterminous United States in two unique ways: (i) the T2M forecast bias (relative to independent observations) induced by a negative precipitation bias tends to be larger for dry initializations, and (ii) on average, the unbiased root-mean-square error (ubRMSE) tends to be larger for dry initializations. Such findings can aid in the identification of forecasts of opportunity; taken a step further, they suggest a pathway for improving bias correction and uncertainty estimation in subseasonal T2M forecasts by conditioning each on initial soil moisture state.

Air Temperature↗

Objective Lightning Probability Forecasting for Kennedy Space Center and Cape Canaveral Air Force Station, Phase III

The AMU created new logistic regression equations in an effort to increase the skill of the Objective Lightning Forecast Tool developed in Phase II (Lambert 2007). One equation was created for each of five sub-seasons based on the daily lightning climatology instead of by month as was done in Phase II. The assumption was that these equations would capture the physical attributes that contribute to thunderstorm formation more so than monthly equations. However, the SS values in Section 5.3.2 showed that the Phase III equations had worse skill than the Phase II equations and, therefore, will not be transitioned into operations. The current Objective Lightning Forecast Tool developed in Phase II will continue to be used operationally in MIDDS. Three warm seasons were added to the Phase II dataset to increase the POR from 17 to 20 years (1989-2008), and data for October were included since the daily climatology showed lightning occurrence extending into that month. None of the three methods tested to determine the start of the subseason in each individual year were able to discern the start dates with consistent accuracy. Therefore, the start dates were determined by the daily climatology shown in Figure 10 and were the same in every year. The procedures used to create the predictors and develop the equations were identical to those in Phase II. The equations were made up of one to three predictors. TI and the flow regime probabilities were the top predictors followed by 1-day persistence, then VT and Ll. Each equation outperformed four other forecast methods by 7-57% using the verification dataset, but the new equations were outperformed by the Phase II equations in every sub-season. The reason for the degradation may be due to the fact that the same sub-season start dates were used in every year. It is likely there was overlap of sub-season days at the beginning and end of each defined sub-season in each individual year, which could very well affect equation performance.

Crawford, Winifred C.↗

T2M Forecasts at Subseasonal Leads: Do Different Soil Moisture Initial States Have Different Impacts?

Soil moisture (W) helps control evapotranspiration (ET), and ET variations can in turn have a distinct impact on 2-m air temperature (T2M), given that increases in evaporative cooling encourage reduced temperatures. Soil moisture is accordingly linked to T2M, and realistic soil moisture initialization has, in previous studies, been shown to improve the skill of subseasonal T2M forecasts. The relationship between soil moisture and evapotranspiration, however, is distinctly nonlinear, with ET tending to increase with soil moisture in drier conditions and to be insensitive to soil moisture variations in wetter conditions. Here, through an extensive analysis of subseasonal forecasts produced with a state-of-the-art seasonal forecast system, this nonlinearity is shown to imprint itself on T2M forecast error in the conterminous United States in two unique ways: (i) the T2M forecast bias (relative to independent observations) induced by a negative precipitation bias tends to be larger for dry initializations, and (ii) on average, the unbiased root-mean-square error (ubRMSE) tends to be larger for dry initializations. Such findings can aid in the identification of forecasts of opportunity; taken a step further, they suggest a pathway for improving bias correction and uncertainty estimation in subseasonal T2M forecasts by conditioning each on initial soil moisture state.

2-meter Temperature↗

Attribution of North American Subseasonal Precipitation Prediction Skill

The skill of NOAA’s official monthly U.S. precipitation forecasts (issued in the middle of the prior month) has historically been low, having shown modest skill over the southern United States, but little or no skill over large portions of the central United States. The goal of this study is to explain the seasonal and regional variations of the North American subseasonal (weeks 3–6) precipitation skill, specifically the reasons for its successes and its limitations. The performances of multiple recent-generation model reforecasts over 1999–2015 in predicting precipitation are compared to uninitialized simulation skill using the atmospheric component of the forecast systems. This parallel analysis permits attribution of precipitation skill to two distinct sources: one due to slowly evolving ocean surface boundary states and the other to faster time-scale initial atmospheric weather states. A strong regionality and seasonality in precipitation forecast performance is shown to be analogous to skill patterns dictated by boundary forcing constraints alone. The correspondence is found to be especially high for the North American pattern of the maximum monthly skill that is achieved in the reforecast. The boundary forcing of most importance originates from tropical Pacific SST influences, especially those related to El Niño–Southern Oscillation. Furthermore, we discuss physical constraints that may limit monthly precipitation skill and interpret the performance of existing models in the context of plausible upper limits.

54 ENVIRONMENTAL SCIENCES↗

Medium-range numerical forecasts of atmospheric angular momentum

Forecasts of zonal wind fields produced by the medium-range forecast (MRF) model of the National Meteorological Center are used to create predictions of the atmosphere's angular momentum at lead times of 1-10 days. Based on momentum forecasts archived for the period December 1985-November 1986, it is found that, on average, the MRF exhibits positive skill relative to persistence-based forecasts at all lead times. Over the entire one-year study period, the improvement over persistence exceeds 20 percent for 2-6 day forecasts and remains as large as 10 percent even for 10-day forecasts. On the other hand, skill scores for the MRF momentum predictions vary considerably from month to month, and for a sizable fraction of the study period, the MRF is less skillful than persistence.

Rosen, Richard D.↗

Prediction and Predictability of the Madden Julian Oscillation in the NASA GEOS-5 Seasonal-to-Subseasonal System

In this study, we examine the prediction skill and predictability of the Madden Julian Oscillation (MJO) in a recent version of the NASA GEOS-5 atmosphere-ocean coupled model run at at 1/2 degree horizontal resolution. The results are based on a suite of hindcasts produced as part of the NOAA SubX project, consisting of seven ensemble members initialized every 5 days for the period 1999-2015. The atmospheric initial conditions were taken from the Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2), and the ocean and the sea ice were taken from a GMAO ocean analysis. The land states were initialized from the MERRA-2 land output, which is based on observation-corrected precipitation fields. We investigated the MJO prediction skill in terms of the bivariate correlation coefficient for the real-time multivariate MJO (RMM) indices. The correlation coefficient stays at or above 0.5 out to forecast lead times of 26-36 days, with a pronounced increase in skill for forecasts initialized from phase 3, when the MJO convective anomaly is located in the central tropical Indian Ocean. A corresponding estimate of the upper limit of the predictability is calculated by considering a single ensemble member as the truth and verifying the ensemble mean of the remaining members against that. The predictability estimates fall between 35-37 days (taken as forecast lead when the correlation reaches 0.5) and are rather insensitive to the initial MJO phase. The model shows slightly higher skill when the initial conditions contain strong MJO events compared to weak events, although the difference in skill is evident only from lead 1 to 20. Similar to other models, the RMM-index-based skill arises mostly from the circulation components of the index. The skill of the convective component of the index drops to 0.5 by day 20 as opposed to day 30 for circulation fields. The propagation of the MJO anomalies over the Maritime Continent does not appear problematic in the GEOS-5 hindcasts implying that the Maritime Continent predictability barrier may not be a major concern in this model. Finally, the MJO prediction skill in this version of GEOS-5 is superior to that of the current seasonal prediction system at the GMAO; this could be partly attributed to a slightly better representation of the MJO in the free running version of this model and partly to the improved atmospheric initialization from MERRA-2.

Achuthavarier, Deepthi↗

Prediction Skill of the 2012 U.S. Great Plains Flash Drought in Subseasonal Experiment (SubX) Models

Flash droughts refer to droughts that develop much more rapidly than normal (i.e., on the order of weeks to a few months). Such droughts can have devastating impacts on agriculture, water resources, and ecosystems. The ability to predict flash droughts in advance would greatly enhance our preparation for them and potentially mitigate their impacts. We investigated the prediction skill of U.S. flash droughts at subseasonal lead times in global forecast systems participating in the Subseasonal Experiment (SubX) project. An additional comprehensive set of hindcasts with NASA?s GEOSv2.1, a model with relatively high prediction skill, was performed to investigate the separate contributions of atmospheric and land initial conditions to flash drought prediction skill. Here we focus on results for the 2012 Great Plains flash drought, noting that the findings based on this event are generally applicable to other U.S. flash droughts. The prediction skill of the SubX models is quite variable. While the skill is limited to less than 2 weeks in most models, it is considerably higher (3-4 weeks or more) for certain models and initialization dates. The enhanced prediction skill is found to originate from two robust sources: 1) accurate soil moisture initialization, and 2) the satisfactory representation of quasi-stationary cross-North Pacific Rossby wave trains that lead to the rapid intensification of flash droughts. Our results corroborate earlier findings that accurate soil moisture initialization is important for skillful subseasonal forecasts and highlight the need for additional research on the sources and predictability of drought-inducing quasi-stationary Rossby waves.

DeAngelis, Anthony M.↗

Forecasting Ocean Chlorophyll in the Equatorial Pacific

Using a global ocean biogeochemical model combined with a forecast of physical oceanic and atmospheric variables from the NASA Global Modeling and Assimilation Office, we assess the skill of a chlorophyll concentrations forecast in the Equatorial Pacific for the period 2012-2015 with a focus on the forecast of the onset of the 2015 El Niño event. Using a series of retrospective 9-month hindcasts, we assess the uncertainties of the forecasted chlorophyll by comparing the monthly total chlorophyll concentration from the forecast with the corresponding monthly ocean chlorophyll data from the Suomi-National Polar-orbiting Partnership Visible Infrared Imaging Radiometer Suite (S-NPP VIIRS) satellite. The forecast was able to reproduce the phasing of the variability in chlorophyll concentration in the Equatorial Pacific, including the beginning of the 2015-2016 El Niño. The anomaly correlation coefficient (ACC) was significant (p less than 0.05) for forecast at 1-month (R=0.33), 8-month (R=0.42) and 9-month (R=0.41) lead times. The root mean square error (RMSE) increased from 0.0399 microgram ch1 L(exp -1) for the 1-month lead forecast to a maximum of 0.0472 microgram ch1 L(exp -1) for the 9-month lead forecast indicating that the forecast of the amplitude of chlorophyll concentration variability was getting worse. Forecasts with a 3-month lead time were on average the closest to the S-NPP VIIRS data (23% or 0.033 microgram ch1 L(exp -1)) while the forecast with a 9-month lead time were the furthest (31% or 0.042 microgram ch1 L(exp -1)). These results indicate the potential for forecasting chlorophyll concentration in this region but also highlights various deficiencies and suggestions for improvements to the current biogeochemical forecasting system. This system provides an initial basis for future applications including the effects of El Niño events on fisheries and other ocean resources given improvements identified in the analysis of these results.

Anomaly Correlation Coefficient (ACC)↗

The MOSAiC Distributed Network: Observing the coupled Arctic system with multidisciplinary, coordinated platforms

Central Arctic properties and processes are important to the regional and global coupled climate system. The Multidisciplinary drifting Observatory for the Study of Arctic Climate (MOSAiC) Distributed Network (DN) of autonomous ice-tethered systems aimed to bridge gaps in our understanding of temporal and spatial scales, in particular with respect to the resolution of Earth system models. By characterizing variability around local measurements made at a Central Observatory, the DN covers both the coupled system interactions involving the ocean-ice-atmosphere interfaces as well as three-dimensional processes in the ocean, sea ice, and atmosphere. The more than 200 autonomous instruments (“buoys”) were of varying complexity and set up at different sites mostly within 50 km of the Central Observatory. During an exemplary midwinter month, the DN observations captured the spatial variability of atmospheric processes on sub-monthly time scales, but less so for monthly means. They show significant variability in snow depth and ice thickness, and provide a temporally and spatially resolved characterization of ice motion and deformation, showing coherency at the DN scale but less at smaller spatial scales. Ocean data show the background gradient across the DN as well as spatially dependent time variability due to local mixed layer sub-mesoscale and mesoscale processes, influenced by a variable ice cover. The second case (May–June 2020) illustrates the utility of the DN during the absence of manually obtained data by providing continuity of physical and biological observations during this key transitional period. We show examples of synergies between the extensive MOSAiC remote sensing observations and numerical modeling, such as estimating the skill of ice drift forecasts and evaluating coupled system modeling. The MOSAiC DN has been proven to enable analysis of local to mesoscale processes in the coupled atmosphere-ice-ocean system and has the potential to improve model parameterizations of important, unresolved processes in the future.

54 ENVIRONMENTAL SCIENCES↗

Operational wind shear detection and warning - The 'CLAWS' experience at Denver and future objectives

An operational wind shear detection and warning experiment was conducted at Denver's Stapleton International Airport in summer 1984. Based on meteorological interpretation of scope displays from a Doppler weather radar, warnings were transmitted to the air traffic control tower via voice radio. Analyses of results indicated real skill in daily microburst forecasts and very short-term (less than 5-min) warnings. Wind shift advisories with 15-30 min forecasts, permitted more efficient runway reconfigurations. Potential fuel savings were estimated at $875,000/yr at Stapleton. The philosophy of future development toward an automated, operational system is discussed.

Mccarthy, John↗

Results from CrIS-ATMS Obtained Using the AIRS Science Team Retrieval Methodology

AIRS was launched on EOS Aqua in May 2002, together with AMSU-A and HSB (which subsequently failed early in the mission), to form a next generation polar orbiting infrared and microwave atmospheric sounding system. AIRS/AMSU had two primary objectives. The first objective was to provide real-time data products available for use by the operational Numerical Weather Prediction Centers in a data assimilation mode to improve the skill of their subsequent forecasts. The second objective was to provide accurate unbiased sounding products with good spatial coverage that are used to generate stable multi-year climate data sets to study the earth's interannual variability, climate processes, and possibly long-term trends. AIRS/AMSU data for all time periods are now being processed using the state of the art AIRS Science Team Version-6 retrieval methodology. The Suomi-NPP mission was launched in October 2011 as part of a sequence of Low Earth Orbiting satellite missions under the "Joint Polar Satellite System" (JPSS). NPP carries CrIS and ATMS, which are advanced infra-red and microwave atmospheric sounders that were designed as follow-ons to the AIRS and AMSU instruments. The main objective of this work is to assess whether CrIS/ATMS will be an adequate replacement for AIRS/AMSU from the perspective of the generation of accurate and consistent long term climate data records, or if improved instruments should be developed for future flight. It is critical for CrIS/ATMS to be processed using an algorithm similar to, or at least comparable to, AIRS Version-6 before such an assessment can be made. We have been conducting research to optimize products derived from CrIS/ATMS observations using a scientific approach analogous to the AIRS Version-6 retrieval algorithm. Our latest research uses Version-5.70 of the CrIS/ATMS retrieval algorithm, which is otherwise analogous to AIRS Version-6, but does not yet contain the benefit of use of a Neural-Net first guess start-up system which significantly improved results of AIRS Version-6. Version-5.70 CrIS/ATMS temperature profile and surface skin temperature retrievals are of very good quality, and are better than AIRS Version-5 retrievals, but are still significantly poorer than those of AIRS Version-6. CrIS/ATMS retrievals should improve when a Neural-Net start-up system is ready for use. We also examined CrIS/ATMS retrievals generated by NOAA using their NUCAPS retrieval algorithm, which is based on earlier versions of the AIRS Science Team retrieval algorithms. We show that the NUCAPS algorithm as currently configured is not well suited for climate monitoring purposes.

CrIS↗

Optimization of a Radiative Transfer Forward Operator for Simulating SMOS Brightness Temperatures over the Upper Mississippi Basin, USA

The Soil Moisture and Ocean Salinity (SMOS) satellite mission is routinely providing global multi-angular observations of brightness temperature (TB) at both horizontal and vertical polarization with a 3-day repeat period. The assimilation of such data into a land surface model (LSM) may improve the skill of operational flood forecasts through an improved estimation of soil moisture (SM). To accommodate for the direct assimilation of the SMOS TB data, the LSM needs to be coupled with a radiative transfer model (RTM), serving as a forward operator for the simulation of multi-angular and multi-polarization top of atmosphere TBs. This study investigates the use of the Variable Infiltration Capacity (VIC) LSM coupled with the Community Microwave Emission Modelling platform (CMEM) for simulating SMOS TB observations over the Upper Mississippi basin, USA. For a period of 2 years (2010-2011), a comparison between SMOS TBs and simulations with literature-based RTM parameters reveals a basin averaged bias of 30K. Therefore, time series of SMOS TB observations are used to investigate ways for mitigating these large biases. Specifically, the study demonstrates the impact of the LSM soil moisture climatology in the magnitude of TB biases. After CDF matching the SM climatology of the LSM to SMOS retrievals, the average bias decreases from 30K to less than 5K. Further improvements can be made through calibration of RTM parameters related to the modeling of surface roughness and vegetation. Consequently, it can be concluded that SM rescaling and RTM optimization are efficient means for mitigating biases and form a necessary preparatory step for data assimilation.

SMOS↗

The WRF-Solar Ensemble Prediction System: Development, Test, and Validation

Providing reliable probabilistic solar radiation information is needed to improve management of the uncertainty and variability of solar generation. Thus, guidance on how to develop skillful and accurate ensemble forecasts is essential and it will ultimately contribute to integration of high amounts of solar energy on the grid. A team from the National Renewable Energy Laboratory and the National Center for Atmospheric Research had been collaborating to develop the WRF-Solar ensemble prediction system (WRF-Solar EPS) in the past three years to produce probabilistic solar irradiance forecasts and better predict solar energy by quantifying forecast uncertainty. The WRF-Solar EPS basically generates ensemble members for solar irradiance based on stochastic perturbations to provide intraday and day-ahead probabilistic forecasts. This study will present main research steps in developing the WRF-Solar EPS including: (a) tangent linear analysis for identifying key input variables of six WRF-Solar modules significantly related to predicting of cloud and solar irradiance, (b) combining stochastic perturbation technique with the WRF-Solar model, and (c) ensemble calibration method to decrease error and uncertainty of ensemble-based solar forecasts. The capability of WRF-Solar EPS is now updated to the most recent version of standard WRF model. This presentation will summarize comprehensive results from the evaluation of forecasts against the National Solar Radiation Data Base as well as ground-measured observations. Moreover, we will introduce the user's guide for WRF-Solar EPS (e.g., parameters to configure stochastic perturbations) and future extension of this research.

day-ahead forecast↗