Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS1984

MERIT - A new approach to upper air forecasting for aviation

The development of a man/computer data enhancement and management system to provide very-short range upper air forecasts is examined. The forecast accuracy and precision problems encountered with the current numerical weather prediction models are discussed. The proposed system is to utilize both radiosonde data and automated pilot reports and provide a 2-12 hour analysis/forecast with a 3 hour forecast cycle. The minimum energy routes using interactive techniques (MERIT) system is described and a diagram is povided. The preliminary testing of a modified MERIT system reveals that the system is not as accurate as the Spectral 12 hour forecast, but is more accurate than the spectral 24 hour forecast. The coplete testing and validation of the MERIT system is required before a comparison with present techniques is possible.

Steinberg, R.↗
NASA NTRS1981

Applications systems verification and transfer project. Volume 1: Operational applications of satellite snow cover observations: Executive summary

Both LANDSAT and NOAA satellite data were used in improving snowmelt runoff forecasts. When the satellite snow cover data were tested in both empirical seasonal runoff estimation and short term modeling approaches, a definite potential for reducing forecast error was evident. A cost benefit analysis run in conjunction with the snow mapping indicated a $36.5 million annual benefit accruing from a one percent improvement in forecast accuracy using the snow cover data for the western United States. The annual cost of employing the system would be $505,000. The snow mapping has proven that satellite snow cover data can be used to reduce snowmelt runoff forecast error in a cost effective manner once all operational satellite data are available within 72 hours after acquisition. Executive summaries of the individual snow mapping projects are presented.

Rango, A.↗
NASA NTRS1992

An atmospheric energy analysis of the impact of satellite lidar winds and TIROS temperatures in global simulations

A study of the effects on forecast accuracy of adding wind-profiler data is conducted. An observing system simulation test is employed that assumes a sufficient concentration of aerosols to provide global wind profiles (a best case scenario). The simulated data for the series of five day forecasts are produced from a twenty day integration utilizing the ECMWF model, which is also employed to produce the verification forecast for the five day period.

Keller, Linda M.↗
NASA NTRS1989

Sensitivity of mesoscale-model forecast skill to some initial-data characteristics, data density, data position, analysis procedure and measurement error

The effects of horizontal and vertical data resolution, data density, data location, different objective analysis algorithms, and measurement error on mesoscale-forecast accuracy are studied with observing-system simulation experiments. Domain-averaged errors are shown to generally decrease with time. It is found that the vertical distribution of error growth depends on the initial vertical distribution of the error itself. Larger gravity-inertia wave noise is produced in forecasts with coarser vertical data resolution. The use of a low vertical resolution observing system with three data levels leads to more forecast errors than moderate and high vertical resolution observing systems with 8 and 14 data levels. Also, with poor vertical resolution in soundings, the initial and forecast errors are not affected by the horizontal data resolution.

Warner, Thomas T.↗
NASA NTRS1995

Lidar-measured winds from space: A key component for weather and climate prediction

The deployment of a space-based Doppler lidar would provide information that is fundamental to advancing the understanding and prediction of weather and climate. This paper reviews the concepts of wind measurement by Doppler lidar, highlights the results of some observing system simulation experiments with lidar winds, and discusses the important advances in earth system science anticipated with lidar winds. Observing system simulation experiments, conducted using two different general circulation models, have shown (1) that there is a significant improvement in the forecast accuracy over the Southern Hemisphere and tropical oceans resulting from the assimilation of simulated satellite wind data, and (2) that wind data are significantly more effective than temperature or moisture data in controlling analysis error. Because accurate wind observations are currently almost entirely unavailable for the vast majority of tropical cyclones worldwide, lidar winds have the potential to substan- tially improve tropical cyclone forecasts. Similarly, to improve water vapor flux divergence calculations, a direct measure of the ageostrophic wind is needed since the present level of uncer- tainty cannot be reduced with better temperature and moisture soundings alone.

Baker, Wayman E.↗
DOE OSTI2022

Addressing delayed case reporting in infectious disease forecast modeling

Infectious disease forecasting is of great interest to the public health community and policymakers, since forecasts can provide insight into disease dynamics in the near future and inform interventions. Due to delays in case reporting, however, forecasting models may often underestimate the current and future disease burden. In this paper, we propose a general framework for addressing reporting delay in disease forecasting efforts with the goal of improving forecasts. We propose strategies for leveraging either historical data on case reporting or external internet-based data to estimate the amount of reporting error. We then describe several approaches for adapting general forecasting pipelines to account for under- or over-reporting of cases. We apply these methods to address reporting delay in data on dengue fever cases in Puerto Rico from 1990 to 2009 and to reports of influenza-like illness (ILI) in the United States between 2010 and 2019. Through a simulation study, we compare method performance and evaluate robustness to assumption violations. Our results show that forecasting accuracy and prediction coverage almost always increase when correction methods are implemented to address reporting delay. Some of these methods required knowledge about the reporting error or high quality external data, which may not always be available. Provided alternatives include excluding recently-reported data and performing sensitivity analysis. This work provides intuition and guidance for handling delay in disease case reporting and may serve as a useful resource to inform practical infectious disease forecasting efforts.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Local-thermal-gradient and large-scale-circulation impacts on turbine-height wind speed forecasting over the Columbia River Basin

Abstract. We investigate the sensitivity of turbine-height wind speed forecast to initial condition (IC) uncertainties over the Columbia River Gorge (CRG) and Columbia River Basin (CRB) for two typical weather phenomena, i.e., local-thermal-gradient-induced marine air intrusion and a cold frontal passage. Four types of turbine-height wind forecast anomalies and their associated IC uncertainties related to local thermal gradients and large-scale circulations are identified using the self-organizing map (SOM) technique. The four SOM types are categorized into two patterns, each accounting for half of the ensemble members. The first pattern corresponds to IC uncertainties that alter the wind forecast through a modulating weather system, which produces the strongest wind anomalies in the CRG and CRB. In the second pattern, the moderate uncertainties in local thermal gradient and large-scale circulation jointly contribute to wind forecast anomaly. We analyze the cross section of wind and temperature anomalies through the gorge to explore the evolution of vertical features of each SOM type. The turbine-height wind anomalies induced by large-scale IC uncertainties are more concentrated near the front. In contrast, turbine-height wind anomalies induced by the local IC thermal uncertainties are found above the surface thermal anomalies. Moreover, the wind forecast accuracy in the CRG and CRB is limited by IC uncertainties in a few specific regions, e.g., the 2 m temperature within the basin and large-scale circulation over the northeast Pacific around 140∘ W.

17 WIND ENERGY↗
DOE OSTI2021

Strategies for microgrid operation under real-world conditions

Microgrids are an increasingly relevant technology for integrating renewable energy sources into electricity systems. Based on a microgrid implementation in California, in this study we investigate microgrid operation under real-world conditions. These conditions have not yet been considered in combination and encompass energy charges, demand charges, export limits, as well as uncertainty about future electricity demand and generation in the microgrid. Under these conditions, we evaluate the performance of two frequently applied groups of strategies for microgrid operation. The first group is composed of proactive strategies that optimize decisions based on forecasts of future electricity generation and demand. The second group includes reactive strategies that make operational decisions based exclusively on the current state of the microgrid. We evaluate the performance of the strategies under varying operational parameters, forecast accuracies, and microgrid configurations—well beyond our Californian showcase. Our results confirm the expectation that proactive strategies outperform reactive ones in the majority of settings. Yet, reactive strategies can perform better under short control intervals or under moderate prediction errors of PV generation or demand. Furthermore, the interplay between real-world conditions and operational strategies reveals several additional insights for research on microgrid operation. First, we find that demand charges and export limits decisively affect microgrid performance. Second, the impact of forecast errors is highly non-linear and non-monotonous. Third, escalating negative interactions between forecast errors and demand charges make proactive strategies benefit from longer control intervals. This result is contrary to existing best practice, which promotes short control intervals to minimize the impact of uncertainty.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Enhancing Multi-Step Reservoir Inflow Forecasting: A Time-Variant Encoder–Decoder Approach

Accurate reservoir inflow forecasting is vital for effective water resource management. Reliable forecasts enable operators to optimize storage and release strategies to meet competing sectoral demands—such as water supply, irrigation, and hydropower scheduling—while also mitigating flood and drought risks. To address this need, in this study, we propose a novel time-variant encoder–decoder (ED) model designed specifically to improve multi-step reservoir inflow forecasting, enabling accurate predictions of reservoir inflows up to seven days ahead. Unlike conventional ED-LSTM and recursive ED-LSTM models, which use fixed encoder parameters or recursively propagate predictions, our model incorporates an adaptive encoder structure that dynamically adjusts to evolving conditions at each forecast horizon. Additionally, we introduce the Expected Baseline Integrated Gradients (EB-IGs) method for variable importance analysis, enhancing interpretability of inflow by incorporating multiple baselines to capture a broader range of hydrometeorological conditions. The proposed methods are demonstrated at several diverse reservoirs across the United States. Our results show that they outperform traditional methods, particularly at longer lead times, while also offering insights into the key drivers of inflow forecasting. These advancements contribute to enhanced reservoir management through improved forecasting accuracy and practical decision-making insights under complex hydroclimatic conditions.

58 GEOSCIENCES↗
DOE OSTI2025

Effects of Atmosphere and Ocean Horizontal Model Resolution on Tropical Cyclone and Upper-Ocean Response Forecasts in Four Major Hurricanes

A coupled atmosphere–ocean model is necessary for tropical cyclone (TC) prediction to accurately characterize ocean feedback on atmospheric processes within the TC environment. Here, the ECMWF coupled global model is run at horizontal resolutions from 9 to 1.4 km in the atmosphere, as well as 25 and 8 km in the ocean, to identify how resolution impacts forecast accuracy of four observed major TCs in the Atlantic: Irma, Florence, Teddy, and Ida. Most of the resolutions used here are unprecedented for global models. GOES-16 and synthetic aperture radar (SAR) satellite images and best track data are used for atmospheric validation. Salinity and temperature observations from Air-Launched Autonomous Micro-Observer (ALAMO) floats are used to validate modeled upper-ocean response, including mixed layer deepening, sea surface cooling, and near-inertial waves in the wakes of TCs. Increasing atmospheric resolution leads to more realistic TC structure and stronger winds, significantly improving TC intensity forecasts and modestly improving track errors. Ocean resolution impacts the upper-ocean response but does not influence atmospheric forecasts for the fast-moving TCs considered here. Stronger mixing, sea surface cooling, and near-inertial oscillations are found for both higher atmosphere and ocean resolutions, provided the initial upper-ocean state is the same for the two ocean resolutions. Whether this agrees better with the ALAMO observations also depends on the realism of the initial upper-ocean state in the model, emphasizing the importance of ocean initialization for the accurate upper-ocean response. Overall, the model at all resolutions correctly predicts stronger mixing, surface cooling, and near-inertial oscillation amplitudes to the right of a TC center, as observed by ALAMO floats.

Atmosphere-ocean interaction↗
DOE OSTI2024

Tropical Interbasin Interaction as Effective Predictors of Late-Spring Precipitation Variability in the Southern Great Plains

Abstract The southern Great Plains experience fluctuating precipitation extremes that significantly impact agriculture and water management. Despite ongoing efforts to enhance forecast accuracy, the underlying causes of these climatic phenomena remain inadequately understood. This study elucidates the relative influence of the tropical Pacific and Atlantic basins on April–May–June precipitation variability in this region. Our partial ocean assimilation experiments using the Community Earth System Model unveil the prominent role of interbasin interaction, with the Pacific and Atlantic contributing approximately 70% and 30%, respectively, to these interbasin contrasts. Our statistical analyses suggest that these tropical interbasin contrasts could serve as a more reliable indicator for late-spring precipitation anomalies than El Niño–Southern Oscillation. The conclusions are reinforced by analyses of seven climate forecasting systems within the North American Multi-Model Ensemble, offering an optimistic outlook for enhancing real-time forecasting of late-spring precipitation in the southern plains. However, the current predictive skills of the interbasin contrasts across the prediction systems are hindered by the lower predictability of the tropical Atlantic Ocean, pointing to the need for future research to refine climate prediction models further. Significance Statement Agriculture and infrastructure in the southern plains face challenges from severe late-spring precipitation extremes. Traditional predictors like El Niño–Southern Oscillation (ENSO) lose effectiveness during the critical spring-to-summer transition, creating a forecasting gap. This study introduces the concept of tropical interbasin interactions, known to enhance seasonal predictability for late-spring precipitation in the southern plains. Novel climate model experiments highlight contributions from the tropical Pacific and Atlantic, offering a promising predictability that potentially surpasses the limitations of ENSO-based predictions. These outcomes hold the potential for developing operational forecasts of late-spring precipitation anomalies in the southern plains, enabling proactive risk management.

Chikamoto, Yoshimitsu↗
DOE OSTI2023

Explainable machine learning model for multi-step forecasting of reservoir inflow with uncertainty quantification

We propose an explainable machine learning (ML) model with uncertainty quantification (UQ) to improve multi-step reservoir inflow forecasting. Traditional ML methods have challenges in forecasting inflows multiple days ahead, and lack explainability and UQ. To address these limitations, we introduce an encoder–decoder long short-term memory (ED-LSTM) network for multi-step forecasting, employ the SHapley Additive exPlanation (SHAP) technique for understanding the influence of hydrometeorological factors on inflow prediction, and develop a novel UQ method for prediction trustworthiness. We apply these methods to forecast 7-day inflow in snow-dominant and rain-driven reservoirs. The results demonstrate the effectiveness of the ED-LSTM model, with high forecasting accuracy for short lead times. Our UQ method provides reliable uncertainty estimates, covering 90% of data with a 90% confidence level. The SHAP analysis reveals the importance of historical inflow and precipitation as influential factors. These findings and methods may support reservoir operators in optimizing water resources management decisions.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2018

Prediction Skill of the MJO Teleconnection Signals in the NASA GEOS Subseasonal Reforecasts

Tropical-extratropical teleconnections are considered key to advancing subseasonal prediction. The Madden Julian oscillation (MJO), characterized by large scale convective envelopes propagating along the tropical Indo-Pacific sector, is known to modulate midlatitude circulation and associated weather patterns. Although there is a general consensus on the MJO's influence on the midlatitude circulation, which is thought to be due to modulations of the North Atlantic Oscillation (NAO) and the Pacific North America (PNA) pattern, relatively less is known about the predictability of these teleconnection signals in dynamical forecast models. The composite evolution of the midlatitude circulation anomalies and associated wave train structure as the delayed response to tropical heating are reported in many studies that have examined reanalyses and long model simulations. However, it is yet to be determined whether they lend any beneficial subseasonal forecast skill, especially to weekly mean surface temperature and precipitation over North America. Investigating useful predictable signals from the MJO teleconnections is also complicated by the fact that the MJO is a moving heat source with an approximate periodicity of 30-60 days, and that the structure and amplitude of the midlatitude response can be sensitive to the longitudinal positioning of the heating anomaly as well as the propagation speed of the MJO. The objective of this study is to investigate the impact of MJO teleconnections on forecast accuracy at 2-3 week lead over North America, with an emphasis on the above-mentioned lesser known aspects of these teleconnections. To this end, we utilize a suite of subseasonal reforecasts performed with the latest NASA GEOS-5 seasonal-to-subseasonal (S2S) system. These reforecasts were performed as part of the NOAA SubX project, wherein the NASA GEOS-5 atmosphere-ocean coupled model was run at degree horizontal resolution, initialized every 5 days for the period 1999-2016. The GEOS-5 model shows skillful predictions of the MJO, with the correlation coefficient based on the real-time multivariate MJO (RMM) index staying at or above 0.5 up to forecast lead 26-36 days. The system is thus a useful tool for investigating MJO teleconnection processes.

Achuthavarier, Deepthi↗
DOE OSTI2022

Do Machine Learning Approaches Offer Skill Improvement for Short-Term Forecasting of Wind Gust Occurrence and Magnitude?

Abstract Wind gusts, and in particular intense gusts, are societally relevant but extremely challenging to forecast. This study systematically assesses the skill enhancement that can be achieved using artificial neural networks (ANNs) for forecasting of wind gust occurrence and magnitude. Geophysical predictors from the ERA5 reanalysis are used in conjunction with an autoregressive term in regression and ANN models with different predictors, and varying model complexity. Models are derived and assessed for the warm (April–September) and cold (October–March) seasons for three high passenger volume airports in the United States. Model uncertainty is assessed by deriving models for 1000 different randomly selected training (70%) and testing (30%) subsets. Gust prediction fidelity in independent test samples is critically dependent on inclusion of an autoregressive term. Gust occurrence probabilities derived using five-layer ANNs exhibit consistently higher fidelity than those from regression models and shallower ANNs. Inclusion of the autoregressive term and increasing the number of hidden layers in ANNs from 1 to 5 also improve the model performance for gust magnitudes (lower RMSE, increased correlation, and model standard deviations that more closely approximate observed values). Deeper ANNs (e.g., 20 hidden layers) exhibit higher skill in forecasting strong (17–25.7 m s −1 ) and damaging (≥25.7 m s −1 ) wind gusts. However, such deep networks exhibit evidence of overfitting and still substantially underestimate (by 50%) the frequency of strong and damaging wind gusts at the three airports considered herein. Significance Statement Improved short-term forecasting of wind gusts will enhance aviation safety and logistics and may offer other societal benefits. Here we present a rigorous investigation of the relative skill of models of wind gust occurrence and magnitude that employ different statistical methods. It is shown that artificial neural networks (ANNs) offer considerable skill enhancement over regression methods, particularly for strong and damaging wind gusts. For wind gust magnitudes in particular, application of deeper learning networks (e.g., five or more hidden layers) offers tangible improvements in forecast accuracy. However, deeper networks are vulnerable to overfitting and exhibit substantial variability with the specific training and testing data subset used. Also, even deep ANNs reproduce only half of strong and damaging wind gusts. These results indicate the need for future work to elucidate the dynamical mechanisms of intense wind gusts and advance solutions to their prediction.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2004

AIRS - the Atmospheric Infrared Sounder

The Atmospheric Infrared Sounder (AIRS) was launched in 2002, along with two companion microwave sounders. This AIRS sounding suite is the most advanced atmospheric sounding system to date, with measurement accuracies far surpassing those of current weather satellites. From its sun synchronous polar orbit, the AIRS system provides more than 90% of the globe every 24 hours. Much of the post-launch period has been devoted to optimizing the 'retrieval' system used to derive atmospheric and other parameters from the observations and to validate those parameters. The geophysical parameters have been produced since the beginning of 2003 - the first data were released to the public in mid-2003, and future improved versions will be released periodically. The ongoing calibration/validation effort has confirmed that the system is very accurate and stable. There are a number of applications for the AIRS products, ranging from numerical weather prediction - where positive impact on forecast accuracy has already been demonstrated, to atmospheric research - where the AIRS water vapor products near the surface and in the mid and upper troposphere as well as in the stratosphere promise to make it possible to characterize and model phenomena that are key for short-term atmospheric processes, from weather patterns to long-term processes, such as interannual variability and climate change.

Aqua↗
NASA NTRS2018

Examining Dense Data Usage near the Regions with Severe Storms in All-Sky Microwave Radiance Data Assimilation and Impacts on GEOS Hurricane Analyses

Many numerical weather prediction (NWP) centers assimilate radiances affected by clouds and precipitation from microwave sensors, with the expectation that these data can provide critical constraints on meteorological parameters in dynamically sensitive regions to make significant impacts on forecast accuracy for precipitation. The Global Modeling and Assimilation Office (GMAO) at NASA Goddard Space Flight Center assimilates all-sky microwave radiance data from various microwave sensors such as all-sky GPM Microwave Imager (GMI) radiance in the Goddard Earth Observing System (GEOS) atmospheric data assimilation system (ADAS), which includes the GEOS atmospheric model, the Gridpoint Statistical Interpolation (GSI) atmospheric analysis system, and the Goddard Aerosol Assimilation System (GAAS). So far, most of NWP centers apply same large data thinning distances, that are used in clear-sky radiance data to avoid correlated observation errors, to all-sky microwave radiance data. For example, NASA GMAO is applying 145 km thinning distances for most of satellite radiance data including microwave radiance data in which all-sky approach is implemented. Even with these coarse observation data usage in all-sky assimilation approach, noticeable positive impacts from all-sky microwave data on hurricane track forecasts were identified in GEOS-5 system. The motivation of this study is based on the dynamic thinning distance method developed in our all-sky framework to use of denser data in cloudy and precipitating regions due to relatively small spatial correlations of observation errors. To investigate the benefits of all-sky microwave radiance on hurricane forecasts, several hurricane cases selected between 2016-2017 are examined. The dynamic thinning distance method is utilized in our all-sky approach to understand the sources and mechanisms to explain the benefits of all-sky microwave radiance data from various microwave radiance sensors like Advanced Microwave Sounder Unit (AMSU-A), Microwave Humidity Sounder (MHS), and GMI on GEOS-5 analyses and forecasts of various hurricanes.

Kim, Min-Jeong↗
DOE OSTI2024

An iterative bidirectional gradient boosting approach for CVR baseline estimation

Here this paper presents a novel Iterative Bidirectional Gradient Boosting Model (IBi-GBM) for estimating the baseline of Conservation Voltage Reduction (CVR) programs. In contrast to many existing methods, we treat CVR baseline estimation as a missing data retrieval problem. The approach involves dividing the load and its corresponding temperature profiles into three periods: pre-CVR, CVR, and post-CVR. To restore the missing load profile during the CVR period, the method employs a three-step process. First, a forward-pass GBM is executed using data from the pre-CVR period as inputs. Subsequently, a backward-pass GBM is applied using data from the post-CVR period. The two restored load profiles are reconciled, considering pre-calculated weights derived from forecasting accuracy, and only the leftmost and rightmost points are retained. The newly restored points are then included as inputs for the subsequent iteration. This iterative procedure continues until the original load data in the CVR period is fully restored. We develop IBi-GBM using actual smart meter and Supervisory Control and Data Acquisition (SCADA) data. Our results demonstrate that IBi-GBM exhibits robust performance across various data resolutions and in different seasons and outperforms existing methods by achieving a 1-2% reduction in normalized Root Mean Square Error (nRMSE).

42 ENGINEERING↗
DOE OSTI2026

Short-term electricity load forecasting: Application-driven evaluation of machine learning models across spatial and temporal scales

As we transition towards a decarbonized economy, the integration of variable renewable energy resources and new demands (e.g., electric vehicles, heat pumps) into the electricity grid places unprecedented pressure on grid operators to effectively anticipate and manage peak load. In this context, machine learning algorithms are proving to be indispensable for accurate short-term load forecasting, a crucial task to address these challenges. This study benchmarks 6 machine learning algorithms, including three neural networks and three tree-based algorithms, across various levels of spatial aggregation and time horizons (1, 4, 8, 24, and 48 h). The central contribution of this work is the comparison and analysis of load forecasting models not only based on statistical metrics, but also based on a novel error metric, which evaluates the cost implications of forecast errors for power system stakeholders. Results show that tree-based models outperform neural networks, based on statistical metrics, and yield less skewed error distributions for most spatial scales. However, through the lens of the novel error metric, neural networks are the more competitive choice, especially for forecast horizons that exceed 8 h. The study concludes with actionable recommendations to grid operators and highlights the need for the development of error metrics that link forecasting accuracy to operational costs. To promote transparency and open science, the datasets and Python code are open-sourced via a supplementary repository.

Houben, Nikolaus↗