Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

The use of snowcovered area in runoff forecasts

Long-term snowcovered area data from aircraft and satellite observations have proven useful in reducing seasonal runoff forecast error on the Kern river watershed. Similar use of snowcovered area on the Kings river watershed produced results that were about equivalent to methods based solely on conventional data. Snowcovered area will be most effective in reducing forecast procedural error on watersheds with: (1) a substantial amount of area within a limited elevation range; (2) an erratic precipitation and/or snowpack accumulation pattern not strongly related to elevation; and (3) poor coverage by precipitation stations or snow courses restricting adequate indexing of water supply conditions. When satellite data acquisition and delivery problems are resolved, the derived snowcover information should provide a means for enhancing operational streamflow forecasts for areas that depend primarily on snowmelt for their water supply.

Rango, A.↗

A Kalman filter for a two-dimensional shallow-water model

A two-dimensional Kalman filter is described for data assimilation for making weather forecasts. The filter is regarded as superior to the optimal interpolation method because the filter determines the forecast error covariance matrix exactly instead of using an approximation. A generalized time step is defined which includes expressions for one time step of the forecast model, the error covariance matrix, the gain matrix, and the evolution of the covariance matrix. Subsequent time steps are achieved by quantifying the forecast variables or employing a linear extrapolation from a current variable set, assuming the forecast dynamics are linear. Calculations for the evolution of the error covariance matrix are banded, i.e., are performed only with the elements significantly different from zero. Experimental results are provided from an application of the filter to a shallow-water simulation covering a 6000 x 6000 km grid.

Parrish, D. F.↗

Convective Weather Forecast Accuracy Analysis at Center and Sector Levels

This paper presents a detailed convective forecast accuracy analysis at center and sector levels. The study is aimed to provide more meaningful forecast verification measures to aviation community, as well as to obtain useful information leading to the improvements in the weather translation capacity models. In general, the vast majority of forecast verification efforts over past decades have been on the calculation of traditional standard verification measure scores over forecast and observation data analyses onto grids. These verification measures based on the binary classification have been applied in quality assurance of weather forecast products at the national level for many years. Our research focuses on the forecast at the center and sector levels. We calculate the standard forecast verification measure scores for en-route air traffic centers and sectors first, followed by conducting the forecast validation analysis and related verification measures for weather intensities and locations at centers and sectors levels. An approach to improve the prediction of sector weather coverage by multiple sector forecasts is then developed. The weather severe intensity assessment was carried out by using the correlations between forecast and actual weather observation airspace coverage. The weather forecast accuracy on horizontal location was assessed by examining the forecast errors. The improvement in prediction of weather coverage was determined by the correlation between actual sector weather coverage and prediction. observed and forecasted Convective Weather Avoidance Model (CWAM) data collected from June to September in 2007. CWAM zero-minute forecast data with aircraft avoidance probability of 60% and 80% are used as the actual weather observation. All forecast measurements are based on 30-minute, 60- minute, 90-minute, and 120-minute forecasts with the same avoidance probabilities. The forecast accuracy analysis for times under one-hour showed that the errors in intensity and location for center forecast are relatively low. For example, 1-hour forecast intensity and horizontal location errors for ZDC center were about 0.12 and 0.13. However, the correlation between sector 1-hour forecast and actual weather coverage was weak, for sector ZDC32, about 32% of the total variation of observation weather intensity was unexplained by forecast; the sector horizontal location error was about 0.10. The paper also introduces an approach to estimate the sector three-dimensional actual weather coverage by using multiple sector forecasts, which turned out to produce better predictions. Using Multiple Linear Regression (MLR) model for this approach, the correlations between actual observation and the multiple sector forecast model prediction improved by several percents at 95% confidence level in comparison with single sector forecast.

Wang, Yao↗

HAIMOS Ensemble Forecasts for Intra-day and Day- Ahead GHI, DNI and Ramps

The objective of this research is to develop a hybrid physics-based/data-driven forecast model to improve direct normal and global horizontal irradiance (DNI and GHI) prediction for horizons ranging from 1 to 72 hours. Project objectives also address key gaps in state-of-the-art solar forecasting: accurate probabilistic solar forecasts and the forecasting of large irradiance ramps (ramp onset and magnitude). The proposed model ensembles Numerical Weather Prediction (NWP) forecasts, determinist physics-based algorithms, and new-generation cloud cover products (high-resolution rapid refresh satellite images and Large Eddy Simulations). The result is the Hybrid Adaptive Input Model Objective Selection (HAIMOS) ensemble model. HAIMOS blends state of the art machine learning methodologies with physics-based models for cloud cover and cloud optical depth forecasts. The technical activities followed a two-pronged strategy. First, the preprocessing of data, the selection of inputs to the nonlinear approximators, the type of approximator and objective functions, and post-processing ensembling techniques included in HAIMOS were all optimized adaptively to find the best model for a specific goal (reduce DNI/GHI forecast error, improve the prediction of ramp onset, etc.). Second, a large effort was put in improving cloud identification and the forecast of cloud cover and cloud optical depth. To this end, new-generation cloud parametrization products were developed in this work. These include improved algorithms to assist in cloud identification, cloud classification and cloud parametrization from satellite images – three key factors in the accuracy of 1 to 6-hours irradiance forecasts and prediction of ramp onset. Furthermore, we also included cloud information extracted from high resolution rapid refresh satellite images (GOES-16) and Large Eddy Simulations (LES). LES was used to model the atmosphere in detail over locations of interest and produce cloud optical depth forecasts. Once these data streams were validated, they were used as input data to the HAIMOS forecast. The model was developed using data from several climatologically distinct locations with potential for high solar penetration. In the last year of the project, we conducted a validation campaign according to the guidelines stipulated by the Topic Area 1 project as described in the FOA. This effort brings, for the first time, proven machine-learning methodologies for generating state-of-the-art solar forecasts interweaved with detailed physics-based models for cloud detection, and cloud optical depth forecasts. HAIMOS will generate accurate irradiance probabilistic forecast to assist in reducing solar generation prediction error. Globally optimized solar forecast models are more likely to impact solar energy stakeholders. The goal of this project was to increase the state-of-the-art forecast skill from their present values of 10 to 35%. At the end of the project, we achieved between 30% and 50% forecast skill across a wide range of horizons for both GHI and DNI.

14 SOLAR ENERGY↗

Quantitative satellite applications - Tropical cyclone intensity monitoring and track forecasting

An assessment is made of the effectiveness of VISSR Atmospheric Sounder (VAS) data gathered over the North Atlantic Ocean area in the 1982 and 1983 hurricane seasons. By the end of the 1983 season, progress had been made in providing high quality analyses and displays of mass, motion and moisture patterns for evaluation. A comparison of mean forecast errors for several different operational models, official forecasts, and the VAS Trajectory model for selected cases in which VAS deep layer mean wind data were available show VAS accuracies that are comparable with those of the official forecasts.

Velden, C. S.↗

Systematic Errors in Simulated L-Band Brightness Temperature in the SMAP Level-4 Soil Moisture Analysis

The NASA Soil Moisture Active Passive (SMAP) mission has been providing L-band (1.4 GHz) brightness temperature (Tb) observations since April 2015. By assimilating the Tb observations into the NASA Catchment land surface model using a spatially distributed ensemble Kalman filter (EnKF), the SMAP Level-4 Soil Moisture (L4_SM) product provides global, 3-hourly, 9-km resolution estimates of surface (0-5 cm) and root-zone (0-100 cm) soil moisture with ~2.5-day latency for use in research and applications. The EnKF-based L4_SM analysis assumes unbiased forecast errors. Consequently, the seasonally varying bias between the model forecast Tb and the observed values is removed prior to the assimilation of the SMAP Tb observations. The L4_SM system is thus designed to only correct errors in synoptic-scale and interannual variations from the long-term mean seasonal cycle while maintaining the model’s (possibly wrong) climatology. In this paper, we examine the Tb observation-minus-forecast (O-F) residuals from the L4_SM Version 7 product (computed after rescaling the Tb observations to the mean seasonal cycle of the simulated Tb). The long-term average of the Tb O-F residuals has a global mean of only 0.13 K and locally small values, ranging from -1 to 3 K. The model forecast Tb, however, still exhibits undesirable systematic errors relative to the (rescaled) Tb observations. At some locations, the time-average Tb O-F values strongly depend on surface soil moisture (SM). At the Yanco SMAP core validation site, for example, the Tb O-F residuals typically range from 5 to 15 K under dry soil moisture conditions (SM < 0.15 m3 m-3) yet are predominantly negative under wet soil moisture conditions (SM > 0.25 m3 m-3), with values ranging from 0 to -40 K. This results in soil moisture analysis increments that persistently make the soil drier under dry SM conditions and persistently make the soil wetter under wet SM conditions, suggesting an error in the dynamic range of the simulated Tb, soil moisture or soil temperature. In this paper, we describe the higher-order systematic Tb forecast errors in more detail, examine their impact on the L4_SM product quality, and explore potential avenues to improve the L4_SM algorithm.

Rolf Reichle↗

Systematic estimation of forecast and observation error covariances in four-dimensional data assimilation

A two-part algorithm is presented for reliably computing weather forecast model and observational error covariances during data assimilation. Data errors arise from instrumental inaccuracies and sub-grid scale variability, whereas forecast errors occur because of modeling errors and the propagation of previous analysis errors. A Kalman filter is defined as the primary algorithm for estimating the forecast and analysis error convariance matrices. A second algorithm is described for quantifying the noise covariance matrices of any degree to obtain accurate values for the observational error covariances. Numerical results are provided from a linearized one-dimensional shallow-water model. The results cover observational noise covariances, initial instrumental errors and erroneous model values.

Dee, D. P.↗

Balancing Authority Cooperation Concepts to Reduce Variable Generation Integration Costs in the Western Interconnection: Consolidating Balancing Authorities and Sharing Balancing Reserves

The study described in this chapter demonstrates the benefits of BA consolidation with the help of a detailed WECC system model and advanced methodology, which is also described in this chapter. The study aims to determine the potential savings in production cost and reduction in balancing reserve requirements in the WECC system. The study has found that effective use of the diversity in load and variable generation over a wide area can indeed help to achieve significant savings. The implementation cost for the consolidation was beyond the scope of this study. The analysis was performed for two different scenarios of VG penetration: 11% (8% wind and 3% solar) and 33% (24% wind and 9% solar) of WECC projected energy demand in 2020. In analysis of balancing reserves, the objective was to determine the reduction in balancing reserve requirements due to BA consolidation, in terms of required capacity and ramp-rates. Hour-ahead and 10-minute ahead forecast errors for load, wind, and solar were simulated. In addition, 1-minute resolution load, wind and solar data were used to derive balancing reserve requirements i.e. load-following and regulation requirements for each individual BA and for the consolidated BA (CBA). The reduction in balancing reserves was determined by calculating the difference between total reserve requirements that need to be carried by different BAs if they operate individually, and reserve requirements that need to be carried by the CBA. The study results show that the consolidated WECC system would have about a 50% overall reduction in balancing reserves for the 11% penetration scenario and a 65% reduction for the 33% penetration scenario in comparison with total reserve requirements that need to be carried by different BAs if they operate individually.

balancing authorities consolidation↗

A Systematic Approach to Isolating the Causes and Impacts of Climate Model Bias Employing Analysis Increments

One of the most promising approaches to isolating the causes and understanding the impacts of climate model formulation errors is through the utilization of information contained in short-term forecast errors. The underlying assumption being that by capturing the errors at the very early stages of growth (before nonlinearities develop), we should be able to associate those errors with specific deficiencies in the model's formulation of the relevant physical processes. Here, we provide an example of utilizing the long-term mean of the 6-hourly analysis increments (first guess forecast minus analysis) produced by MERRA-2 to correct the NASA/GEOS AGCM over well-defined regions, thereby allowing us to quantify how the reduced tendency errors in these regions manifest themselves both locally and remotely through large-scale teleconnections to reduce the model's climatological biases. We extend previous work (focused on boreal summer) to address the full annual cycle of model bias. A key result is the large seasonality of the errors over the Tibet region and their impacts on the Northern Hemisphere jet biases, and related precipitation and temperature biases over North American. Attempts to correct the phase and amplitude errors of the climatological boreal winter ridge over western North America (a likely key requirement for improving winter climate forecasts over North America) reveal a surprising complexity in the sources of the errors in what is otherwise manifest as a rather simple PNA-like bias structure.

Schubert, S.↗

Applications systems verification and transfer project. Volume 4: Operational applications of satellite snow cover observations. Colorado Field Test Center

The study was conducted on six watersheds ranging in size from 277 km to 3460 km in the Rio Grande and Arkansas River basins of southwestern Colorado. Six years of satellite data in the period 1973-78 were analyzed and snowcover maps prepared for all available image dates. Seven snowmapping techniques were explored; the photointerpretative method was selected as the most accurate. Three schemes to forecast snowmelt runoff employing satellite snowcover observations were investigated. They included a conceptual hydrologic model, a statistical model, and a graphical method. A reduction of 10% in the current average forecast error is estimated when snowcover data in snowmelt runoff forecasting is shown to be extremely promising. Inability to obtain repetitive coverage due to the 18 day cycle of LANDSAT, the occurrence of cloud cover and slow image delivery are obstacles to the immediate implementation of satellite derived snowcover in operational streamflow forecasting programs.

Shafer, B. A.↗

A stochastic-dynamic model for global atmospheric mass-field statistics

Global atmospheric mass field error correlations based on satellite observations and on numerical forecasts show strong and systematic latitude dependence. A model for the latitude dependent spatial correlation structure of mass field forecast errors is derived from dynamical considerations. Three methods of solution were tested. In the first method, the equation was solved by expansion in spherical harmonics, and the correlation function was computed analytically using the expansion coefficients. In the second method, the finite difference equivalent of the equation was solved using a fast poisson solver. The correlation function was computed using stratified sampling of the individual realizations. In the third method, a higher order equation was derived, and solved directly in finite differences by two successive applications of the fast poisson solver. The three methods were compared for accuracy and efficiency, and the third method was chosen as clearly superior.

Ghil, M.↗

Assimilation of MODIS Dark Target and Deep Blue Observations in the Dust Aerosol Component of NMMB-MONARCH version 1.0

A data assimilation capability has been built for the NMMB-MONARCH chemical weather prediction system, with a focus on mineral dust, a prominent type of aerosol. An ensemble-based Kalman filter technique (namely the local ensemble transform Kalman filter - LETKF) has been utilized to optimally combine model background and satellite retrievals. Our implementation of the ensemble is based on known uncertainties in the physical parametrizations of the dust emission scheme. Experiments showed that MODIS AOD retrievals using the Dark Target algorithm can help NMMB-MONARCH to better characterize atmospheric dust. This is particularly true for the analysis of the dust outflow in the Sahel region and over the African Atlantic coast. The assimilation of MODIS AOD retrievals based on the Deep Blue algorithm has a further positive impact in the analysis downwind from the strongest dust sources of the Sahara and in the Arabian Peninsula. An analysis-initialized forecast performs better (lower forecast error and higher correlation with observations) than a standard forecast, with the exception of underestimating dust in the long-range Atlantic transport and degradation of the temporal evolution of dust in some regions after day 1. Particularly relevant is the improved forecast over the Sahara throughout the forecast range thanks to the assimilation of Deep Blue retrievals over areas not easily covered by other observational datasets.The present study on mineral dust is a first step towards data assimilation with a complete aerosol prediction system that includes multiple aerosol species.

atmospheric dust↗

Required Time of Arrival as a Control Mechanism to Mitigate Uncertainty in Arrival Traffic Demand Management

The objective of this study is to explore the use of Required Time of Arrival (RTA) capability on the flight deck as a control mechanism on arrival traffic management to improve traffic delivery accuracy by mitigating the effect of traffic demand uncertainty. The uncertainties are caused by various factors, such as departure error due to the difference between scheduled departure and the actual take-off time. A simulation study was conducted using the Multi Aircraft Control System (MACS) software, a comprehensive research platform developed in the Airspace Operations Laboratory (AOL) at NASA Ames Research Center. The Crossing Time (CT) performance (i.e. the difference between target crossing time and actual crossing time) of the RTA for uncertainty mitigation during cruise phase was evaluated under the influence of varying two main factors: wind severity (heavy wind vs. mild wind), and wind error (1 hour, 2 hours, and 5 hours wind forecast errors). To examine the CT performance improvement made by the RTA, the comparison to the CT of the aircraft that were not assigned with RTA (Non-RTA) under the influence of the selected factors was also made. The Newark Liberty International Airport (EWR) was chosen for this study. A total 66 inbound traffic to the EWR (34 of them were airborne when the simulation was initiated, 32 were pre-departures at that time) was simulated, where the pre-scripted departure error was assigned to each pre-departure (61 conform to their Expected Departure Clearance Time, which is +-300 seconds of their scheduled departure time). The results of the study show that the delivery accuracy improvement can be achieved by assigning RTA, regardless of the influence of the selected two factors (the wind severity and the wind information inaccuracy). Across all wind variances, 66.9 (265 out of 396) of the CT performance of the RTA assigned aircraft was within +- 60 seconds (i.e. target tolerance range) and 88.9 (352 out of 396) aircraft met +-300 seconds marginal tolerance range, while only 33.6 (133 out of 396) of the Non-RTA assigned aircrafts CT performance achieved the target tolerance range and 75.5 (299 out of 396) stayed within the marginal. Examination of the impact of different error sources i.e. departure error, wind severity, and wind error suggest that although large departure errors can significantly impact the CT performance, the impacts of wind severity and errors were modest relative the targeted +- 60 second conformance range.

required time of arrival (RTA)↗

T2M Forecasts at Subseasonal Leads: Do Different Soil Moisture Initial States Have Different Impacts?

Soil moisture (W) helps control evapotranspiration (ET), and ET variations can in turn have a distinct impact on 2-m air temperature (T2M), given that increases in evaporative cooling encourage reduced temperatures. Soil moisture is accordingly linked to T2M, and realistic soil moisture initialization has, in previous studies, been shown to improve the skill of subseasonal T2M forecasts. The relationship between soil moisture and evapotranspiration, however, is distinctly nonlinear, with ET tending to increase with soil moisture in drier conditions and to be insensitive to soil moisture variations in wetter conditions. Here, through an extensive analysis of subseasonal forecasts produced with a state-of-the-art seasonal forecast system, this nonlinearity is shown to imprint itself on T2M forecast error in the conterminous United States in two unique ways: (i) the T2M forecast bias (relative to independent observations) induced by a negative precipitation bias tends to be larger for dry initializations, and (ii) on average, the unbiased root-mean-square error (ubRMSE) tends to be larger for dry initializations. Such findings can aid in the identification of forecasts of opportunity; taken a step further, they suggest a pathway for improving bias correction and uncertainty estimation in subseasonal T2M forecasts by conditioning each on initial soil moisture state.

2-meter Temperature↗

Deep Learning Experiments for Tropical Cyclone Intensity Forecasts

Reducing tropical cyclone (TC) intensity forecast errors is a challenging task that has interested the operational forecasting and research community for decades. To address this, we developed a deep learning (DL)-based multilayer perceptron (MLP) TC intensity prediction model. The model was trained using the global Statistical Hurricane Intensity Prediction Scheme (SHIPS) predictors to forecast the change in TC maximum wind speed for the Atlantic basin. In the first experiment, a 24-h forecast period was considered. To overcome sample size limitations, we adopted a leave one year out (LOYO) testing scheme, where a model is trained using data from all years except one and then evaluated on the year that is left out. When tested on 2010–18 operational data using the LOYO scheme, the MLP outperformed other statistical–dynamical models by 9%–20%. Additional independent tests in 2019 and 2020 were conducted to simulate real-time operational forecasts, where the MLP model again outperformed the statistical–dynamical models by 5%–22% and achieved comparable results as HWFI. The MLP model also correctly predicted more rapid intensification events than all the four operational TC intensity models compared. In the second experiment, we developed a lightweight MLP for 6-h intensity predictions. When coupled with a synthetic TC track model, the lightweight MLP generated realistic TC intensity distribution in the Atlantic basin. Therefore, the MLP-based approach has the potential to improve operational TC intensity forecasts, and will also be a viable option for generating synthetic TCs for climate studies.

58 GEOSCIENCES↗

Using OSSEs to Evaluate the Impacts of Geostationary Infrared Sounders

An observing system simulation experiment (OSSE) was performed to assess the impact of assimilating hyperspectral infrared (IR) radiances from geostationary orbit on numerical weather prediction, with a focus on the proposed sounder on board the Geostationary Extended Observations (GeoXO) program’s central satellite. Infrared sounders on a geostationary platform would fill several gaps left by IR sounders on polar-orbiting satellites, and the increased temporal resolution would allow the observation of weather phenomena evolution. The framework for this OSSE was the Global Modeling and Assimilation Office (GMAO) OSSE system, which includes a full suite of meteorological observations. The experiment additionally assimilated four identical IR sounders from geostationary orbit to create a “ring” of vertical profiling observations. Based on the experimentation, assimilation of the IR sounders provided a beneficial impact on the analyzed mass and wind fields, particularly in the tropics, and produced an error reduction in the initial 24–48 h of the subsequent forecasts. Specific attention was paid to the impact of the GeoXO Sounder (GXS) over the contiguous United States (CONUS) as this is a region that is well-observed and as such difficult to improve. The forecast sensitivity to observation impact (FSOI) metric, computed across all four synoptic times over the CONUS, reveals that the GXS had the largest impact on the 24-h forecast error of the assimilated hyperspectral infrared satellite radiances as measured using a moist energy error norm. Based on this analysis, the proposed GXS has the potential to improve numerical weather prediction globally and over the CONUS.

OSSE↗

Feedforward-feedback ammonia control at a water resource recovery facility based on a digital twin with hybrid model

Ammonia-based aeration control (ABAC) at full-scale Water Resource Recovery Facilities (WRRFs) can be challenged by diurnal loading and transport delays. This work addressed these challenges using a hybrid feedforward–feedback controller built on Activated Sludge Model 1 (ASM1), marking the first full-scale deployment to pair a mechanistic feedforward core with data-driven corrections. The objectives were to improve ammonia setpoint tracking, assess performance of the mechanistic model when enhanced with data-driven corrections, and document full-scale operation. The hybrid model incorporates two data-driven components: (1) a Mechanistic Error Forecasting Engine (MEFE), consisting of a multivariate linear regressor and a long short-term memory (LSTM) ensemble. Defying expectations, low-parameter models outperformed more complex alternatives, reducing the mechanistic error by 71%. (2) A Residual Oscillation Forecasting Engine (ROFE), based on Fast Fourier Transform, reduced the remaining error by another 35%. Two proportional–integral (PI) feedback loops further (i) trim the feedforward output and (ii) eliminate residual controller error in the final aerobic zone. In full-scale operation, the controller reduced mean-squared error (MSE) by 94% over the baseline and produced more stable dissolved oxygen (DO) setpoints. Overall, it was proven that layering multi-timescale data-driven models on a mechanistic core can yield reliable ABAC performance at WRRFs.

54 ENVIRONMENTAL SCIENCES↗

On the potential use of satellite sounder data in forecasting tropical cyclone motion

Although many prediction schemes are available, tropical cyclone track forecast errors are still unacceptably large. A primary difficulty is that tropical cyclones and their environments are poorly observed by conventional data networks. Satellite sounders, however, routinely provide numerous observations near these storms. Mean layer temperatures from the Scanning Microwave Spectrometer (SCAMS) on board the Nimbus-6 satellite are decomposed using empirical orthogonal functions, and the expansion coefficients are related to deviations from persistence track forecasts. Based on multiple correlation coefficients it appears that upper-level (250-100 mb) temperatures contain significant information about the right-angle error of the persistence forecast location. Temperatures from the 1000-500 mb layer seemed to contain little forecast information. Implications of these results for further work are offered.

Kidder, S. Q.↗