Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

A Comparison of Forecast Error Generators for Modeling Wind and Load Uncertainty

This paper presents four algorithms to generate random forecast error time series, including a truncated-normal distribution model, a state-space based Markov model, a seasonal autoregressive moving average (ARMA) model, and a stochastic-optimization based model. The error time series are used to create real-time (RT), hour-ahead (HA), and day-ahead (DA) wind and load forecast time series that statistically match historically observed forecasting data sets, used for variable generation integration studies. A comparison is made using historical DA load forecast and actual load values to generate new sets of DA forecasts with similar stoical forecast error characteristics. This paper discusses and compares the capabilities of each algorithm to preserve the characteristics of the historical forecast data sets.

Lu, Ning↗

Generating short-term probabilistic wind power scenarios via nonparametric forecast error density estimators: Generating short-term probabilistic wind power scenarios via nonparametric forecast error density estimators

Forecasts of available wind power are critical in key electric power systems operations planning problems, including economic dispatch and unit commitment. Such forecasts are necessarily uncertain, limiting the reliability and cost effectiveness of operations planning models based on a single deterministic or “point” forecast. A common approach to address this limitation involves the use of a number of probabilistic scenarios, each specifying a possible trajectory of wind power production, with associated probability. We present and analyze a novel method for generating probabilistic wind power scenarios, leveraging available historical information in the form of forecasted and corresponding observed wind power time series. We estimate non-parametric forecast error densities, specifically using epi-spline basis functions, allowing us to capture the skewed and non-parametric nature of error densities observed in real-world data. We then describe a method to generate probabilistic scenarios from these basis functions that allows users to control for the degree to which extreme errors are captured.We compare the performance of our approach to the current state-of-the-art considering publicly available data associated with the Bonneville Power Administration, analyzing aggregate production of a number of wind farms over a large geographic region. Finally, we discuss the advantages of our approach in the context of specific power systems operations planning problems: stochastic unit commitment and economic dispatch. Here, our methodology is embodied in the joint Sandia – University of California Davis Prescient software package for assessing and analyzing stochastic operations strategies.

17 WIND ENERGY↗

Wind and Load Forecast Error Model for Multiple Geographically Distributed Forecasts

The impact of wind and load forecast errors on power grid operations is frequently evaluated by conducting multi-variant studies, where these errors are simulated repeatedly as random processes based on their known statistical characteristics. To generate these errors correctly, we need to reflect their distributions (which do not necessarily follow a known distribution law), standard deviations, auto- and cross-correlations. For instance, load and wind forecast errors can be closely correlated in different zones of the system. This paper introduces a new methodology for generating multiple cross-correlated random processes to simulate forecast error curves based on a transition probability matrix computed from an empirical error distribution function. The matrix will be used to generate new error time series with statistical features similar to observed errors. We present the derivation of the method and present some experimental results by generating new error forecasts together with their statistics.

17 WIND ENERGY↗

Exploring the Relationship Between Temperature Forecast Errors and Earth System Variables

Accurate subseasonal weather forecasts, from two weeks up to a season, can help reduce costs and impacts related to weather and corresponding extremes. The quality of weather forecasts has improved considerably in recent decades as models represent more details of physical processes, and they benefit from assimilating comprehensive Earth observation data as well as increasing computing power. However, with ever–growing model complexity, it becomes increasingly difficult to pinpoint weaknesses in the forecast models’ process representations which is key to improving forecast accuracy. In this study, we use a comprehensive set of observation–based ecological, hydrological and meteorological variables to study their potential for explaining temperature forecast errors at the weekly time scale. For this purpose, we compute Spearman correlations between each considered variable and the forecast error obtained from the ECMWF subseasonal–to–seasonal (S2S) reforecasts at lead times of 1–6 weeks. This is done across the globe for the time period 2001–2017. The results show that temperature forecast errors globally are most strongly related with climate–related variables such as surface solar radiation and precipitation, which highlights the model’s difficulties in accurately capturing the evolution of the climate–related variables during the forecasting period. At the same time, we find particular regions in which other variables are more strongly related to forecast errors. For instance, in central Europe, eastern North America and southeastern Asia, vegetation greenness and soil moisture are relevant, while in western South America and central North America, circulation–related variables such as surface pressure relate more strongly with forecast errors. Overall, the identified relationships between forecast errors and independent Earth observations reveal promising variables on which future forecasting system development could focus by specifically considering related process representations and data assimilation.

Temperature↗

Distribution of Wind Power Forecast Errors from Operational Systems

Wind power forecasting is one important tool in the integration of large amounts of renewable generation into the electricity system. Wind power forecasts from operational systems are not perfect, and thus, an understanding of the forecast error distributions can be important in system operations. In this work, we examine the errors from operational wind power forecasting systems, both for asingle wind plant and for an entire interconnection. The resulting error distributions are compared with the normal distribution and the distribution obtained from the persistence forecasting model at multiple timescales. A model distribution is fit to the operational system forecast errors and the potential impact on system operations highlighted through the generation of forecast confidenceintervals.

17 WIND ENERGY↗

Spectral Analysis of Forecast Error Investigated with an Observing System Simulation Experiment

The spectra of analysis and forecast error are examined using the observing system simulation experiment (OSSE) framework developed at the National Aeronautics and Space Administration Global Modeling and Assimilation Office (NASAGMAO). A global numerical weather prediction model, the Global Earth Observing System version 5 (GEOS-5) with Gridpoint Statistical Interpolation (GSI) data assimilation, is cycled for two months with once-daily forecasts to 336 hours to generate a control case. Verification of forecast errors using the Nature Run as truth is compared with verification of forecast errors using self-analysis; significant underestimation of forecast errors is seen using self-analysis verification for up to 48 hours. Likewise, self analysis verification significantly overestimates the error growth rates of the early forecast, as well as mischaracterizing the spatial scales at which the strongest growth occurs. The Nature Run-verified error variances exhibit a complicated progression of growth, particularly for low wave number errors. In a second experiment, cycling of the model and data assimilation over the same period is repeated, but using synthetic observations with different explicitly added observation errors having the same error variances as the control experiment, thus creating a different realization of the control. The forecast errors of the two experiments become more correlated during the early forecast period, with correlations increasing for up to 72 hours before beginning to decrease.

OSSE↗

Solar and Wind Forecast Error Reserve Sharing in a Multi-Utility Region

As electricity systems transition to higher levels of solar and wind generation, electric system operators will likely need to hold additional reserves to manage solar and wind forecast error. Because solar and wind forecast errors tend to be weakly correlated across space, system operators can reduce their reserve requirements by sharing reserves. This paper examines the benefits of forecast error reserve sharing among balancing areas in the Southeastern United States, in scenarios in which solar and wind generation ranges from 34% to 65% of total generation. It finds that day-ahead forecast error reserve requirements increase linearly with growth in solar and wind generation capacity (6%-10% of total capacity), but that reserve sharing can significantly reduce these requirements (by 6%-29%). It finds that, in economic terms, the value of forecast error reserve sharing ($\$$0.09-$\$$1.24 billion per year, $\$$0.12-$\$$1.68/MWh of load across scenarios) tends to decline with higher levels of solar and wind generation, due to lower reserve and energy prices. Even with declines in reserve prices, forecast error reserve sharing can still provide substantial value, though with higher levels of solar, wind, and electricity storage this value is increasingly tied to avoiding scarcity prices.

14 SOLAR ENERGY↗

Solar and Wind Forecast Error Reserve Sharing in a Multi-Utility Region

As electricity systems transition to higher levels of solar and wind generation, electric system operators will likely need to hold additional reserves to manage the forecast error associated with these resources. Because wind and solar forecast errors tend to be poorly correlated across space, system operators can reduce their reserve requirements by sharing reserves. This paper examines the value of forecast error reserve sharing among balancing areas in the Southeast United States. It finds that forecast error reserve requirements increase linearly with growth in solar and wind generation capacity but that reserve sharing can significantly reduce physical (MW) reserve requirements (from 25%-26% to 18%-19% of average load in high solar scenarios). It finds that the value of forecast error reserve sharing declines with higher levels of solar and wind generation, due to lower wholesale energy and reserve prices. Even with declines in wholesale prices, forecast error reserve sharing can still provide substantial value (as much as $\$$400 million per year in a high solar scenario), though with higher levels of solar, wind, and electricity storage, this value is increasingly tied to avoiding scarcity prices. The results suggest the importance of coordinated capacity expansion planning for forecast error reserve sharing.

14 SOLAR ENERGY↗

Distortion Representation of Forecast Errors for Model Skill Assessment and Objective Analysis

We proposed a novel characterization of errors for numerical weather predictions. In its simplest form we decompose the error into a part attributable to phase errors and a remainder. The phase error is represented in the same fashion as a velocity field and is required to vary slowly and smoothly with position. A general distortion representation allows for the displacement and amplification or bias correction of forecast anomalies. Characterizing and decomposing forecast error in this way has two important applications, which we term the assessment application and the objective analysis application. For the assessment application, our approach results in new objective measures of forecast skill which are more in line with subjective measures of forecast skill and which are useful in validating models and diagnosing their shortcomings. With regard to the objective analysis application, meteorological analysis schemes balance forecast error and observational error to obtain an optimal analysis. Presently, representations of the error covariance matrix used to measure the forecast error are severely limited. For the objective analysis application our approach will improve analyses by providing a more realistic measure of the forecast error. We expect, a priori, that our approach should greatly improve the utility of remotely sensed data which have relatively high horizontal resolution, but which are indirectly related to the conventional atmospheric variables. In this project, we are initially focusing on the assessment application, restricted to a realistic but univariate 2-dimensional situation. Specifically, we study the forecast errors of the sea level pressure (SLP) and 500 hPa geopotential height fields for forecasts of the short and medium range. Since the forecasts are generated by the GEOS (Goddard Earth Observing System) data assimilation system with and without ERS 1 scatterometer data, these preliminary studies serve several purposes. They (1) provide a testbed for the use of the distortion representation of forecast errors, (2) act as one means of validating the GEOS data assimilation system and (3) help to describe the impact of the ERS 1 scatterometer data.

Hoffman, Ross N.↗

A stochastic-dynamic model for the spatial structure of forecast error statistics

The present investigation is concerned with the presentation of a simplified model of the spatial structure of forecast error statistics, a comparison of the model with actual numerical weather prediction results, and the extent to which simplifying assumptions made in the model are justified. A stochastic-dynamic model is derived for the spatial structure of the global atmospheric mass-field forecast error. The model states that the relative potential vorticity of the forecast error is random. The covariance function of the model's solutions is found to be governed by a simple deterministic equation. The agreement between the stochastic model and actual mass-field forecast errors fields for 12-36 h periods validates the assumptions on which the model is derived. Within this period, the difference between the potential voriticity fields of the atmosphere and of the numerical forecasts used in the comparison is well represented by white noise.

Balgovind, R.↗

Utilizing physics-based input features within a machine learning model to predict wind speed forecasting error

Machine learning is quickly becoming a commonly used technique for wind speed and power forecasting. Many machine learning methods utilize exogenous variables as input features, but there remains the question of which atmospheric variables are most beneficial for forecasting, especially in handling non-linearities that lead to forecasting error. This question is addressed via creation of a hybrid model that utilizes an autoregressive integrated moving-average (ARIMA) model to make an initial wind speed forecast followed by a random forest model that attempts to predict the ARIMA forecasting error using knowledge of exogenous atmospheric variables. Variables conveying information about atmospheric stability and turbulence as well as inertial forcing are found to be useful in dealing with non-linear error prediction. Streamwise wind speed, time of day, turbulence intensity, turbulent heat flux, vertical velocity, and wind direction are found to be particularly useful when used in unison for hourly and 3 h timescales. The prediction accuracy of the developed ARIMA–random forest hybrid model is compared to that of the persistence and bias-corrected ARIMA models. The ARIMA–random forest model is shown to improve upon the latter commonly employed modeling methods, reducing hourly forecasting error by up to 5 % below that of the bias-corrected ARIMA model and achieving an R 2 value of 0.84 with true wind speed.

17 WIND ENERGY↗

Characterization and Impact of Extreme Forecast Errors on Power Systems

Extreme events in the electrical power system, caused by the load and wind forecasting errors, can impact the power system infrastructure via two main avenues. The first avenue is a sudden and significant power unbalance exceeding reasonable operating reserve capacity. The second is a sudden increase of power flows on the system critical paths causing transmission violations. The challenge in managing these system unbalances is more significant for a standalone balancing area operation. The consolidation of balancing authorities into a single balancing area can offset the operating reserve problem but this strategy enhances incremental power flows on the transmission interfaces, potentially leading to more unpredictable transmission congestion. This paper evaluates the expectancy of occurrence of tail events due to forecast error extremes using California ISO and BPA data. Having this type of information, independent system operators and operating utilities could be better prepared to address the tail events by exploring alternative reserve options such as: wide area control coordination, new operating proce-dures and remedial actions.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Short-Term Load Forecasting Error Distributions and Implications for Renewable Integration Studies: Preprint

Load forecasting in the day-ahead timescale is a critical aspect of power system operations that is used in the unit commitment process. It is also an important factor in renewable energy integration studies, where the combination of load and wind or solar forecasting techniques create the net load uncertainty that must be managed by the economic dispatch process or with suitable reserves. An understanding of that load forecasting errors that may be expected in this process can lead to better decisions about the amount of reserves necessary to compensate errors. In this work, we performed a statistical analysis of the day-ahead (and two-day-ahead) load forecasting errors observed in two independent system operators for a one-year period. Comparisons were made with the normal distribution commonly assumed in power system operation simulations used for renewable power integration studies. Further analysis identified time periods when the load is more likely to be under- or overforecast.

17 WIND ENERGY↗

Simulating wind power forecast error distributions for spatially aggregated wind power plants

Dispersion and aggregation of wind power plants lower the uncertainty of wind power by reducing wind power forecasting errors. Using quantitative methods, this paper studies the dispersion's impact on the uncertainty of the aggregated wind power production. A method to simulate day-ahead forecast error distributions at different dispersion and forecasting skill scenarios is presented. The proposed method models the uncertainty of wind power forecasting on an annual basis and at different levels of production. As a result, the uncertainty in the forecasting of spatially dispersed wind power plants is modelled using two continuous distributions: Laplace and beta distribution. The analysis shows that even the production level uncertainty can be modelled in various dispersion and forecasting skill scenarios. The model for aggregated forecast error distributions requires only four variables: capacity-weighted distance of the total wind power plant fleet, mean of the site-specific mean absolute errors (MAEs), number of aggregated wind power plants, and the mean variability of the elevations from the proximities of the aggregated wind power plants. Here, the results are especially promising when the number of aggregated wind power plants exceeds five, the terrain complexity is low or moderate, and the aggregation region is large. This is demonstrated through a case study for Texas, United States.

17 WIND ENERGY↗

An Optimized Autoregressive Forecast Error Generator for Wind and Load Uncertainty Study

This paper presents a first-order autoregressive algorithm to generate real-time (RT), hour-ahead (HA), and day-ahead (DA) wind and load forecast errors. The methodology aims at producing random wind and load forecast time series reflecting the autocorrelation and cross-correlation of historical forecast data sets. Five statistical characteristics are considered: the means, standard deviations, autocorrelations, and cross-correlations. A stochastic optimization routine is developed to minimize the differences between the statistical characteristics of the generated time series and the targeted ones. An optimal set of parameters are obtained and used to produce the RT, HA, and DA forecasts in due order of succession. This method, although implemented as the first-order regressive random forecast error generator, can be extended to higher-order. Results show that the methodology produces random series with desired statistics derived from real data sets provided by the California Independent System Operator (CAISO). The wind and load forecast error generator is currently used in wind integration studies to generate wind and load inputs for stochastic planning processes. Our future studies will focus on reflecting the diurnal and seasonal differences of the wind and load statistics and implementing them in the random forecast generator.

17 WIND ENERGY↗

The behavior of forecast error covariances for a Kalman filter in two dimensions

The behavior of forecast error covariances in a fairly realistic setting is demonstrated via a Kalman filter algorithm. It is used to assimilate simulated data from the existing radiosonde network, from the demonstration network of 31 Doppler wind profilers in the central U.S., and from hypothetical radiometers located at five of the profiler sites. Some theoretical justification of the hypothesis advanced by Phillips (1982), and the hypothesis is used to formulate the model error covariance matrix required by the Kalman filter. The results show that assimilating the profiler wind data leads to a large reduction of forecast/analysis error in heights as well as in winds, over the profiler region and also downstream, when compared with the results of assimilating the radiosonde data alone. The forecast error covariance matrices that the Kalman filter calculates to obtain this error reduction differ considerably from those prescribed by the optimal interpolation schemes that are employed for data assimilation at operational centers.

Cohn, Stephen E.↗