Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Efficient Probabilistic Prediction and Uncertainty Quantification of Tropical Cyclone–Driven Storm Tides and Inundation

Abstract This study proposes and assesses a methodology to obtain high-quality probabilistic predictions and uncertainty information of near-landfall tropical cyclone–driven (TC-driven) storm tide and inundation with limited time and resources. Forecasts of TC track, intensity, and size are perturbed according to quasi-random Korobov sequences of historical forecast errors with assumed Gaussian and uniform statistical distributions. These perturbations are run in an ensemble of hydrodynamic storm tide model simulations. The resulting set of maximum water surface elevations are dimensionality reduced using Karhunen–Loève expansions and then used as a training set to develop a polynomial chaos (PC) surrogate model from which global sensitivities and probabilistic predictions can be extracted. The maximum water surface elevation is extrapolated over dry points incorporating energy head loss with distance to properly train the surrogate for predicting inundation. We find that the surrogate constructed with third-order PCs using elastic net penalized regression with leave-one-out cross validation provides the most robust fit across training and test sets. Probabilistic predictions of maximum water surface elevation and inundation area by the surrogate model at 48-h lead time for three past U.S. landfalling hurricanes (Irma in 2017, Florence in 2018, and Laura in 2020) are found to be reliable when compared to best track hindcast simulation results, even when trained with as few as 19 samples. The maximum water surface elevation is most sensitive to perpendicular track-offset errors for all three storms. Laura is also highly sensitive to storm size and has the least reliable prediction. Significance Statement The purpose of this study is to develop and evaluate a methodology that can be used to provide high-quality probabilistic predictions of hurricane-induced storm tide and inundation with limited time and resources. This is important for emergency management purposes during or after the landfall of hurricanes. Our results show that sampling forecast errors using quasi-random sequences combined with machine learning techniques that fit polynomial functions to the data are well suited to this task. The polynomial functions also have the benefit of producing exact sensitivity indices of storm tide and inundation to the forecasted hurricane properties such as path, intensity, and size, which can be used for uncertainty estimation. The code implementing the presented methodology is publicly available on GitHub.

54 ENVIRONMENTAL SCIENCES↗

Review of the WECC EDT phase 2 EIM benefits analysis and results report.

A region-wide Energy Imbalance Market (EIM) was recently proposed by the Western Electricity Coordinating Council (WECC). In order for the Western Area Power Administration (Western) to make more informed decisions regarding its involvement in the EIM, Western asked Argonne National Laboratory (Argonne) to review the EIM benefits study (the October 2011 revision) performed by Energy and Environmental Economics, Inc. (E3). Key components of the E3 analysis made use of results from a study conducted by the National Renewable Energy Laboratory (NREL); therefore, we also reviewed the NREL work. This report examines E3 and NREL methods and models used in the EIM study. Estimating EIM benefits is very challenging because of the complex nature of the Western Interconnection (WI), the variability and uncertainty of renewable energy resources, and the complex decisions and potentially strategic bidding of market participants. Furthermore, methodologies used for some of the more challenging aspects of the EIM have not yet matured. This review is complimentary of several components of the EIM study. Analysts and modelers clearly took great care when conducting detailed simulations of the WI using well-established industry tools under stringent time and budget constraints. However, it is our opinion that the following aspects of the study and the interpretation of model results could be improved upon in future analyses. The hurdle rate methodology used to estimate current market inefficiencies does not directly model the underlying causes of sub-optimal dispatch and power flows. It assumes that differences between historical flows and modeled flows can be attributed solely to market inefficiencies. However, flow differences between model results and historical data can be attributed to numerous simplifying assumptions used in the model and in the input data. We suggest that alternative approaches be explored in order to better estimate the benefits of introducing market structures like the EIM. In addition to more efficient energy transactions in the WI, the EIM would reduce the amount of flexibility reserves needed to accommodate forecast errors associated with variable production from wind and solar energy resources. The modeling approach takes full advantage of variable resource diversity over the entire market footprint, but the projected reduction in flexibility reserves may be overly optimistic. While some reduction would undoubtedly occur, the EIM is only an energy market and would therefore not realize the same reduction in reserves as an ancillary services market. In our opinion the methodology does not adequately capture the impact of transmission constraints on the deployment of flexibility reserves. Estimates of flexibility reserves assume that forecast errors follow a normal distribution. Improved estimates could be obtained by using other probability distributions to estimate up and down reserves to capture the underlying uncertainty of these resources under specific operating conditions. Also, the use of a persistence forecast method for solar is questionable, because solar insolation follows a deterministic pattern dictated by the sun's path through the sky. We suggest a more rigorous method for forecasting solar insolation using the sun's relatively predictable daily pattern at specific locations. The EIM study considered only one scenario for hydropower resources. While this scenario is within the normal range over the WI footprint, it represents a severe drought condition in the Colorado River Basin from which Western schedules power. Given hydropower's prominent role in the WI, we recommend simulating a range of hydropower conditions since the relationship between water availability and WI dispatch costs is nonlinear. Also, the representation of specific operational constraints faced by hydropower operators in the WI needs improvements. The model used in the study cannot fully capture all of the EIM impacts and complexities of power system operations. In particular, a primary benefit of the EIM is a shorter dispatch interval; namely, 5 minutes. However, the model simulates the dispatch hourly. Therefore it cannot adequately measure the benefits of a more frequent dispatch. A tool with a finer time resolution would significantly improve simulation accuracy. When the study was conducted, the rules for the EIM were not clearly defined and it was appropriate to estimate societal benefits of the EIM assuming a perfect market without a detailed specification of the market design. However, incorporating a more complete description of market rules will allow for better estimates of EIM benefits. Furthermore, performing analyses using specific market rules can identify potential design flaws that may be difficult and expensive to correct after the market is established. Estimated cost savings from a more efficient dispatch are less than one percent of the total cost of electricity production.

14 SOLAR ENERGY↗

Distribution-Agnostic Stochastic Optimal Power Flow for Distribution Grids

This paper outlines a data-driven, distributionally robust approach to solve chance-constrained AC optimal power flow problems in distribution networks. Uncertain forecasts for loads and power generated by photovoltaic (PV) systems are considered, with the goal of minimizing PV curtailment while meeting power flow and voltage regulation constraints. A data- driven approach is utilized to develop a distributionally robust conservative convex approximation of the chance-constraints; particularly, the mean and covariance matrix of the forecast errors are updated online, and leveraged to enforce voltage regulation with predetermined probability via Chebyshev-based bounds. By combining an accurate linear approximation of the AC power flow equations with the distributionally robust chance constraint reformulation, the resulting optimization problem becomes convex and computationally tractable.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Multi-Factor-Coupled, Ahead-of-Time Aggregation of Power Flexibility Under Forecast Uncertainty

The increasing penetration of distributed energy resources (DERs) is significantly reshaping the role of distribution systems under active energy management. To aggregate the active-reactive power flexibility of DERs dispersed at the feeder and provide capacity support to the transmission system, it is essential to efficiently identify feasible substation power injection trajectories. This paper introduces a novel ahead-of-time flexibility characterization method to address it. First, a polyhedral non-feeder-level power flexibility region (PFR) is constructed, accounting for various time-dependent, power-coupled, and forecast error uncertainties. Then, a polyhedral feeder-level PFR is analytically derived through a coordinate transformation, which can reveal the uncertainty propagation path, i.e., how uncertainty applies to the feeder-level PFR. To facilitate the high-level application, a tractable chance-constrained Chebyshev centering optimization model is further developed to find a ball-shaped inner approximation of the feeder-level PFR. Finally, the proposed method is validated on a modified IEEE 123-bus test system. Here, both theoretical and experimental results show that, with appropriate robustness parameter settings, the proposed method can make the approximated PFR less conservative with abundant robustness against forecast error uncertainty.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Impact of Measured Spectrum Variation on Solar Photovoltaic Efficiencies Worldwide

In photovoltaic power ratings, a single solar spectrum, AM1.5, is the de facto standard for record laboratory efficiencies, commercial module specifications, and performance ratios of solar power plants. More detailed energy analysis that accounts for local spectral irradiance, along with temperature and broadband irradiance, reduces forecast errors to expand the grid utility of solar energy. Here, ground-level measurements of spectral irradiance collected worldwide have been pooled to provide a sampling of geographic, seasonal, and diurnal variation. Applied to nine solar cell types, the resulting divergence in solar cell efficiencies illustrates that a single spectrum is insufficient for comparisons of cells with different spectral responses. Cells with two or more junctions tend to have efficiencies below that under the standard spectrum. Silicon exhibits the least spectral sensitivity: relative weekly site variation ranges from 1% in Lima, Peru to 14% in Edmonton, Canada.

energy yield↗

Evaluation of the Relative Contribution of Observing Systems in Reanalyses: Aircraft Temperature Bias and Analysis Innovations

Reanalyses have become important sources of data in weather and climate research. While observations are the most crucial component of the systems, few research projects consider carefully the multitudes of assimilated observations and their impact on the results. This is partly due to the diversity of observations and their individual complexity, but also due to the unfriendly nature of the data formats. Here, we discuss the NASA Modern-Era Retrospective analysis for Research and Applications (MERRA) and a companion dataset, the Gridded Innovations and Observations (GIO). GIO is simply a post-processing of the assimilated observations and their innovations (forecast error and analysis error) to a common spatio-temporal grid, following that of the MERRA analysis fields. This data includes in situ, retrieved and radiance observations that are assimilated and used in the reanalysis. While all these disparate observations and statistics are in a uniform easily accessible format, there are some limitations. Similar observations are binned to the grid, so that multiple observations are combined in the gridding process. The data is then implicitly thinned. Some details in the meta data may also be lost (e.g. aircraft or station ID). Nonetheless, the gridded observations should provide easy access to all the observations input to the reanalysis. To provide an example of the GIO data, a case study evaluating observing systems over the United States and statistics is presented, and demonstrates the evaluation of the observations and the data assimilation. The GIO data is used to collocate 200mb Radiosonde and Aircraft temperature measurements from 1979-2009. A known warm bias of the aircraft measurements is apparent compared to the radiosonde data. However, when larger quantities of aircraft data are available, they dominate the analysis and the radiosonde data become biased against the forecast. When AMSU radiances become available the radiosonde and aircraft analysis and forecast error take on an annual cycle. While this supports results of previous work that recommend bias corrections for the aircraft measurements, the interactions with AMSU radiances will also require further investigation. This also provides an example for reanalysis users in examining the available observations and their impact on the analysis. GIO data is presently available alongside the MERRA reanalysis.

Bosilovich, Michael G.↗

Occupant Preference-Aware Load Scheduling for Resilient Communities

The load scheduling of resilient communities in the islanded mode is subject to many uncertainties such as weather forecast errors and occupant behavior stochasticity. To date, it remains unclear how occupant preferences affect the effectiveness of the load scheduling of resilient communities. This paper proposes an occupant thermal preference-aware load scheduler for resilient communities operating in the islanded mode. First, key resilience indicators are selected to quantify its impacts on the load scheduling of a resilient community. A deterministic model predictive control-based load scheduling framework is adopted as the baseline. Then, a chance-constrained controller is proposed to address the occupant-induced uncertainty in room temperature setpoints. Finally, the chance-constrained controller is compared with the deterministic controller on a virtual community testbed based on a real-world net-zero energy community in Florida, U.S. Results have shown that the proposed chance-constrained controller performs better in terms of serving occupants’ thermal preference and the required battery sizes compared to the deterministic controller with the presence of the assumed stochastic occupant behavior. This work indicates that it is necessary to consider the stochasticity of the occupant behavior when designing optimal load schedulers for resilient communities.

Wang, Jing↗

Simulation of Photovoltaic Power Output for Solar Integration Studies in the Southeast US

We describe the method used to simulate one year of AC power at one-minute intervals for a large collection of hypothetical utility-scale photovoltaic plants of varying size, employing either fixed-tilt PV modules or single-axis tracking, and for distribution-connected photovoltaic (DPV) power systems assumed for a number of metropolitan areas. We also describe the simulation of an accompanying day-ahead forecast of hourly AC power for utility-scale plants and DPV systems such that forecast errors are consistent with errors reported for current forecasting methods. The results of these simulations are intended for use in a study that examines the possible effects of increased levels of photovoltaic (PV) generation bulk on power variability within the Tennessee Valley Authority (TVA) and Southern Company service territories.

14 SOLAR ENERGY↗

Integration of Uncertainty Information into Power System Operations

Contemporary power systems face uncertainties coming from multiple sources, including forecast errors of load, wind and solar generation, uninstructed deviation and forced outage of traditional generators, loss of transmission lines, and others. With increasing amounts of wind and solar generation being integrated into the system, these uncertainties have been growing significantly. It is critical important to build knowledge of major sources of uncertainty, learn how to simulate them, and then incorporate this information into the decision-making processes and power system operations, for better reliability and efficiency. This paper gives a comprehensive view on the sources of uncertainty in power systems, important characteristics, available models, and ways of their integration into system operations. It is primarily based on previous works conducted at the Pacific Northwest National Laboratory (PNNL).

24 POWER TRANSMISSION AND DISTRIBUTION↗

Incorporating Uncertainty of Wind Power Generation Forecast into Power System Operation, Dispatch, and Unit Commitment Procedures

An approach to evaluate the uncertainties of the balancing capacity, ramping capability, and ramp duration requirements is proposed. The approach includes three steps: forecast data acquisition, statistical analysis of retrospective information, and prediction of grid balancing requirements for a specified time horizon and a given confidence level. An assessment of the capacity and ramping requirements is performed using a specially developed probabilistic algorithm based on histogram analysis, incorporating sources of uncertainty - both continuous (wind and load forecast errors) and discrete (forced generator outages and start-up failures). A new method called the 'flying-brick' technique is developed to evaluate the look-ahead required generation performance envelope for the worst case scenario within a user-specified confidence level. A self-validation process is used to validate the accuracy of the confidence intervals. To demonstrate the validity of the developed uncertainty assessment methods and its impact on grid operation, a framework for integrating the proposed methods with an EMS system is developed. Demonstration through EMS integration illustrates the applicability of the proposed methodology and the developed tool for actual grid operation and paves the road for integration with EMS systems in control rooms.

17 WIND ENERGY↗

Bi-Level Arbitrage Potential Evaluation for Grid-Scale Energy Storage Considering Wind Power and LMP Smoothing Effect

Our paper deals with extended-term energy storage (ES) arbitrage problems to maximize the annual revenue in deregulated power systems with high penetration wind power. The conventional ES arbitrage model takes the locational marginal prices (LMP) as an input and is unable to account for the impacts of ES operations on system LMPs. This paper proposes a bi-level ES arbitrage model, where the upper level maximizes the ES arbitrage revenue and the lower level simulates the market clearing process considering wind power and ES. The bi-level model is formulated as a mathematical program with equilibrium constraints (MPEC) and then recast into a mixed-integer linear programming (MILP) using strong duality theory. Wind power fluctuations are characterized by the GARCH forecast model and the forecast error is modeled by forecast-bin based Beta distributions. Case studies are performed on a modified PJM 5-bus system and an IEEE 118-bus system with a weekly time horizon over an annual term to show the validity of the proposed bi-level model. The results from the conventional model and the bi-level model are compared under different ES power and energy ratings, and also various load and wind penetration levels.

17 WIND ENERGY↗

A Short-Term Solar Forecasting Platform Using a Physics-Based Smart Persistence Model and Data Imputation Method

Electrical energy plays vital role in our socio-economic activity and therefore ensuring the reliability of the electric grid, from the generation, transmission and distribution level is critical. In order to maintain the power system parameter viz., frequency, voltage, etc., optimally, balancing of generation and consumption is very much essential. However, solar energy is infirm power by nature this is due to cloud cover / other local phenomena. Hence, Photovoltaic (PV) power generation brings a significant challenge to the grid operator due to the variability of the solar energy. The complexity of this challenge in terms of planning and dispatch ability of PV resources, aggravates with the high penetration of solar energy into the electric grid. In this setting, reliable solar radiation forecasting models based on accurate and quality input data become essential. In order to develop a suitable model for predicting solar radiation, quality historical / real time measurement is also needed. Under this study NIWE and NREL jointly developed / tested short-term solar forecasting frameworks using a smart persistence and physics-based smart persistence models for intra-hour forecasting of solar radiation (PSPI) and benchmarked 9 different data imputation techniques in 15 Solar Radiation Resource Assessment (SRRA) stations, located at different parts of India. During any measurement campaign, due to various technical reasons, we may miss few observations. However, the missing observation often reduce the performance of any forecasting model. Therefore, suitable data imputation method would assist us to obtain continuous observation of solar radiation. A station-by-station and method-by-method analysis was carried out to understand the performance of each model. Based on our analysis, among all the data imputation methods, the Kalman data imputation method is better for Indian Weather condition. In addition, Kalman StructTS, Linear, Stine and Arima methods yield slightly inferior accuracy compared to Kalman, but outperform the other methods. The extended solar radiation data are used by solar forecasting models to provide the prediction of solar radiation at 15 SRRA stations. As far as short term forecasting model is concerned, the PSPI model outperforms the Smart Persistence model. However, the forecast error is increases with the forecasting horizon.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Sensitivity of Forecast Skill to Different Objective Analysis Schemes

Numerical weather forecasts are characterized by rapidly declining skill in the first 48 to 72 h. Recent estimates of the sources of forecast error indicate that the inaccurate specification of the initial conditions contributes substantially to this error. The sensitivity of the forecast skill to the initial conditions is examined by comparing a set of real-data experiments whose initial data were obtained with two different analysis schemes. Results are presented to emphasize the importance of the objective analysis techniques used in the assimilation of observational data.

Baker, W. E.↗

Forecasts of the 500 mb height using a dynamically oriented statistical model

The forecast skill of a simple dynamically inspired statistical model of the Northern Hemisphere 500 mb height field is evaluated in spectral and physical space for a variety of forecast lead times (1-32 days) and predictand averaging times (1-32 days). The model includes viscous damping, wave propagation, climatology and implicit stochastic forcing. The largest model skill was found for forecasts of the zonal flow and the largest waves. In general, the largest forecast skills were also associated with the largest forecast error, there being a slight geographic phase shift of the skill with respect to the error. Model skills for climate (time-averaged) forecasts are greater when using instantaneous rather than time averages to forecast time averages. Analysis of model errors suggests areas for improvement in representing forcing terms and model physics. However, the model error fields are largely 'white noise' which suggests that global forecast skills substantially larger than those obtained here are unlikely to be achieved by more sophisticated models.

Roads, J. O.↗

Carbon Data Assimilation with a Coupled Ensemble Kalman Filter (Final Technical Report)

We proposed (and accomplished) the development of an Ensemble Kalman Filter (EnKF) approach for the estimation of surface carbon fluxes as if they were parameters, augmenting the model with them. Our system is quite different from previous approaches, such as carbon flux inversions, 4D-­Var, and EnKF with approximate background error covariance (Peters et al., 2008). We showed (using observing system simulation experiments, OSSEs) that these differences lead to a more accurate estimation of the evolving surface carbon fluxes at model grid-scale resolution. The main properties of the LETKF-­C are: a) The carbon cycle LETKF is coupled with the simultaneous assimilation of the standard atmospheric variables, so that the ensemble wind transport of the CO2 provides an estimation of the carbon transport uncertainty. b) The use of an assimilation window (6hr) much shorter than the months-long windows used in other methods. This avoids the inevitable “blurring” of the signal that takes place in long windows due to turbulent mixing since the CO2 does not have time to mix before the next window. In this development we introduced new, advanced techniques that have since been adopted by the EnKF community (Kang, 2009, Kang et al., 2011, Kang et al. 2012). These advances include “variable localization” that reduces sampling errors in the estimation of the forecast error covariance, more advanced adaptive multiplicative and additive inflations, and vertical localization based on the time scale of the processes. The main result has been obtained using the LETKF-­C with all these advances, and assimilating simulated atmospheric CO2 observations from different observing systems (surface flask observations of CO2 but no surface carbon fluxes observations, total column CO2 from GoSAT/OCO-­2, and upper troposphere AIRS retrievals). After a spin-­up of about one month, the LETKF-­C succeeded in reconstructing the true evolving surface fluxes of carbon at a model grid resolution. When applied to the CAM3.5 model, the LETKF gave very promising results as well, although only one month is available.

54 ENVIRONMENTAL SCIENCES↗

Final report on "Carbon Data Assimilation with a Coupled Ensemble Kalman Filter"

We proposed (and accomplished) the development of an Ensemble Kalman Filter (EnKF) approach for the estimation of surface carbon fluxes as if they were parameters, augmenting the model with them. Our system is quite different from previous approaches, such as carbon flux inversions, 4D-Var, and EnKF with approximate background error covariance (Peters et al., 2008). We showed (using observing system simulation experiments, OSSEs) that these differences lead to a more accurate estimation of the evolving surface carbon fluxes at model grid-scale resolution. The main properties of the LETKF-C are: a) The carbon cycle LETKF is coupled with the simultaneous assimilation of the standard atmospheric variables, so that the ensemble wind transport of the CO2 provides an estimation of the carbon transport uncertainty. b) The use of an assimilation window (6hr) much shorter than the months-long windows used in other methods. This avoids the inevitable “blurring” of the signal that takes place in long windows due to turbulent mixing since the CO2 does not have time to mix before the next window. In this development we introduced new, advanced techniques that have since been adopted by the EnKF community (Kang, 2009, Kang et al., 2011, Kang et al. 2012). These advances include “variable localization” that reduces sampling errors in the estimation of the forecast error covariance, more advanced adaptive multiplicative and additive inflations, and vertical localization based on the time scale of the processes. The main result has been obtained using the LETKF-C with all these advances, and assimilating simulated atmospheric CO2 observations from different observing systems (surface flask observations of CO2 but no surface carbon fluxes observations, total column CO2 from GoSAT/OCO-2, and upper troposphere AIRS retrievals). After a spin-up of about one month, the LETKF-C succeeded in reconstructing the true evolving surface fluxes of carbon at a model grid resolution. When applied to the CAM3.5 model, the LETKF gave very promising results as well, although only one month is available.

58 GEOSCIENCES↗

The Impact of Anisotropic Error Correlation Modelling

Most data assimilation systems assume isotropic forecast error correlations, but results from two dimensional Kalman Filter experiments indicate that the correlations can be far from isotropic. In this paper we use a simple two-dimensional data assimilation system, which analyses trace chemical species such as ozone, to assess different approaches to modelling the error correlations. We compare assimilation results using isotropic correlations with results obtained using different approaches to modelling anisotropic correlations: first, using correlations based on the concentrations of the trace chemicals, and secondly using an advective correlation model. We show that these relatively cheap ways of modelling anisotropic correlations give objectively better results than using isotropic correlations. We discuss the possible extension of these approaches to a full 3-D meteorological data assimilation system.

Swinbank, R.↗