Search NASA⌕ Search

SEARCH · Search NASA

Results for “forecast error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Neutrino masses and cosmological parameters from a Euclid-like survey: Markov Chain Monte Carlo forecasts including theoretical errors

We present forecasts for the accuracy of determining the parameters of a minimal cosmological model and the total neutrino mass based on combined mock data for a future Euclid-like galaxy survey and Planck. We consider two different galaxy surveys: a spectroscopic redshift survey and a cosmic shear survey. We make use of the Monte Carlo Markov Chains (MCMC) technique and assume two sets of theoretical errors. The first error is meant to account for uncertainties in the modelling of the effect of neutrinos on the non-linear galaxy power spectrum and we assume this error to be fully correlated in Fourier space. The second error is meant to parametrize the overall residual uncertainties in modelling the non-linear galaxy power spectrum at small scales, and is conservatively assumed to be uncorrelated and to increase with the ratio of a given scale to the scale of non-linearity. It hence increases with wavenumber and decreases with redshift. With these two assumptions for the errors and assuming further conservatively that the uncorrelated error rises above 2% at k = 0.4 h/Mpc and z = 0.5, we find that a future Euclid-like cosmic shear/galaxy survey achieves a 1-σ error on M{sub ν} close to 32 meV/25 meV, sufficient for detecting the total neutrino mass with good significance. If the residual uncorrelated errors indeed rises rapidly towards smaller scales in the non-linear regime as we have assumed here then the data on non-linear scales does not increase the sensitivity to the total neutrino mass. Assuming instead a ten times smaller theoretical error with the same scale dependence, the error on the total neutrino mass decreases moderately from σ(M{sub ν}) = 18 meV to 14 meV when mildly non-linear scales with 0.1 h/Mpc < k < 0.6 h/Mpc are included in the analysis of the galaxy survey data.

79 ASTRONOMY AND ASTROPHYSICS↗

Complementarities of GEO and LEO IR Sounders for Numerical Weather Prediction in an OSSE Framework

Preparations are underway for the United States’ weather satellite program and the expected advancements in the coming decade. Among these changes is the launch of the proposed NOAA/NASA Geostationary eXtended Observations (GeoXO) Sounder (GXS), coordinated with international counterparts, to form a global ring of hyperspectral infrared (IR) sounders. Coincident with the progress of IR sounders from GEO platforms, the future of low Earth orbit (LEO) sounders is being re-envisioned after decades of beneficial impact in numerical weather prediction (NWP) systems. To address questions about the utility of the two platform types in concert, the Global Modeling and Assimilation Office (GMAO) Observing System Simulation Experiment (OSSE) framework was used to examine the roles of GEO and LEO sounders and their impact on forecast error reduction. Overall, inclusion of both types of platforms in the satellite program produces the largest forecast error reduction with LEO sounders having a strong impact on global skill and GEO sounders providing the most benefit on the scale of targeted regions.

Erica McGrath-Spangler↗

Satellite Detection of Precipitation over the North Pacific

Intense extratropical winter cyclones often impact the West Coast of North America with strong winds and heavy precipitation. Several times during a winter season, short-term forecasts (24 - 48 hours) of these storms are seriously deficient with central pressure errors in the 10's of hPa and surface low position errors in the 100's of km. For example, 48-hr sea level pressure errors (forecast - observation) at buoy 46005 off the Oregon coast for the 2001 - 2002 winter season is plotted. In addition, two times the standard deviation (determined from pressure errors from the last four winter seasons) are also shown. It is evident from this figure that large forecast errors (i.e. greater than 10 hPa) occurred about 10 times this past winter at buoy 46005 with three events where the errors were 20 hPa. Beside large forecast errors of sea level pressure, numerical forecasts of precipitation for land falling cyclones can also be flawed. This is due in large part to the lack of accurate precipitation information over the ocean. Therefore, remote sensing techniques are the only viable option for obtaining accurate information on the distribution and intensity of precipitation over the North Pacific. Due to the radiative characteristics of precipitation sized hydrometeors at microwave frequencies, microwave sensors are able to detect precipitation over oceanic regions. Past studies have demonstrated the utility of passive microwave rainrate data for locating intense rainfall in rapidly deepening cyclones, in detecting developing polar mesocyclones and in determining frontal bands. There are currently many sources of microwave rainrate data: the Special Sensor Microwave Imager (SSM/I) (currently flying on three platforms), the Advanced Microwave Sounding Unit (AMSU-B) (currently flying on NOAA-15, NOAA-16, and NOAA-17), and the Tropical Rainfall Measuring Mission Microwave Imager (TMI). Data will soon be available from the Advanced Microwave Radiometer-EOS (AMSR-E) on the Aqua platform. In this paper, we present a new technique for mapping rainrate distributions over the North Pacific utilizing rainrate estimates from several microwave sensors and upper-tropospheric winds derived from geosynchronous satellite IR data. The goal of this work is to develop a way to obtain high temporal and spatial rainfall information over the North Pacific. This information will be used to support the verification of model derived precipitation distributions and to support the analysis of in situ measurements of rainfall during the Improvement of Microphysical Parameterization through Observational Verification Experiment (IMPROVE) field campaigns.

Smith, Jeremy↗

Quantifying and simulating the weather forecast uncertainty for advanced building control

Weather forecast uncertainty is unavoidable despite technological advancements. Accurately quantifying and modelling this uncertainty is essential for developing and comparing advanced building controllers. In this study, we present a structured approach using a first-order autoregressive model (AR(1)) to model uncertainty in ambient temperature and global solar irradiation (GHI) forecasts. We analyzed weather data from four cities and employed Jensen–Shannon divergence (JSD) to evaluate the similarity between synthetic and actual forecast errors. The average JSD values for temperature are 0.027 (Berkeley), 0.021 (Leuven), 0.018 (Berlin), and 0.008 (Oslo), and for GHI, the average JSD values are 0.016 (Berkeley), 0.058 (Leuven), and 0.013 (Berlin). The low JSD values indicate a high similarity between the synthetic and real forecast error distributions. Further, our approach successfully generates synthetic weather forecasts that mirror the statistical properties of actual forecasts. The implementation of our method for uncertain forecast generation is being added to the BOPTEST framework.

54 ENVIRONMENTAL SCIENCES↗

The Impact of Solar Photovoltaic Generation on Balancing Requirements in the Southern Nevada System

Abstract—The impact of integrating large-scale solar photovoltaic (PV) generation on the balancing requirements in terms of regulation and load-following requirements in the southern Nevada balancing area is evaluated. The “swinging door” algorithm and the “probability box” method developed by Pacific Northwest National Laboratory (PNNL) were used to quantify the impact of large PV generation on the balancing requirements of the system operations. The system’s actual scheduling, real-time dispatch and regulation processes were simulated. Different levels of distributed generation were also considered in the study. The impact of hourly solar PV generation forecast errors on regulation and load-following requirements was assessed. The sensitivity of balancing requirements with respect to real-time forecast errors of large PV generation was analyzed. Index Terms—Ancillary services, balancing requirements, load following, regulation, renewables integration, swinging door

Balancing' Southern Nevada System↗

Improving Wind Predictions in the Marine Atmospheric Boundary Layer through Parameter Estimation in a Single-Column Model

A current barrier to greater deployment of offshore wind turbines is the poor quality of numerical weather prediction model wind and turbulence forecasts over open ocean. The bulk of development for atmospheric boundary layer (ABL) parameterization schemes has focused on land, partly due to a scarcity of observations over ocean. The 100-m FINO1 tower in the North Sea is one of the few sources worldwide of atmospheric profile observations from the sea surface to turbine hub height. These observations are crucial to developing a better understanding and modeling of physical processes in the marine ABL. In this study, we use the WRF single column model (SCM), coupled with an ensemble Kalman filter from the Data Assimilation Research Testbed (DART), to create 100-member ensembles at the FINO1 location. The goal of this study is to determine the extent to which model parameter estimation can improve offshore wind forecasts.

17 WIND ENERGY↗

Operation-adversarial scenario generation

This paper proposes a modified conditional generative adversarial network (cGAN) model to generate net load scenarios for power systems that are statistically credible, conditioned by given labels (e.g., seasons), and, at the same time, “stressful” to the system operations and dispatch decisions. The measure of stress used in this paper is based on the operating cost increases due to net load changes. The proposed operation-adversarial cGAN (OA-cGAN) internalizes a DC optimal power flow model and seeks to maximize the operating cost and achieve a worst-case data generation. The training and testing stages employed in the proposed OA-cGAN use historical day-ahead net load forecast errors and has been implemented for the realistic NYISO 11-zone system. In conclusion, our numerical experiments demonstrate that the generated operation-adversarial forecast errors lead to more cost-effective and reliable dispatch decisions.

42 ENGINEERING↗

Applications systems verification and transfer project. Volume 1: Operational applications of satellite snow cover observations: Executive summary

Both LANDSAT and NOAA satellite data were used in improving snowmelt runoff forecasts. When the satellite snow cover data were tested in both empirical seasonal runoff estimation and short term modeling approaches, a definite potential for reducing forecast error was evident. A cost benefit analysis run in conjunction with the snow mapping indicated a $36.5 million annual benefit accruing from a one percent improvement in forecast accuracy using the snow cover data for the western United States. The annual cost of employing the system would be $505,000. The snow mapping has proven that satellite snow cover data can be used to reduce snowmelt runoff forecast error in a cost effective manner once all operational satellite data are available within 72 hours after acquisition. Executive summaries of the individual snow mapping projects are presented.

Rango, A.↗

A Posteriori Correction of Forecast and Observation Error Variances

Proposed method of total observation and forecast error variance correction is based on the assumption about normal distribution of "observed-minus-forecast" residuals (O-F), where O is an observed value and F is usually a short-term model forecast. This assumption can be accepted for several types of observations (except humidity) which are not grossly in error. Degree of nearness to normal distribution can be estimated by the symmetry or skewness (luck of symmetry) a(sub 3) = mu(sub 3)/sigma(sup 3) and kurtosis a(sub 4) = mu(sub 4)/sigma(sup 4) - 3 Here mu(sub i) = i-order moment, sigma is a standard deviation. It is well known that for normal distribution a(sub 3) = a(sub 4) = 0.

Rukhovets, Leonid↗

Insights into Methodologies and Operational Details of Resource Adequacy Assessment: A Case Study with Application to a Broader Flexibility Framework

Assessing and maintaining resource adequacy (RA) is a core pillar of power systems. However, recent changes in the physical makeup of these systems and the conditions under which these systems must operate have yielded a renewed interest in the methods, metrics, and assumptions that underpin RA assessments. In this paper, we systematically explore a wide range of RA modeling dimensions, including: the objective function and level of operational detail in the underlying model formulation; the quantity (look-ahead) and quality (accuracy) of data that is available for making operational decisions within those models; and the physical configuration of solar photovoltaics (PV) with battery storage hybrid resources. We apply a set of probabilistic RA tools and production cost modeling tools to a realistic test system based loosely on a future Electric Reliability Council of Texas power system dominated by solar PV resources. Under the assumptions of our system and models, we find that multi-stage probabilistic assessments may provide a more robust evaluation of RA by capturing a wider range of operational and system interactions, but this comes at a computational cost of 1-2 orders of magnitude longer run time depending on the specific configuration. In addition, the information on thermal generator availability impacts RA performance by an order of magnitude more than solar resource forecasts, which is driven by the comparatively larger magnitude of thermal outages than solar forecast errors within our test system. Lastly, the flexibility provided by hybrid and other resources can help reduce system load-shedding event frequencies and enable the system to be more robust to inaccurate forecast information, and alternative hybrid inverter sizes can impact RA levels by 1-2 orders of magnitude. Our results point to the importance of a broader flexibility framework to describe the interaction between (1) flexibility "supply" from both physical resource capabilities and operational constraints considered in the modeling, and (2) flexibility "demand" from forecast errors, thermal generator outages, and other sources of uncertainty, as well as their RA impacts. Results are likely sensitive to the system buildout explored; future work could consider additional system configurations and conditions.

ENERGY PLANNING, POLICY, AND ECONOMY,POWER TRANSMI↗

A Neural Optimizer With Decision-Focused Learning for Optimal Energy Storage Operation

Here, this article introduces a neural optimizer-based framework for optimizing battery energy storage system (BESS) control for grid services, including demand charge and energy cost reduction. By leveraging decision-focused learning (DFL), the proposed framework ensures seamless integration and adaptation, significantly enhancing control performance. A patch time-series transformer is employed for peak load forecasting, incorporating aleatoric uncertainty quantification to account for forecasting uncertainties within the decision-making process. The framework utilizes a solver-in-the-loop approach to generate optimal BESS actions, which are then used to train the neural optimizer-based agent. By co-optimizing both BESS operational modes and output power within the NN, the system achieves improved performance and robustness. After initial training, the forecasting and control models are jointly fine-tuned to account for forecasting errors, further improving decision precision and efficiency through DFL. Case studies are performed to validate the performance of the framework using multiple real-world datasets, demonstrating superior performance in monthly peak load forecasting compared to state-of-the-art models. In addition, the results are compared against existing decision-making approaches. The results demonstrate a reduction in monthly peak forecasting error by approximately 15% across various performance measures and achieve an optimization gap for BESS operation that is about three times smaller compared to existing methods.

Kim, Hyeonjin [Pacific Northwest National Laborato↗

Effect of data assimilation in the Polar WRF with 3DVAR on the prediction of radiation, heat flux, cloud, and near surface atmospheric variables over Svalbard

Although the Polar Weather Research and Forecasting (PWRF) model has been developed for polar environments, simulations of atmospheric states in the polar region still have large uncertainties. Therefore, the effects of data assimilation (DA) to improve forecasts in the polar region were investigated for September 2017 using PWRF and the three-dimensional variational (3DVAR) DA method. The experiments without DA and those with DA assimilating only conventional observations and both conventional observations and satellite radiance data were performed. The forecasts from all experiments both without and with DA underestimated (overestimated) the downward longwave (shortwave) radiation flux due to the underestimation of the amount of Arctic clouds. When satellite radiance data (i.e., the Advanced Microwave Sounding Unit-A (AMSU-A) and Microwave Humidity Sounder (MHS)) were assimilated in addition to conventional observations in the PWRF, the distribution and amount of water vapor became closer to observations, which improves cloud liquid water forecasts. Therefore, when both conventional observations and radiance data were assimilated, the 25–30 h forecast errors of the downward longwave and shortwave radiation fluxes and sensible and latent heat fluxes decreased by 12.7%, 8.1%, 3.2%, and 7.8% with the WSM5 scheme and by 17.1%, 4.7%, 2.5%, and 3.1% with the 2-moment Morrison scheme, respectively, compared to those in the experiments without DA. The forecast errors of the 10 m wind and 2 m temperature with DA were smaller than those without DA at most observation stations. Therefore, the uncertainties of the Arctic forecasts in the PWRF decreased when using DA. To further improve Arctic forecasts, the assimilation of various additional satellite data is necessary.

54 ENVIRONMENTAL SCIENCES↗

Ensemble Data Assimilation Without Ensembles: Methodology and Application to Ocean Data Assimilation

Two methods to estimate background error covariances for data assimilation are introduced. While both share properties with the ensemble Kalman filter (EnKF), they differ from it in that they do not require the integration of multiple model trajectories. Instead, all the necessary covariance information is obtained from a single model integration. The first method is referred-to as SAFE (Space Adaptive Forecast error Estimation) because it estimates error covariances from the spatial distribution of model variables within a single state vector. It can thus be thought of as sampling an ensemble in space. The second method, named FAST (Flow Adaptive error Statistics from a Time series), constructs an ensemble sampled from a moving window along a model trajectory. The underlying assumption in these methods is that forecast errors in data assimilation are primarily phase errors in space and/or time.

Data Assimilation↗

Impact of Flow-Dependent Error Correlations and Tropospheric Chemistry on Assimilated Ozone

The presentation compares different versions of a global three-dimensional ozone data assimilation system developed at NASA's Data Assimilation Office. The Solar Backscatter Ultraviolet/2 (SBUV/2) total and partial ozone column retrievals are the sole data assimilated in all of the experiments presented. We study the impact of changing the forecast error covariance model from a version assuming static correlations with a one that captures a short-term Lagrangian evolution of those correlations. This is further combined with a study of the impact of neglecting the tropospheric ozone production, loss and dry deposition rates, which are obtained from the Harvard GEOS-CHEM model. We compare statistical characteristics of the assimilated data and the results of validation against independent observations, obtained from WMO balloon-borne sondes and the Polar Ozone and Aerosol Measurement (POAM) III instrument. Experiments show that allowing forecast error correlations to evolve with the flow results in positive impact on assimilated ozone within the regions where data were not assimilated, particularly at high latitudes in both hemispheres. On the other hand, the main sensitivity to tropospheric chemistry is in the Tropics and sub-Tropics. The best agreement between the assimilated ozone and the in-situ sonde data is in the experiment using both flow-dependent error covariances and tropospheric chemistry.

Wargan, K.↗

A Secure and Adaptive Hierarchical Multi-Timescale Framework for Resilient Load Restoration Using a Community Microgrid

Distribution system integrated community microgrids (CMGs) can partake in restoring loads during extended duration outages. At such times, the CMGs are challenged with limited resource availability, absence of robust grid support, and heightened demand-supply uncertainty. Here, this paper proposes a secure and adaptive three-stage hierarchical multi-timescale framework for scheduling and real-time (RT) dispatch of CMGs with hybrid PV systems to address these challenges. The framework enables the CMG to dynamically expand its boundary to support the neighboring grid sections and is adaptive to the changing forecast error impacts. The first stage solves a stochastic extended duration scheduling (EDS) problem to obtain referral plans for optimal resource rationing. The intermediate near-real-time (NRT) scheduling stage updates the EDS schedule closer to the dispatch time using new obtained forecasts, followed by the RT dispatch stage. To make the decisions more secure and robust against forecast errors, a novel concept called delayed recourse is designed. The approach is evaluated via numerical simulations on a modified IEEE 123-bus system and validated using OpenDSS and hardware-in-loop simulations. The results show superior performance in maximizing load supply and continuous secure distribution network operation under different operating scenarios.

24 POWER TRANSMISSION AND DISTRIBUTION↗

A Brief Assessment of the Impact of Nearly 40 Years of Assimilated Observations Over the Amazon Basin

Adding a Forecast Sensitivity-based Observation Impact component to Version 2 of the Modern Era Retrospective-analysis for Research and Applications, the present study provides an assessment of the impact of nearly 40 years of observations on short-range (24-hr) forecasts over the Amazon basin. Under self-verification, forecast errors are found to slightly increase from the early data-sparse days to the more recent years, when data dramatically increase. Throughout the reanalysis, satellite radiances dominate in volume, but only before 1999 they dominate the impacts. Beyond 1999, over 50% of forecast error reduction is associated with conventional observations (radiosondes). Atmospheric Motion Vectors are also found to be large contributors to error reduction, but their contribution reduces in dry periods. In opposition to Atmospheric Motion Vectors, satellite radiances tend to contribute more in the dry season. Results provide motivation for additional conventional observations and the use of all-sky treatment of radiances.

F. L. R. Diniz↗

Stochastic Optimal Power Flow Based on Data-Driven Distributionally Robust Optimization

We propose a data-driven method to solve a stochastic optimal power flow (OPF) problem based on limited information about forecast error distributions. The objective is to determine power schedules for controllable devices in a power network to balance operational cost and conditional value-at-risk (CVaR) of device and network constraint violations. These decisions include scheduled power output adjustments and reserve policies, which specify planned reactions to forecast errors in order to accommodate fluctuating renewable energy sources. Instead of assuming the uncertainties across the networks follow prescribed probability distributions, we assume the distributions are only observable through a finite training dataset. By utilizing the Wasserstein metric to quantify differences between the empirical data-based distribution and the real data-generating distribution, we formulate a distributionally robust optimization OPF problem to search for power schedules and reserve policies that are robust to sampling errors inherent in the dataset. A multi-stage closed-loop control strategy based on model predictive control (MPC) is also discussed. A simpIe numerical example illustrates inherent tradeoffs between operational cost and risk of constraint violation, and we show how our proposed method offers a data-driven framework to balance these objectives.

24 POWER TRANSMISSION AND DISTRIBUTION↗