Search NASA⌕ Search

SEARCH · Search NASA

Results for “solar irradiance forecasting”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Use Probabilistic Forecasts in Reliable and Economic Electricity Market Scheduling and Operations

The value of probabilistic forecasts in electricity market operations is being increasingly recognized lately, however, the use is still limited. This study demonstrates two cases of using probabilistic forecasts in scheduling and operations of the California electricity market. We first develop a data-driven method to give weather-informed estimates of ramping reserves based on short-term probabilistic solar irradiance forecasts. By using forecasts across multiple sites, our proposed method presents advantages over the real-world baseline in terms of system reliability and economics. Our second case uses probabilistic hydro power forecasts in the scheduling of a hydro power plant under economic and environmental constraints. By optimizing the bids into both the day-ahead and real-time markets, our results demonstrate considerable economic benefits.

13 HYDRO ENERGY↗
DOE OSTI2022

Sizing ramping reserve using probabilistic solar forecasts: A data-driven method

Ramping products have been introduced or proposed in several U.S. power markets to mitigate the impact of load and renewable uncertainties on market efficiency and reliability. Current methods often rely on historical data to estimate the requirements of ramping products and fail to take into account the effects of the latest weather conditions and their uncertainties, which could lead to overly conservative or insufficient requirements. This study proposes a k-nearest-neighbor-based method to give weather-informed estimates of ramping needs based on short-term probabilistic solar irradiance forecasts. Forecasts from multiple sites are employed in conjunction with principal component analysis to derive numerical classifiers to characterize system-level weather conditions. In addition, we develop a data-driven method to optimize the model parameters in a rolling-forward manner. By using real-world data from the California Independent System Operator, we design two metrics to evaluate method performance: 1) frequency of shortage and 2) oversupply of ramping product. Our proposed method presents advantages in comparison with the baseline and a set of benchmark methods: without compromising system reliability, it reduces system ramping requirements by up to 25%, therefore improving both system reliability and economics.

14 SOLAR ENERGY↗
DOE OSTI2025

A Scientist-in-the-Loop Data Analytics Framework for Intelligent Simulation Model Tuning and Validation

This project developed a scientist-in-the-loop data analytics framework for intelligent simulation model tuning and validation, targeting the Weather Research and Forecasting (WRF) model and its solar energy variant, WRF-Solar-BNL. Domain experts, such as climate scientists, depend on large-scale numerical simulations for knowledge discovery and decision-making, yet the complexity of parameter tuning and the disconnect between automated optimization and domain expertise pose significant challenges. We extended an interactive visual analytics framework that enables domain experts to observe and intervene in the computational steering process by identifying disagreements between the simulation model, surrogate model, and the expert’s domain knowledge. Using Bayesian Optimization with Gaussian Process Regression as the surrogate model, our system allows users to probe parameter relationships, analyze correlation patterns, and adjust tuning parameters in real time. We developed use cases for solar irradiance forecasting through sustained collaboration with Brookhaven National Laboratory, resolving critical model configuration challenges and achieving meaningful reductions in prediction error. The project supported one PhD student, one MS student, and eight undergraduate students across three Data Science Capstone projects, resulting in one master’s thesis.

Dasgupta, Aritra [New Jersey Institute of Technolo↗
DOE OSTI2023

Recursive Blind Forecasting of Photovoltaic Generation and Consumer Load for Microgrids

Existing forecasting frameworks that predict time-series photovoltaic (PV) generation and consumer load for micro-grids' operation and control assume near-continuous availability of real-time predictors from the field. The incoming data are used to periodically re-train the models and update forecast snapshots over a moving horizon window. However, such frameworks are not resilient to disruptions in data availability caused by losses in communications between the field sensors and data loggers. This paper bridges the shortcoming by leveraging a previously proposed forecasting framework that is resilient to abrupt changes in data quality caused by communication losses. Assuming no availability of real-time field system data, which is typical in extreme weather events such as hurricanes, the framework uses lightweight recursive time-series models to independently forecast solar irradiance, ambient temperature, PV power, and consumer load for three horizon windows: 24 hours, 12 hours, and 1 hour. Four types of ensemble-based regression trees-simple gradient boosted trees (GBR), GBR with an adaptive component (A-GBR), random forests (RF), and extra trees (ExTR)-are leveraged and their performances are compared against a simple historical weekly mean. Numerical results show that A-GBR performs better on average by 32% for 24-hour horizon and 39% for 12-hour horizon, whereas ExTR outdoes the other models on average by 10% for 1-hour horizon.

Sundararajan, Aditya↗
DOE OSTI2020

Stochastic Home Energy Management Systems with Varying Controllable Resources

This paper studies the performance of a model predictive control (MPC) algorithm in a home energy management system (HEMS) as the set of controllable resources varies and under both a constant and a time-of-use (TOU) electricity price structure. The set of controllable resources includes residentially-owned photovoltaic (PV) panels, a home battery system (HBS), an electric vehicle (EV), and a home heating, ventilation, and air conditioning (HVAC) system. The HEMS optimally schedules the set of controllable resources given user preferences such as indoor thermal comfort and electricity cost sensitivity. The home energy management system is built on a chance constrained, MPC-based algorithm, where the chance constraint ensures the indoor thermal comfort is satisfied with a high probability given uncertainty in the outdoor temperature and solar irradiance forecasts. Simulation results for varying sets of controllable resources under two different electricity price structures demonstrate the variation in the HEMS control with respect to HBS operation, electricity cost, and grid power usage.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

A Gridded Solar Irradiance Ensemble Prediction System Based on WRF-Solar EPS and the Analog Ensemble

The WRF-Solar Ensemble Prediction System (WRF-Solar EPS) and a calibration method, the analog ensemble (AnEn), are used to generate calibrated gridded ensemble forecasts of solar irradiance over the contiguous United States (CONUS). Global horizontal irradiance (GHI) and direct normal irradiance (DNI) retrievals, based on geostationary satellites from the National Solar Radiation Database (NSRDB) are used for both calibrating and verifying the day-ahead GHI and DNI predictions (GDIP). A 10-member ensemble of WRF-Solar EPS is run in a re-forecast mode to generate day-ahead GDIP for three years. The AnEn is used to calibrate GDIP at each grid point independently using the NSRDB as the “ground truth”. Performance evaluations of deterministic and probabilistic attributes are carried out over the whole CONUS. The results demonstrate that using the AnEn calibrated ensemble forecast from WRF-Solar EPS contributes to improving the overall quality of the GHI predictions with respect to an AnEn calibrated system based only on the deterministic run of WRF-Solar. In fact, the calibrated WRF-Solar EPS’s mean exhibits a lower bias and RMSE than the calibrated deterministic WRF-Solar. Moreover, using the ensemble mean and spread as predictors for the AnEn allows a more effective calibration than using variables only from the deterministic runs. Finally, it has been shown that the recently introduced algorithm of correction for rare events is of paramount importance to obtain the lowest values of GHI from the calibrated ensemble (WRF-Solar EPS AnEn), qualitatively consistent with those observed from the NSRDB.

14 SOLAR ENERGY↗
DOE OSTI2023

Influences of Cloud Microphysics on the Components of Solar Irradiance in the WRF-Solar Model

An accurate forecast of Global Horizontal solar Irradiance (GHI) and Direct Normal Irradiance (DNI) in cloudy conditions remains a major challenge in the solar energy industry. This study focuses on the impact of cloud microphysics on GHI and its partition into DNI and Diffuse Horizontal Irradiance (DHI) using the Weather Research and Forecasting model specifically designed for solar radiation applications (WRF-Solar) and seven microphysical schemes. Three stratocumulus (Sc) and five shallow cumulus (Cu) cases are simulated and evaluated against measurements at the US Department of Energy’s Atmospheric Radiation Measurement (ARM) user facility, Southern Great Plains (SGP) site. Results show that different microphysical schemes lead to spreads in simulated solar irradiance components up to 75% and 350% from their ensemble means in the Cu and Sc cases, respectively. The Cu cases have smaller microphysical sensitivity due to a limited cloud fraction and smaller domain-averaged cloud water mixing ratio compared to Sc cases. Cloud properties also influence the partition of GHI into DNI and DHI, and the model simulates better GHI than DNI and DHI due to a non-physical error compensation between DNI and DHI. The microphysical schemes that produce more accurate liquid water paths and effective radii of cloud droplets have a better overall performance.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2025

Quantifying and simulating the weather forecast uncertainty for advanced building control

Weather forecast uncertainty is unavoidable despite technological advancements. Accurately quantifying and modelling this uncertainty is essential for developing and comparing advanced building controllers. In this study, we present a structured approach using a first-order autoregressive model (AR(1)) to model uncertainty in ambient temperature and global solar irradiation (GHI) forecasts. We analyzed weather data from four cities and employed Jensen–Shannon divergence (JSD) to evaluate the similarity between synthetic and actual forecast errors. The average JSD values for temperature are 0.027 (Berkeley), 0.021 (Leuven), 0.018 (Berlin), and 0.008 (Oslo), and for GHI, the average JSD values are 0.016 (Berkeley), 0.058 (Leuven), and 0.013 (Berlin). The low JSD values indicate a high similarity between the synthetic and real forecast error distributions. Further, our approach successfully generates synthetic weather forecasts that mirror the statistical properties of actual forecasts. The implementation of our method for uncertain forecast generation is being added to the BOPTEST framework.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Advances in solar forecasting: Computer vision with deep learning

Renewable energy forecasting is crucial for integrating variable energy sources into the grid. It allows power systems to address the intermittency of the energy supply at different spatiotemporal scales. To anticipate the future impact of cloud displacements on the energy generated by solar facilities, conventional modeling methods rely on numerical weather prediction or physical models, which have difficulties in assimilating cloud information and learning systematic biases. Augmenting computer vision with machine learning overcomes some of these limitations by fusing real-time cloud cover observations with surface measurements acquired from multiple sources. This Review summarizes recent progress in solar forecasting from multisensor Earth observations with a focus on deep learning, which provides the necessary theoretical framework to develop architectures capable of extracting relevant information from data generated by ground-level sky cameras, satellites, weather stations, and sensor networks. Overall, machine learning has the potential to significantly improve the accuracy and robustness of solar energy meteorology; however, more research is necessary to realize this potential and address its limitations.

14 SOLAR ENERGY↗
DOE OSTI2020

Benchmark probabilistic solar forecasts: Characteristics and recommendations

We illustrate and compare commonly used benchmark, or reference, methods for probabilistic solar forecasting that researchers use to measure the performance of their proposed techniques. A thorough review of the literature indicates wide variation in the benchmarks implemented in probabilistic solar forecast studies. To promote consistent and sensible methodological comparisons, we implement and compare ten variants from six common benchmark classes at two temporal scales: intra-hourly forecasts and hourly resolution forecasts. Using open-source Surface Radiation Budget Network (SURFRAD) data from 2018, these benchmark methods are compared using proper probabilistic metrics and common diagnostic tools. Practical implementation issues, such as the impact of missing data and applicability for operational forecasting, are also discussed. Furthermore, we make recommendations for practitioners on the appropriate selection of benchmark methods to properly showcase state-of-the-art improvements in forecast reliability and sharpness. All code and open-source data are available on Github for reproducibility and for other researchers to apply the same benchmark methods to their own data.

14 SOLAR ENERGY↗
DOE OSTI2021

HAIMOS Ensemble Forecasts for Intra-day and Day- Ahead GHI, DNI and Ramps

The objective of this research is to develop a hybrid physics-based/data-driven forecast model to improve direct normal and global horizontal irradiance (DNI and GHI) prediction for horizons ranging from 1 to 72 hours. Project objectives also address key gaps in state-of-the-art solar forecasting: accurate probabilistic solar forecasts and the forecasting of large irradiance ramps (ramp onset and magnitude). The proposed model ensembles Numerical Weather Prediction (NWP) forecasts, determinist physics-based algorithms, and new-generation cloud cover products (high-resolution rapid refresh satellite images and Large Eddy Simulations). The result is the Hybrid Adaptive Input Model Objective Selection (HAIMOS) ensemble model. HAIMOS blends state of the art machine learning methodologies with physics-based models for cloud cover and cloud optical depth forecasts. The technical activities followed a two-pronged strategy. First, the preprocessing of data, the selection of inputs to the nonlinear approximators, the type of approximator and objective functions, and post-processing ensembling techniques included in HAIMOS were all optimized adaptively to find the best model for a specific goal (reduce DNI/GHI forecast error, improve the prediction of ramp onset, etc.). Second, a large effort was put in improving cloud identification and the forecast of cloud cover and cloud optical depth. To this end, new-generation cloud parametrization products were developed in this work. These include improved algorithms to assist in cloud identification, cloud classification and cloud parametrization from satellite images – three key factors in the accuracy of 1 to 6-hours irradiance forecasts and prediction of ramp onset. Furthermore, we also included cloud information extracted from high resolution rapid refresh satellite images (GOES-16) and Large Eddy Simulations (LES). LES was used to model the atmosphere in detail over locations of interest and produce cloud optical depth forecasts. Once these data streams were validated, they were used as input data to the HAIMOS forecast. The model was developed using data from several climatologically distinct locations with potential for high solar penetration. In the last year of the project, we conducted a validation campaign according to the guidelines stipulated by the Topic Area 1 project as described in the FOA. This effort brings, for the first time, proven machine-learning methodologies for generating state-of-the-art solar forecasts interweaved with detailed physics-based models for cloud detection, and cloud optical depth forecasts. HAIMOS will generate accurate irradiance probabilistic forecast to assist in reducing solar generation prediction error. Globally optimized solar forecast models are more likely to impact solar energy stakeholders. The goal of this project was to increase the state-of-the-art forecast skill from their present values of 10 to 35%. At the end of the project, we achieved between 30% and 50% forecast skill across a wide range of horizons for both GHI and DNI.

14 SOLAR ENERGY↗
DOE OSTI2021

Use of Physics to Improve Solar Forecast: Physics-Informed Persistence Models for Simultaneously Forecasting GHI, DNI, and DHI

Observation-based statistical models have been widely used in forecasting solar energy; however, existing models often lack a clear relation to physics and are limited largely to global horizontal irradiance (GHI) forecasts over relatively short time horizons (< 1 hour). Incorporating physics into observation-based models, increasing forecast time horizons and developing a model system for forecasting not only GHI but also direct normal irradiance (DNI) and diffuse horizontal irradiance (DHI) remain challenging, especially under cloudy conditions because of complex cloud-radiation interactions. This work attempts to address these challenges by developing a hierarchy of four new physics-informed persistence models that can be used to simultaneously forecast GHI, DNI and DHI. The decade-long measurements (1998 to 2014) at the U.S. Department of Energy's Atmospheric Radiation Measurement (ARM)'s Southern Great Plains (SGP) Central Facility site are used to evaluate the performance of the new models. Overall, the results show that the new physics-informed forecast models generally outperform the simple and smart persistence models, and improve the forecast accuracy at lead times from 1.25 hours up to 6 hours. Further analysis reveals that the forecast error is highly related to the error and temporal variability of the assumed cloud predictor. The best model for forecasting different radiative components can be explained by the relationship between solar irradiances and cloud properties.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Impact of Measured Spectrum Variation on Solar Photovoltaic Efficiencies Worldwide

In photovoltaic power ratings, a single solar spectrum, AM1.5, is the de facto standard for record laboratory efficiencies, commercial module specifications, and performance ratios of solar power plants. More detailed energy analysis that accounts for local spectral irradiance, along with temperature and broadband irradiance, reduces forecast errors to expand the grid utility of solar energy. Here, ground-level measurements of spectral irradiance collected worldwide have been pooled to provide a sampling of geographic, seasonal, and diurnal variation. Applied to nine solar cell types, the resulting divergence in solar cell efficiencies illustrates that a single spectrum is insufficient for comparisons of cells with different spectral responses. Cells with two or more junctions tend to have efficiencies below that under the standard spectrum. Silicon exhibits the least spectral sensitivity: relative weekly site variation ranges from 1% in Lima, Peru to 14% in Edmonton, Canada.

energy yield↗
DOE OSTI2022

A Physics-Based DNI Model for Advancing Solar Resource Assessment and Forecasting: Preprint

Direct Normal Irradiance (DNI) is one of the most used quantities to quantify the magnitude of solar energy resource. The concept of DNI is often interpreted differently for ground measurements and solar forecasting by numerical weather prediction (NWP) models, leading to substantial bias during evaluation of DNI forecasts especially under cloudy-sky conditions. To eliminate the bias, we use the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI) to provide a physics-based solution of solar radiation in the circumsolar region. The FARMS-DNI is implemented in the Weather Research and Forecasting model with solar extensions (WRF-Solar) to forecast day-ahead DNI in the north America. By comparing with conventional predictions from WRF-Solar and satellite observations from the National Solar Radiation Data Base (NSRDB), we found significant improvements in our prediction of DNI.

DNI↗
DOE OSTI2023

Open Source Evaluation Framework for Solar Forecasting

The Solar Forecast Arbiter is an open-source evaluation framework for solar forecasting. The framework enables evaluations of solar irradiance, solar power, and net-load forecasts that are impartial, repeatable and auditable. The Solar Forecast Arbiter addresses stakeholder-informed use cases including evaluation of forecast skill, comparisons to reference data sets, private forecast trials, and evaluation of probabilistic forecast skill. The framework includes a data validation toolkit, reference data sources, data privacy protocols, and benchmark forecast capabilities for intra-hour and day ahead forecast horizons. Reports and metrics communicate the relative merits of the test and benchmark forecasts. The reports are created from standardized templates and include graphics for qualitatively evaluating deterministic and probabilistic forecasts and standard metrics for quantitatively evaluating forecasts. The Solar Forecast Arbiter is designed to support all solar forecasting stakeholders, including Solar Forecasting 2 Topic Area 2 and Topic Area 3 teams.

14 SOLAR ENERGY↗
DOE OSTI2023

Evaluating Recursive Blind Forecast Against API and Baseline: A Puerto Rican Case Study on Solar Irradiance for Normal and Extreme Weather

This paper leverages ongoing work in a community microgrid in Adjuntas, Puerto Rico to forecast global horizontal irradiance (GHI) and compare performance in normal and extreme weather. Given a positive correlation of 0.98 between GHI and PV power, forecasting GHI can be an effective, indirect forecast of photovoltaic (PV) power, especially in microgrids where the end-users, owners, operators, or other stakeholders are reluctant to share data for training or validation due to privacy and security concerns. A recursive one-shot (termed as "blind") forecast is, hence, formulated, wherein a gradient-boosted regression tree (GBR) is built to forecast GHI for a 7-day horizon in normal weather, and a 2-day horizon in extreme weather. To demonstrate its resilience, the architecture is trained on normal and hurricane weather GHI from 2002-2022. It is generalized on February 9-16, 2023, and on the landfall of Hurricane Nicole (Nov 4-5, 2022), respectively. Forecasts from GBR are compared against that from a satellite-based API resource and three baselines: persistence, averaging, and exponential smoothing. Results show GBR and persistence outperform sophisticated API in both types of weather for this case study.

Sundararajan, Aditya↗
NASA NTRS1993

Recent decreasing trend in the total solar irradiance - 1981-1992 spacecraft measurements

During 1990-1992, pyrheliometric measurements from the Earth Radiation Budget Satellite (ERBS) indicate that the total solar irradiance is decreasing at an annual rate of -0.2 Wm exp -2 with declining solar magnetic activity. Regression analyses of spacecraft irradiance measurements and of solar magnetic activity indices (10.7-cm solar radio flux and photometric sunspot index) verified the ERBS decreasing trend. The decreasing rate suggests that the irradiance should decrease 0.1 percent by 1997 when minimum solar magnetic activity is forecasted. If the forecasted 1990-1997 irradiance decrease is equal in magnitude to the magnitude of the 1986-1989 irradiance rise, one could conclude that solar irradiance variability has a strong 11-year component and no significant 22-year component. The ERBS measurements yielded 1365.4 +/- 0.7 Wm exp -2 as the mean irradiance value. In this paper, 1981-1992 spacecraft irradiance measurements are presented and compared with solar indices.

Lee, Robert B., III↗
DOE OSTI2022

Advanced Solar and Load Forecasting Incorporating HD Sky Imaging (Phase III)

Due to rapidly changing sky conditions, the available solar irradiance for energy generation is subject to wide swings in amplitude. As the market penetration of solar energy continues to increase rapidly, these variations in solar power generation are beginning to have an impact on grid stability and increased wear on power switches. Solar power forecasting plays a critical role in operations for Independent System Operators (ISOs) and utilities. Accurate forecasts help maintain grid reliability, optimize generation from renewables, and reduce operating costs. Of particular interest to the ISOs and utilities are sudden changes in solar irradiance, termed “ramp events,” due to the movement of clouds. One significant impact of ramp events on the grid is additional ancillary service requirements necessary to manage such variability. Ramp events can also cause voltage fluctuations in the distribution grids and trigger actions of automated line equipment (e.g., tap changers), leading to additional maintenance costs. In high penetration solar regions, forecasts must be made for both transmission-connected and distribution-connected resources – either behind the meter or in front of it. Particularly for distributed solar energy resources, forecasting can be a challenge due to the lack of visibility of the energy resource. Brookhaven National Laboratory (BNL) has been working towards nowcasting Global Horizontal Irradiance (GHI) using low-cost technologies for several years now. The Solar NowCasting technology being developed by BNL is a 0 – 30 min solar “nowcasting” technology applicable to a scale covering both large generating facilities and residential, distributed solar installations that relies on a network of ground-based high-definition (HD) cameras and surface pyranometers. GHI forecasts are being produced for both regions using 8 ground-based HD cameras and at least 2 surface pyranometers. When stitched together, the camera images can be used to forecast the impact of clouds on available solar irradiance over a domain of ~50 km 2 . Phase I of the project was the engineering scale up conceptual design stage. Phase II was the initial field test and demonstration, in which the technology was scaled up by a factor of 20 times and successfully demonstrated in eastern Long Island. In Phase III, an additional forecasting network was added in upstate NY and both networks are currently being operated until at least a full year of data is gathered by the Albany network to allow for the collection of sufficient data to evaluate performance against the persistence and smart persistence models using the Solar Arbiter.

14 SOLAR ENERGY↗