Finite-Surface Integration Algorithm for Improving the Forecast of Cloudy-Sky DNI
This presentation provides an overview of a finite-surface integration algorithm for forecasting cloudy-sky direct normal irradiance in the circumsolar region.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This presentation provides an overview of a finite-surface integration algorithm for forecasting cloudy-sky direct normal irradiance in the circumsolar region.
Fengyun-4A (FY-4A), which is the latest-generation Chinese geostationary meteorological satellite, measures solar reflection and thermal emission with high temporal, spatial, and spectral resolutions. It is expected to be highly beneficial for solar resource assessment and forecasting in China. This study is the first to estimate, using FY-4A and a random forest model, the global horizontal irradiance (GHI) at a 4-km–15-min spatio-temporal resolution over China, as a means to arrive at a solar photovoltaic (PV) resource map. In terms of GHI estimates, the root mean square error and mean bias error between hourly measured and retrieved values are 147.02 (35.2%), –5.64 W/m 2 (–1.4%), respectively, whereas the values of daily estimates are 29.20 (18.0%), –2.97 W/m 2 (–1.3%). The retrieval accuracy is found much better for instances with solar zenith angles smaller than 60°. Relatively larger errors are found at locations in the Sichuan Basin and northeastern China, which can be attributed to bright surfaces and/or strong cloud transients. With the retrieved irradiance, PV resource is derived through a physical model chain. The annual mean PV resource map suggests that, over most of the west areas, the annual mean effective irradiance exceeds 1700 kWh/m 2 , with the highest value found in Tibet (around 2000 kWh/m 2 per annum). Eastern China has an annual effective irradiance of only 1300–1500 kWh/m 2 . In conclusion, the region with poorest solar resource is the Sichuan Basin (less than 1100 kWh/m 2 per annum).
The integration of thermal energy storage into a concentrating solar power system allows for mitigating some of the risk associated with uncertain solar irradiance and uncertain energy prices. We solve a 48 h dispatch optimization model with continually updated conditional point forecasts of both direct normal irradiance (DNI) and electricity prices with a rolling-horizon scheme at hourly resolution over the course of a year. Joint, conditional forecasts for DNI and prices are formed using an autoregressive moving-average time series model with exogenous weather predictors. We guide dispatch using a mixed-integer programming model, but in order to evaluate performance we use the System Advisor Model (SAM) of the National Renewable Energy Laboratory. SAM is a techno-economic simulation model that accounts for plant thermodynamics with higher fidelity. Our conditional DNI forecasts improve annual revenue by 4%–12% over using historical forecasts based on data from previous years. Conditional price forecasts improve annual revenue by 6%–19% in the real-time market over analogous historical forecasts. Updating these forecasts every six hours, rather than every 24 h, further improves annual revenue by 5%–6%. Here, we also investigate a method that values terminal inventory in our dispatch optimization model, again when used in a rolling-horizon scheme.
Advanced building controls and energy optimization for new constructions and retrofits rely on accurate weather data. Traditionally, most studies utilize airport weather information as the decision inputs. However, most buildings are in environments that are quite different than those at the airport miles away. Tree cover, adjacent buildings, and micro-climate effects caused by the larger surrounding area can all yield deviations in air temperature, humidity, solar irradiance, and wind that are large enough to influence design and operation decisions. In order to overcome this challenge, there are many prior studies on developing weather forecasting algorithms from micro-to meso-scales. Additionally, this paper reviews and complies knowledge on common weather data resources, data processing methodologies and forecasting techniques of weather information. Commonly used statistical, machine learning and physical-based models are discussed and presented as two major categories: deterministic forecasting and probabilistic forecasting. Finally, evaluation metrics for forecasting errors are listed and discussed.
Emerging grid-interactive efficient buildings (GEBs) have great potential to provide much-needed demand flexibility to electric grids while fulfilling their own control targets by co-optimizing smart appliances, solar photovoltaics, electric vehicles, and energy storage at buildings. To enable the optimal operation of GEBs, site-specific weather information—such as temperature, solar irradiance, relative humidity, and wind speed—is crucial; however, this information is generally unavailable or expensive to obtain. This paper develops advanced machine learning methods to provide precise weather forecasts for individual building sites using readily available weather station data. Support vector regression and artificial neural networks have been employed to learn the spatiotemporal correlations between the weather conditions at nearby weather stations and the individual building site. The proposed site-specific weather forecasting methods have been validated using 1-year actual weather measurement data collected in the Denver metro area. Results show that the developed machine-learning-driven methods can accurately forecast the temperature at the target building site 1 hour ahead with mean absolute error less than 0.72°C and a 48% improvement over the persistence method. Site-specific weather forecasts will improve the understanding of the microclimate effect and its impact on building energy consumption. This information will drive efficiency upgrades and adjustments of building control strategies to improve energy savings and increase flexibility in building loads.
We examine the impact of atmospheric aerosols and clouds on the surface solar radiation and solar energy at Nainital, a high-altitude remote location in the central Gangetic Himalayan region (CGHR). For this purpose, we exploited the synergy of remote-sensed data in terms of ground-based AERONET Sun Photometer and satellite observations from the MODerate Resolution Imaging Spectroradiometer (MODIS) and the Meteosat Second Generation (MSG), with radiative transfer model (RTM) simulations and 1 day forecasts from the Copernicus Atmosphere Monitoring Service (CAMS). Clouds and aerosols are one of the most common sources of solar irradiance attenuation and hence causing performance issues in the photovoltaic (PV) and concentrated solar power (CSP) plant installations. The outputs of RTM results presented with high accuracy under clear, cloudy sky and dust conditions for global horizontal (GHI) and beam horizontal irradiance (BHI). On an annual basis the total aerosol attenuation was found to be up to 105 kWh m –2 for the GHI and 266 kWh m –2 for BHI, respectively, while the cloud effect is much stronger with an attenuation of 245 and 271 kWh m –2 on GHI and BHI. The results of this study will support the Indian solar energy producers and electricity handling entities in order to quantify the energy and financial losses due to cloud and aerosol presence.
Geomagnetic activity is often described using summary indices to summarize the likelihood of space weather impacts, as well as when parameterizing space weather models. The geomagnetic index K p in particular, is widely used for these purposes. Current state-of-the-art forecast models provide deterministic K p predictions using a variety of methods – including empirically-derived functions, physics-based models, and neural networks – but do not provide uncertainty estimates associated with the forecast. This paper provides a sample methodology to generate a 3-hour-ahead K p prediction with uncertainty bounds and from this provide a probabilistic geomagnetic storm forecast. Specifically, we have used a two-layered architecture to separately predict storm (K p ≥ 5 – ) and non-storm cases. As solar wind-driven models are limited in their ability to predict the onset of transient-driven activity we also introduce a model variant using solar X-ray flux to assess whether simple models including proxies for solar activity can improve the predictions of geomagnetic storm activity with lead times longer than the L1-to-Earth propagation time. By comparing the performance of these models we show that including operationally-available information about solar irradiance enhances the ability of predictive models to capture the onset of geomagnetic storms and that this can be achieved while also enabling probabilistic forecasts.
Multiple publicly available software packages exist that analyze solar time series data, including RdTools and Solar Data Tools, among others. Several of these packages contain their own unique quality assurance (QA) and feature recognition algorithms. The python PVAnalytics package was developed to offer an internally consistent source for these analysis tools, making it easier for the end user to deploy these routines on his or her solar data. The PVAnalytics package currently contains routines for outlier detection, inverter clipping detection, irradiance and temperature checks, orientation checks, and data shift detection, among other functions. These functions have been aggregated from various sources including Solar Forecast Arbiter, RdTools, and the QA process developed by NREL's PV Fleets Initiative. We are continuously adding new functionality to the package, including documentation, examples and algorithms. By bundling QA functionality into a single software package, we hope to make PVAnalytics a comprehensive software library to support analysis of solar metadata and time series data.
Concentrating solar power (CSP) technologies can utilize heat from concentrated sunlight from a field of tracking mirrors to generate electricity, reform fuel, provide process heat, or augment fossil plant heat sources. Electricity-generating power tower systems focus light from thousands of independent heliostats onto a thermal receiver, which uses the focused light to warm a heat transfer fluid (HTF), typically, a molten nitrate salt. The HTF is then sent to a power generation cycle or diverted into thermal energy storage (TES) for later use. Thermal storage is – in principle – a straightforward proposition. However, optimal utilization of a TES resource is complex and multi-faceted: thermal energy may be dispatched to produce electricity immediately upon first availability, or thermal energy may be reserved for next-day peak periods at risk of filling storage and dumping energy, or a portion of the thermal energy can be reserved to maintain equipment temperatures, reducing power cycle startup time, etc. Many possible dispatch permutations variously emphasize producing peak power, operating through transients, expediting daily startup, etc. The best operation strategy can change day-to-day throughout the year, depending on the weather and market pricing forecasts. The project we describe in this report develops a software package that allows users to explore design optimization, operations decisions, and performance characterization of concentrating solar power tower plants. Users interface with the tool through a scripting language, and results are reported in time series tables, plots, runtime logs, and design outputs. Users choose from a list of variables such as tower height, solar multiple, design-point irradiance, thermal storage size, etc., and specify information about the system using a list of parameters. The software can then optimize the specified variables to reduce the cost of energy produced by the system while meeting certain production requirements, accounting for uncertain weather and electricity price forecasts, and correcting for equipment failures or repair time. The software we develop is the first comprehensive design tool of its kind to incorporate all of these aspects while being deployed as open source.
The Long Island Solar Farm (LISF) is a 32-megawatt solar photovoltaic power plant built through a collaboration including BP Solar, the Long Island Power Authority (LIPA), and the U.S. Department of Energy (DOE). The LISF, located on the Brookhaven National Laboratory site, began delivering power to the LIPA grid in November 2011, and is currently one of the largest solar photovoltaic power plants in the eastern United States. It is generating enough renewable energy to power approximately 4,500 homes and is helping New York State meet its clean energy and carbon reduction goals. Brookhaven National Laboratory (BN)L has the LISF instrumented and is capturing solar insolation and power data that can be used for research purposes. Additional information on LISF is available here: https://www.bnl.gov/lisf/. A network of nine high-definition (HD cameras) and 32 pyranometers are deployed within the LISF for the purpose of monitoring the location and characteristics of clouds and available global horizontal irradiance at the surface across the region. Information collected by this network every 30 s is currently used in BNL’s solar NowCasting algorithm, which forecasts near-term solar energy availability accounting for the behavior of clouds. The most important parameters for forecasting the near-term solar energy availability are accurate estimations of their horizontal extend, horizontal motion, and cloud base height. Currently, images from nearly located cameras are used to estimate the cloud base height. In order to evaluate the potential of this method for estimating the cloud base height, we decided to deploy a Vaisala ceilometer at the LISF.
Radiative transfer models require vast computing resources to solve cloud transmittance and reflectance from the radiative transfer equation. As a result, models offering precise simulation in operations often acquire individual cloud transmittance or reflectance from a lookup table precomputed for practicable scenarios. To further expedite the computation of global horizontal irradiance and to reduce the storage requirements, the Fast All-sky Radiation Model for Solar applications (FARMS) parameterized the lookup table using elementary functions with specified coefficients. This study extends FARMS direct normal irradiance (DNI) computation by utilizing hyperbolic tangent functions and various polynomial functions to parameterize the cloud transmittance for scattered solar radiation in the circumsolar region. The parameterization is implemented in FARMS with DNI (FARMS-DNI) and accounts for the circumsolar radiation when assessing or forecasting DNI. The evaluation, with long-term observations at the National Renewable Energy Laboratory's, Solar Radiation Research Laboratory, and the Atmospheric Radiation Measurement, Southern Great Plains, Central Facility, shows that the parameterized DNIs are virtually identical with those computed by coupling FARMS-DNI to a lookup table of cloud transmittance. This parameterization has diverse applications in radiative transfer models and numerical weather prediction models used to assess or forecast direct solar radiation.
Solar forecasting is shifting to the probabilistic paradigm due to the inherent uncertainty within the solar resource. Input uncertainty quantification is one of the widely used and best-performing ways to model solar uncertainty. However, compared to other sources of inputs, such as numerical weather prediction models, pure sky image-based probabilistic solar forecasting lags behind. In this research, an occlusion-perturbed convolutional neural network, named the PSolarNet, is developed. The PSolarNet provides very short-term deterministic forecasts, forecast scenarios, and probabilistic forecasts of the global horizontal irradiance from sky image sequences. Case studies based on 6 years of open-source data show that the developed PSolarNet is able to generate accurate 10-minute ahead deterministic forecasts with a 5.62% normalized root mean square error, realistic and diverse forecast scenarios with a 0.966 average correlation with the actual time series, and reliable and sharp probabilistic forecasts with a 2.77% normalized continuous ranked probability score.
Solar forecasting is shifting to the probabilistic paradigm due to the inherent uncertainty within the solar resource. Input uncertainty quantification is one of the widely used and best-performing ways to model solar uncertainty. However, compared to other sources of inputs, such as numerical weather prediction models, pure sky image-based probabilistic solar forecasting lags behind. In this research, an occlusion-perturbed convolutional neural network, named the PSolarNet, is developed. The PSolarNet provides very short-term deterministic forecasts, forecast scenarios, and probabilistic forecasts of the global horizontal irradiance from sky image sequences. Case studies based on 6 years of open-source data show that the developed PSolarNet is able to generate accurate 10-minute ahead deterministic forecasts with a 5.62% normalized root mean square error, realistic and diverse forecast scenarios with a 0.966 average correlation with the actual time series, and reliable and sharp probabilistic forecasts with a 2.77% normalized continuous ranked probability score.
The National Solar Radiation Database (NSRDB) is an extensively used dataset that furnishes satellite-retrieved solar resource data across the United States and an expanding list of other countries. Although the NSRDB uses a physical model to compute global horizontal irradiance (GHI), it currently employs an empirical approach based on surface observations to estimate cloudy-sky direct normal irradiance (DNI). Recently, a new physics-based approach, known as the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI), was developed to improve DNI forecasting. FARMS-DNI integrates direct and scattered solar radiances within the circumsolar region, resulting in improved day-ahead forecasting of DNI by incorporating it into the Weather Research and Forecasting model with Solar extensions (WRF-Solar). This study incorporates FARMS-DNI into the NSRDB algorithm to produce high-spatiotemporal-resolution DNI data from satellite data. The accuracy of the NSRDB based on FARMS-DNI is analyzed using surface observations from 19 sites situated within the National Oceanic and Atmospheric Administration (NOAA) Surface Radiation Budget (SURFRAD) and Solar Radiation (SOLRAD) networks, the University of Oregon (UO) network, the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) network, and at the National Renewable Energy Laboratory (NREL). The results demonstrate that FARMS-DNI reduces the significant overestimation of DNI in the conventional NSRDB at all surface sites, particularly in cloud overcast conditions classified using both satellite retrievals and surface observations. Consequently, this new model can effectively improve the overall accuracy of the NSRDB. The results also suggest that further improvement of DNI estimates at individual time steps, however, requires advanced satellite techniques and precise identification of clouds and retrieval of cloud properties.
Forecasting load at the feeder level has become increasingly challenging with the penetration of behind-the-meter solar, as this self-generation is only visible to the utility as aggregated net-load. This work proposes a methodology for creation of scenarios of solar penetration at the feeder level for use by forecasters to test the robustness of their algorithm to progressively higher penetrations of solar. The algorithm draws on publicly available observations of weather condition (e.g., rainy/cloudy/fair) for use as proxies to sky clearness. These observations are used to mask and weight the interval deviations of similar native usage profiles from which average interval usage is calculated and subsequently added to interval net generation to reconstruct interval total generation. This approach improves the estimate of annual energy generation by 23%; where the net generation signal currently reflects 52% of total annual gener- ation, now 75% is captured. This methodology for creation of forecast testing scenarios is data driven and extensible to service territories which lack information on irradiance measurements and geocoordinates.
GET-Solar (Generation forecasting and parameter Estimation Tool for Solar) can be used to estimate behind the meter (BTM) solar generation from limited datasets. Using distributed sets of diverse solar sites, but with close spatial proximity, and/or limited historical PV generation information can be used to generate of solar profiles. This is useful for applications where partial solar generation data is available, and on-site irradiance data is not available. GET-Solar calculates PV technical data parameters and calculates output by modeling shading and cloud cover impacts. Clear sky irradiance profiles are used to calculate base generation profiles on which the local shading and cloud cover layers are added. In order to arrive at clear sky generation data, PV mounting information like panel tilt and and angle is needed. For cases where PV mounting information is missing, panel tilt and azimuth angle can be estimated using a non-linear optimization algorithm. GET-Solar can also be used for forecasting applications where historical PV data is available to estimate local shading at various solar positions. This overall framework can be used for estimation of solar parameters, and assisting in analyzing and modeling diverse sets of DER where solar generation is also present in utility meter data. GET-Solar has been developed in Python and uses the Pyomo optimization language.
The National Solar Radiation Database (NSRDB) is a widely used resource providing satellite-derived solar data across the United States and globally. While the NSRDB employs a physical model for computing global horizontal irradiance (GHI), its current method for estimating cloudy-sky direct normal irradiance (DNI) relies on surface observations and empirical models. Recently, a novel physics-based approach, the Fast All-Sky Radiation Model for Solar applications with DNI (FARMS-DNI), was developed to enhance the DNI forecasting. FARMS-DNI incorporates both direct and scattered solar radiation within the circumsolar region, resulting in improved day-ahead DNI predictions when integrated into the Weather Research and Forecasting model with Solar extensions (WRF-Solar). This study integrates FARMS-DNI into the NSRDB algorithm to generate high-resolution DNI data from satellite resources. Our findings reveal that FARMS-DNI effectively mitigates the substantial DNI overestimation present in the conventional NSRDB across surface sites, particularly in conditions categorized as cloudy overcast. Consequently, this innovative model substantially enhances the overall accuracy of the NSRDB.
The National Solar Radiation Database (NSRDB) is a widely used resource providing satellite-derived solar data across the United States and globally. While the NSRDB employs a physical model for computing global horizontal irradiance (GHI), its current method for estimating cloudy-sky direct normal irradiance (DNI) relies on surface observations and empirical models. Recently, a novel physics-based approach, the Fast All-Sky Radiation Model for Solar applications with DNI (FARMS-DNI), was developed to enhance the DNI forecasting. FARMS-DNI incorporates both direct and scattered solar radiation within the circumsolar region, resulting in improved day-ahead DNI predictions when integrated into the Weather Research and Forecasting model with Solar extensions (WRF-Solar). This study integrates FARMS-DNI into the NSRDB algorithm to generate high-resolution DNI data from satellite resources. Our findings reveal that FARMS-DNI effectively mitigates the substantial DNI overestimation present in the conventional NSRDB across surface sites, particularly in conditions categorized as cloudy overcast. Consequently, this innovative model substantially enhances the overall accuracy of the NSRDB.