The influence of cloud cover on the reliability of satellite-based solar resource data
Explore the source record for details and available documents.
54 ENVIRONMENTAL SCIENCES↗
Engineering topics
Xie, Yu
Publications and source records attributed to Xie, Yu.
Use of physics to improve solar forecast: Part Ⅲ, impacts of different cloud types
Explore the source record for details and available documents.
54 ENVIRONMENTAL SCIENCES↗
Use of physics to improve solar forecast: Part III, impacts of different cloud types
Cloud-type impacts present a great challenge to solar forecasting due to diverse and complex cloud-radiation interactions. This third part of our paper sequence seeks to address this challenge by quantifying the forecast accuracies under eight cloud types: cumulus (Cu), stratified clouds (St), altocumulus (Ac), altostratus (As), cirrostratus/anvil (Cr), cirrus (Ci), congestus (Co), deep convective clouds (Dc) across four physics-informed persistence models reported in Part I. To generalize the cloud impacts, the eight cloud types are further grouped into three cloud categories based on their common features: weak convective clouds, stratiform clouds, and strong convective clouds. Here, the decade-long (2001 ~ 2014) collocated measurements of irradiances and cloud types at the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Program South Great Plain (SGP) Central Facility site are used for model evaluation. Results reveal a clear performance hierarchy for global horizontal irradiance (GHI) and direct normal irradiance (DNI): best for weak convective clouds and cirrus, intermediate for stratiform clouds, and worst for strong convective clouds. Performance for diffuse horizontal irradiance (DHI) is less influenced by cloud types. Cloud albedo dominates all three irradiances for Dc, while both cloud albedo and cloud fraction are influential for other cloud types. A 12 %~33 % improvement in accuracy at 6-hour lead time compared to the benchmark smart model confirms the effectiveness of incorporating physics into the models for various cloud types; further improvements are expected by directly integrating cloud type information into forecasting models by modifying the physical formulation of cloud-radiation interaction, and/or using more advanced machine learning models.
14 SOLAR ENERGY↗
Measured Long-Term Solar Irradiance for Climate Studies
Solar radiation is primarily measured using high-quality radiometers (e.g., pyranometers and pyrheliometers). These instruments need to be calibrated regularly (every two years at a minimum). They are also susceptible to various sources of uncertainties. Therefore, rigorous data quality assessment is required to obtain high-confidence data from these radiometers. This is especially true when the data is used to understand climatic trends and/or extreme weather events. In this study, we attempted to create a continuous and reliable dataset by correcting the underlying data which we believe contains bias due to reference pyranometers swap procedures. These biases can be significant which can be up to two percentage points thereby influencing the interpretation of climate changes and/or extreme events. This study elaborates on the biases and methods to correct those biases.
data integrity↗
Bias Correction and Statistical Downscaling of Future Solar Irradiance Projections Using the NSRDB
Assessing renewable energy resources under future climate scenarios has been highlighted to understand potential impacts of future climate change in renewable generation on the power sector. Climate model projection has been recognized by the renewable energy community as a useful data set to analyze the impacts of future climate change on renewable resources. However, future climate projections generated from general circulation models (GCMs) contain inherent biases that need to be corrected for accurate analysis of future projections of climate variables. In addition, the coarse spatiotemporal resolution of GCMs needs to be improved for regional climate studies. In this work, we develop statistical methods to downscale future projections of global horizontal irradiance (GHI) in a computationally efficient way. Our approach builds statistical downscaling models that correct bias of climate projection of GHI and downscale the future GHI projection from daily-scale to hourly-scale. The National Solar Radiation Database (NSRDB) is used to calibrate the statistical models and validate the downscaled GHI projections across the contiguous United State (CONUS). Preliminary results show that the statistical approach efficiently downscales climate projections of GHI with a nBIAS of 3%, nMAE of 34 % and nRMSE of 46% calculated against NSRDB for CONUS. This study describes the implemented methodology and initial results as well as future research to create high-resolution climate data sets for solar energy applications.
analytical models↗
The National Climate Database (NCDB): An Unbiased 100-Year Dataset for PV Modeling
In this study, we develop a statistical technique to downscale the future projection of solar irradiance for photovoltaics (PV) energy-related applications. A set of Regional Climate Model (RCM)-based projections obtained from the North American Coordinated Regional Climate Downscaling Experiment (NA-CORDEX) are used as inputs to statistical methods to generate high-resolution global horizontal irradiance (GHI) over the contiguous United States (CONUS). The main steps of the statistical downscaling method include (1) regridding RCM output (0.22 degree and daily resolutions) to handle the modeled-observed data sets on a common grid, (2) correcting bias of RCM GHI using satellite-derived observation, and (3) implementing temporal and spatial downscaling to generate GHI at 8-km and hourly resolution. Basically, complex physical processes and interactions between solar radiation and various atmospheric constituents lead solar irradiance to be highly variable and uncertain. Underrepresentation of clouds from the RCM parameterizations is the main source of error and uncertainty in modeling solar irradiance. Thus, we adapt and use the high-quality satellite-derived data from the National Solar Radiation Database (NSRDB) to analyze the bias and error of RCM GHI as well as estimate the statistical parameters for spatial and temporal downscaling. This presentation will summarize the comprehensive analysis conducted to produce and assess the results under two climate scenarios (RCP4.5 and RCP8.5). We will also present a detailed validation demonstrating the strengths of the downscaling method, a summary of the 100-year dataset from 2001-2100, and future extension of this research.
bias correction↗
The influence of cloud cover on the reliability of satellite-based solar resource data
Satellite-based solar resource data are often developed and validated by using binary cloudiness categories: clear sky or overcast cloudy sky. To investigate the reliability of solar resource data in partially cloudy conditions, we estimate cloud fraction using two distinct algorithms: a physical retrieval model using surface observed global horizontal irradiance (GHI) and direct normal irradiance (DNI) and a temporal average of cloud mask data estimated by the observed DNI. Our analysis reveals a significant presence of scattered clouds, broken clouds, and mismatches between satellite- and surface-based cloud data at 17 surface sites across the contiguous United States, though confidently clear and cloudy conditions collectively account for more than 70 % of the data. Solar radiation is computed using the National Solar Radiation Database (NSRDB) algorithm and validated using surface observations. Here, our findings suggest that, in the presence of scattered clouds, NSRDB data for clear-sky conditions can be subject to significant overestimation. In cloudy-sky conditions classified by satellite data, DNI computed by the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI) can be underestimated when limited clouds are detected by surface observations. The bias observed in several cloudiness categories indicates that the NSRDB is exceptionally accurate in confidently clear conditions. However, clear-sky conditions with scattered clouds and mismatched cloud data contribute significantly to the overall uncertainties in the NSRDB. Therefore, future improvements in solar resource data should involve development and implementation of satellite-derived cloud fraction and should consider a novel radiative transfer model accounting for amplified cloud reflection. The evaluation within cloudiness categories also provides a physical rationale for the superior performance of FARMS-DNI compared to the Direct Insolation Simulation Code (DISC) in both cloudy-sky and all-sky conditions.
14 SOLAR ENERGY↗
National Climate Database (NCDB)
The National Climate Database (NCDB) is a high resolution, bias-corrected climate dataset consisting of the three most widely used variables of solar radiation- global horizontal (GHI), direct normal (DNI), and diffuse horizontal irradiance (DHI)- as well as other meteorological data. The goal of the NCDB is to provide unbiased high temporal and spatial resolution climate data needed for renewable energy modeling. The NCDB is modeled using a statistical downscaling approach with Regional Climate Model (RCM)-based climate projections obtained from the North American Coordinated Regional Climate Downscaling Experiment (NA-CORDEX; linked below). Daily climate projections simulated by the Canadian Regional Climate Model 4 (CanRCM4) forced by the second-generation Canadian Earth System Model (CanESM2) for two Representative Concentration Pathways (RCP4.5 or moderate emissions scenario and RCP8.5 or highest baseline emission scenario) are selected as inputs to the statistical downscaling models. The National Solar Radiation Database (NSRDB) is used to build and calibrate statistical models.
Array↗
Improving the National Solar Radiation Database (NSRDB) Using a Physics-Based Direct Normal Irradiance (DNI) Model: Preprint
The National Solar Radiation Database (NSRDB) is a widely used resource providing satellite-derived solar data across the United States and globally. While the NSRDB employs a physical model for computing global horizontal irradiance (GHI), its current method for estimating cloudy-sky direct normal irradiance (DNI) relies on surface observations and empirical models. Recently, a novel physics-based approach, the Fast All-Sky Radiation Model for Solar applications with DNI (FARMS-DNI), was developed to enhance the DNI forecasting. FARMS-DNI incorporates both direct and scattered solar radiation within the circumsolar region, resulting in improved day-ahead DNI predictions when integrated into the Weather Research and Forecasting model with Solar extensions (WRF-Solar). This study integrates FARMS-DNI into the NSRDB algorithm to generate high-resolution DNI data from satellite resources. Our findings reveal that FARMS-DNI effectively mitigates the substantial DNI overestimation present in the conventional NSRDB across surface sites, particularly in conditions categorized as cloudy overcast. Consequently, this innovative model substantially enhances the overall accuracy of the NSRDB.
DNI↗
Improving the National Solar Radiation Database (NSRDB) Using a Physics-Based Direct Normal Irradiance (DNI) Model
The National Solar Radiation Database (NSRDB) is a widely used resource providing satellite-derived solar data across the United States and globally. While the NSRDB employs a physical model for computing global horizontal irradiance (GHI), its current method for estimating cloudy-sky direct normal irradiance (DNI) relies on surface observations and empirical models. Recently, a novel physics-based approach, the Fast All-Sky Radiation Model for Solar applications with DNI (FARMS-DNI), was developed to enhance the DNI forecasting. FARMS-DNI incorporates both direct and scattered solar radiation within the circumsolar region, resulting in improved day-ahead DNI predictions when integrated into the Weather Research and Forecasting model with Solar extensions (WRF-Solar). This study integrates FARMS-DNI into the NSRDB algorithm to generate high-resolution DNI data from satellite resources. Our findings reveal that FARMS-DNI effectively mitigates the substantial DNI overestimation present in the conventional NSRDB across surface sites, particularly in conditions categorized as cloudy overcast. Consequently, this innovative model substantially enhances the overall accuracy of the NSRDB.
Xie, Yu↗
Statistical Downscaling of Climate Models for Solar Resource Assessment
This study presents the development of statistical models to efficiently downscale future projections of solar irradiance for solar energy applications. A climate data set simulated from a Regional Climate Model (RCM) obtained from the North American Coordinated Regional Climate Downscaling Experiment (NA-CORDEX) is selected as input to the statistical models to create high-resolution global horizontal irradiance (GHI) over the contiguous United States (CONUS). Our approach builds statistical downscaling models that (1) regrid RCM data (0.22 degree and daily spatiotemporal resolution), (2) correct bias of GHI projections, (3) downscale the future GHI project from daily-scale to hourly-scale, and (4) spatially downscale to generate GHI at 8-km resolution. To calibrate and validate the statistical models, we adapt and use the National Solar Radiation Database (NSRDB). Preliminary results show that the statistical downscaling approach downscales future projections of GHI under two climate scenarios (RCP4.5 and RCP8.5) with a nBIAS of 3%, nMAE of 34% and nRMSE of 46% estimated against NSRDB for the contiguous United State. This presentation will summarize the implemented methodology and validation results as well as future extension of this research.
climate data↗
Bias Correction and Statistical Downscaling of Solar Radiation Using NA-CORDEX and the NSRDB
The current state-of-art for estimating long-term PV production uses long-term estimates of solar radiation variables, such as global horizontal irradiance (GHI), from previous years. This data is used in models such as the System Advisor Model (SAM) or PYSyst to predict annual production for a PV plant. This information is then used to estimate the production over the next 20 years (a typical plant lifetime) under the assumption that the variability over the current period is representative of the future. As the PV industry moves to extend plant lifetimes to 50 years the current assumptions of representativeness of weather may not be appropriate. This is especially true as our climate changes rapidly. To assess long-term PV production, future projections for solar radiation based on projected carbon emissions are readily available in regional and global climate models. However, climate model projections contain inherent biases that may need to be corrected for accurate analysis of future projections of climate variables. Several studies have analyzed projections of solar radiation for future years, however the accuracy of the model output compared to current and historic data has not been widely studied. Chen (2021) showed that available climate models do not accurately represent solar radiation in some cases, over-projecting GHI at the surface while under-projecting its obstructions, such as clouds and aerosols. This works aims to (1) increase understanding of the accuracy of solar radiation currently available in global and regional climate models and (2) implement bias correction through linear models based on reanalysis data compared to observed solar radiation. The latter aim will be conducted using available observed solar radiation data and modeled data from several regional climate models (RCMs). The bias correction method will be applied to projections of solar radiation resulting in a more accurate representation of the future of solar production.
climate data↗
The National Climate Data Base (NCDB): A Bias-Corrected High-Resolution Climate Dataset
Assessing renewable energy resources under future climate scenarios has been highlighted in recent years to analyze and understand potential impacts of future change in renewable generation on the power sector. Solar energy is well-known as the most plentiful among various renewable resources and usually converted to electricity using photovoltaics (PV) technologies, and the global deployment of PV technology has increased rapidly in recent decades. In this study, we develop a statistical technique to downscale the future projection of solar irradiance for PV energy-related applications. A set of Regional Climate Model (RCM)-based projections obtained from the North American Coordinated Regional Climate Downscaling Experiment (NA-CORDEX) are used as inputs to statistical methods to generate high-resolution global horizontal irradiance (GHI) over the contiguous United States (CONUS). The main steps of the statistical downscaling method include (1) regridding RCM output (0.22 degree and daily resolutions) to handle the modeled-observed data sets on a common grid, (2) correcting bias of RCM GHI using satellite-derived observation, and (3) implementing temporal and spatial downscaling to generate GHI at 8-km and hourly resolution. Basically, complex physical processes and interactions between solar radiation and various atmospheric constituents lead solar irradiance to be highly variable and uncertain. Underrepresentation of clouds from the RCM parameterizations is the main source of error and uncertainty in modeling solar irradiance. Thus, we adapt and use the high-quality satellite-derived data from the National Solar Radiation Database (NSRDB) to analyze the bias and error of RCM GHI as well as estimate the statistical parameters for spatial and temporal downscaling. This presentation will summarize the comprehensive analysis conducted to produce and assess the results under two climate scenarios (RCP4.5 and RCP8.5). We will also present a detailed validation demonstrating the strengths of the proposed downscaling method and future extension of this research.
climate data↗
Low-index mesoscopic surface reconstructions of Au surfaces using Bayesian force fields
Metal surfaces have long been known to reconstruct, significantly influencing their structural and catalytic properties. Many key mechanistic aspects of these subtle transformations remain poorly understood due to limitations of previous simulation approaches. Using active learning of Bayesian machine-learned force fields trained from ab initio calculations, we enable large-scale molecular dynamics simulations to describe the thermodynamics and time evolution of the low-index mesoscopic surface reconstructions of Au (e.g., the Au(111)-‘Herringbone,’ Au(110)-(1 × 2)-‘Missing-Row,’ and Au(100)-‘Quasi-Hexagonal’ reconstructions). This capability yields direct atomistic understanding of the dynamic emergence of these surface states from their initial facets, providing previously inaccessible information such as nucleation kinetics and a complete mechanistic interpretation of reconstruction under the effects of strain and local deviations from the original stoichiometry. We successfully reproduce previous experimental observations of reconstructions on pristine surfaces and provide quantitative predictions of the emergence of spinodal decomposition and localized reconstruction in response to strain at non-ideal stoichiometries. A unified mechanistic explanation is presented of the kinetic and thermodynamic factors driving surface reconstruction. Furthermore, we study surface reconstructions on Au nanoparticles, where characteristic (111) and (100) reconstructions spontaneously appear on a variety of high-symmetry particle morphologies.
36 MATERIALS SCIENCE↗
Influences of Cloud Microphysics on the Components of Solar Irradiance in the WRF-Solar Model
An accurate forecast of Global Horizontal solar Irradiance (GHI) and Direct Normal Irradiance (DNI) in cloudy conditions remains a major challenge in the solar energy industry. This study focuses on the impact of cloud microphysics on GHI and its partition into DNI and Diffuse Horizontal Irradiance (DHI) using the Weather Research and Forecasting model specifically designed for solar radiation applications (WRF-Solar) and seven microphysical schemes. Three stratocumulus (Sc) and five shallow cumulus (Cu) cases are simulated and evaluated against measurements at the US Department of Energy’s Atmospheric Radiation Measurement (ARM) user facility, Southern Great Plains (SGP) site. Results show that different microphysical schemes lead to spreads in simulated solar irradiance components up to 75% and 350% from their ensemble means in the Cu and Sc cases, respectively. The Cu cases have smaller microphysical sensitivity due to a limited cloud fraction and smaller domain-averaged cloud water mixing ratio compared to Sc cases. Cloud properties also influence the partition of GHI into DNI and DHI, and the model simulates better GHI than DNI and DHI due to a non-physical error compensation between DNI and DHI. The microphysical schemes that produce more accurate liquid water paths and effective radii of cloud droplets have a better overall performance.
54 ENVIRONMENTAL SCIENCES↗
Forecasting Day-Ahead Solar Irradiance for Puerto Rico Using the WRF Model and NSRDB
Accurately predicting solar energy resources is a major challenge in integrating photovoltaics generation on the electric grid. Numerical weather prediction has been recognized by the solar energy community as a major approach to provide solar resource forecasts at various locations and for a variety of timescales. In this study, as a part of the Puerto Rico Grid Resilience and Transitions to 100% Renewable Energy Study (PR100), we develop day-head solar irradiance forecast data using the Weather Research and Forecasting (WRF) model at 3 km and hourly/5-minute. The global horizontal irradiance (GHI) and direct normal irradiance (DNI) forecasts simulated from the WRF model are postprocessed by a simple optimization method using satellite-derived gridded observations from the National Solar Radiation Data Base (NSRDB) to reduce error and bias of the solar irradiance forecasts covering 2018-2020. The NSRDB contributes to improving the GHI and DNI forecasts and also offers the opportunity for an in-depth analysis to evaluate their accuracy over a wide range of Puerto Rico regions. Preliminary results show overall improvements of GHI forecasts up to 37% (DNI: 15%) for mean absolute error and 97% (DNI: 76%) for mean bias error by applying a postprocessing technique to WRF model output.
data models↗
What's New in the NSRDB
The National Solar Radiation Database (NSRDB) provides solar resource data across the globe at a high temporal and spatial resolution. This data is primarily used in solar energy modeling. The NSRDB is updated annually for the United States and North, Central and South America and the data is currently available from 1998-2021. In 2022 the NSRDB was updated using the latest version of the underlying Physical Solar Model (PSM). This update includes improved surface albedo and gap-filling of cloud properties. The inclusion of these updates reduced the uncertainty in the data compared to previous versions of the NSRDB. The Himawari and Meteosat Indian Ocean Data Coverage (IODC) satellites were added to the Geostationary Operational Environmental Satellite (GOES) and made our coverage global. While standard data from the GOES continues to be served at an hourly 4km x 4km resolution, full resolution data has also been made available to the user. The NSRDB now contains over 200Tb of data with nearly 40Tb being added annually. We provide significant flexibility for data download depending on the amount of data required by the users. In this paper we provide an update on the current status on the NSRDB.
photovoltaic systems↗