Adapting quantile mapping to bias correct solar radiation data
Not Available
Engineering topics
Publications and source records attributed to Sengupta, Manajit.
Not Available
Explore the source record for details and available documents.
Explore the source record for details and available documents.
Cloud-type impacts present a great challenge to solar forecasting due to diverse and complex cloud-radiation interactions. This third part of our paper sequence seeks to address this challenge by quantifying the forecast accuracies under eight cloud types: cumulus (Cu), stratified clouds (St), altocumulus (Ac), altostratus (As), cirrostratus/anvil (Cr), cirrus (Ci), congestus (Co), deep convective clouds (Dc) across four physics-informed persistence models reported in Part I. To generalize the cloud impacts, the eight cloud types are further grouped into three cloud categories based on their common features: weak convective clouds, stratiform clouds, and strong convective clouds. Here, the decade-long (2001 ~ 2014) collocated measurements of irradiances and cloud types at the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) Program South Great Plain (SGP) Central Facility site are used for model evaluation. Results reveal a clear performance hierarchy for global horizontal irradiance (GHI) and direct normal irradiance (DNI): best for weak convective clouds and cirrus, intermediate for stratiform clouds, and worst for strong convective clouds. Performance for diffuse horizontal irradiance (DHI) is less influenced by cloud types. Cloud albedo dominates all three irradiances for Dc, while both cloud albedo and cloud fraction are influential for other cloud types. A 12 %~33 % improvement in accuracy at 6-hour lead time compared to the benchmark smart model confirms the effectiveness of incorporating physics into the models for various cloud types; further improvements are expected by directly integrating cloud type information into forecasting models by modifying the physical formulation of cloud-radiation interaction, and/or using more advanced machine learning models.
Satellite-based solar resource data are often developed and validated by using binary cloudiness categories: clear sky or overcast cloudy sky. To investigate the reliability of solar resource data in partially cloudy conditions, we estimate cloud fraction using two distinct algorithms: a physical retrieval model using surface observed global horizontal irradiance (GHI) and direct normal irradiance (DNI) and a temporal average of cloud mask data estimated by the observed DNI. Our analysis reveals a significant presence of scattered clouds, broken clouds, and mismatches between satellite- and surface-based cloud data at 17 surface sites across the contiguous United States, though confidently clear and cloudy conditions collectively account for more than 70 % of the data. Solar radiation is computed using the National Solar Radiation Database (NSRDB) algorithm and validated using surface observations. Here, our findings suggest that, in the presence of scattered clouds, NSRDB data for clear-sky conditions can be subject to significant overestimation. In cloudy-sky conditions classified by satellite data, DNI computed by the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI) can be underestimated when limited clouds are detected by surface observations. The bias observed in several cloudiness categories indicates that the NSRDB is exceptionally accurate in confidently clear conditions. However, clear-sky conditions with scattered clouds and mismatched cloud data contribute significantly to the overall uncertainties in the NSRDB. Therefore, future improvements in solar resource data should involve development and implementation of satellite-derived cloud fraction and should consider a novel radiative transfer model accounting for amplified cloud reflection. The evaluation within cloudiness categories also provides a physical rationale for the superior performance of FARMS-DNI compared to the Direct Insolation Simulation Code (DISC) in both cloudy-sky and all-sky conditions.
The National Climate Database (NCDB) is a high resolution, bias-corrected climate dataset consisting of the three most widely used variables of solar radiation- global horizontal (GHI), direct normal (DNI), and diffuse horizontal irradiance (DHI)- as well as other meteorological data. The goal of the NCDB is to provide unbiased high temporal and spatial resolution climate data needed for renewable energy modeling. The NCDB is modeled using a statistical downscaling approach with Regional Climate Model (RCM)-based climate projections obtained from the North American Coordinated Regional Climate Downscaling Experiment (NA-CORDEX; linked below). Daily climate projections simulated by the Canadian Regional Climate Model 4 (CanRCM4) forced by the second-generation Canadian Earth System Model (CanESM2) for two Representative Concentration Pathways (RCP4.5 or moderate emissions scenario and RCP8.5 or highest baseline emission scenario) are selected as inputs to the statistical downscaling models. The National Solar Radiation Database (NSRDB) is used to build and calibrate statistical models.
As the world increasingly seeks low-carbon energy solutions, solar power emerges as the most abundant resource on our planet. However, the challenge of effectively harnessing this energy is crucial in the coming years. Solar energy applications such as photovoltaics, solar heating and cooling, and concentrating solar power use different technologies to capitalize on sunlight. Each system has unique capabilities and requirements, underscoring the need for reliable information about solar resources across diverse installations, from residential rooftops to large-scale power plants. This is especially important for substantial projects, often exceeding $1 billion in construction costs. Before embarking on such ventures, it is imperative to obtain accurate data concerning solar resource quality and reliability at specific sites. Developers require detailed historical information, including seasonal, daily, hourly, and, ideally, subhourly variability to effectively predict a power plant's annual performance. Without these vital data, financial analyses fall short. Moreover, with the growing adoption of distributed photovoltaics, integrating these generation sources becomes critical to maintaining grid reliability and stability. By accurately forecasting generation patterns, utilities and system operators can facilitate greater integration of solar energy, thus ensuring the operational stability of the grid. The complexity and importance of these issues have prompted the foremost experts in the field to collaborate under the auspices of the International Energy Agency's (IEA's) Photovoltaic Power Systems Programme (PVPS) Task 16 to publish this handbook, which summarizes state-of-the-art information about all these topics. The efforts focus on providing reliable data and insights that can help shape our investments in solar energy and drive a sustainable future.
The objective of the National Renewable Energy Laboratory's (NREL's) Solar Radiation Research Laboratory (SRRL) is to collect and use high-quality solar radiation data sets for research leading to the widespread adoption of solar technologies. To appropriately populate and track the diverse array of instruments at the NREL-SRRL, NREL has established a Standard Operating Procedure (SOP) for optimal instrument deployment within the SRRL for both the Baseline Measurement System (BMS) and the Research Measurement System (RMS). Using best practices methodologies, the NREL-SRRL maintains a varied and extensive array of solar monitoring equipment to test, evaluate, and characterize the solar sensors used by federal and international agencies as well as the solar industry to determine the solar resource. The SOP provides the industry with guidance for solar resource assessment and is used for procedures in the long-term continuous monitoring of legacy instruments alongside state-of-the-art instruments. Based on the SOP, instruments are annually evaluated for continued deployment. Instruments that do not meet the SOP criteria are decommissioned, and new instruments that meet the criteria are deployed. Streamlining and optimizing the use of this facility ensures that the lab continues to be a world-leading solar calibration and measurement facility. This 2024 edition includes updates to the appendices to reflect the instrument changes from one year to another.
The National Solar Radiation Database (NSRDB) is a widely used resource providing satellite-derived solar data across the United States and globally. While the NSRDB employs a physical model for computing global horizontal irradiance (GHI), its current method for estimating cloudy-sky direct normal irradiance (DNI) relies on surface observations and empirical models. Recently, a novel physics-based approach, the Fast All-Sky Radiation Model for Solar applications with DNI (FARMS-DNI), was developed to enhance the DNI forecasting. FARMS-DNI incorporates both direct and scattered solar radiation within the circumsolar region, resulting in improved day-ahead DNI predictions when integrated into the Weather Research and Forecasting model with Solar extensions (WRF-Solar). This study integrates FARMS-DNI into the NSRDB algorithm to generate high-resolution DNI data from satellite resources. Our findings reveal that FARMS-DNI effectively mitigates the substantial DNI overestimation present in the conventional NSRDB across surface sites, particularly in conditions categorized as cloudy overcast. Consequently, this innovative model substantially enhances the overall accuracy of the NSRDB.
REST2 is the high-performance solar radiation model for cloudless-sky irradiance, illuminance, and photosynthetically active radiation.
The Puerto Rico Grid Resilience and Transitions to 100% Renewable Energy Study (PR100) is a comprehensive analysis based on extensive stakeholder input of possible pathways for Puerto Rico to achieve its goal of 100% renewable energy by 2050. PR100 was an integrated effort drawing on expertise and capabilities of the contributing national laboratories that explored possible pathways for Puerto Rico to achieve its goal of 100% renewable energy in the long term (by 2050), increase reliability and resilience in the immediate term (within the next few years), and work toward energy justice. The purpose of the study is to provide decision support and inform investment decisions for implementers of Puerto Rico's energy transition. See NREL/TP-6A20-88614 for the Spanish translation of this report.
El Estudio de Resiliencia de la Red de Puerto Rico y Transiciones a Energia 100% Renovable (PR100) es un analisis integral basado en amplios aportes de las partes interesadas sobre posibles caminos para que Puerto Rico alcance su meta de 100% de energía renovable para 2050. PR100 fue un esfuerzo integrado que se baso en experiencia y capacidades de los laboratorios nacionales contribuyentes que exploraron posibles caminos para que Puerto Rico logre su objetivo de 100% de energía renovable en el largo plazo (para 2050), aumente la confiabilidad y la resiliencia en el plazo inmediato (dentro de los proximos anos), y trabajar hacia la justicia energetica. El proposito del estudio es brindar apoyo a las decisiones e informar las decisiones de inversion para los implementadores de la transicion energetica de Puerto Rico. See NREL/TP-6A20-88384 for the English translation of this report.
The Puerto Rico Grid Resilience and Transitions to 100% Renewable Energy Study (PR100) is a comprehensive analysis based on extensive stakeholder input of possible pathways for Puerto Rico to achieve its goal of 100% renewable energy by 2050. In this summary report of the PR100 Final Report, we describe the background and motivation behind the study, provide an overview, summarize results, highlight key findings, and outline implementation actions for stakeholders to take in the immediate-, near-, mid-, and long-term to achieve Puerto Rico’s energy system goals.
The Puerto Rico Grid Resilience and Transitions to 100% Renewable Energy Study (PR100) is a comprehensive analysis based on extensive stakeholder input of possible pathways for Puerto Rico to achieve its goal of 100% renewable energy by 2050. In this summary report of the PR100 Final Report, we describe the background and motivation behind the study, provide an overview, summarize results, highlight key findings, and outline implementation actions for stakeholders to take in the immediate-, near-, mid-, and long-term to achieve Puerto Rico’s energy system goals. For the English version of this report, see NREL/TP-6A20-88615 (https://www.nrel.gov/docs/fy24osti/88615.pdf).
An accurate forecast of Global Horizontal solar Irradiance (GHI) and Direct Normal Irradiance (DNI) in cloudy conditions remains a major challenge in the solar energy industry. This study focuses on the impact of cloud microphysics on GHI and its partition into DNI and Diffuse Horizontal Irradiance (DHI) using the Weather Research and Forecasting model specifically designed for solar radiation applications (WRF-Solar) and seven microphysical schemes. Three stratocumulus (Sc) and five shallow cumulus (Cu) cases are simulated and evaluated against measurements at the US Department of Energy’s Atmospheric Radiation Measurement (ARM) user facility, Southern Great Plains (SGP) site. Results show that different microphysical schemes lead to spreads in simulated solar irradiance components up to 75% and 350% from their ensemble means in the Cu and Sc cases, respectively. The Cu cases have smaller microphysical sensitivity due to a limited cloud fraction and smaller domain-averaged cloud water mixing ratio compared to Sc cases. Cloud properties also influence the partition of GHI into DNI and DHI, and the model simulates better GHI than DNI and DHI due to a non-physical error compensation between DNI and DHI. The microphysical schemes that produce more accurate liquid water paths and effective radii of cloud droplets have a better overall performance.
This repository contains all of the methods for the NSRDB data processing pipeline. The NSRDB is a serially complete collection of hourly and half-hourly values of meteorological data and the three most common measurements of solar radiation: global horizontal, direct normal and diffuse horizontal irradiance.
Explore the source record for details and available documents.
The National Solar Radiation Database (NSRDB) is an extensively used dataset that furnishes satellite-retrieved solar resource data across the United States and an expanding list of other countries. Although the NSRDB uses a physical model to compute global horizontal irradiance (GHI), it currently employs an empirical approach based on surface observations to estimate cloudy-sky direct normal irradiance (DNI). Recently, a new physics-based approach, known as the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI), was developed to improve DNI forecasting. FARMS-DNI integrates direct and scattered solar radiances within the circumsolar region, resulting in improved day-ahead forecasting of DNI by incorporating it into the Weather Research and Forecasting model with Solar extensions (WRF-Solar). This study incorporates FARMS-DNI into the NSRDB algorithm to produce high-spatiotemporal-resolution DNI data from satellite data. The accuracy of the NSRDB based on FARMS-DNI is analyzed using surface observations from 19 sites situated within the National Oceanic and Atmospheric Administration (NOAA) Surface Radiation Budget (SURFRAD) and Solar Radiation (SOLRAD) networks, the University of Oregon (UO) network, the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) network, and at the National Renewable Energy Laboratory (NREL). The results demonstrate that FARMS-DNI reduces the significant overestimation of DNI in the conventional NSRDB at all surface sites, particularly in cloud overcast conditions classified using both satellite retrievals and surface observations. Consequently, this new model can effectively improve the overall accuracy of the NSRDB. The results also suggest that further improvement of DNI estimates at individual time steps, however, requires advanced satellite techniques and precise identification of clouds and retrieval of cloud properties.