SEARCH · Search NASA
Results for “solar irradiance data”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
pvlib iotools—Open-source Python functions for seamless access to solar irradiance data
Access to accurate solar resource data is critical for numerous applications, including estimating the yield of solar energy systems, developing radiation models, and validating irradiance datasets. However, lack of standardization in data formats and access interfaces across providers constitutes a major barrier to entry for new users. pvlib python’s iotools subpackage aims to solve this issue by providing standardized Python functions for reading local files and retrieving data from external providers. All functions follow a uniform pattern and return convenient data outputs, allowing users to seamlessly switch between data providers and explore alternative datasets. The pvlib package is community-developed on GitHub: https://github.com/pvlib/pvlib-python. As of pvlib python version 0.9.5, the iotools subpackage supports 12 different datasets, including ground measurement, reanalysis, and satellite-derived irradiance data. The supported ground measurement networks include the Baseline Surface Radiation Network (BSRN), NREL MIDC, SRML, SOLRAD, SURFRAD, and the US Climate Reference Network (CRN). Additionally, satellite-derived and reanalysis irradiance data from the following sources are supported: PVGIS (SARAH & ERA5), NSRDB PSM3, and CAMS Radiation Service (including McClear clear-sky irradiance).
High-Fidelity Solar Irradiance Data: Simple Access to State-of-the-Art Information Accelerates Southeast Asia's Clean Energy Economic Transformation
High quality, robust, and reliable renewable energy resource data is foundational to climate-smart decision making, evidence-based policy planning, and clean energy investment mobilization. USAID and NREL, through the Advanced Energy Partnership for Asia, are expanding access to this critical resource data by providing free, high-fidelity solar resource data for Southeast Asia through the RE Data Explorer platform. This brief highlights several ways the Southeast Asia solar resource data has been used for power system planning and project development in the region.
Physics-Guided Machine Learning for Prediction of Cloud Properties in Satellite-Derived Solar Data
With over 20 years of high-resolution surface irradiance data covering most of the western hemisphere, the National Solar Radiation Database (NSRDB) is a vital public data asset. The NSRDB uses a two-step Physical Solar Model (PSM) that explicitly considers the effects of clouds and other atmospheric variables on radiative transfer. High-quality physical and optical cloud properties derived from satellite imagery are perhaps the most important data inputs to the PSM, representing the greatest source of radiation attenuation and scattering. However, traditional methods for cloud property retrieval have their own limitations and are unable to accurately predict cloud properties outside of nominal conditions. We introduce a physics-guided neural network that can accurately predict cloud properties when traditional methods fail or are inaccurate. Using this framework, we show reductions in relative Root Mean Square Error (RMSE) for Global Horizontal Irradiance (GHI) up to 13 percentage points for timesteps that previously had missing or low-quality cloud property data. We expect that this methodology will be effective in improving the quality of cloud property and solar irradiance data in the NSRDB.
Physics-Guided Machine Learning for Prediction of Cloud Properties in Satellite-Derived Solar Data: Preprint
With over 20 years of high-resolution surface irradiance data covering most of the western hemisphere, the National Solar Radiation Database (NSRDB) is a vital public data asset. The NSRDB uses a two-step Physical Solar Model (PSM) that explicitly considers the effects of clouds and other atmospheric variables on radiative transfer. High-quality physical and optical cloud properties derived from satellite imagery are perhaps the most important data input to the PSM, representing the greatest source of radiation attenuation and scattering. However, traditional methods for cloud property retrieval have their own limitations and are unable to accurately predict cloud properties outside of nominal conditions. We introduce a physics-guided neural network that can accurately predict cloud properties when traditional methods fail or are inaccurate. Using this framework, we show reductions in relative Root Mean Square Error (RMSE) for Global Horizontal Irradiance (GHI) up to 13 percentage points for timesteps that previously had missing or low-quality cloud property data. We expect that this methodology will be effective in improving the quality of cloud property and solar irradiance data in the NSRDB.
A Nonstationary and Non-Gaussian Moving Average Model for Solar Irradiance
Historically, power has flowed from large power plants to customers. Increasing penetration of distributed energy resources such as solar power from rooftop photovoltaic has made the distribution network a two-way-street with power being generated at the customer level. The incorporation of renewables introduces additional uncertainty and variability into the power grid. Distribution network operation studies are being adapted to include renewables; however, such studies require high quality solar irradiance data that adequately reflect realistic meteorological variability. Data from satellite-based products are spatially complete, but temporally coarse, whereas solar irradiances exhibit high frequency variation at very fine timescales. We propose a new stochastic method for temporally downscaling global horizontal irradiance (GHI) to 1 min resolution, but we do not consider the spatial aspect due to limited availability of the in situ irradiance measurements. Solar irradiance's first and second-order structures vary diurnally and seasonally, and our model adapts to such nonstationarity. Empirical irradiance data exhibits highly non-Gaussian behavior; we develop a nonstationary and non-Gaussian moving average model that is shown to capture realistic solar variability at multiple timescales. We also propose a new estimation scheme based on Cholesky factors of empirical autocovariance matrices, bypassing difficult and inaccessible likelihood-based approaches. The model is demonstrated for a case study of three locations that are located in diverse climates through the United States. The model is compared against competitors from the literature and is shown to provide better uncertainty and variability quantification on testing data.
Joint Resource Modeling and Assessment for Hybrid Distributed Solar and Wind Systems
The inherent variability and uncertainty in distributed energy resources can presents myriad challenges to the planning and operations of power systems. These risks are poised to become larger as the penetration of renewable energy sources rises in the power generation mix. Hybrid solar-wind energy systems are able to mitigate some of these risks by their complementary resource availability. Surface solar and wind fields are coupled and correlated in both space and time. Appropriately estimating the hybrid solar wind energy system requires simulating the spatio-temporal structure of these fields that can be produced for each time horizon. We introduce a novel joint spatio-temporal stochastic differential equation (SPDE) approach that captures the spatio-temporal dynamics of solar and wind fields and their joint dependency over a domain for each time step. In the case study on Colorado, we consider nonstationary three-level hierarchical spatio temporal models for both hourly solar irradiance data and wind speed data in Colorado. Dependence between the solar irradiance data and wind speed data is captured by a shared spatio-temporal random effect. Our approach performs well in terms of the prediction score criterion.
Towards Integrating Data Quality Assessments and Radiometer Uncertainty for Determining the Expanded Uncertainty of Three-Component Solar Radiation Measurements
Accurate solar irradiance data are fundamental for determining the design and performance characteristics of photovoltaic systems. The uncertainty of solar irradiance measurements depends on many factors including radiometer design, calibration, installation, maintenance, and operational environment. The key contributors to this uncertainty can be classified as the measurement uncertainty of a particular radiometer and the operational uncertainty determined for the time of measurement. Radiometer measurement uncertainty estimates (U R ) can be based on well-established methods used as part of the radiometer calibration process. Estimates of operational uncertainties (U o ) require consideration of additional site-specific factors that affect data quality. A method is needed for establishing the accuracy of solar irradiance data by integrating an existing data quality process and measurement uncertainty estimates for specific radiometers. An algorithm has been developed to integrate data quality analyses and measurement uncertainty estimates for three-component solar irradiance data: global horizontal (total hemispheric) irradiance, direct normal (beam) irradiance, and diffuse horizontal (sky) irradiance collected at one- to 60-minute intervals. The algorithm has been tested using one-minute irradiance measurements. The goal of the project is to distribute a user-friendly software package based on the new algorithm.
SoDa: An Irradiance-Based Synthetic Solar Data Generation Tool (SoDa) v0.1
SoDa is an irradiance-based synthetic Solar Data generation tool to generate realistic sub-minute solar photovoltaic (PV) power time series, that emulate the weather pattern for a certain geographical location. Our tool relies on the National Solar Radiation Database (NSRDB) to obtain irradiance and weather data patterns for the site. Irradiance is mapped onto a PV model estimate of a solar plant's 30-min power output, based on the configuration of the panel. We use a stochastic model with a switching behavior due to different weather regimes as provided by the cloud type label in the NSRDB, with parameters for the cloudy states trained on the high-resolution solar power measurements from a Phasor Measurement Unit (PMU).
Physics-guided machine learning for improved accuracy of the National Solar Radiation Database
The National Solar Radiation Database (NSRDB) provides high-resolution spatiotemporal solar irradiance data for the entire globe. The NSRDB uses a two-step Physical Solar Model (PSM) to compute the effects of clouds and other atmospheric variables on the solar radiation reaching the surface of the Earth. Physical and optical cloud properties are fundamental inputs to the PSM and are derived from the National Oceanic and Atmospheric Administration's Geostationary Operational Environmental Satellites. This paper describes recent improvements to the NSRDB driven by physics-guided machine learning methods for cloud property retrieval. The impacts of these new methods on the NSRDB irradiance data are validated using an extensive set of ground measurement sites, showing significant improvement for all sites. We report on average, the mean absolute percentage error for global horizontal irradiance and direct normal irradiance show reductions of 2.16 and 3.95 percentage points respectively for all daylight conditions, 5.92 and 17.39 percentage points respectively for cloudy conditions, and 9.00 and 22.59 percentage points respectively for gap-filled cloudy conditions. These new methods will help improve the quality and accuracy of the irradiance and cloud data in the NSRDB.
Evaluation of clear-sky and satellite-derived irradiance data for determining the degradation of photovoltaic system performance
Knowing the degradation in performance of a photovoltaic (PV) system over time is important for estimating the lifetime energy produced and the financial return. A key parameter for normalizing performance and determining degradation is the plane-of-array (POA) irradiance. Because accurate long-term POA measurements are not always readily available, three methods of providing irradiance data for determining the degradation rate of PV systems were evaluated—a method using irradiance data modeled with the Ineichen clear-sky model and monthly Linke turbidity coefficients, a method using the supplemental clear-sky irradiance data from the National Solar Radiation Data Base (NSRDB), and a method using the NSRDB solar irradiance data for both cloudy and clear-sky conditions (all-sky). The irradiance data from the three methods were evaluated using measured irradiance data from 1998 through 2018 for the seven-station SURFRAD network and for 3-, 5-, and 10-year periods that might be used for evaluating PV system performance. Only the two clear-sky methods for the 10-year periods had less uncertainty with respect to determining PV system degradation than the expected median degradation rate for PV systems of -0.5%/year to -0.6%/year. Shorter periods and the all-sky method had larger uncertainties, making their use questionable for determining the degradation rates of PV systems.
Spatiotemporal Downscaling Model for Solar Irradiance Forecast Using Nearest-Neighbor Random Forest and Gaussian Process
Accurate solar photovoltaic (PV) capacity estimation requires high-resolution, site-specific solar irradiance data to account for localized variability. However, global datasets, such as the National Solar Radiation Database (NSRDB), provide regional averages that fail to capture the fine-scale fluctuations critical for large-scale grid integration. This limitation is particularly relevant in the context of increasing distributed energy resources (DERs) penetration, such as rooftop PV. Additionally, it is critical to the implementation of the U.S. Federal Energy Regulatory Commission (FERC) Order 2222, which facilitates DER participation in U.S. bulk power markets. To address this challenge, this study evaluates Nearest-Neighbor Random Forest (NNRF) and Nearest-Neighbor Gaussian Process (NNGP) models for spatiotemporal downscaling of global solar irradiance data. By leveraging historical irradiance and meteorological data, these models incorporate spatial, temporal, and feature-based correlations to enhance local irradiance predictions. The NNRF model, a machine-learning approach, prioritizes computational efficiency and predictive accuracy, while the NNGP model offers a level of interpretability and prediction uncertainty by numerically quantifying correlations and dependencies in the data. Model validation was conducted using day-ahead predictions. The results showed that the average Goodness of Fit (GoF) of the NNRF model of 90.61% across all eight sites outperformed the GoF of the NNGP of 85.88%. Additionally, the computational speed of NNRF was 2.5 times faster than the NNGP. Finally, the NNGP displayed polynomial scaling while the NNRF scaled linearly with increasing number of nearest neighbors. Additional validation of the model on five sites in Puerto Rico further confirmed the superiority of the NNRF model over the NNGP model. These findings highlight the robustness and computational efficiency of NNRF for large-scale solar irradiance downscaling, making it a strong candidate for improving PV capacity estimation and real-time electricity market integration for DERs.
An improved method for direct incident solar radiation calculation from hourly solar insolation data in building energy simulation
Solar radiation considerably influences the energy consumption of buildings and the power production of building integrated photovoltaic (BIPV) systems. Hourly solar insolation (Wh/m 2 ), represented as the amount of solar irradiance collected on the ground during a 1-h period, is the most common solar radiation data available and widely used in weather files applied in building energy modeling programs (BEMPs). Because the solar beam and position vary over time, the use of hourly insolation data as the input might result in errors in the estimation of the direct incident solar radiation on a particular surface. In this study, methods used in BEMPs for direct incident solar radiation calculations are first analyzed, and an improved method adopting a new algorithm for estimating the solar irradiance is proposed. Furthermore, the algorithm assumes that the solar irradiance changes linearly within a 1-h period and can be estimated based on the solar irradiance at the half clock and slope. The collected direct normal solar irradiance data of 2016 from eight solar radiation stations in China were used to demonstrate the proposed method and evaluate its performance by comparing the results with those from three conventional methods used in BEMPs along with the ground truth measurements. In addition, in this study, factors affecting the accuracy of the calculation results are explored. The results of the estimated direct incident solar radiation show that the proposed method achieves the best accuracy, followed by the methods used in DOE-2, EnergyPlus, and DeST. The proposed method guarantees that the hourly direct solar insolation will remain the same and reflects the variation in the direct solar irradiance across a 1-h time frame. The proposed method can be adopted in BEMPs to improve the accuracy of the solar radiation calculation, thereby improving the accuracy of the simulated building performance and the BIPV production.
Simulative Prediction of Solar Illuminance and Application of the Du-Sharples Model in Estimating Adapted Daylighting Metrics for an Urban Environment
The practice of daylighting in indoor spaces can significantly reduce electricity consumption and carbon emissions, improve human productivity, and enhance mood and cognitive perception. This work discussed the recent developments in daylighting science and practice, computed the periodic variations in average diurnal daylight levels for each month, quantified in terms of global horizontal illuminance and diffuse horizontal illuminance, for Kolkata, India, a city with tropical wet and dry climate, with two empirical luminous efficacy models of estimating solar illuminance, and assessed daylighting metrics with the Du-Sharples model. A program was formulated that could compute and generate daylight data with monthly-hourly solar irradiation data and the Du-Sharples model was utilized to predict dirt-corrected daylighting metrics for three glazing transmittance values and five elemental carbon deposition levels on glazing material. The highest monthly average global horizontal illuminance is recorded in April (64.05 klx for Littlefair model and 66.82 klx for Muneer-Kinghorn model) and the highest monthly average diffuse horizontal illuminance is recorded in July (33.23 klx for Littlefair model and 30.63 klx for Muneer-Kinghorn model). Further, the computed yearly average global and diffuse horizontal illuminance levels agree well with a previous study that applied the Perez model. Yearly average horizontal work surface illuminance level remained >1.5 klx for window-towall area ratio >30 %. The approach adopted in this work and the temporal variation charts of computed exterior daylight level data may assist building service engineers, architects, and indoor lighting practitioners in making informed policy decisions at different stages of building planning.
Clear-Sky Probability for the 2023 Annular Solar Eclipse and the 2024 Total Solar Eclipse Using the NREL National Solar Radiation Database
The National Renewable Energy Laboratory (NREL) and collaborators have created a clear-sky probability analysis to help guide viewers to the 2023 annular solar eclipse and the 2024 total solar eclipse. Using cloud and solar data from the NREL National Solar Radiation Database (NSRDB), the analysis provides cloudless-sky probabilities specific to the date, time, and location of each eclipse with a 4-km resolution. Though not intended to be an eclipse weather forecast, the detailed maps can help guide eclipse enthusiasts to likely optimal viewing locations. Additionally, high-resolution data are presented for the centerline of the path of each eclipse, representing the likelihood for cloudless skies and atmospheric clarity. The NSRDB provides industry, academia, and other stakeholders with high-resolution solar irradiance data to support feasibility analyses for photovoltaic and concentrating solar power generation projects.
Deliverable 6.7-Final Technical Report: Development Summary and Evaluation of the Solar Uncertainty Integrator (SUNI) Software
The Data Quality and Uncertainty Integration Project was a three-year effort to address stakeholder needs for assessing solar radiation resource data quality based on existing tools for estimating radiometer measurement uncertainties and assessing post-measurement data quality. The annual research objectives for the project addressed a logical progression of effort needed to achieve the ultimate project goal of developing the Solar Uncertainty Integrator (SUNI) software. This final technical report summarizes the development process for achieving these key research objectives and addresses the outreach and code development efforts in the final year of the project to develop a new solar irradiance data uncertainty integration software package.
Assessing Uncertainty in Solar Measurements: Key Findings From NLR's SUNI Application Across 89 Stations
The Solar Uncertainty Integrator (SUNI) study was developed by the National Laboratory of the Rockies (NLR's) to provide a standardized "bulk uncertainty processing" method for solar irradiance data, which are essential for the successful deployment of solar energy systems. This poster provides an overview of key findings from NLR's SUNI application across 89 stations.
NREL Pyrheliometer Comparisons: September 23 - September 28, 2023 (NPC-2023)
Accurate measurements of direct normal (beam) solar irradiance from pyrheliometers are important for developing and deploying solar energy conversion systems, for improving our understanding of Earth's energy budget for climate change studies, and for other science and technology applications involving solar flux. Providing these measurements places many demands on the quality system used by the operator of commercially available radiometers. Maintaining accurate radiometer calibrations that are traceable to an international standard is the first step in producing research-quality solar irradiance measurements. In 1977, the World Meteorological Organization (WMO) established the World Radiometric Reference (WRR) as the international standard for the measurement of direct normal solar irradiance (Frohlich 1991). The WRR is an internationally recognized, detector-based measurement standard determined by the collective performance of six electrically self-calibrated absolute cavity radiometers comprising the World Standard Group (WSG). Various countries, including the United States, have contributed these specialized radiometers to the Physikalisch-Meteorologisches Observatorium Davos - World Radiation Center (PMOD/WRC) to establish the WSG. As with all measurement systems, Absolute Cavity Radiometers (ACR) are subject to performance changes over time. Therefore, PMOD/WRC in Davos, Switzerland, hosts an quinquennial International Pyrheliometer Comparison (IPC) event for transferring the WRR to participating radiometers by invitation. The National Renewable Energy Laboratory (NREL) has represented the U.S. Department of Energy (DOE) in each IPC since 1980. And NREL has developed and maintained a select group of absolute cavity radiometers with direct calibration traceability to the WRR, and it uses these reference instruments to calibrate pyrheliometers and pyranometers using the International Organization for Standardization (ISO) 17025-accredited Broadband Outdoor Radiometer Calibration (BORCAL) process (Reda et al. 2008). To fill the gap between each IPC, NREL pyrheliometer comparisons (NPCs) are held annually at the Solar Radiation Research Laboratory (SRRL) in Golden, Colorado. Open to all ACR owners and operators, each NPC provides an opportunity to determine the unique WRR transfer factor (WRR-TF) for each participating pyrheliometer. By adjusting all subsequent pyrheliometer measurements by the appropriate WRR-TF, the solar irradiance data are traceable to the WRR.