Search NASA⌕ Search

SEARCH · Search NASA

Results for “solar irradiance data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Bias Correction and Statistical Downscaling of Solar Radiation Using NA-CORDEX and the NSRDB

The current state-of-art for estimating long-term PV production uses long-term estimates of solar radiation variables, such as global horizontal irradiance (GHI), from previous years. This data is used in models such as the System Advisor Model (SAM) or PYSyst to predict annual production for a PV plant. This information is then used to estimate the production over the next 20 years (a typical plant lifetime) under the assumption that the variability over the current period is representative of the future. As the PV industry moves to extend plant lifetimes to 50 years the current assumptions of representativeness of weather may not be appropriate. This is especially true as our climate changes rapidly. To assess long-term PV production, future projections for solar radiation based on projected carbon emissions are readily available in regional and global climate models. However, climate model projections contain inherent biases that may need to be corrected for accurate analysis of future projections of climate variables. Several studies have analyzed projections of solar radiation for future years, however the accuracy of the model output compared to current and historic data has not been widely studied. Chen (2021) showed that available climate models do not accurately represent solar radiation in some cases, over-projecting GHI at the surface while under-projecting its obstructions, such as clouds and aerosols. This works aims to (1) increase understanding of the accuracy of solar radiation currently available in global and regional climate models and (2) implement bias correction through linear models based on reanalysis data compared to observed solar radiation. The latter aim will be conducted using available observed solar radiation data and modeled data from several regional climate models (RCMs). The bias correction method will be applied to projections of solar radiation resulting in a more accurate representation of the future of solar production.

climate data↗
DOE OSTI2024

The National Climate Database (NCDB): An Unbiased 100-Year Dataset for PV Modeling

In this study, we develop a statistical technique to downscale the future projection of solar irradiance for photovoltaics (PV) energy-related applications. A set of Regional Climate Model (RCM)-based projections obtained from the North American Coordinated Regional Climate Downscaling Experiment (NA-CORDEX) are used as inputs to statistical methods to generate high-resolution global horizontal irradiance (GHI) over the contiguous United States (CONUS). The main steps of the statistical downscaling method include (1) regridding RCM output (0.22 degree and daily resolutions) to handle the modeled-observed data sets on a common grid, (2) correcting bias of RCM GHI using satellite-derived observation, and (3) implementing temporal and spatial downscaling to generate GHI at 8-km and hourly resolution. Basically, complex physical processes and interactions between solar radiation and various atmospheric constituents lead solar irradiance to be highly variable and uncertain. Underrepresentation of clouds from the RCM parameterizations is the main source of error and uncertainty in modeling solar irradiance. Thus, we adapt and use the high-quality satellite-derived data from the National Solar Radiation Database (NSRDB) to analyze the bias and error of RCM GHI as well as estimate the statistical parameters for spatial and temporal downscaling. This presentation will summarize the comprehensive analysis conducted to produce and assess the results under two climate scenarios (RCP4.5 and RCP8.5). We will also present a detailed validation demonstrating the strengths of the downscaling method, a summary of the 100-year dataset from 2001-2100, and future extension of this research.

bias correction↗
DOE OSTI2022

Automated Shift Detection in Sensor-Based PV Power and Irradiance Time Series: Preprint

PV power and irradiance sensor-based measurements are prone to error, resulting in issues such as abrupt time series data shifts. These shifts, which are usually unintentional, may be caused by software or hardware configuration changes on a PV system, and do not reflect an actual change in overall system performance. Locating these shifts and segmenting the associated time series aids in more accurate future PV analysis. In this research, an offline changepoint detection (CPD) algorithm that automatically detects these abrupt data shifts in sensor-based time series is introduced. Data shift periods in 101 daily PV power and irradiance time series were labeled manually by two solar experts. These data streams represent sensor-based measurements, and display a variety of data shift behaviors. A changepoint detection algorithm was tuned using the 101 labeled data streams, with each model configuration's ability to detect labeled changepoints benchmarked using metrics such as F1-score, recall, and Rand Index. Best performing models on seasonality-corrected data streams include the Pruned Exact Linear (PELT) method, the Binary Segmentation method, and the Bottom-Up method, all scoring an average F1-score of 0.76 or greater at detecting labeled changepoints within a 30-day window for the labeled data sets. To promote further research in this space, we are releasing the labeled data shift sets on U.S. Department of Energy's (DOE) DuraMAT Data Hub, and the associated algorithm in the Python PVAnalytics package.

changepoint detection↗
DOE OSTI2022

Automated Shift Detection in Sensor-Based PV Power and Irradiance Time Series

PV power and irradiance sensor-based measurements are prone to error, resulting in issues such as abrupt time series data shifts. These shifts, which are usually unintentional, may be caused by software or hardware configuration changes on a PV system, and do not reflect an actual change in overall system performance. Locating these shifts and segmenting the associated time series aids in more accurate future PV analysis. In this research, an offline changepoint detection (CPD) algorithm that automatically detects these abrupt data shifts in sensor-based time series is introduced. Data shift periods in 101 daily PV power and irradiance time series were labeled manually by two solar experts. These data streams represent sensor-based measurements, and display a variety of data shift behaviors. A changepoint detection algorithm was tuned using the 101 labeled data streams, with each model configuration's ability to detect labeled changepoints benchmarked using metrics such as F1-score, recall, and Rand Index. Best performing models on seasonality-corrected data streams include the Pruned Exact Linear (PELT) method, the Binary Segmentation method, and the Bottom-Up method, all scoring an average F1-score of 0.76 or greater at detecting labeled changepoints within a 30-day window for the labeled data sets. To promote further research in this space, we are releasing the labeled data shift sets on U.S. Department of Energy's (DOE) DuraMAT Data Hub, and the associated algorithm in the Python PVAnalytics package.

changepoint detection↗
DOE OSTI2022

Automated Shift Detection in Sensor-Based PV Power and Irradiance Time Series

PV power and irradiance sensor-based measurements are prone to error, resulting in issues such as time series data shifts. In this research, a changepoint detection (CPD) algorithm that automatically detects data shifts in sensor-based time series is introduced. Data shift periods in 101 daily PV power and irradiance time series were labeled manually by two solar experts. These data streams represent sensor-based measurements, and display a variety of data shift behaviors. A changepoint detection algorithm was tuned using the 101 labeled data streams, with each model configuration's ability to detect labeled changepoints benchmarked using metrics such as F1-score, recall, and Rand Index. Best performing models on seasonality-corrected data streams include the Pruned Exact Linear (PELT) method, the Binary Segmentation method, and the Bottom-Up method, all scoring an average F1-score of 0.76 or greater at detecting labeled changepoints within a 30-day window across the labeled data sets. Pending approval, we plan to release the labeled data sets for this research on NREL's DuraMAT Data Hub, and the associated algorithm in the Python PVAnalytics package. By supplying the training sets and algorithm, we hope to encourage further development in this research space.

data shift↗
DOE OSTI2024

Improving the National Solar Radiation Database (NSRDB) Using a Physics-Based Direct Normal Irradiance (DNI) Model

The National Solar Radiation Database (NSRDB) is a widely used resource providing satellite-derived solar data across the United States and globally. While the NSRDB employs a physical model for computing global horizontal irradiance (GHI), its current method for estimating cloudy-sky direct normal irradiance (DNI) relies on surface observations and empirical models. Recently, a novel physics-based approach, the Fast All-Sky Radiation Model for Solar applications with DNI (FARMS-DNI), was developed to enhance the DNI forecasting. FARMS-DNI incorporates both direct and scattered solar radiation within the circumsolar region, resulting in improved day-ahead DNI predictions when integrated into the Weather Research and Forecasting model with Solar extensions (WRF-Solar). This study integrates FARMS-DNI into the NSRDB algorithm to generate high-resolution DNI data from satellite resources. Our findings reveal that FARMS-DNI effectively mitigates the substantial DNI overestimation present in the conventional NSRDB across surface sites, particularly in conditions categorized as cloudy overcast. Consequently, this innovative model substantially enhances the overall accuracy of the NSRDB.

Xie, Yu↗
DOE OSTI2024

Improving the National Solar Radiation Database (NSRDB) Using a Physics-Based Direct Normal Irradiance (DNI) Model: Preprint

The National Solar Radiation Database (NSRDB) is a widely used resource providing satellite-derived solar data across the United States and globally. While the NSRDB employs a physical model for computing global horizontal irradiance (GHI), its current method for estimating cloudy-sky direct normal irradiance (DNI) relies on surface observations and empirical models. Recently, a novel physics-based approach, the Fast All-Sky Radiation Model for Solar applications with DNI (FARMS-DNI), was developed to enhance the DNI forecasting. FARMS-DNI incorporates both direct and scattered solar radiation within the circumsolar region, resulting in improved day-ahead DNI predictions when integrated into the Weather Research and Forecasting model with Solar extensions (WRF-Solar). This study integrates FARMS-DNI into the NSRDB algorithm to generate high-resolution DNI data from satellite resources. Our findings reveal that FARMS-DNI effectively mitigates the substantial DNI overestimation present in the conventional NSRDB across surface sites, particularly in conditions categorized as cloudy overcast. Consequently, this innovative model substantially enhances the overall accuracy of the NSRDB.

DNI↗
DOE OSTI2021

The WRF-Solar Ensemble Prediction System to Provide Solar Irradiance Probabilistic Forecasts

In this study, we introduce the recently developed WRF-Solar Ensemble System (WRF-Solar EPS) and a calibration method. The performances of forecast models are evaluated using the National Solar Radiation Data Base (NSRDB) observational analysis for day-ahead solar irradiance predictions. The results demonstrate that the ensemble forecast improves the quality of the forecasts by taking into account the uncertainty of each ensemble member. The Analog Ensemble (AnEn) calibration contributed to the reduction of positive bias and an overall improvement in the probabilistic attributes such as reliability and statistical consistency.

analog ensemble↗
DOE OSTI2022

A Comparison of Time-Series Gap-Filling Methods to Impute Solar Radiation Data: Preprint

Complete solar resource data sets play a critical role at every stage of solar energy projects; however, measured or modeled solar resource data come with significant uncertainties and usually suffer from several issues, including, but not limited to, data gaps and data quality issues. To mitigate these issues, an appropriate data imputation method should be implemented to build a complete and reliable temporal (and spatial) database. Motivated by this, in this study, we extensively compare the performance of eight different gap-filling methods by creating random and artificial data gaps in (i) hourly irradiance data for 1 year using a few locations of the National Solar Radiation Database (NSRDB) and (ii) 1-minute ground measurement data sets from the Surface Radiation Budget Network (SURFRAD) and the National Renewable Energy Laboratory (NREL) stations.

clearness index↗
DOE OSTI2024

The National Climate Data Base (NCDB): A Bias-Corrected High-Resolution Climate Dataset

Assessing renewable energy resources under future climate scenarios has been highlighted in recent years to analyze and understand potential impacts of future change in renewable generation on the power sector. Solar energy is well-known as the most plentiful among various renewable resources and usually converted to electricity using photovoltaics (PV) technologies, and the global deployment of PV technology has increased rapidly in recent decades. In this study, we develop a statistical technique to downscale the future projection of solar irradiance for PV energy-related applications. A set of Regional Climate Model (RCM)-based projections obtained from the North American Coordinated Regional Climate Downscaling Experiment (NA-CORDEX) are used as inputs to statistical methods to generate high-resolution global horizontal irradiance (GHI) over the contiguous United States (CONUS). The main steps of the statistical downscaling method include (1) regridding RCM output (0.22 degree and daily resolutions) to handle the modeled-observed data sets on a common grid, (2) correcting bias of RCM GHI using satellite-derived observation, and (3) implementing temporal and spatial downscaling to generate GHI at 8-km and hourly resolution. Basically, complex physical processes and interactions between solar radiation and various atmospheric constituents lead solar irradiance to be highly variable and uncertain. Underrepresentation of clouds from the RCM parameterizations is the main source of error and uncertainty in modeling solar irradiance. Thus, we adapt and use the high-quality satellite-derived data from the National Solar Radiation Database (NSRDB) to analyze the bias and error of RCM GHI as well as estimate the statistical parameters for spatial and temporal downscaling. This presentation will summarize the comprehensive analysis conducted to produce and assess the results under two climate scenarios (RCP4.5 and RCP8.5). We will also present a detailed validation demonstrating the strengths of the proposed downscaling method and future extension of this research.

climate data↗
DOE OSTI2021

Measured and satellite-derived albedo data for estimating bifacial photovoltaic system performance

The albedo of the ground surface is an important factor in the cost-effectiveness of a bifacial photovoltaic (PV) system. To improve the availability of reliable albedo data, datasets of ground albedo and associated meteorological data were developed by using existing measurement network data and data measured by the PV industry. The measured datasets include time-series data as well as summary information of tabular monthly and yearly data and plots of monthly and hourly albedo values. Satellite-derived values of albedo are available from the National Solar Radiation Data Base (NSRDB). The NSRDB albedos were compared to the measured albedos for Surface Radiation budget (SURFRAD) network locations for the period 2001–2017, and the mean bias difference results were from -0.044 to +0.056. Overall, these differences are greater than the albedo measurement uncertainty of ±0.02; consequently, the NSRDB albedos should be used with caution for estimating the performance of bifacial PV systems. Differences between SURFRAD and NSRDB albedos are attributed to the NSRDB method for determining albedo and to the ground surfaces within the NSRDB 4 km spatial resolution pixel consisting of a mixture of surface types rather than just the single surface types viewed by the albedometers at the SURFRAD stations.

14 SOLAR ENERGY↗
DOE OSTI2022

PVAnalytics: A Python Package for Automated Processing of Solar Time Series Data

Multiple publicly available software packages exist that analyze solar time series data, including RdTools and Solar Data Tools, among others. Several of these packages contain their own unique quality assurance (QA) and feature recognition algorithms. The python PVAnalytics package was developed to offer an internally consistent source for these analysis tools, making it easier for the end user to deploy these routines on his or her solar data. The PVAnalytics package currently contains routines for outlier detection, inverter clipping detection, irradiance and temperature checks, orientation checks, and data shift detection, among other functions. These functions have been aggregated from various sources including Solar Forecast Arbiter, RdTools, and the QA process developed by NREL's PV Fleets Initiative. We are continuously adding new functionality to the package, including documentation, examples and algorithms. By bundling QA functionality into a single software package, we hope to make PVAnalytics a comprehensive software library to support analysis of solar metadata and time series data.

data cleaning↗
DOE OSTI2024

High-Resolution Meteorology with Climate Change Impacts from Global Climate Model Data Using Generative Machine Learning

As renewable energy generation increases, the impacts of weather and climate on energy generation and demand become critical to the reliability of the energy system. However, these impacts are often overlooked. Global climate models (GCMs) can be used to understand possible changes to our climate, but their coarse resolution makes them difficult to use in energy system modelling. Here we present open-source generative machine learning methods that produce meteorological data at a nominal spatial resolution of 4 km at an hourly frequency based on inputs from 100 km daily-average GCM data. These methods run 40 times faster than traditional downscaling methods and produce data that have high-resolution spatial and temporal attributes similar to historical datasets. We demonstrate that these methods can be used to downscale projected changes in wind, solar and temperature variables across multiple GCMs including projections for more frequent low-wind and high-temperature events in the Eastern United States.

climate change↗
DOE OSTI2021

A Comparison of Time Series Gap-Filling Methods to Impute Solar Radiation Data

Complete solar resource datasets play a critical role at every stage of solar project phases. However, measured or modeled solar resource data come with significant uncertainties and usually suffer from several issues, including but not limited to, data gaps, data quality issue, etc. In order to mitigate these issues an appropriate data imputation method should be implemented to build a complete and reliable temporal (and spatial) database. Being motivated by this, in this study we compare the performances of eight different gap filling methods extensively by creating random and artificial data gaps in (i) hourly irradiance data for one year using a few locations of the National Solar Radiation Database (NSRDB) and (ii) one-minute ground measurement dataset from Surface Radiation Budget Network (SURFRAD) stations.

clearness index↗
DOE OSTI2023

Integration of a physics-based direct normal irradiance ($\mathrm{DNI}$) model to enhance the National Solar Radiation Database ($\mathrm{NSRDB}$)

The National Solar Radiation Database (NSRDB) is an extensively used dataset that furnishes satellite-retrieved solar resource data across the United States and an expanding list of other countries. Although the NSRDB uses a physical model to compute global horizontal irradiance (GHI), it currently employs an empirical approach based on surface observations to estimate cloudy-sky direct normal irradiance (DNI). Recently, a new physics-based approach, known as the Fast All-sky Radiation Model for Solar applications with DNI (FARMS-DNI), was developed to improve DNI forecasting. FARMS-DNI integrates direct and scattered solar radiances within the circumsolar region, resulting in improved day-ahead forecasting of DNI by incorporating it into the Weather Research and Forecasting model with Solar extensions (WRF-Solar). This study incorporates FARMS-DNI into the NSRDB algorithm to produce high-spatiotemporal-resolution DNI data from satellite data. The accuracy of the NSRDB based on FARMS-DNI is analyzed using surface observations from 19 sites situated within the National Oceanic and Atmospheric Administration (NOAA) Surface Radiation Budget (SURFRAD) and Solar Radiation (SOLRAD) networks, the University of Oregon (UO) network, the U.S. Department of Energy (DOE) Atmospheric Radiation Measurement (ARM) network, and at the National Renewable Energy Laboratory (NREL). The results demonstrate that FARMS-DNI reduces the significant overestimation of DNI in the conventional NSRDB at all surface sites, particularly in cloud overcast conditions classified using both satellite retrievals and surface observations. Consequently, this new model can effectively improve the overall accuracy of the NSRDB. The results also suggest that further improvement of DNI estimates at individual time steps, however, requires advanced satellite techniques and precise identification of clouds and retrieval of cloud properties.

14 SOLAR ENERGY↗
DOE OSTI2020

Evaluation of the PV Resource Dataset in Central and North America: Preprint

A recent effort from the National Renewable Energy Laboratory (NREL) has led to a new radiative transfer model, Fast All-sky Radiation Model for Solar applications with Narrowband Irradiances on Tilted surfaces (FARMS-NIT), to efficiently compute plane-of-array (POA) irradiance. This model has been implemented by the National Solar Radiation Data Base (NSRDB) to provide photovoltaic (PV) resource over Central and North America in both narrow- and broad wavelength bands. This study conducts a comprehensive evaluation of the PV resource dataset using surface-based observations in various climate zones. The results demonstrate the PV resource has an excellent agreement with the cloudy-sky observations from thermopiles and reference cells.

41 EE - Solar Energy Technologies Office (EE-4S)↗
DOE OSTI2024

Data-Driven Model for Photovoltaic Generation: Comparison with Physical Models Using a Microgrid in Puerto Rico

Photovoltaic (PV) generation is a critical component of microgrids, but its accurate modeling is challenging due to the complex and dynamic interactions between solar irradiance, temperature, and PV system installation. This paper develops a multilayer perceptron (MLP) model that inputs solar irradiance and temperature to estimate the PV generation, and it compares the proposed data-driven model’s performance to two well-known physical models: the single-diode model and the inverter model. The results demonstrate that all the models can reach high levels of accuracy. However, the MLP model outperforms the physical models on average by 4.5 to 6.6 percent in R squared scores and 220 to 290 Watts in RMSE scores, and it does not require physical system parameters. Moreover, the data-driven model can overcome the limitations of the lack of real-time PV generation data.

R pesante colón, Marcos↗
DOE OSTI2023

Subordinated Gaussian Processes for Solar Irradiance

Traditionally the power grid has been a one-way street with power flowing from large transmission-connected generators through the distribution network to consumers. This paradigm is changing with the introduction of distributed renewable energy resources (DERs), and with it, the way the grid is managed. There is currently a dearth of high fidelity solar irradiance datasets available to help grid researchers understand how expansion of DERs could affect future power system operations. Realistic simulations of by-the-second solar irradiances are needed to study how DER variability affects the grid. Irradiance data are highly non-stationary and non-Gaussian, and even modern time series models are challenged by their distributional properties. We develop a subordinated non-Gaussian stochastic model whose simulations realistically capture the distribution and dependence structure in measured irradiance. We illustrate our approach on a fine resolution dataset from Hawaii, where our approach outperforms standard nonlinear time series models.

MATHEMATICS AND COMPUTING,SOLAR ENERGY↗