Search NASA⌕ Search

SEARCH · Search NASA

Results for “mean squared error”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 757 records · Page 42

Optimal Bandwidth for Multitaper Spectrum Estimation

A systematic method for bandwidth parameter selection is desired for Thomson multitaper spectrum estimation. We give a method for determining the optimal bandwidth based on a mean squared error (MSE) criterion. When the true spectrum has a second-order Taylor series expansion, one can express quadratic local bias as a function of the curvature of the spectrum, which can be estimated by using a simple spline approximation. This is combined with a variance estimate, obtained by jackknifing over individual spectrum estimates, to produce an estimated MSE for the log spectrum estimate for each choice of time-bandwidth product. The bandwidth that minimizes the estimated MSE then gives the desired spectrum estimate. Additionally, the bandwidth obtained using our method is also optimal for cepstrum estimates. We give an example of a damped oscillatory (Lorentzian) process in which the approximate optimal bandwidth can be written as a function of the damping parameter. Furthermore, the true optimal bandwidth agrees well with that given by minimizing estimated the MSE in these examples.

97 MATHEMATICS AND COMPUTING↗

Provable Convergence of Plug-and-Play Priors With MMSE Denoisers

Plug-and-play priors (PnP) is a methodology for regularized image reconstruction that specifies the prior through an image denoiser. While PnP algorithms are well understood for denoisers performing maximum a posteriori probability (MAP) estimation, they have not been analyzed for the minimum mean squared error (MMSE) denoisers. Here we address this gap by establishing the first theoretical convergence result for the iterative shrinkage/thresholding algorithm (ISTA) variant of PnP for MMSE denoisers. We show that the iterates produced by PnP-ISTA with an MMSE denoiser converge to a stationary point of some global cost function. We validate our analysis on sparse signal recovery in compressive sensing by comparing two types of denoisers, namely the exact MMSE denoiser and the approximate MMSE denoiser obtained by training a deep neural net.

97 MATHEMATICS AND COMPUTING↗

Occlusion-Perturbed Deep Learning for Probabilistic Solar Forecasting via Sky Images

Solar forecasting is shifting to the probabilistic paradigm due to the inherent uncertainty within the solar resource. Input uncertainty quantification is one of the widely used and best-performing ways to model solar uncertainty. However, compared to other sources of inputs, such as numerical weather prediction models, pure sky image-based probabilistic solar forecasting lags behind. In this research, an occlusion-perturbed convolutional neural network, named the PSolarNet, is developed. The PSolarNet provides very short-term deterministic forecasts, forecast scenarios, and probabilistic forecasts of the global horizontal irradiance from sky image sequences. Case studies based on 6 years of open-source data show that the developed PSolarNet is able to generate accurate 10-minute ahead deterministic forecasts with a 5.62% normalized root mean square error, realistic and diverse forecast scenarios with a 0.966 average correlation with the actual time series, and reliable and sharp probabilistic forecasts with a 2.77% normalized continuous ranked probability score.

Bayesian model averaging↗

Numerical Validation of an Algorithm for Combined Soiling and Degradation Analysis of Photovoltaic Systems

We describe and demonstrate an open-source algorithm for simultaneously quantifying degradation and soiling of photovoltaic (PV) systems from energy-production time series data. The new analysis is based on year-on-year degradation rate analysis combined with stochastic rate and recovery soiling analysis. The algorithm is designed to fit into the workflow provided by RdTools, a Python module maintained by NREL and collaboratively developed with the community, which provides a framework and functions for degradation and loss-factor analysis of PV field data. We demonstrate the method on numerically simulated PV data sets and show that it reduces the root-mean-square error of the P50 degradation rate estimate when soiling is present.

14 SOLAR ENERGY↗

Physics-Guided Machine Learning for Prediction of Cloud Properties in Satellite-Derived Solar Data

With over 20 years of high-resolution surface irradiance data covering most of the western hemisphere, the National Solar Radiation Database (NSRDB) is a vital public data asset. The NSRDB uses a two-step Physical Solar Model (PSM) that explicitly considers the effects of clouds and other atmospheric variables on radiative transfer. High-quality physical and optical cloud properties derived from satellite imagery are perhaps the most important data inputs to the PSM, representing the greatest source of radiation attenuation and scattering. However, traditional methods for cloud property retrieval have their own limitations and are unable to accurately predict cloud properties outside of nominal conditions. We introduce a physics-guided neural network that can accurately predict cloud properties when traditional methods fail or are inaccurate. Using this framework, we show reductions in relative Root Mean Square Error (RMSE) for Global Horizontal Irradiance (GHI) up to 13 percentage points for timesteps that previously had missing or low-quality cloud property data. We expect that this methodology will be effective in improving the quality of cloud property and solar irradiance data in the NSRDB.

cloud properties↗

Behind-the-Meter Solar Generation Disaggregation using Consumer Mixture Models

To facilitate deep penetration of solar energy in smart grids, we need high observability of solar generation at the edges of the grid. Current advanced metering infrastructures (AMI) only monitor the aggregated measurements from net-metered households, but disaggregated consumption and solar generation components are required for grid optimizations. We propose an unsupervised disaggregation model for disaggregating solar generation from AMI measurements without the need of training data. The model requires only AMI measurements from consumers in a region and the solar irradiance as input, and models the consumption of consumers by neighboring households without rooftop photovoltaics (PV) to perform the disaggregation. We evaluate our results on a real life dataset from Austin, Texas. We show that our model is able to disaggregate consumption and solar generation measurements with 42.24% and 31.67% less mean squared error, respectively, in comparison to a baseline technique that uses supervised learning. This shows that our model is capable of disaggregating historical data even if the dataset has no training data and only contains minimal exogenous data.

14 SOLAR ENERGY↗

Estimation of Behind-the-Meter Solar Generation by Integrating Physical with Statistical Models

Accurate estimation of solar photovoltaic (PV) generation is crucial for distribution grid control and optimization. Unfortunately, most of the residential solar PV installations are behind-the-meter. Thus, utilities only have access to the net load readings. This paper presents an unsupervised framework for estimating solar PV generation by disaggregating the net load readings. The proposed framework synergistically combines a physical PV system performance model with a statistical model for load estimation. Specifically, our algorithm iteratively estimates solar PV generation with a physical model and electric load with the Hidden Markov model regression. The proposed algorithm is also capable of estimating the key technical parameters of the solar PV systems. Our proposed method is validated against net load and solar PV generation data gathered from residential customers located in Austin, Texas. The validation results show that our method reduces mean squared error by 44% compared to the state-of-the-art disaggregation algorithm.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Enhancement of satellite precipitation estimation via unsupervised dimensionality reduction

A methodology to enhance Satellite Precipitation Estimation (SPE) using unsupervised dimensionality reduction (UDR) techniques is developed. This enhanced technique is an extension to the Precipitation Estimation from Remotely Sensed Imagery using an Artificial Neural Network (PERSIANN) and Cloud Classification System (CCS) method (PERSIANN-CCS) enriched using wavelet features combined with dimensionality reduction. Cloud-top brightness temperature measurements from Geostationary Operational Environmental Satellite (GOES-12) are used for precipitation estimation at 4 km 4 km spatial resolutions every 30 min. The study area in the continental United States covers parts of Louisiana, Arkansas, Kansas, Tennessee, Mississippi, and Alabama. Based on quantitative measures, root mean square error (RMSE) and Heidke skill score (HSS), the results show that the UDR techniques can improve the precipitation estimation accuracy. In addition, ICA is shown to have better performance than other UDR techniques; and in some cases, it achieves 10% improvement in the HSS.

Mahrooghy, Majid↗

An Improved Microwave Semiempirical Model for the Dielectric Behavior of Moist Soils

Soil semiempirical dielectric models (SEMs) are powerful, and they are generally considered a useful hybrid of both empirical and physical models. In this work, the Wang-Schmugge dielectric model is improved to more accurately estimate the relative complex dielectric constants (CDCs) of moist soils. Instead of the Debye relaxation spectrum of liquid water located outside of the soil (i.e., free out-of-soil water) adopted in the Wang-Schmugge model, the Debye relaxation formula related to the free-water component inside the soil [i.e., free soil water (FSW)], which is correlated with the soil texture, is employed in the improved SEM. In addition, the effective conductivity loss term related to both soil texture and soil moisture is introduced to explain the ionic conductivity losses of FSW. Since the soil moisture influence is reduced at high frequencies, the effective conductivity loss term related to only the soil texture is also analyzed for 14-18 GHz. As in the Wang-Schmugge model, the relative CDC of bound soil water varies with the soil volumetric moisture content when the soil moisture is lower than the maximum bound water fraction in the new model, which takes a different approach than the Mironov mineralogy-based SEM. The proposed model obtains better fitting results than the three most widely employed SEMs. Lastly, the improved model exhibits a significantly improved accuracy with a higher correlation coefficient (R²), a closer 1:1 relationship, and a lower root-mean-square error, including in the L-band, and especially in the imaginary part of the L-band.

semiempirical dielectric model (SEM)↗

An Improved Algorithm for Estimating Surface Shortwave Radiation: Preliminary Evaluation With MODIS Products

Cloud parameters, as key inputs in radiative transfer algorithms, have a critical impact on surface shortwave radiation (SSR) computation. By introducing a parameterization of cloud transmittance and reflectance, based on radiative transfer simulations, this study improves the accuracy of an existing physically based model which severely underestimates SSR under thick cloud conditions. The cloud parameterization adopts the single-layer cloud model and simulates cloud transmittances and reflectances by varying cloud optical thickness, cloud particle size, and solar zenith angle. The revised model is applied to estimate instantaneous SSR using Moderate-resolution Imaging Spectroradiometer (MODIS) atmospheric and land products. The retrieved SSR is evaluated against observation data from 41 Baseline Surface Radiation Network (BSRN) stations and is also compared with the MODIS official SSR product. The root mean square error (RMSE) of the estimated instantaneous radiation is approximately 52 and 98 W m -2 under clear-sky and all-sky conditions, respectively. The accuracy of the improved parameterization is higher than that of the original model, and there is no obvious underestimation of SSR in the case of high cloud optical thickness. Therefore, the new algorithm improves the accuracy of SSR estimates in the presence of thick clouds. Retrievals with the improved model also achieve higher accuracy than the MODIS official SSR product (MCD18A1). To conclude, the reliable performance of the scheme at most BSRN stations illustrates that the improved model can be used to map SSR on a global scale.

42 ENGINEERING↗

Detection of False Data Injection Attacks in Battery Stacks Using Input Noise-Aware Nonlinear State Estimation and Cumulative Sum Algorithms

Grid-scale battery energy storage systems (BESSs) are vulnerable to false data injection attacks (FDIAs), which could be used to disrupt state of charge (SoC) estimation. Inaccurate SoC estimation has negative impacts on system availability, reliability, safety, and the cost of operation. In this article a combination of a Cumulative Sum (CUSUM) algorithm and an improved input noise-aware extended Kalman filter (INAEKF) is proposed for the detection and identification of FDIAs in the voltage and current sensors of a battery stack. The series-connected stack is represented by equivalent circuit models, the SoC is modeled with a charge reservoir model and the states are estimated using the INAEKF. Further, the root mean squared error of the states’ estimation by the modified INAEKF was found to be superior to the traditional EKF. By employing the INAEKF, this article addresses the research gap that many state estimators make asymmetrical assumptions about the noise corrupting the system. Additionally, the INAEKF estimates the input allowing for the identification of FDIA, which many alternative methods are unable to achieve. The proposed algorithm was able to detect attacks in the voltage and current sensors in 99.16% of test cases, with no false positives. Utilizing the INAEKF compared to the standard EKF allowed for the identification of FDIA in the input of the system in 98.43% of test cases.

25 ENERGY STORAGE↗

Machine Learning-Driven Reliability Estimation of PV Inverters Considering Alert-Ambient Variability

Weather-induced spatio-temporal degradation limits outdoor PV inverter lifetime and reliability, necessitating advanced data analysis. This study employs a top-down, data-driven approach utilizing multiple machine learning (ML) algorithms to estimate inverter reliability in a 1.4 MW PV power plant, considering factors such as irradiance, humidity, temperature, time of day, and weather conditions. An extensive alert dataset from 17 identical inverters, including alert types, propagation, and frequency, reveals significant correlations with environmental factors and inverter output power, enabling the construction of a performance reliability model. Dual-stage supervised-ML models are evaluated for accuracy, with the ‘classification-regression’ model by an artificial neural network (ANN) tested on the averaged “Alert-Ambient” dataset, which is outperformed by ‘clustering-regression’ models using random forest (RF) and K-Nearest Neighbors (KNN) on individual inverter datasets. K-means clustering applies principal component analysis to reduce dimensions, achieving improved accuracy beyond the 80% achieved by ANN on the averaged dataset. Second-stage regression estimates inverter reliability with a mean square error of 0.0195 on the averaged dataset and as low as 0.002 on individual inverter datasets using RF. Furthermore, these findings highlight the method's suitability for estimating PV inverter output reliability under ambient conditions, essential for digital twin development and related applications.

14 SOLAR ENERGY↗

Real-Time High-Accuracy Digital Wireless Time, Frequency, and Phase Calibration for Coherent Distributed Antenna Arrays

his work presents a fully-digital high-accuracy real-time calibration procedure for frequency and time alignment of open-loop wirelessly coordinated coherent distributed antenna array (CDA) modems, enabling radio frequency (RF) phase coherence of spatially separated commercial off-the-shelf (COTS) software-defined radios (SDRs) without cables or external references such as the global navigation satellite system (GNSS). Building on previous work using high-accuracy spectrally-sparse time of arrival (ToA) waveforms and a multistep ToA refinement process, a high-accuracy two-way time transfer (TWTT)-based time–frequency coordination approach is demonstrated. Due to the two-way nature of the high-accuracy TWTT approach, the time and frequency estimates are Doppler and multipath tolerant, so long as the channel is reciprocal over the synchronization epoch. This technique is experimentally verified using COTS SDRs in a lab environment in static and dynamic scenarios and with significant multipath scatterers. Time, frequency, and phase stability were evaluated by beamforming over coaxial cables to an oscilloscope which achieved time and phase precisions of ~60– 70 ps , with median coherent gains above 99% using optimized coordination parameters, and a beamforming frequency root-mean-square error (RMSE) of 3.73 ppb in a dynamic scenario. Finally, experiments were conducted to compare the performance of this technique with previous works using an analog continuous-wave two-tone (CWTT) frequency reference technique in both static and dynamic settings.

Clock synchronization↗

Filtered Backprojection in Compton Imaging using a Spherical Harmonic Wiener Filter with Pixelated CdZnTe

Filtered backprojection is an image reconstruction technique for Compton imaging that provides reasonably high resolution at much lower computational costs when compared to iterative methods. Here, this work applies a Wiener filter that has been derived for spherical harmonics on Compton imaging using the OrionUM pixelated CdZnTe imaging-spectrometer. To regularize the filter, an investigation is made into the power spectral density of the signal and noise to develop an appropriate spectral signal-to-noise ratio model for the restoration process. Experimental measurements were conducted with two 228Th sources placed 30° apart. The resulting filtered image of the two sources have an average full-width-at-half-maximum (FWHM) of 9.8° or 7.5° when using a mean squared error and structural similarity optimization approach respectively; an improvement from the 29.0° FWHM image when using simple backprojection.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Tomographic Sparse View Selection Using the View Covariance Loss

Standard computed tomography (CT) reconstruction algorithms such as filtered back projection (FBP) and Feldkamp-Davis-Kress (FDK) require many views for producing high-quality reconstructions, which can slow image acquisition and increase cost in non-destructive evaluation (NDE) applications. Over the past 20 years, a variety of methods have been developed for computing high-quality CT reconstructions from sparse views. However, the problem of how to select the best views for CT reconstruction remains open. In this paper, we present a novel view covariance loss (VCL) function that measures the joint information of a set of views by approximating the normalized mean squared error (NMSE) of the reconstruction. We present fast algorithms for computing the VCL along with an algorithm for selecting a subset of views that approximately minimizes its value. Our experiments on simulated and measured data indicate that for a fixed number of views our proposed view covariance loss selection (VCLS) algorithm results in reconstructions with lower NRMSE, fewer artifacts, and greater accuracy than current alternative approaches.

Lin, Jingsong [Purdue University]↗

Effects-Based Monitoring of Geomagnetically-Induced Current Using a Convolutional Neural Network

Geomagnetically-induced current (GIC) due to space weather can flow in the power grid causing undesirable effects such as transformer overheating, misoperation of protection devices, and potential blackouts. It is therefore important to monitor GIC in the power grid to improve online situational awareness and decision-making of system operators during a geomagnetic disturbance. To avoid the costly installation of GIC monitors at transformers’ neutrals, it is desirable to find correlations between GIC and already-monitored parameters. Hence, this work proposed the use of a convolutional neural network (CNN) to compute GIC amplitudes from learned patterns in the time-series data of transformer even harmonic currents. Using an electromagnetic transient program, GIC injection simulations were performed for a modeled Dominion Energy Virginia (DEV) substation with two 504 MVA, 500/230 kV transformers. Data collected from these offline simulations were used to train the CNN to provide online GIC monitoring. Testing the CNN performance involved using real GIC measurements from published literature and from a physical GIC monitor in the DEV area. Finally, the results showed that the proposed method was able to provide GIC readings with a root mean squared error of 1.56 A/phase (equivalent to an average accuracy of 94%) for these real GIC waveforms.

42 ENGINEERING↗

A Solar Time-based Analog Ensemble Method for Regional Solar Power Forecasting

This paper presents a new analog ensemble method for day-ahead regional photovoltaic (PV) power forecasting with hourly resolution. By utilizing open weather forecast and power measurement data, this prediction method is processed within a set of historical data with similar meteorological data (temperature and irradiance), and astronomical date (solar time and earth declination angle). Further, clustering and blending strategies are applied to improve its accuracy in regional PV forecasting. The robustness of the proposed method is demonstrated with three different numerical weather prediction models, the North American Mesoscale Forecast System, the Global Forecast System, and the Short-Range Ensemble Forecast, for both region level and single site level PV forecasts. Using real measured data, the new forecasting approach is applied to the load zone in Southeastern Massachusetts as a case study. In conclusion, the normalized root mean square error (NRMSE) has been reduced by 13.80%-61.21% when compared with three tested baselines.

14 SOLAR ENERGY↗

Joint Estimation of Behind-the-Meter Solar Generation in a Community

Distribution grid planning, control, and optimization require accurate estimation of solar photovoltaic (PV) generation and electric load in the system. Most of the small residential solar PV systems are installed behind-the-meter making only the net load readings available to the utilities. This paper presents an unsupervised framework for joint disaggregation of the net load readings of a group of customers into the solar PV generation and electric load. Our algorithm synergistically combines a physical PV system performance model for individual solar PV generation estimation with a statistical model for joint load estimation. The electric loads for a group of customers are estimated jointly by a mixed hidden Markov model (MHMM) which enables modeling the general load consumption behavior present in all customers while acknowledging the individual differences. At the same time, the model can capture the change in load patterns over a time period by the hidden Markov states. The proposed algorithm is also capable of estimating the key technical parameters of the solar PV systems. Our proposed method is evaluated using the net load, electric load, and solar PV generation data gathered from residential customers located in Austin, Texas. Testing results show that our proposed method reduces the mean squared error of state-of-the-art net-load disaggregation algorithms by 67%.

behind-the-meter solar generation↗