SEARCH · Search NASA

Results for “disaggregation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

All sources NASA NTRS DOE OSTI

DOE OSTI2023

A Modified Sequence-to-point HVAC Load Disaggregation Algorithm

This paper presents a modified sequence-to-point (S2P) algorithm for disaggregating the heat, ventilation, and air conditioning (HVAC) load from the total building electricity consumption. The original S2P model is convolutional neural network (CNN) based, which uses load profiles as inputs. We propose three modifications. First, the input convolution layer is changed from 1D to 2D so that normalized temperature profiles are also used inputs to the S2P model. Second, a drop-out layer is added to improve adaptability and generalizability so that the model trained in one area can be transferred to other geographical areas without labelled HVAC data. Third, a fine-tuning process is proposed for areas with a small amount of labelled HVAC data so that the pre-trained S2P model can be fine-tuned to achieve higher disaggregation accuracy (i.e., better transferability) in other areas. The model is first trained and tested using smart meter and sub-metered HVAC data collected in Austin, Texas. Then, the trained model is tested on two other areas: Boulder, Colorado and San Diego, California. Simulation results show that the proposed modified S2P algorithm outperforms the original S2P model and the support-vector machine based approach in accuracy, adaptability, and transferability.

Ye, Kai↗

DOE OSTI2023

An ICA-Based HVAC Load Disaggregation Method Using Smart Meter Data

This paper presents an independent component analysis (ICA) based unsupervised-learning method for heat, ventilation, and air-conditioning (HVAC) load disaggregation using row-resolution (i.e., 15 minutes) smart meter data. We first demonstrate that the electricity consumption profiles on mild-temperature days can be used to approximate the base load on hot days. A residual load profile can then be calculated by subtracting the mild-day load profile from the hot-day load profile. The residual load profiles are processed using ICA for HVAC load extraction. An optimization-based algorithm is proposed for post-adjustment of the ICA results, considering two bounding factors for enhancing the robustness of the ICA algorithm. First, we use the hourly HVAC energy bounds computed from the relationship between HVAC load and temperature to remove unrealistic HVAC load spikes. Second, we exploit the dependency between the daily nocturnal and diurnal loads extracted from historical meter data to smooth the base load profile. Pecan Street data with sub-metered HVAC data were used to test and verify the proposed methods. Simulation results demonstrated that the proposed method is computationally efficient and robust across multiple customers.

Kim, Hyeonjin↗

NASA NTRS2019

Passive/active Microwave Soil Moisture Change Disaggregation Using Smapvex12 Data

The SMAPVEX12 (Soil Moisture Active Passive (SMAP) Validation Experiment 2012) experiment was conducted during June-July 2012 in Manitoba, Canada with the goal of collecting remote sensing data and ground measurements for the development and testing of soil moisture retrieval algorithms under varying vegetation and soil conditions for the SMAP satellite. The aircraft based soil moisture data provided by the passive/active microwave sensor PALS (Passive and Active L-band System) has a nominal spatial resolution of 1600 m. However, this resolution is not compatible with agricultural, meteorological and hydrological studies that require high spatial resolutions and this issue can be solved by soil moisture disaggregation. The soil moisture disaggregation algorithm integrates radiometer soil moisture retrievals and high-resolution radar observations and it can provide soil moisture estimates at a finer scale than the radiometer data alone. In this study, a change detection algorithm was used for disaggregation of coarse resolution passive microwave soil moisture retrievals with radar backscatter coefficients obtained from the higher spatial resolution UAVSAR (Unmanned Air Vehicle Synthetic Aperture Radar) at crop field scale. The accuracy of the disaggregated change in soil moisture was evaluated using ground based soil moisture measurements collected during SMAPVEX12 campaign. The results showed that soil moisture spatial variabilities were better characterized by the disaggregated change in soil moisture estimates at 5 m / 800 m resolution as well as good agreement with in situ measurements. It also showed that VWC (Vegetation Water Content) did not have a big impact on disaggregation algorithm performance, with R2 of the disaggregated results ranging 0.628-0.794. The 5 m and 800m resolution disaggregated soil moisture did no show significant difference in statistical performance variables.

Radar Backscatter↗

DOE OSTI2024

Evaluating the potential of disaggregated memory systems for HPC applications

Summary Disaggregated memory is a promising approach that addresses the limitations of traditional memory architectures by enabling memory to be decoupled from compute nodes and shared across a data center. Cloud platforms have deployed such systems to improve overall system memory utilization, but performance can vary across workloads. High‐performance computing (HPC) is crucial in scientific and engineering applications, where HPC machines also face the issue of underutilized memory. As a result, improving system memory utilization while understanding workload performance is essential for HPC operators. Therefore, learning the potential of a disaggregated memory system before deployment is a critical step. This paper proposes a methodology for exploring the design space of a disaggregated memory system. It incorporates key metrics that affect performance on disaggregated memory systems: memory capacity, local and remote memory access ratio, injection bandwidth, and bisection bandwidth, providing an intuitive approach to guide machine configurations based on technology trends and workload characteristics. We apply our methodology to analyze thirteen diverse workloads, including AI training, data analysis, genomics, protein, fusion, atomic nuclei, and traditional HPC bookends. Our methodology demonstrates the ability to comprehend the potential and pitfalls of a disaggregated memory system and provides motivation for machine configurations. Our results show that eleven of our thirteen applications can leverage injection bandwidth disaggregated memory without affecting performance, while one pays a rack bisection bandwidth penalty and two pay the system‐wide bisection bandwidth penalty. In addition, we also show that intra‐rack memory disaggregation would meet the application's memory requirement and provide enough remote memory bandwidth.

Ding, Nan↗

DOE OSTI2025

Deep Factorization Machine Learning for Disaggregation of Transmission Load Profiles with High Penetration of Behind-The-Meter Solar

The ever-growing integration of distributed energy resources (DERs), especially behind-the-meter (BTM) solar generations, poses imperative operational challenges to system operators such as regional transmission organizations (RTOs). It is important for RTOs to effectively and accurately extract actual load profiles at the transmission level for a single node with significant BTM solar injection. This paper first illustrates the necessity of disaggregating the daily actual load profile of a single node. Furthermore, by segmenting nodes with selected timeseries features, nodes with significant BTM solar generation are identified. Lastly, a bi-level framework is proposed, comprising reference node disaggregation and DeepFM nodal disaggregation, aimed at disaggregating the nodal load profiles from which system operators require more information. By adopting a hybrid Deep Factorization Machine (DeepFM) model, the model achieve accurate results by extracting both linear and nonlinear relations between nodes in the same region and the zonal load and nodal load profile. To overcome the lack of ground truth, this paper segments the load profile into daytime, nighttime, and zero-crossing points and utilizes the latter two for evaluation purposes. The proposed disaggregation procedure is validated using real world, minute-level, normalized, and anonymized nodal data in the PJM service territory.

42 ENGINEERING↗

DOE OSTI2025

An Optimization-Based HVAC Load and PV Disaggregation Methodology With Contextual Supervision

Here, this letter presents an optimization-based Heating, Ventilation, and Air Conditioning (HVAC) and PV disaggregation approach. This letter builds on the previous works of authors, which discuss HVAC disaggregation strategy for aggregated levels without requiring sub-metered information. This letter expands on previous works to discuss optimization-based HVAC disaggregation by varying PV penetration scenarios with joint disaggregation of HVAC load and PV.

Analytics↗

DOE OSTI2023

Semi-Supervised, Non-Intrusive Disaggregation of Nodal Load Profiles With Significant Behind-the-Meter Solar Generation

It is of imperative interests for regional transmission organizations (RTOs) to effectively extract actual load profiles at transmission nodes with significant behind-the-meter solar generation, which remains a gap in the existing technology paradigm. This paper proposes an explicit yet efficient linear estimator to disaggregate actual load profiles at transmission buses with significant behind-the-meter (BTM) solar generations. The proposed estimator is based on disaggregating (i.e., extracting) at locations close to transmission buses under consideration. Further, to overcome the lack of “ground truth” and validate the performance of the proposed algorithms, we first propose semi-supervised mechanisms with parameter tuning as well as unsupervised clustering and leverage the unique characteristics of zero-crossing points in BTM solar peaking behaviors, which we refer to as “Zone-to-Node (Z2N)” methods. Next, we further propose a bi-level Node-to-Node (N2N) framework that improves the overall disaggregation performances compared to Z2N. Numerical results are presented using real-world data at PJM Interconnection.

14 SOLAR ENERGY↗

NASA NTRS2010

Traffic Flow Management Using Aggregate Flow Models and the Development of Disaggregation Methods

A linear time-varying aggregate traffic flow model can be used to develop Traffic Flow Management (tfm) strategies based on optimization algorithms. However, there are no methods available in the literature to translate these aggregate solutions into actions involving individual aircraft. This paper describes and implements a computationally efficient disaggregation algorithm, which converts an aggregate (flow-based) solution to a flight-specific control action. Numerical results generated by the optimization method and the disaggregation algorithm are presented and illustrated by applying them to generate TFM schedules for a typical day in the U.S. National Airspace System. The results show that the disaggregation algorithm generates control actions for individual flights while keeping the air traffic behavior very close to the optimal solution.

Sun, Dengfeng↗

DOE OSTI2023

Feeder Power Disaggregation: A Data-Efficient Matrix Completion Approach

This paper presents a data-driven algorithm for the feeder power disaggregation problem in distribution systems. Leveraging spatio-temporal power patterns in residential homes, residential power is discomposed into three components: sparse-switching loads, periodic loads, and photovoltaic (PV) generation, which are characterized through the design of two sparse matrices and a low-rank matrix. The matrix completion process is data-efficient because of the matrix sparsity and low rankness, along with the use of power system models. The proposed approach is tested using real-world residential data set on a 33-bus distribution system, demonstrating accurate power disaggregation with efficient matrix completion.

distribution system↗

DOE OSTI2023

Net Load Forecasting With Disaggregated Behind-the-Meter PV Generation

As worldwide use of residential photovoltaic (PV) systems grows, system operators and utilities will need to transition from forecasting pure demand to forecasting net load with behind-the-meter (BTM) PV generation. However, PV generation can be difficult to predict and the measurements of PV generation from BTM residential systems are often invisible behind a measurement of the net load, making net load forecasting challenging. This paper proposes a novel two-stage framework for net load forecasting in areas with limited observability and high BTM PV generation. First, the profiles of observable customers are used to disaggregate the net load measurements into the pure load and PV generation. Then, separate models are used to forecast the PV generation and pure load individually, and the results are combined for a net load forecast. Further, this paper also proposes a compensator for correcting the error of the net load forecast, using historical forecast errors of the PV generation, pure load, and net load. The proposed framework is tested through two case studies for areas with high BTM PV penetration and less than 10% observable customers. The two-stage forecasting model is compared to two benchmark methods - a time series forecasting model, and a model that forecasts the net load directly using historical net load measurements. Results show that the proposed disaggregation-forecasting framework reduces the error of the net load forecast compared to both benchmark models. In addition, when the net load forecast error is periodic, the compensator can correct the error to improve the forecast accuracy.

14 SOLAR ENERGY↗

DOE OSTI2024

A Contextually Supervised Optimization-Based HVAC Load Disaggregation Methodology

This paper presents a novel contextually supervised optimization-based approach for disaggregating heating, ventilation, and air-conditioning (HVAC) loads using smart meter or Supervisory Control and Data Acquisition data. To disaggregate the load into HVAC loads, large and infrequently used loads (LIUL), and base loads, we formulate an optimization problem to minimize a set of five loss terms, consisting of the reconstruction errors of the overall load profile, the ramp rate losses, and three distinct loss functions linked with the HVAC load, base load, and LIUL, respectively. To enhance accuracy, we incorporate two forms of contextual information into the problem formulation. First, we utilize mutual information to estimate HVAC energy consumption. Second, we employ a base load dictionary to constrain HVAC load estimation errors. The obtained HVAC load profiles are fine-tuned by abnormal ramp detection followed by binary hypothesis testing. Here, the proposed method is developed and tested using sub-metered residential and commercial building data. Simulation results show that the proposed method outperforms existing methods across various data resolutions and load aggregation levels, showing excellent transferability and generalizability.

24 POWER TRANSMISSION AND DISTRIBUTION↗

DOE OSTI2023

A Field Study of Nonintrusive Load Monitoring Devices and Implications for Load Disaggregation

Evaluations of nonintrusive load monitoring (NILM) algorithms and technologies have mostly occurred in constrained, artificial environments. However, few field evaluations of NILM products have taken place in actual buildings under normal operating conditions. This paper describes a field evaluation of a state-of-the-art NILM product, tested in eight homes. The match rate metric—a technique recommended by a technical advisory group—was used to measure the NILM’s success in identifying specific loads and the accuracy of the energy consumption estimates. A performance assessment protocol was also developed to address common issues with NILM mislabeling and ground-truth comparisons that have not been sufficiently addressed in past evaluations. The NILM product’s estimates were compared to the submetered consumption of eight major appliances. Overall, the product had good performance in disaggregating the energy consumption of the electric water heaters, which included both electric resistance and heat-pump water heaters, but only a fair accuracy with refrigerators, dryers, and air conditioners. The performance was poor for cooking equipment, furnace fans, clothes washers, and dishwashers. Moreover, the product was often unable to detect major loads in homes. Typically, two or more appliances were not detected in a home. At least two dryers, furnace fans, and air conditioners went undetected across the eight homes. On the other hand, the dishwasher was detected in all homes where available or monitored. The key findings were qualitatively compared to those of past field evaluations. Potential areas for improvement in NILM product performance were determined along with areas where complementary technologies may be able to aid in load-disaggregation applications.

47 OTHER INSTRUMENTATION↗

NASA NTRS2018

An Initial Assessment of a SMAP Soil Moisture Disaggregation Scheme Using TIR Surface Evaporation Data over the Continental United States

The Soil Moisture Active Passive (SMAP) mission is dedicated toward global soil moisture mapping. Typically, an L-band microwave radiometer has spatial resolution on the order of 36-40 km, which is too coarse for many specific hydro-meteorological and agricultural applications. With the failure of the SMAP active radar within three months of becoming operational, an intermediate (9-km) and finer (3-km) scale soil moisture product solely from the SMAP mission is no longer possible. Therefore, the focus of this study is a disaggregation of the 36-km resolution SMAP passive-only surface soil moisture (SSM) using the Soil Evaporative Efficiency (SEE) approach to spatial scales of 3-km and 9-km. The SEE was computed using thermal-infrared (TIR) estimation of surface evaporation over Continental U.S. (CONUS). The disaggregation results were compared with the 3 months of SMAP-Active (SMAP-A) and Active/Passive (AP) products, while comparisons with SMAP-Enhanced (SMAP-E), SMAP-Passive (SMAP-P), as well as with more than 180 Soil Climate Analysis Network (SCAN) stations across CONUS were performed for a 19 month period. At the 9-km spatial scale, the TIR-Downscaled data correlated strongly with the SMAP-E SSM both spatially (r = 0.90) and temporally (r = 0.87). In comparison with SCAN observations, overall correlations of 0.49 and 0.47; bias of −0.022 and −0.019 and unbiased RMSD of 0.105 and 0.100 were found for SMAP-E and TIR-Downscaled SSM across the Continental U.S., respectively. At 3-km scale, TIR-Downscaled and SMAP-A had a mean temporal correlation of only 0.27. In terms of gain statistics, the highest percentage of SCAN sites with positive gains (>55%) was observed with the TIR-Downscaled SSM at 9-km. Overall, the TIR-based downscaled SSM showed strong correspondence with SMAP-E; compared to SCAN, and overall both SMAP-E and TIR-Downscaled performed similarly, however, gain statistics show that TIR-Downscaled SSM slightly outperformed SMAP-E.

Disaggregation↗

DOE OSTI2023

Feeder Power Disaggregation: A Data-Efficient Matrix Completion Approach: Preprint

This paper presents a data-driven algorithm for the feeder power disaggregation problem in distribution systems. Leveraging spatio-temporal power patterns in residential homes, residential power is discomposed into three components: sparse-switching loads, periodic loads, and photovoltaic generation, using two sparse matrices and a rank-one matrix. The matrix completion process is data-efficient because of the matrix sparsity and low rankness, along with the use of power system models. The proposed approach is tested using real-world residential datasets on a 33-bus distribution system, demonstrating accurate power disaggregation with efficient matrix completion.

distribution system↗

DOE OSTI2023

Small molecules disaggregate alpha-synuclein and prevent seeding from patient brain-derived fibrils

The amyloid aggregation of alpha-synuclein within the brain is associated with the pathogenesis of Parkinson’s disease (PD) and other related synucleinopathies, including multiple system atrophy (MSA). Alpha-synuclein aggregates are a major therapeutic target for treatment of these diseases. We identify two small molecules capable of disassembling preformed alpha-synuclein fibrils. The compounds, termed CNS-11 and CNS-11g, disaggregate recombinant alpha-synuclein fibrils in vitro, prevent the intracellular seeded aggregation of alpha-synuclein fibrils, and mitigate alpha-synuclein fibril cytotoxicity in neuronal cells. Furthermore, we demonstrate that both compounds disassemble fibrils extracted from MSA patient brains and prevent their intracellular seeding. They also reduce in vivo alpha-synuclein aggregates in C. elegans . Both compounds also penetrate brain tissue in mice. A molecular dynamics–based computational model suggests the compounds may exert their disaggregating effects on the N terminus of the fibril core. These compounds appear to be promising therapeutic leads for targeting alpha-synuclein for the treatment of synucleinopathies.

60 APPLIED LIFE SCIENCES↗

NASA NTRS2021

Assessing Disaggregated SMAP Soil Moisture Products in the United States

A soil moisture (SM) disaggregation algorithm based on thermal inertia (TI) theory was implemented to downscale the Soil Moisture Active Passive (SMAP) Enhanced product(SPL2SMPE) from 9 km to 1 km over the continental United States. The algorithm applies land surface temperature and normalized difference vegetation index from Moderate Resolution Imaging Spectroradiometer (MODIS) at higher spatial resolution to estimate relative soil wetness within a coarse SMAP grid -this MODIS-derived relative wetness is then used to produce the downscaled SMAP SM. Results from the algorithm were evaluated in terms of their spatiotemporal coverage and accuracy using in situ measurements from SMAP Core Validation Sites (CVS), the US Department of Agriculture Soil Climate Analysis Network (USDA-SCAN), and the National Oceanic and Atmospheric Administration Climate Reference Network(NOAA-CRN). Results were also compared with the baselineSPL2SMPE and the SMAP/Sentinel-1 (SPL2SMAPS) 1kmproduct. Overall, the unbiased root mean square error (ubRMSE)of the disaggregated SM at the CVS using the TI approach is approximately 0.04 m3=m3, which is the SMAP mission requirement for the baseline products. The TI approach out performs the SMAP/Sentinel SL2SMAPS 1km product by approximately0.02 m3=m3. Over the agriculture/crop areas from SCAN and CRN sparse network stations, the TI approach exhibits better ubRMSE compared to SPL2SMPE andSPL2SMAPS byabout0.01 and 0.02 m3=m3, indicating its advantage in these areas. However, a drawback of this approach is that there are data gaps due to cloud cover as optical sensors cannot have a clear view of the land surface.

Soil moisture↗

NASA NTRS2022

A Disaggregation Algorithm for the High Resolution Soil Moisture Product from the Upcoming NISAR Mission

The NASA-ISRO Synthetic Aperture Radar (NISAR) is in the developmental stage and is planned to launch in Jan 2024 with two different microwave frequency bands L-band (~1.25 GHz) and S-band (~3.20 GHz), respectively, to provide fine-scale observations at resolutions of 5 to 10 meters. NISAR mission will provide a very high-resolution (200m) soil moisture product globally with a temporal resolution of 6 days, using L-band SAR observations. A data-driven approach is developed for disaggregating the coarse resolution (9 km) soil moisture data to a very high-resolution (200 m) soil moisture product using fine-scale (~ 10 m) NISAR L-band observations. In this study, we used ALOS PALSAR-2 L-band SAR observations in place of expected NISAR L-band observations. The developed disaggregation approach was tested on two different locations of India and USA and showed that the proposed approach has a great potential to estimate soil moisture at a very high resolution of 200m with very low uncertainties (0.02 m3/m3 – 0.04 m3/m3).

Vanama, Venkat↗

DOE OSTI2023

Predictive model for real-time energy disaggregation using long short-term memory

To provide affordable energy-saving solutions for the small and medium-sized manufacturers (SMMs), we propose a unified framework for generating predictive models that support real-time disaggregation of power consumption from combined inputs, enabling automatic machine state identification simultaneously for joint analysis of energy usage patterns. Further, the proposed framework transforms raw power consumption into a time series with look-back and bootstrap capabilities for historical pattern detection, while a learning architecture utilizes the stacked long short-term memory (LSTM) layers as encoders for embedding generation with sequential awareness. Experimental results demonstrate 93.65% minimum accuracy in ideal case of real-time energy usage and machine state prediction.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗