Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed Estimation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Comparing storm resolving models and climates via unsupervised machine learning

Global storm-resolving models (GSRMs) have gained widespread interest because of the unprecedented detail with which they resolve the global climate. However, it remains difficult to quantify objective differences in how GSRMs resolve complex atmospheric formations. This lack of comprehensive tools for comparing model similarities is a problem in many disparate fields that involve simulation tools for complex data. To address this challenge we develop methods to estimate distributional distances based on both nonlinear dimensionality reduction and vector quantization. Our approach automatically learns physically meaningful notions of similarity from low-dimensional latent data representations that the different models produce. This enables an intercomparison of nine GSRMs based on their high-dimensional simulation data (2D vertical velocity snapshots) and reveals that only six are similar in their representation of atmospheric dynamics. Furthermore, we uncover signatures of the convective response to global warming in a fully unsupervised way. Our study provides a path toward evaluating future high-resolution simulation data more objectively.

54 ENVIRONMENTAL SCIENCES↗

Joint modelling of astrophysical systematics for cosmology with LSST cosmic shear

ABSTRACT We present a novel framework for jointly modelling the weak lensing source galaxy redshift distribution and the intrinsic alignment (IA) of galaxies through a shared luminosity function (LF). In the context of a Rubin Observatory’s Legacy Survey of Space and Time (LSST) Year 1 and Year 10 cosmic shear analysis, we show that our novel approach produces cosmological parameter constraints which are comparable to standard methods, while offering more physical insight into IA and selection effects. We clarify the relationship between individual parameters of a Schechter LF and the redshift distribution of a magnitude-limited sample, showing the consequences of marginalizing over these parameters when modelling IAs in standard cosmic shear analyses. We explore the impact of the shape of the LF on the cosmic shear data vector, and we outline the potential of this method to naturally model selection functions in redshift distribution estimation. Although this work focuses on LSST cosmic shear, the proposed joint modelling framework is broadly applicable to weak lensing surveys.

Šarčević, Nikolina (ORCID:0000000173016415)↗

A Mobility-Driven Approach to Modeling Building Energy

Buildings are one of the primary energy consumers in any city's energy use [12]. Presence and absence of humans is a major contributing factor to the energy use in a building. In this paper, we present an approach to generating a realistic model of human building occupancy throughout a typical work week. We use the Toolbox for Urban Mobility Systems (TUMS) to generate a synthetic population based on population distribution estimates, we schedule the population's daily commute based on National Household Travel Survey (NHTS) survey data, and we simulate their daily travel patterns using an agent-based transportation simulation (TRANSIMS). We process and fuse the simulation output to produce a list of the first and last seen location of each agent in the simulation. Based on the arrival at the last destination, we map each agent to one of the nearby buildings. Using these agent arrivals, as well as NHTS data, we create an hourly occupancy schedule for each building. We successfully demonstrate this workflow at the example of the Chicago Loop, a major business district in Chicago, Illinois.

Berres, Andy↗

Multiscale Based Characterization and Classification of Urban Land-Use

Machine learning and deep learning provide a means for generating urban land-use maps with relatively little human effort compared to manually digitizing images. This is especially important for supporting global and regional initiatives focused on sustainability, planning, health, pro-poor policy, infrastructure, and population distribution estimates. Many of these initiatives work in areas where geospatial data is scarce, such as the global south, and often use land-use maps to help achieve their goals. In this study, we develop a typology for automated labeling of urban land-use data that captures the variation in structural patterns within cities. A comparison of classification accuracy between convolutional neural networks (CNNs) and support vector machines (SVMs) coupled with handcrafted features is conducted. Through experimental validation on two highly dense cities in Africa, we report on new insights and the potential benefits offered by both multiscale handcrafted features and multiscale-CNNs even with limited training data.

Arndt, Jacob↗

SONET: a semantic ontological network graph for managing points of interest data heterogeneity

Scalability, standardization, and management are important issues when working with very large Volunteered Geographic Information (VGI). VGI is a rich and valuable source of Points of Interest (POI) information, but its inherent heterogeneity in content, structure, and scale across sources present major challenges for interlinking data sources for analysis. To be useful at scale, the raw information needs to be transformed into a standardized schema that can be easily and reliably used by data analysts. In this work, we tackle the problem of unifying POI categories (e.g. restaurants, temple, and hotel) across multiple data sources to aid in improving land use maps and population distribution estimation as well as support data analysts wishing to fuse multiple data sources with the OpenStreetMap (OSM) mapping platform or working with projects that are already configured in the OSM schema and wish to add additional sources of information. Graph theory and its implementation through the SONET graph database, provides a programmatic way to organize, store, and retrieve standardized POI categories at multiple levels of abstraction. Additionally, it addresses category heterogeneity across data sources by standardizing and managing categories in a way that makes cross-domain analysis possible.

Palumbo, Rachel↗

Arctic Shrub Expansion, Plant Functional Trait Variation, and Effects on Belowground Carbon Cycling (Final Technical Report)

Terrestrial ecosystems are undergoing dramatic changes in response to climate warming, and these changes are expected to feedback to the atmosphere, potentially altering the trajectory of future climate change. Feedbacks from Arctic ecosystems are a major concern because the Arctic is projected to warm significantly in the 21 st century and because >50% of global belowground organic carbon is stored in permafrost and overlying soils. Warming-driven release of this carbon could drastically increase atmospheric greenhouse gas concentrations and accelerate climate warming. Plant communities are also responding to warming, as evidenced by the widely documented increase in woody-shrub growth and “greening” across much of the Arctic tundra biome. This vegetation shift may offset or amplify warming by altering carbon cycling. The direction and magnitude of shrub effects remain highly uncertain, however, due to limited understanding of the consequences of shrub expansion for belowground carbon cycling and simplification of these relationships in models. The major shrubs expanding in the Arctic (Betula, Salix, and Alnus) vary widely with respect to aboveground and belowground traits (e.g., tissue production and chemistry, rooting depth, microbial symbionts), and may also exhibit substantial intraspecific variation in these traits in response to environmental conditions. Such variation is likely to have profound implications for soil carbon cycling. The overarching goal of this project was to improve process-based understanding of the influence of shrub expansion on carbon cycling to enable improved representation of carbon dynamics in ecosystem and Earth system models. We investigated how plant functional traits vary among shrub genera, respond to environmental conditions, and affect belowground carbon and nutrient cycling by quantifying relationships among functional traits and biogeochemical cycling along edaphic gradients nested within a climate gradient in the Alaskan tundra. We found consistent differences in leaf and root traits among shrub genera and between shrubs and a widespread sedge species, indicating diverse nutrient acquisition strategies and belowground impacts among different arctic shrubs. We also found striking differences in trait values among individuals within the same species or genera within sites. Soil parameters were more important than climate parameters for predicting size and leaf trait variation, and root trait responses were less dependent on climate overall. For all but one root trait, including parameters representing aboveground traits improved the predictive ability of models. These results demonstrate that tundra shrub traits vary considerably at local scales and soil factors drive this variation, especially belowground. Furthermore, leveraging information about aboveground traits and soil conditions can improve predictions of how belowground traits will respond to climate change. Despite these differences, soil carbon and nitrogen pools in the active layer did not vary among plots dominated by different shrub or sedge genera. Instead, pool sizes generally decreased from warmer to colder sites, consistent with a productivity gradient. Patterns of isotopic N composition indicate that shrubs tighten nitrogen cycling via nitrogen resorption or immobilization of shrub litter. Overall, these results suggest that further identifying the specific shrub genera in the tundra landscape will ultimately provide better predictions of belowground dynamics across the changing arctic. We also performed simulation experiments with the Terrestrial Ecosystem Model (TEM) incorporated in the Predictive Ecosystem Analyzer (PEcAn) framework, treats model parameters as probability distributions, estimates parameters based on a synthesis of available field data, and then quantifies both model sensitivity and uncertainty to a given parameter or suite of parameters. We performed simulations across different types of tundra, including shrub tundra. One key finding was that both model sensitivity and uncertainty to a given parameter could vary within the same type of tundra, but in a different geographical location, such as over the climate gradient of shrub tundra described above. We organized a special session at the annual meeting of the Ecological Society of America in August 2019 to disseminate our results, refine recommendations for model improvement, and initiate collaborations to implement these recommendations in existing models of tundra carbon dynamics at ecosystem to Earth system scales. Our results support DOE near-term priorities by providing mechanistic insights into the role of vegetation change in the terrestrial carbon cycle in a region that is inadequately represented in Earth system models. Current models reduce the complexity of Arctic vegetation to a small number of plant functional types (PFTs). This approach implicitly assumes that each PFT represents the average ecological function of its constituent species, thus ignoring the effects of trait variation on biogeochemical cycling and potentially leading to large uncertainty in the sign and magnitude of ecosystem feedbacks to climate. By quantifying variation of plant functional traits across broad gradients of climatic and edaphic conditions and elucidating the linkages of such variation with carbon and nutrient cycling, our results illustrate the need and create a foundation for further developing trait-based modeling approaches that allow the traits of PFTs to vary as a function of environmental conditions. These approaches should improve the capacity of simulation models to offer insights into ecosystem carbon dynamics associated with novel plant communities in a rapidly changing Arctic.

54 ENVIRONMENTAL SCIENCES↗

Efficient Network Partitioning: Application for Decentralized State Estimation in Power Distribution Grids: Preprint

Increase in the proliferation of DERs requires real-time situational awareness for efficient grid operations. State estimation plays an important role for real time control and management of the power grid. As the sensing infrastructure grows, aggregating and handling high volumes of data at a centralized location is extremely difficult. To address this challenge, this paper first proposes a novel and efficient hierarchical spectral clustering-based network partition algorithm followed by a decentralized compressive sensing (DCS) based state estimation. The applicability of the proposed network partitioning algorithm is tested on IEEE-123 bus, IEEE-8500 node, and a 6204-node distribution network. The results shows that the proposed approach efficiently divides the network into multiple sub-networks with the minimum edge connections among the neighbors. Then, we perform DCS-based state estimation on the 6204-node distribution network after dividing the network into 18 optimal partitions. Simulation results show that DCS-based state estimation recovers the system states with high accuracy and low complexity.

ADMM↗

Real-Time Distribution System State Estimation with Asynchronous Measurements

We report state estimation is a fundamental task in power systems. Although distribution systems are increasingly equipped with sensing devices and smart meters, measurements are typically reported at different rates and asynchronously; these aspects pose severe strains on workhorse state estimation algorithms, which are designed to process batches of data collected in a synchronous manner from all the measurement units. In this paper, we develop a novel state estimation algorithm to continuously update the estimate of the state based on measurements received in an asynchronous manner from measurement units. The synthesis of the algorithm hinges on a proximal-point type method, implemented in an online fashion, and capable of processing measurements received sequentially from sensors. A performance analysis is presented by providing bounds on the estimation error in terms of the mean and variance that hold at each iteration and asymptotically. The scheme is also compared with a more traditional Weighted Least Squares estimator that compensates for the lack of measurement data by using, as pseudo measurements, the measurement retrieved during a certain time window. Numerical simulations on the IEEE 37-bus feeder corroborate the analytical findings.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Ensemble‐Based Spatially Distributed CLM5 Hydrological Parameter Estimation for the Continental United States

Abstract One of the major challenges in large‐domain hydrological modeling efforts lies in the estimation of spatially distributed hydrological parameters while simultaneously accounting for their associated uncertainties. Addressing this challenge is particularly difficult in ungauged locations. With growing societal demands for large‐scale streamflow projections to inform water resource management and long‐term planning, evaluating and constraining hydrological parameter uncertainty is increasingly vital. This study introduces a hybrid regionalization approach to enhance hydrological predictions of the Community Land Model version 5 (CLM5) across the Continental United States (CONUS), with a total of 50,629 1/8° grid cells. This hybrid method combines the strengths of two existing techniques: parameter regionalization and streamflow signature regionalization. It identifies ensemble behavioral parameters for each 1/8° grid cell across the CONUS domain, tailored to three distinct streamflow signatures focused on low flows, high flows, and annual water balance. Evaluating this hybrid method for 464 CAMELS (Catchment Attributes and Meteorology for Large‐sample Studies) basins demonstrates a significant improvement in CLM5 hydrological predictions, even in challenging arid regions. In CONUS applications, the derived spatially distributed parameter sets capture both spatial continuity and variation of parameters, highlighting their heterogeneous nature within specific regions. Overall, this hybrid regionalization approach offers a promising solution to the complex task of improving hydrological modeling over large domains for important hydrological applications.

CLM5↗

Distribution System State Estimation With High Penetration of Demand Response Enabled Loads

Demand-side operations incentivize utility customers to take part in various grid services. A demand response enabled load (DREL) is a flexible grid asset that schedules electricity consumption in response to a time-of-use (TOU) energy price. Consequently, its energy profile differs from that of a conventional load that is insensitive to price. This difference may cause new challenges for distribution system state estimation (DSSE). It is well known that DSSE often needs to use pseudo-measurements based on historic load profiles to increase system observability. However, historic profiles of conventional loads are not representative of DREL behaviors. Additionally, the inaccuracy impacts DSSE results and other DSSE-dependent operations. In this paper, we propose an online pseudo-measurement generation approach for DSSE with DRELs. We formulate an optimization model to represent DRELs self-adjusting actions. Sampling-based stochastic optimization techniques are proposed to account for uncertainties in DRELs. A set of representative DREL behavior data corresponding to the samples are used to characterize DREL pseudo-measurements. Case studies with modified IEEE 123-bus test system verify the validity of the proposed work.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Efficient Network Partitioning: Application for Decentralized State Estimation in Power Distribution Grids

Increase in the proliferation of distributed energy resources require real-time situational awareness for efficient grid operations. State estimation plays an important role for the real-time control and management of the power grid. As the sensing infrastructure grows, aggregating and handling high volumes of data at a centralized location is extremely difficult. To address this challenge, this paper first proposes a novel and efficient hier-archical spectral clustering-based network partitioning algorithm followed by a decentralized compressive sensing (DCS)-based state estimation. The applicability of the proposed network partitioning algorithm is tested on an IEEE 123-bus network, an IEEE 8,500-node system, and a 6,000+ node distribution network. The results shows that the proposed approach efficiently divides the network into multiple sub-networks with the minimum number of edge connections among the neighbors. Then, we perform DCS-based state estimation on the 6,000+ node distribution network after dividing the network into 18 optimal partitions. Simulation results show that the DCS-based state estimation recovers the system states with high accuracy and low complexity.

alternating direction method of multipliers↗

Analyzing the Effects of Cyberattacks on Distribution System State Estimation

Key components of power systems—such as energy management systems, automatic generation control, and state estimation—are under serious vulnerability from cyberattacks. Cyber threats in electric grids have increased significantly because of the increased interconnectivity of supervisory control and data acquisition systems and public network infrastructure. As the penetration level of distributed energy resources increases, it is imperative to employ system-monitoring techniques such as state estimation for the reliable operation of distribution systems. Recently, multiple methods have been developed that exploit the low rank property of distribution system state matrix and are robust to bad data, such as matrix completion. This paper analyzes the impact of various realistic cyberattack scenarios on matrix completion. Realistic cyberattack scenarios are converted into data corruption models that are used in an extensive simulation of a custom IEEE 123-bus system.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Analyzing the Effects of Cyberattacks on Distribution System State Estimation: Preprint

Key components of power systems—such as energy management systems, automatic generation control, and state estimation—are under serious vulnerability from cyber attacks. Cyber threats in electric grids have increased significantly because of the increased interconnectivity of supervisory control and data acquisition systems and public network infrastructure. As the penetration level of distributed energy resources increases, it is imperative to employ system-monitoring techniques such as state estimation for the reliable operation of distribution systems. Recently, multiple methods have been developed that exploit the low rank property of distribution system state matrix and are robust to bad data, such as matrix completion. This paper analyzes the impact of various realistic cyber attack scenarios on matrix completion. Realistic cyber attack scenarios are converted into data corruption models that are used in an extensive simulation of a custom IEEE 123-bus system.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Net Load Redistribution Attacks on Nodal Voltage Magnitude Estimation in AC Distribution Networks

A high penetration level of smart devices and communication networks increases the threat of cyber-attacks in the distribution system. In this paper, we model a hidden, coordinated, net load redistribution attack (NLRA) in an AC distribution system. Based on local information of an attack region, the attacker’s goal is to create violations in nodal voltage magnitude estimation. Acting as a system operator equipped with global AC state estimation and bad data detection, we validate the stealthiness of the hidden NLRA in multiple attack cases. Simulation results on a modified PG&E 69-node distribution system show the validity of the proposed NLRA. The influence of NLRA on the distribution system is assessed and the impact of attack regions, attack timing, and system observability is also revealed.

Zhang, Hang↗

How to Obtain the Redshift Distribution from Probabilistic Redshift Estimates

Abstract A reliable estimate of the redshift distribution n ( z ) is crucial for using weak gravitational lensing and large-scale structures of galaxy catalogs to study cosmology. Spectroscopic redshifts for the dim and numerous galaxies of next-generation weak-lensing surveys are expected to be unavailable, making photometric redshift (photo- z ) probability density functions (PDFs) the next best alternative for comprehensively encapsulating the nontrivial systematics affecting photo- z point estimation. The established stacked estimator of n ( z ) avoids reducing photo- z PDFs to point estimates but yields a systematically biased estimate of n ( z ) that worsens with a decreasing signal-to-noise ratio, the very regime where photo- z PDFs are most necessary. We introduce Cosmological Hierarchical Inference with Probabilistic Photometric Redshifts ( CHIPPR ), a statistically rigorous probabilistic graphical model of redshift-dependent photometry that correctly propagates the redshift uncertainty information beyond the best-fit estimator of n ( z ) produced by traditional procedures and is provably the only self-consistent way to recover n ( z ) from photo- z PDFs. We present the chippr prototype code, noting that the mathematically justifiable approach incurs computational cost. The CHIPPR approach is applicable to any one-point statistic of any random variable, provided the prior probability density used to produce the posteriors is explicitly known; if the prior is implicit, as may be the case for popular photo- z techniques, then the resulting posterior PDFs cannot be used for scientific inference. We therefore recommend that the photo- z community focus on developing methodologies that enable the recovery of photo- z likelihoods with support over all redshifts, either directly or via a known prior probability density.

79 ASTRONOMY AND ASTROPHYSICS↗