Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Using containers to speed up development, to run integration tests and to teach about distributed systems

GlideinWMS is a workload manager provisioning resources for many experiments including CMS and DUNE. The software is distributed both as native packages and specialized production containers. Following an approach used in other communities like web development we built our workspaces, system-like containers to ease development and testing. Developers can change the source tree or check out a different branch and quickly reconfigure the services to see the effect of their changes. In this paper, we’ll talk about what differentiates workspaces from other containers. We’ll describe our base system composed of three containers. A one-node cluster including a compute element and a batch system. A GlideinWMS Factory controlling pilot jobs. And a scheduler and Frontend, to submit jobs and provision resources. Additional containers can be used for optional components. This system can easily run on a laptop and we’ll share our evaluation of different container runtimes, with an eye for ease of use and performance. Finally, we’ll talk about our experience as developers and with students. The GlideinWMS workspaces are easily integrated with IDEs like VS Code, simplifying debugging and allowing development and testing of the system also when offline. They simplified the training and onboarding of new team members and Summer interns. And they were useful in workshops where students could have first-hand experience with the mechanisms and components that, in production, run millions of jobs.

Mambelli, Marco↗
DOE OSTI2025

Using Containers to Speed Up Development, to Run Integration Tests and to Teach About Distributed Systems

GlideinWMS is a workload manager provisioning resources for many experiments, including CMS and DUNE. The software is distributed both as native packages and specialized production containers. Following an approach used in other communities like web development, we built our workspaces, system-like containers to ease development and testing. Developers can change the source tree or check out a different branch and quickly reconfigure the services to see the effect of their changes. In this paper, we will talk about what differentiates workspaces from other containers. We will describe our base system, composed of three containers: a one-node cluster including a compute element and a batch system, a GlideinWMS Factory controlling pilot jobs, and a scheduler and Frontend to submit jobs and provision resources. Additional containers can be used for optional components. This system can easily run on a laptop, and we will share our evaluation of different container runtimes, with an eye for ease of use and performance. Finally, we will talk about our experience as developers and with students. The GlideinWMS workspaces are easily integrated with IDEs like VS Code, simplifying debugging and allowing development and testing of the system even when offline. They simplified the training and onboarding of new team members and summer interns. And they were useful in workshops where students could have first-hand experience with the mechanisms and components that, in production, run millions of jobs.

Mambelli, Marco [Fermilab] (ORCID:0000000294892681↗
DOE OSTI2024

Model-Based Detection of Coordinated Attacks (DCA) in Distribution Systems

The fast-paced growth in digitization of smart grid components enhances system observability and remote-control capabilities through efficient communication. However, enhanced connectivity results in heightened system vulnerability towards cybersecurity risks in the cyber-physical power system. Coordinated cyber-attacks (CCA), when undetected, lead to system-wide impact in terms of large disturbances or widespread outages. Detecting CCA in the cyber layer is critical to thwart cyber-attacks in real-time before the attack impacts the physical system. The challenge of locating CCA stems from the complex grid dynamics, making it difficult to distinguish between normal operational variations and cyber-attack impact. CCA often employs multiple attack vectors targeting geographically distributed components, further complicating CCA identification. Existing research in intrusion detection is primarily focused on the transmission network and limited to detecting individual attacks. In this paper, a novel proactive DCA strategy is proposed for early detection of CCA by establishing correlations among distinct attack events through model-based reinforcement learning that utilizes abductive reasoning to conclude the attacker goal. The solution includes understanding the system model, learning the system dynamics, and correlating individual cyber-attacks to extract the attacker’s objective. The developed learning algorithm identifies the most probable attack path to reach the attacker’s objective by predicting the next attack steps. A DNP3-based cyber-physical co-simulation testbed is developed to test the proposed algorithm using the IEEE 13-node test feeder.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Self-Assembling Microgrids for Resilient Distribution Systems of the Future: Implementation in a Commercial DERMS Platform

Microgrids have long provided resilience to critical facilities such as hospitals and military installations, and they are now increasingly being looked at as a building block for future grids to support the energy resilience needs of the grid of the future. State-of-the-art technologies, such as blackstart algorithms using renewable distributed energy resources (DERs) to effectively and seamlessly form microgrids, have been produced by national labs over the years. Their adoption by the utility industry would be critical to reap the most benefits toward energy and climate resilience, and the pathway is via commercialization of these self-assembling microgrid algorithms by integrating them in a commercial product platform. This project brings a national labs team (LLNL, LANL) together with a vendor (Smarter Grid Solutions) to perform proof-of-concept integration of the algorithms into the vendor’s commercial Distributed Energy Resources Management System (DERMS). The project provides a strong pathway to commercialization of the algorithms thereby promoting adoption of resilient microgrid technology by utilities to offer resilience benefits to all customers and especially to disadvantaged and underserved communities.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

Data-Informed Synthetic Networks of Water Distribution Systems for Resilience Analysis in Puerto Rico

The increasing potential of infrastructure disruptions calls for high-quality infrastructure models to be used in resilience analysis and decision making. Unfortunately, many utilities and communities do not have access to accurate and detailed models due to a lack of data and resources. Furthermore, security restrictions on sharing infrastructure models present roadblocks to research, analysis, and decision making. Recent advances in the development of synthetic water distribution models provide a potential solution to this problem. There is an opportunity to improve these methods by leveraging incomplete pipe datasets to aid synthetic network generation. To address this gap, we developed a methodology for synthetic network generation that incorporates partial pipe data using a modification of the minimum cost flow algorithm for network generation and pipe sizing. This methodology demonstrates how partial pipe data can be leveraged to improve site-specific synthetic network generation. For the study area of Mayagüez, Puerto Rico, a synthetic model generated using 50% of real pipe data matches the pressure of the validation system with an average error of 23.5 m of head, which improves upon the average error of 31.6 m of head produced by a synthetic model generated using no data of the real pipes. Additionally, synthetic networks are shown to replicate the pressure response under a disruption scenario of the validation network, suggesting potential use in resilience analysis.

resilience analysis↗
DOE OSTI2024

Custom Accessors: Enabling Scalable Data Ingestion, (Re-)Organization, and Analysis on Distributed Systems

The emerging class of high velocity and high volume data analytic workflows comprise interwoven data ingestion, organization, and processing stages, with ingestion and organization steps often contributing comparable or even higher computational costs than actual processing steps. Since complex workflows consist of a variety of phases that view and use data differently, being able to construct efficient, scalable, distributed data structures (arrays, vectors, sets, maps, and multi-maps) is essential and requires custom methods to extend and shrink containers, analyze and position data, and, maintain globallyconsistent meta-data. In this paper, we propose a novel datastructure access paradigm based on the concept of Accessors. At a high level, accessors are customizable callable objects that can modify the behavior of insert, read, update, and delete operations for distributed containers while preserving atomicity guarantees. Accessors provide a very clean and natural way to implement a variety of programming patterns, e.g., conditional insertion/deletion and cascading computations, which would be otherwise hard (or even impossible) to express in parallel and distributed settings without using locks. We demonstrate the practicality and usefulness of our approach with two representative use cases and study the performance of these applications on a distributed High-Performance Computing system. Our analysis highlights that our proposed abstraction allows for an effective overlapping and concurrent execution of different workflow steps (e.g., data ingestion and analysis), which in a conventional analytics pipeline would execute sequentially, contributing cumulatively to the overall latency.

Castellana, Vito G. [BATTELLE (PACIFIC NW LAB)] (O↗
DOE OSTI2024

Technical Impacts of Light-Duty and Heavy-Duty Transportation Electrification on a Coordinated Transmission and Distribution System

In this study, we propose a strategy to model the required spatiotemporal charging demand from light-duty (LD) and medium- and heavy-duty (MHD) electric vehicles (EVs) using actual transportation data by mapping the demand for the required EV charging to a realistic and coordinated distribution and transmission electric grid at the predicted times of the day to study their impact on the power system in a variety of load, weather, and EV penetration scenarios. This work is the first study that includes the actual weather data and transportation data with realistic and coordinated distribution and transmission grid data in a large industry-scale level study. The main goal of this study is to identify possible issues and required upgrades in the electric grid, caused by an increase in EV integration. The transmission case study is a large grid with 6717 buses over a Texas footprint, and the distribution grid is over Houston, a city in Texas, covering over three million customers. The resulting overloads and voltage violations experienced in the system are discussed, and required planning upgrades to avoid these issues are suggested.

AC optimal power flow (AC-OPF)↗
DOE OSTI2024

Distribution System Behind-the-Meter DERs: Estimation, Uncertainty Quantification, and Control

This paper summarizes the three-year technical activities of the IEEE Task Force (TF) on behind-the-meter (BTM) distributed energy resources (DERs): estimation, uncertainty quantification, and control. The potential grid services from BTM DERs are discussed in detail. The paper also reviews the state-of-the-art for BTM DERs visibility, uncertainty quantification, and, optimization and control. Furthermore, different aspects of the market structures associated with BTM DERs are covered, including emerging market and business models. Finally, needs and recommendations are provided for additional areas such as system protection, computing capabilities, algorithm development, market structure design, cyberinfrastructure and security, and hardware and software developments.

behind-the-meter↗
DOE OSTI2025

Machine Learning-Assisted Distribution System Network Reconfiguration Problem

High penetration from volatile renewable energy resources in the grid and the varying nature of loads raise the need for frequent line switching to ensure the efficient operation of electrical distribution networks. Operators must ensure maximum load delivery, reduced losses, and the operation between voltage limits. However, computations to decide the optimal feeder configuration are often computationally expensive and intractable, making it unfavorable for real-time operations. This is mainly due to the existence of binary variables in the network reconfiguration optimization problem. To tackle this issue, we have devised an approach that leverages machine learning techniques to reshape distribution networks featuring multiple substations. This involves predicting the substation responsible for serving each part of the network. Hence, it leaves simple and more tractable Optimal Power Flow problems to be solved. This method can produce accurate results in a significantly faster time, as demonstrated using the IEEE 37-bus distribution feeder. Compared to the traditional optimization-based approaches, a feasible solution is achieved approximately ten times faster for all the tested scenarios.

deep neural networks↗
DOE OSTI2024

Commercialization of Distribution System Load Modeling Tool for Improved DER Interconnection Studies

Residential and commercial buildings have huge potential to contribute value to improve grid resilience by participating grid services. To reveal the significant value, it is critical to estimate the grid service capability from these buildings. Unlike the large-scale distributed energy resources such as wind and solar farms, those buildings need to participate grid services in aggregation, not by individual. Therefore, it is important to appropriately group buildings for aggregation. The load profiles in the same group will have similar characteristics at the same time step, so grid operators can send the grid service signal to the customer group with a higher chance to respond at that time step. In this paper, we develop a load profile clustering method to classify the building-level load profiles for grid service capability estimation. In our two-step clustering approach, we first calculate the total load consumption for each building, clustering the load profiles based on energy consumption level. Then, we further cluster the load profiles in each energy cluster based on the load shape. The parameter selection for each clustering step is discussed. The proposed method is applied on actual building-level load profiles, and the results have proved the effectiveness of this method.

14 SOLAR ENERGY↗
DOE OSTI2026

Data Management for Digital Twin Implementation: Enhancing Existing SCADA Architecture for INL's CITRC Test Distribution System

The United States power grid will continue to experience stress from aging infrastructure, extreme weather, and increasing loads. In order to strengthen resiliency, researchers need to run tests and simulations that model real-life infrastructure. Idaho National Laboratory (INL) is creating a digital twin of its Critical Infrastructure Test Range Complex (CITRC). CITRC is an at-scale grid testbed which can be configured in utility-realistic distribution scenarios for a variety of tests, such as advanced grid protection and control. A digital twin of this infrastructure would support in-depth tests/simulations without risking physical consequences, before trialing devices under test at-scale. This project focuses on the data acquisition part of constructing a digital twin. It investigates the Supervisory Data Acquisition and Control (SCADA) system of CITRC and explores ways to utilize this system for the twin. Future “ideal” at-scale implementations such as upgraded equipment, modern communication protocols, and automation applications are also explored.

24 - POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Forecasting EV Charging Demand on the Distribution System

The U.S. transportation and electricity sectors have historically operated independently, but the growth of electric vehicles (EVs) is driving their convergence. After decades of stagnant demand, utilities must prepare for rising load growth, driven in part by transportation electrification. Utilities must anticipate when and where these new loads will materialize to effectively manage EV growth and maintain grid reliability. This presentation outlines NREL's approach to developing high-resolution EV load datasets for distribution planning, with insights from the Multi-State Transportation Electrification Impact Study on EV and load forecasting, infrastructure requirements, and managed charging strategies.

25 ENERGY STORAGE↗
DOE OSTI2026

Development Fiber Optic Distributed System for Direct Detection of Subsurface Gases Leakages

Carbon, natural gas, and hydrogen gas storage is an emerging solution to safeguard us against pollution, support goals of negative carbon emission, and protect sources of renewable energy. Properly constructed storage wells provide a virtually impervious barrier to any unintended subsurface transmission. The ability to ensure the long-term integrity of such wells is vital to the success of any storage operation and be successful in the public eyes. Therefore, robust monitoring of any gas migration into the subsurface is highly sought. A fiber-optic distributed chemical sensor (DCS) enables monitoring of long-term well integrity along its depth, ensuring the success of any storage operation and bolsters public acceptance of the safety of the reservoir via leak early detection. The same technique can be applied to gas monitoring in pipeline networks and nuclear stockpile monitoring applications. Fiber based Raman spectroscopy enables DCS, as optical fibers can be deployed in virtually any environment and relay spectroscopic information over long distances back to the user. Hollow core fibers (HCF) make excellent DCSs as the air core of the fiber allows gas from the environment to diffuse into the core, which interacts with the laser signal that is carried in the air core. This work builds upon the previous LDRD project, Fiber Optic System for Direct Detection of Carbon Dioxide Leakage in Carbon Storage Wells (21-FS-003), in which the feasibility of Raman spectroscopy detection of Carbon Dioxide (CO2) in HCF detection was demonstrated. We mitigated the risk of this DCS technology by establishing and completing five objectives. The first objective was to model and optically characterize HCF uptake of CO2, establishing the relationship between HCF length, gas diffusion time, detectable gas concentration, and measured Raman intensity. In objective two, we developed a fiber core drilling recipe to enable additional diffusion ports in the fiber core and established a method for maintaining fiber strength and integrity post drilling. Objective three characterized the drilled fibers against the undrilled fibers, establishing the differences in the gas mechanics and optical properties and provided parameters to iterate the drilling process. In objective four, a fusion splicing technique was developed to join the HCF to conventional single-mode fibers, localizing the gas detection point at the drilled HCF hole, emulating a DCS. Lastly, objective five was the testing of the sensor in Edgar Mines at Colorado School of Mines on a CO2 pipeline with a simulated leak, to showcase the ability to detect CO2 leaks. This capstone result showed CO2 leak detection in < 10 minutes, raising the technology readiness level of HCF segments as deployable DCS.

organic↗
DOE OSTI2024

The power reliability event simulator tool (PRESTO): A novel approach to distribution system reliability analysis and applications

The growing interest in onsite solar photovoltaic and energy storage systems is partially motivated by customer concerns regarding grid reliability. However, accurately assessing the effectiveness of PVESS in mitigating these interruptions requires a comprehensive understanding of location-specific outage patterns and the ability to simulate realistic scenarios. To address the gap, we introduce the Power Reliability Event Simulation TOol (PRESTO), the first publicly available tool that simulates location-specific power interruptions at the county level. PRESTO allows for a more realistic assessment of system reliability by considering the unpredictability and location-specific patterns of power interruptions. We applied PRESTO in a case study of a single-family home across three U.S. counties, examining the performance of a solar photovoltaic system with 10kWh of battery storage during short-duration power interruptions. Our findings show that this system reliably met 93% of energy demand for essential non-heating and cooling loads, fully serving these loads in 84% of events, despite the constraints of daily time-of-use bill management which limits the battery's state-of-charge reserve. However, when heating and cooling loads were included, system performance decreased significantly, with only 70% of demand met and full service in 43% of events. These results highlight the challenges of using solar photovoltaic and energy storage systems for short-duration outages, emphasizing the need to consider factors like battery size and grid charging strategies to improve reliability. Our study demonstrates the practical applications of PRESTO, providing valuable insights into potential mitigation strategies including grid charging and optimizing battery size.

14 SOLAR ENERGY↗
DOE OSTI2025

Mini Guide: Community Engagement Approaches for Distribution System Resilience

The focus on electric grid resilience has gained significant momentum in recent years. The imperatives behind this focus are multifaceted, including the escalating threats of climate change, extreme weather events, and cyber and physical attacks. These challenges expose the vulnerabilities of the country’s aging grid infrastructure and underscore the important

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Advanced Intelligent Sensor Development and Demonstration for Future Distribution Systems with High Penetration DERs

The nation’s electric grid is evolving to supply the electricity needed for economic growth, health, and quality of life. As the DOE has pointed out “Old Tools Won’t Solve New Problems” This project conceived, designed, built, and demonstrated a new tool that promises to make the emerging grid dependable at a lower cost. The tool is a smart sensor with the sensitivity and the bandwidth to measure actionable information about grid health that was unmeasurable.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Current Best Practices on Wildfire Risk Reduction for Electric Transmission and Distribution Systems

This report provides a set of best practices in response to Section 4(d) of Executive Order 14308, Empowering Commonsense Wildfire Prevention and Response. The information contained herein is expected to be used in conjunction with other materials at the Federal Energy Regulatory Commission Wildfire Risk Mitigation Technical Conference (Docket No. AD25-16-000), with possible direction to the North American Electric Reliability Corporation to take action. The objective of this report is to provide an overview of existing and emerging best practices currently employed or planned by utilities for wildfire mitigation, demonstrating how these efforts align with the executive order’s emphasis on reducing electric utility–caused wildfires while also balancing cost-effectiveness. Additionally, while most practices in utility-developed wildfire mitigation plans focus on risk reduction through robustness and operational reliability, this report also discusses best practices for resilience. The best practices are adopted from publicly available utility wildfire mitigation plans from the United States and Canada, recent findings from wildfire risk reduction research, and industry engagement.

24 POWER TRANSMISSION AND DISTRIBUTION↗