Search NASA⌕ Search

SEARCH · Search NASA

Results for “control algorithms”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 793 records · Page 44
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Training reinforcement learning models via an adversarial evolutionary algorithm

When training for control problems, more episodes used in training usually leads to better generalizability, but more episodes also requires significantly more training time. There are a variety of approaches for selecting the way that training episodes are chosen, including fixed episodes, uniform sampling, and stochastic sampling, but they can all leave gaps in the training landscape. In this work, we describe an approach that leverages an adversarial evolutionary algorithm to identify the worst performing states for a given model. We then use information about these states in the next cycle of training; this process can be repeated until the desired level of model performance is met. We demonstrate this approach with the OpenAI Gym cart-pole problem. With this problem, we show that the adversarial evolutionary algorithm did not reduce the number of episodes required in training needed to attain model generalizability when compared with stochastic sampling, and actually performed slightly worse.

Coletti, Mark↗
DOE OSTI2014

MO-G-BRD-01: Point/Counterpoint Debate: Arc Based Techniques Will Make Conventional IMRT Obsolete

A variety of intensity modulated radiation therapy (IMRT) delivery techniques have been developed that have provided clinicians with the ability to deliver highly conformal dose distributions. The delivery techniques include compensators, step-and-shoot IMRT, sliding window IMRT, volumetric modulated arc therapy (VMAT), and tomotherapy. A key development in the field of IMRT was the introduction of new planning algorithms and delivery control systems in 2007 that made it possible to coordinate the gantry rotation speed, dose rate, and multileaf collimator leaf positions during the delivery of arc therapy. With these developments, VMAT became a routine clinical tool. The use of VMAT has continued to grow in recent years and some would argue that this will soon make conventional IMRT obsolete, and this is the premise of this debate. To introduce the debate, David Shepard, Ph.D. will provide an overview of IMRT delivery techniques including historical context and how they are being used today. The debate will follow with Richard Popple, Ph.D. arguing FOR the Proposition and Peter Balter, Ph.D. arguing AGAINST it. Learning Objectives: Understand the different delivery techniques for IMRT. Understand the potential benefits of conventional IMRT. Understand the potential benefits of arc-based IMRT delivery.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2019

MASK3 for Advanced WEC Dynamics and Controls

This report outlines the "MASK3" wave tank test within the Advanced WEC Dynamics and Controls (AWDC) project. This test represents the final test in the AWDC project. The focus of the MASK3 test was to consider coordinated 3-degree-of-freedom (3DOF) control of a WEC in a realistic ocean environment. A key aspect of this test was the inclusion of a "self-tuning" mechanism which uses an optimization algorithm to update controller gains based on a changing sea state. The successful implementation of the self-tuning mechanism is the last crucial step required for such a controller to be implemented in real ocean environments.

16 TIDAL AND WAVE POWER↗
DOE OSTI2019

Advanced WEC Dynamics and Controls MASK3 Test

Sandia National Laboratories and the Department of Energy (DOE) have completed on a multi-year program to examine the effects of control theory on increasing power produced by resonant wave energy conversion (WEC) devices. The tank tests have been conducted at the Naval Surface Warfare Center Carderock Division (NSWCCD) Maneuvering and Sea Keeping Basin (MASK) in West Bethesda, MD. This report outlines the "MASK 3 " wave tank test within the Advanced WEC Dynamics and Controls (AWDC) project. This test represents the final test in the AWDC project. The focus of the MASK 3 test was to consider coordinated 3 -degree-of-freedom ( 3 DOF) control of a WEC in a realistic ocean environment. A key aspect of this test was the inclusion of a "self-tunine mechanism which uses an optimization algorithm to update controller gains based on a changing sea state. The successful implementation of the self-tuning mechanism is the last crucial step required for such a controller to be implemented in real ocean environments.

16 TIDAL AND WAVE POWER↗
DOE OSTI2017

A Review of Power Distribution Test Feeders in the United States and the Need for Synthetic Representative Networks

Under the increasing penetration of distributed energy resources and new smart network technologies, distribution utilities face new challenges and opportunities to ensure reliable operations, manage service quality, and reduce operational and investment costs. Simultaneously, the research community is developing algorithms for advanced controls and distribution automation that can help to address some of these challenges. However, there is a shortage of realistic test systems that are publically available for development, testing, and evaluation of such new algorithms. Concerns around revealing critical infrastructure details and customer privacy have severely limited the number of actual networks published and that are available for testing. In recent decades, several distribution test feeders and US-featured representative networks have been published, but the scale, complexity, and control data vary widely. This paper presents a first-of-a-kind structured literature review of published distribution test networks with a special emphasis on classifying their main characteristics and identifying the types of studies for which they have been used. As a result, this both aids researchers in choosing suitable test networks for their needs and highlights the opportunities and directions for further test system development. In particular, we highlight the need for building large-scale synthetic networks to overcome the identified drawbacks of current distribution test feeders.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2015

Improvement of Algorithms for Pressure Maintenance Systems in Drum-Separators of RBMK-1000 Reactors

The main tasks and challenges for pressure regulation in the drum-separators of RBMK-1000 reactors are described. New approaches to constructing algorithms for pressure control in drum-separators by electro-hydraulic turbine control systems are discussed. Results are provided from tests of the operation of modernized pressure regulators during fast transients with reductions in reactor power.

21 SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLANTS↗
DOE OSTI2020

A Distributed Control Architecture for Cascaded H-Bridge Converter with Integrated Battery Energy Storage

Cascaded H-bridge topology has been used in grid-tied converters for battery energy storage system due to its modular structure. To fully utilize the converter’s modularity, this paper proposes a hierarchical distributed control architecture that consists of primary control, secondary control and battery state of charge (SOC) balancing control. Primary control ensures accurate current tracking while a distributed secondary control based on consensus algorithm is presented to regulate power sharing among modules and is proved to be stable theoretically. Here, a distributed SOC balancing control is further introduced to improve energy efficiency of battery energy storage system. Finally, the hierarchical distributed control strategy is implemented using hardware controllers and a software platform. Besides, a carrier phase shift control is also implemented to achieve multilevel output voltage and harmonic reduction. The experimental results demonstrate the performance of the proposed control scheme effectively.

25 ENERGY STORAGE↗
DOE OSTI2016

Image segmentation for uranium isotopic analysis by SIMS: Combined adaptive thresholding and marker controlled watershed approach

A novel approach to particle identification and particle isotope ratio determination has been developed for nuclear safeguard applications. This particle search approach combines an adaptive thresholding algorithm and marker-controlled watershed segmentation (MCWS) transform, which improves the secondary ion mass spectrometry (SIMS) isotopic analysis of uranium containing particle populations for nuclear safeguards applications. The Niblack assisted MCWS approach (a.k.a. SEEKER) developed for this work has improved the identification of isotopically unique uranium particles under conditions that have historically presented significant challenges for SIMS image data processing techniques. Particles obtained from five NIST uranium certified reference materials (CRM U129A, U015, U150, U500 and U850) were successfully identified in regions of SIMS image data 1) where a high variability in image intensity existed, 2) where particles were touching or were in close proximity to one another and/or 3) where the magnitude of ion signal for a given region was count limited. Analysis of the isotopic distributions of uranium containing particles identified by SEEKER showed four distinct, accurately identified 235U enrichment distributions, corresponding to the NIST certified 235U/238U isotope ratios for CRM U129A/U015 (not statistically differentiated), U150, U500 and U850. Additionally, comparison of the minor uranium isotope (234U, 235U and 236U) atom percent values verified that, even in the absence of high precision isotope ratio measurements, SEEKER could be used to segment isotopically unique uranium particles from SIMS image data. Although demonstrated specifically for SIMS analysis of uranium containing particles for nuclear safeguards, SEEKER has application in addressing a broad set of image processing challenges.

adaptive thresholding↗
DOE OSTI2021

Scalable/Secure Cooperative Algorithms and Framework for Extremely-high Penetration Solar Integration (SolarExPert) (Final Technical Report)

This SolarExPert project has developed a Sustainable Grid Platform (SGP) with scalable architecture of distributed control and optimization. The SGP consists of the following major functions: 1) an advanced grid architecture with hierarchical and distributed communication and control, combined with the OpenFMB standard and implemented on the Multi-Agent OpenDSS (MA-OpenDSS) platform; 2) an online distributed stochastic optimal power flow; 3) an online distributed system state estimation algorithm; 4) the distributed Volt/VAR optimization and frequency control algorithms; 5) the distributed distribution system restoration strategy. The developed SGP together with advanced functions are tested in 1 million (1M)-node distribution system on the MA-OpenDSS platform. Furthermore, the models and algorithms are tested in 100,000-node system HiL simulation, and also in P-HiL implementation with 100 physical devices. The developed functions haven been validated and tested on the selected actual distribution feeder with the data collected from the field of Maui Meadows in Hawaii. The distributed PV hosting capacities with cooperative Volt/VAR and Volt/VAR/Watt control are estimated and compared to provide recommendations for customers and the utility company.

14 SOLAR ENERGY↗
DOE OSTI2022

Prevalence and scalable control of localized networks

The ability to control network dynamics is essential for ensuring desirable functionality of many technological, biological, and social systems. Such systems often consist of a large number of network elements, and controlling large-scale networks remains challenging because the computation and communication requirements increase prohibitively fast with network size. Here, we introduce a notion of network locality that can be exploited to make the control of networks scalable, even when the dynamics are nonlinear. We show that network locality is captured by an information metric and is almost universally observed across real and model networks. In localized networks, the optimal control actions and system responses are both shown to be necessarily concentrated in small neighborhoods induced by the information metric. This allows us to develop localized algorithms for determining network controllability and optimizing the placement of driver nodes. This also allows us to develop a localized algorithm for designing local feedback controllers that approach the performance of the corresponding best global controllers, while incurring a computational cost orders-of-magnitude lower. Here, we validate the locality, performance, and efficiency of the algorithms in Kuramoto oscillator networks, as well as three large empirical networks: synchronization dynamics in the Eastern US power grid, epidemic spreading mediated by the global air-transportation network, and Alzheimer’s disease dynamics in a human brain network. Taken together, our results establish that large networks can be controlled with computation and communication costs comparable to those for small networks.

42 ENGINEERING↗
DOE OSTI2020

Implementation Plan for Combined Heat and Power Systems VOLTTRON Controller: Performance Monitoring and Real-Time Commissioning Algorithm Verification

Building-integrated cooling, heating, and power (CHP) systems are more efficient than conventional systems at providing local power and thermal energy, and favorable fuel prices are bound to spur their increased adoption. However, to realize the full benefit of the CHP systems, we must ensure persistence of energy efficient operations. Much of the inefficiency in the current building operations can be eliminated by use of automated performance monitoring (PM), real-time commissioning verification (CxV) and automated fault detection and diagnostic (AFDD) tools. Automation can help system operators make intelligent decisions. Remote and continuous monitoring of system conditions and performance will enable better management and integration of CHP with existing building systems. Continuous PM, real-time CxV, and AFDD could alleviate burdens for operations staff, enhance operations and maintenance (O&M), and improve reliability of building and CHP systems. To address the O&M challenges and to provide a means to maximize the rate-of-return of building-integrated CHP systems, the Building Technologies Office (BTO) within the U.S. Department of Energy’s (DOE’s) Office of Energy Efficiency and Renewable Energy (EERE) initiated a project to design, develop, and field test a VOLTTRON™-based supervisory controller and associated open-source algorithms. These algorithms will ensure real-time optimal operation of a building-integrated CHP system, support electric grid reliability, and lead to achieving the goal of clean, efficient, reliable, and affordable next-generation integrated energy system. Previous report listed the components for which PM, real-time CxV, and AFDD algorithms will be developed, how the algorithms will be tested, and the metrics that will be used to validate the algorithms and their ease of deployment. Deployment of these algorithms in the field will result in a reduction in energy consumption of between 10% and 20% (for both CHP and conventional building systems). This report builds upon the previous report by detailing the process by which PNNL will implement performance monitoring and real-time commissioning algorithms for CHP systems in conjunction with the use of the VOLTTRON CHP economic dispatch agent in host facilities.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2013

Lighting energy savings potential of split-pane electrochromic windows controlled for daylighting with visual comfort

A simulation study was conducted to evaluate lighting energy savings of split-pane electrochromic (EC) windows controlled to satisfy key visual comfort parameters. Using the Radiance lighting simulation software, interior illuminance and luminance levels were computed for a south-facing private office illuminated by a window split into two independently-controlled EC panes. The transmittance of these was optimized hourly for a workplane illuminance target while meeting visual comfort constraints, using a least-squares algorithm with linear inequality constraints. Blinds were successively deployed until visual comfort criteria were satisfied. The energy performance of electrochromics proved to be highly dependent on how blinds were controlled. With hourly blind position adjustments, electrochromics showed significantly higher (62percent and 53percent, respectively without and with overhang) lighting energy consumption than clear glass. With a control algorithm designed to better approximate realistic manual control by an occupant, electrochromics achieved significant savings (48percent and 37percent, respectively without and with overhang). In all cases, energy consumption decreased when the workplace illuminance target was increased. In addition, the fraction of time during which the occupant had an unobstructed view of the outside was significantly greater with electrochromics: 10 months out of the year versus a handful of days for the reference case.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2021

Quantum cluster algorithm for data classification

Abstract We present a quantum algorithm for data classification based on the nearest-neighbor learning algorithm. The classification algorithm is divided into two steps: Firstly, data in the same class is divided into smaller groups with sublabels assisting building boundaries between data with different labels. Secondly we construct a quantum circuit for classification that contains multi control gates. The algorithm is easy to implement and efficient in predicting the labels of test data. To illustrate the power and efficiency of this approach, we construct the phase transition diagram for the metal-insulator transition of VO 2 , using limited trained experimental data, where VO 2 is a typical strongly correlated electron materials, and the metallic-insulating phase transition has drawn much attention in condensed matter physics. Moreover, we demonstrate our algorithm on the classification of randomly generated data and the classification of entanglement for various Werner states, where the training sets can not be divided by a single curve, instead, more than one curves are required to separate them apart perfectly. Our preliminary result shows considerable potential for various classification problems, particularly for constructing different phases in materials.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Numerical gate synthesis for quantum heuristics on bosonic quantum processors

There is a recent surge of interest and insights regarding the interplay of quantum optimal control and variational quantum algorithms. We study the framework in the context of qudits which are, for instance, definable as controllable electromagnetic modes of a superconducting cavity system coupled to a transmon. By employing recent quantum optimal control approaches described in (Petersson and Garcia, 2021), we showcase control of single-qudit operations up to eight states, and two-qutrit operations, mapped respectively onto a single mode and two modes of the resonator. We discuss the results of numerical pulse engineering on the closed system for parametrized gates useful to implement Quantum Approximate Optimization Algorithm (QAOA) for qudits. The results show that high fidelity ( > 0.99) is achievable with sufficient computational effort for most cases under study, and extensions to multiple modes and open, noisy systems are possible. The tailored pulses can be stored and used as calibrated primitives for a future compiler in circuit quantum electrodynamics (cQED) systems.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2024

Lax-Oleinik-Type Formulas and Efficient Algorithms for Certain High-Dimensional Optimal Control Problems

Two of the main challenges in optimal control are solving problems with state-dependent running costs and developing efficient numerical solvers that are computationally tractable in high dimension. In this paper, we provide analytical solutions to certain optimal control problems whose running cost depends on the state variable and with constraints on the control. We also provide Lax-Oleinik-type representation formulas for the corresponding Hamilton-Jacobi partial differential equations with state-dependent Hamiltonians. Additionally, we present an efficient, grid-free numerical solver based on our representation formulas, which is shown to scale linearly with the state dimension, and thus, to overcome the curse of dimensionality. Using existing optimization methods and the min-plus technique, we extend our numerical solvers to address more general classes of convex and nonconvex initial costs. We demonstrate the capabilities of our numerical solvers using implementations on a central processing unit (CPU) and a field-programmable gate array (FPGA). In several cases, our FPGA implementation obtains over a 10 times speedup compared to the CPU, which demonstrates the promising performance boosts FPGAs can achieve. Furthermore, our numerical results show that our solvers have the potential to serve as a building block for solving broader classes of high-dimensional optimal control problems in real-time.

97 MATHEMATICS AND COMPUTING↗