Search NASA⌕ Search

SEARCH · Search NASA

Results for “safe control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Interpreting Primal-Dual Algorithms for Constrained Multiagent Reinforcement Learning: Preprint

We study multiagent reinforcement learning (MARL) with constraints. This setting is gaining importance as MARL algorithms find new applications in real-world systems ranging from power grids to drone swarms. Most constrained MARL (C-MARL) algorithms use a primal-dual approach to enforce constraints through a penalty function added to the reward. In this paper, we study the structural effects of the primal-dual approach on the constraints and value function. First, we show that using the constraint evaluation as the penalty leads to a weak notion of safety, but by making simple modifications to the penalty function, we can enforce meaningful probabilistic safety constraints. Second, we show that the penalty term changes the value function in a way that is easy to model, and demonstrate the consequences of not doing so. We conclude with simulations in a simple constrained multiagent environment to back up the theoretical results.

data-driven control↗

Test Rack Development for Extended Operation of Advanced Stirling Convertors at NASA Glenn Research Center

The U.S. Department of Energy, Lockheed Martin Space Systems Company, Sunpower Inc., and NASA Glenn Research Center (GRC) have been developing an Advanced Stirling Radioisotope Generator (ASRG) for use as a power system on space science missions. This generator will make use of free-piston Stirling convertors to achieve higher conversion efficiency than with currently available alternatives. One part of NASA GRC's support of ASRG development includes extended operation testing of Advanced Stirling Convertors (ASCs) developed by Sunpower Inc. and GRC. The ASC consists of a free-piston Stirling engine integrated with a linear alternator. NASA GRC has been building test facilities to support extended operation of the ASCs for several years. Operation of the convertors in the test facility provides convertor performance data over an extended period of time. One part of the test facility is the test rack, which provides a means for data collection, convertor control, and safe operation. Over the years, the test rack requirements have changed. The initial ASC test rack utilized an alternating-current (AC) bus for convertor control; the ASRG Engineering Unit (EU) test rack can operate with AC bus control or with an ASC Control Unit (ACU). A new test rack is being developed to support extended operation of the ASC-E2s with higher standards of documentation, component selection, and assembly practices. This paper discusses the differences among the ASC, ASRG EU, and ASC-E2 test racks.

Dugala, Gina M.↗

A unique facility for V/STOL aircraft hover testing

The paper discusses the Navy's XFV-12A tethered hover testing capabilities utilizing NASA's Impact Dynamic Research Facility (IDRF) at Langley. The facility allows for both static and dynamic tethered hover test operations to be undertaken with safety. The installation which consists of the 'Z' system (tether), restraint system, static tiedowns and the control room and console, is presented in detail. Among the capabilities demonstrated were the ability to recover the aircraft anytime during a test, to rapidly and safely define control limits, and to provide a realistic environment for pilot training and proficiency in VTOL flight.

Culpepper, R. G.↗

Safe Reinforcement Learning-Based Transient Stability Control for Islanded Microgrids With Topology Reconfiguration

This paper proposes a safe reinforcement learning (RL)-based transient stability emergency control (TSEC) method for islanded microgrids. RL requires extensive interaction with the environment to learn control strategies, hence, a data-driven approach is used as a substitute for time-consuming time-domain simulation calculations. Deep sigma point processes (DSPP), which is a Gaussian process model, is utilized to predict the normal distribution of transient stability of microgrids and to construct a transient stability chance constraint. Reward-constrained policy optimization (RCPO) can simultaneously achieve objective prediction, policy learning, and constraint cost coefficient update across multiple timescales. RCPO interacts with the DSPP-based microgrid environment through a multi-process parallel manner, greatly increasing the training speed. Case studies on a real islanded microgrid demonstrate that the proposed method can efficiently and quickly obtain the optimal emergency control strategy while adhering to all hard constraints.

14 SOLAR ENERGY↗

Control-Chain Safety Tray and Friction Pull

Tray mounted above suspended ceiling keeps sprinkler-system control chain safely out of way of pedestrian traffic below. Tray reached easily by using fireman's hook short stepladder, or chair or by jumping up to grasp chain. Safety tray used for infrequently used control chains on vents and dampers.

Hajdik, G.↗

Nonlinear dynamics of proton beams with hollow electron lens in the CERN high-luminosity LHC

The design stored beam energy in the CERN high-luminosity large hadron collider (HL-LHC) upgrade is about 700 MJ, with about 36 MJ in the beam tails, according to estimates based on scaling considerations from measurements at the LHC. Such a large amount of stored energy in the beam tails poses serious challenges on its control and safe disposal. In particular, orbit jitters can cause significant losses on primary collimators, which can lead to accidental beam dumps, magnet quenches, or even permanent damage to collimators and other accelerator elements. Thus, active control of the diffusion speed of halo particles is necessary and the use of hollow electron lenses (HELs) represents the most promising approach to handle overpopulated tails at the HL-LHC. HEL is a very powerful and advanced tool that can be used for controlled depletion of beam tails, thus enhancing the performance of beam halo collimation. For these reasons, HELs have been recently included in the HL-LHC baseline. In this paper, we present detailed beam dynamics calculations performed with the goal of defining HEL specifications and operational scenarios for HL-LHC. The prospects for effective halo control in HL-LHC are presented.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Flightworthy active control landing gear for a supersonic aircraft

A flightworthy active control landing gear system for a supersonic aircraft was designed to minimize aircraft loads during takeoff, impact, rollout, and taxi. The design consists of hydromechanical modifications to the existing gear and the development of a fail-safe electronic controller. analytical RESULTS INDICATE that for an aircraft sink rate of 0.914 m/sec (3 ft/sec) the system achieves a peak load reduction of 36% during landing impact.

Ross, I.↗

Interaction of Airspace Partitions and Traffic Flow Management Delay

To ensure that air traffic demand does not exceed airport and airspace capacities, traffic management restrictions, such as delaying aircraft on the ground, assigning them different routes and metering them in the airspace, are implemented. To reduce the delays resulting from these restrictions, revising the partitioning of airspace has been proposed to distribute capacity to yield a more efficient airspace configuration. The capacity of an airspace partition, commonly referred to as a sector, is limited by the number of flights that an air traffic controller can safely manage within the sector. Where viable, re-partitioning of the airspace distributes the flights over more efficient sectors and reduces individual sector demand. This increases the overall airspace efficiency, but requires additional resources in some sectors in terms of controllers and equipment, which is undesirable. This study examines the tradeoff of the number of sectors designed for a specified amount of traffic in a clear-weather day and the delays needed for accommodating the traffic demand. Results show that most of the delays are caused by airport arrival and departure capacity constraints. Some delays caused by airspace capacity constraints can be eliminated by re-partitioning the airspace. Analyses show that about 360 high-altitude sectors, which are approximately today s operational number of sectors of 373, are adequate for delays to be driven solely by airport capacity constraints for the current daily air traffic demand. For a marginal increase of 15 seconds of average delay, the number of sectors can be reduced to 283. In addition, simulations of traffic growths of 15% and 20% with forecasted airport capacities in the years 2018 and 2025 show that delays will continue to be governed by airport capacities. In clear-weather days, for small increases in traffic demand, increasing sector capacities will have almost no effect on delays.

Palopo, Kee↗

Warrick Conductivity Level Controllers Series 3H

This is my internship poster. In the poster I talk about the level controllers that I wired together and installed to support electrolysis testing systems in efforts to make the systems more efficient and run based on the communication between devices to ensure a closed loop system that can run on its own in a safe and controlled manner. I included pictures of some of the wiring as well as the level sensor devices and relays. I also included pictures of the tanks that will be filled at different heights with deionized water based on where the level sensors are.

08 HYDROGEN↗

Development of algorithms for augmenting and replacing conventional process control using reinforcement learning

Here, this work seeks to allow for the online operation and training of model-free reinforcement learning (RL) agents but limit the risk to system equipment and personnel. The parallel implementation of RL alongside more conventional process control (CPC) allows for the RL algorithm to learn from CPC. The past performance of both methods are assessed on a continuous basis allowing for a transition from CPC to RL and, if needed, transitioning back to CPC from RL. This allows for the RL algorithm to slowly and safely assume control of the process without significant degradation in control performance. It is shown that the RL can derive a near optimal policy even when coupled with a suboptimal CPC. It is also demonstrated that the coupled RL-CPC algorithm learns at a faster rate than traditional RL methods of exploration while the algorithm’s performance does not deteriorate below CPC, even when exposed to an unknown operating condition.

30 DIRECT ENERGY CONVERSION↗

The Development of a Human Systems Simulation Laboratory at Idaho National Laoboratory: Progress, Requirements and Lessons Learned

Next generation nuclear power plants and digital upgrades to the existing nuclear fleet introduce potential human performance issues in the control room. Safe application of new technologies calls for a thorough understanding of how those technologies affect human performance and in turn, plant safety. In support of advancing human factors for small modular reactors and light water reactor sustainability, the Idaho National Laboratory (INL) has developed a reconfigurable simulation laboratory capable of testing human performance in multiple nuclear power plant (NPP) control room simulations. This paper discusses the laboratory infrastructure and capabilities, the laboratory’ s staffing requirements, lessons learned, and the researcher’s approach to measuring human performance in the simulation lab.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Ultrasonic Device Would Open Pipe Bombs

Piezoelectric ultrasonic transducer, energized by frequency generator and power supply, vibrates shell of pipe bomb while hardly disturbing explosive inner material. Frequency-control circuitry senses resonance in shell and holds generator at that frequency to induce fatigue cracking in threads of end cap. In addition to disarming bombs, ultrasonically induced fatigue may have other applications. In manufacturing, replaces some machining and cutting operations. In repair of equipment, cleanly and quickly disassembles corroded parts. In demolition of buildings used to dismember steel framework safely and controllably.

El-Raheb, Michael S.↗

A hardware-in-the-loop (HIL) testbed for cyber-physical energy systems in smart commercial buildings

In recent years, there has been a growing trend toward the development of smart buildings that rely on cyber-physical systems (CPS) to optimize occupant comfort, safety, and energy efficiency. To ensure the reliable and efficient operation of CPS with designed control strategies, it is important to evaluate their performance under various scenarios before deploying them in the real world. This is where a Hardware-in-the-loop (HIL) testbed designed for studying sensor and control-related studies in smart buildings can be highly valuable. With the growing threat of cyber-attacks and physical faults targeting smart buildings, it is essential to ensure the security of building operations. A HIL testbed can emulate cyber-attack and physical fault scenarios, allowing researchers to develop and test threat detection and mitigation algorithms. This enables researchers to identify potential issues and optimize the algorithms in a safe and controlled environment before they are deployed in real-world settings, reducing the risk of failures that can negatively impact occupant comfort, safety, and energy efficiency. Therefore, this paper developed a HIL testbed designed for cyber-physical energy systems (e.g. buildings automation system (BAS)) in smart commercial buildings. The HIL testbed is comprised of a real-time building and Heating, Ventilation, and Air-Conditioning (HVAC) emulator using Modelica-based dynamic models, a set of BAS controllers, and a BAS computer server. The data generation capability of the HIL testbed is demonstrated by tracking normal and faulty operating data in the BAS, as well as monitoring detailed network traffic in the local BAS network. Here, this study further demonstrates the HIL testbed’s capability by conducting case studies on real-time physical fault and cyber-attack experiments using a Department of Energy (DOE) prototype commercial building. It is anticipated that the fully functional HIL testbed will be utilized for a variety of sensor and control-related studies, including but not limited to testing, developing, validating of different HVAC control strategies, fault detection & diagnosis, energy monitoring and analysis, cyber security study, etc.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Flash LIDAR Emulator for HIL Simulation

NASA's Autonomous Landing and Hazard Avoidance Technology (ALHAT) project is building a system for detecting hazards and automatically landing controlled vehicles safely anywhere on the Moon. The Flash Light Detection And Ranging (LIDAR) sensor is used to create on-the-fly a 3D map of the unknown terrain for hazard detection. As part of the ALHAT project, a hardware-in-the-loop (HIL) simulation testbed was developed to test the data processing, guidance, and navigation algorithms in real-time to prove their feasibility for flight. Replacing the Flash LIDAR camera with an emulator in the testbed provided a cheaper, safer, more feasible way to test the algorithms in a controlled environment. This emulator must have the same hardware interfaces as the LIDAR camera, have the same performance characteristics, and produce images similar in quality to the camera. This presentation describes the issues involved and the techniques used to create a real-time flash LIDAR emulator to support HIL simulation.

Brewster, Paul F.↗

Human-in-the-loop Robotic Control for Human-Robot Collaboration

The prospect of a collaborative work environment between humans and robotic automation in a manufacturing setting [1] provides the motivation for finding innovative solutions to human-in-the-loop control for safe, efficient, and trustworthy human-robot collaboration (HRC), or HR interaction (HRI), in cyberphysical human systems (CPHSs) [2], [3]. Studies in [4] show that collaborative automation can be beneficial to 90% of approximately 300,000 small-to-medium-scale enterprises in the United States. In the paradigm of human-centered automation [5], human safety, ergonomics, and the collaborative efficiency of the work are given the utmost importance. Traditional methods to ensure the safety of humans around factory robots involve the use of cages. Recent work looked beyond cage-based safety to provide robot control and sensing-driven solutions for human safety around robots [6]-[8].

Ashwin P. Dani↗

Voltage-Based Strategies for Preventing Battery Degradation under Diverse Fast-Charging Conditions

Maintaining safe operating conditions is a key challenge for high-performance lithium-ion battery applications. The lithium-plating reaction remains a risk during charging, but limited studies consider the highly variable charging conditions possible in commercial cells. Here we combine pseudo-2D electrochemical modeling with data visualization methods to reveal important relationships between the measurable cell voltage and difficult-to-predict Li-plating onset criteria. An extensively validated model is used to compute Li plating for thousands of multistep charging conditions spanning diverse rates, temperatures, states-of-charge, and cell aging. Here we observe an empirical cell operating voltage limit below which plating does not occur across all conditions, and this limit varies with the battery state-of-charge and aging. A model sensitivity analysis also indicates that, when comparing two charging voltage profiles, the capacity difference at 4.0 V correlates well with the difference in the plating onset capacity. These results encourage simple strategies for Li-plating prevention that are complementary to existing battery controls.

25 ENERGY STORAGE↗

An Innovative Very Low Thermal Power Waste Heat Recovery System for Thermal Control of Deep Space Missions: A Thermal Flask in Space

Future missions to deep space, such as those to the outer planets (Jupiter, Saturn, etc.), which would rely on solar photovoltaic power, would need extremely large solar arrays to produce sufficient power for their operations because solar intensity is so low at those locations. Hence any additional power that would be needed for thermal control is extremely limited. Previous deep space missions like Juno (to Jupiter) required almost 200 W of electrical power for thermal control. This is prohibitively large for many future mission concepts, and leads to them needing very large solar arrays. For Saturn, where the solar flux is 1/4th the flux at Jupiter, this would entail an extremely large increase in the solar array size to accommodate the need for thermal survival power, which would be prohibitively large in size and mass, and very expensive. Hence there is a need to come up with a thermal architecture and design options that would not need such prohibitively large thermal power levels. One solution relies on harvesting the pre-existing waste heat from all the heat dissipation that would be present from operation of electronics, instruments, etc. for their own functionality. For example, for a generic Saturn mission, the various electronics would already dissipate about 200 Watts of heat that is simply "thrown away" to space from the spacecraft surfaces. The amount of thermal power that would be required for the safe thermal control of components within the spacecraft in deep space would be roughly of this magnitude for this class of spacecraft. So it makes good sense to try to harvest the waste heat and employ it to maintain the temperatures of all the components within their allowable limits. In particular, propulsion systems typically need to be kept above their freezing limits, around room temperature (15 C). Electronics needs to be kept typically above -40 C and batteries above -20 C. The next question becomes how to harvest this waste heat and direct it to the components that would need it for their survival. The proposed system utilizes a mechanically pumped, single phase fluid loop to pick up the waste heat from components attached to this loop's tubing and then directed to a thermal flask that has tubing attached to it. The thermal flask is cylindrically shaped and contains essentially all systems and components in the spacecraft within it, with the exception of the solar array, antennae, thrusters and various apertures of instruments, etc. to allow them an unobstructed view of space. Waste heat from the heat-dissipating components warms up the fluid and is carried to the flask surface and deposited on it via the fluid loop's flow. The entire flask is covered with Multi-Layered Insulation (MLI) to minimize the heat loss from the flask and allow it to remain warm. Hence the flask essentially creates a thermal environment within which the spacecraft components reside. The temperature of the components within the flask is then essentially the same as the temperature of the flask. This approach could be a very enabling feature for deep space missions. This paper describes the approach utilized for this thermal architecture, along with its mechanical and implementation aspects. Additionally it will compare and contrast this approach with the more conventional solutions utilized earlier.

Bhandari, Pradeep↗