SEARCH · Search NASA

Results for “Autonomous control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 595 records · Page 33

All sources NASA NTRS DOE OSTI

DOE OSTI2020

Advancing Fusion with Machine Learning Research Needs Workshop Report

Abstract Machine learning and artificial intelligence (ML/AI) methods have been used successfully in recent years to solve problems in many areas, including image recognition, unsupervised and supervised classification, game-playing, system identification and prediction, and autonomous vehicle control. Data-driven machine learning methods have also been applied to fusion energy research for over 2 decades, including significant advances in the areas of disruption prediction, surrogate model generation, and experimental planning. The advent of powerful and dedicated computers specialized for large-scale parallel computation, as well as advances in statistical inference algorithms, have greatly enhanced the capabilities of these computational approaches to extract scientific knowledge and bridge gaps between theoretical models and practical implementations. Large-scale commercial success of various ML/AI applications in recent years, including robotics, industrial processes, online image recognition, financial system prediction, and autonomous vehicles, have further demonstrated the potential for data-driven methods to produce dramatic transformations in many fields. These advances, along with the urgency of need to bridge key gaps in knowledge for design and operation of reactors such as ITER, have driven planned expansion of efforts in ML/AI within the US government and around the world. The Department of Energy (DOE) Office of Science programs in Fusion Energy Sciences (FES) and Advanced Scientific Computing Research (ASCR) have organized several activities to identify best strategies and approaches for applying ML/AI methods to fusion energy research. This paper describes the results of a joint FES/ASCR DOE-sponsored Research Needs Workshop on Advancing Fusion with Machine Learning, held April 30–May 2, 2019, in Gaithersburg, MD (full report available at https://science.osti.gov/-/media/fes/pdf/workshop-reports/FES_ASCR_Machine_Learning_Report.pdf ). The workshop drew on broad representation from both FES and ASCR scientific communities, and identified seven Priority Research Opportunities (PRO’s) with high potential for advancing fusion energy. In addition to the PRO topics themselves, the workshop identified research guidelines to maximize the effectiveness of ML/AI methods in fusion energy science, which include focusing on uncertainty quantification, methods for quantifying regions of validity of models and algorithms, and applying highly integrated teams of ML/AI mathematicians, computer scientists, and fusion energy scientists with domain expertise in the relevant areas.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NASA NTRS1997

Promethazine affects autonomic cardiovascular mechanisms minimally

Promethazine hydrochloride, Phenergan, is a phenothiazine derivative with antihistaminic (H1), sedative, antiemetic, anticholinergic, and antimotion sickness properties. These properties have made promethazine a candidate for use in environments such as microgravity, which provoke emesis and motion sickness. Recently, we evaluated carotid baroreceptor-cardiac reflex responses during two Space Shuttle missions 18 to 20 hr after the 50 mg intramuscular administration of promethazine. Because the effects of promethazine on autonomic cardiovascular mechanisms in general and baroreflex function in particular were not known, we were unable to exclude a possible influence of promethazine on our results. Our purpose was to determine the ground-based effects of promethazine on autonomic cardiovascular control. Because of promethazine's antihistaminic and anticholinergic properties, we expected that a 50-mg intramuscular injection of promethazine would affect sympathetically and vagally mediated cardiovascular mechanisms. Eight healthy young subjects, five men and three women, were studied at rest in recumbency. All reported drowsiness as a result of the promethazine injection; most also reported nervous excitation, dry mouth, and fatigue. Three subjects had significant reactions: two reported excessive anxiety and one reported dizziness. Measurements were performed immediately prior to injection and 3.1 +/- 0.1 and 19.5 +/- 0.4 hr postinjection. We found no significant effect of promethazine on resting mean R-R interval, arterial pressure, R-R interval power spectra, carotid baroreflex function, and venous plasma catecholamine levels.

Clinical Trial↗

NASA NTRS1999

Next Generation Remote Agent Planner

In May 1999, as part of a unique technology validation experiment onboard the Deep Space One spacecraft, the Remote Agent became the first complete autonomous spacecraft control architecture to run as flight software onboard an active spacecraft. As one of the three components of the architecture, the Remote Agent Planner had the task of laying out the course of action to be taken, which included activities such as turning, thrusting, data gathering, and communicating. Building on the successful approach developed for the Remote Agent Planner, the Next Generation Remote Agent Planner is a completely redesigned and reimplemented version of the planner. The new system provides all the key capabilities of the original planner, while adding functionality, improving performance and providing a modular and extendible implementation. The goal of this ongoing project is to develop a system that provides both a basis for future applications and a framework for further research in the area of autonomous planning for spacecraft. In this article, we present an introductory overview of the Next Generation Remote Agent Planner. We present a new and simplified definition of the planning problem, describe the basics of the planning process, lay out the new system design and examine the functionality of the core reasoning module.

Jonsson, Ari K.↗

DOE OSTI2022

Rapid Load Transition for Integrated Solid Oxide Fuel Cell - Gas Turbine (SOFC-GT) Energy Systems: A Demonstration of the Potential for Grid Response

Rapid load transition is an essential requirement for integrated energy systems to maintain grid resilience as more renewable resources are added to the grid. Integrated solid oxide fuel cell - gas turbine (SOFC-GT) systems can provide high efficiency and low carbon emissions over a broad range of turndown. These hybrids also have the potential to enable rapid grid response. The challenge has been to demonstrate effective control strategies to manage load transitions. In the present study, a load transition of ~50% was achieved in 10 s using a novel but simple strategy. Power demand on the SOFC and the GT were ramped down concurrently. During this transition, the SOFC anode fuel was manipulated to maintain SOFC fuel utilization while the cathode inlet air flow and temperature were also manipulated to thermally protect the SOFC. This study was conducted using the Hybrid Performance (Hyper) facility at the National Energy Technology Laboratory (NETL) in a co-simulation environment with the Idaho National Laboratory (INL)'s grid-simulation. The load ramping strategy was tested using a hardware-based cyber-physical simulation methodology. The results demonstrate a high-fidelity representation of SOFC-GT hybrid dynamics and validation of the control strategy. Thermal and electrochemical transients indicated that the SOFC was well protected during rapid load turndown without violating operability constraints. This demonstration revealed the non-linear nature of tightly coupled SOFC-GT system components, especially the non-linear response of SOFC cathode air flow and inlet temperature controls. These results highlight the needs and challenges in developing adaptive automatic controls for autonomous rapid load transitions. This work demonstrates that SOFC-GT hybrids are a viable option to provide the fast-ramping characteristics essential to accommodate high levels of variable renewable power while maintaining grid resilience, reliability, and environmental performance. The results also demonstrate the utility of co-simulation in advancing the tightly-coupled integrated energy systems needed to meet goals for zero-carbon power generation.

DIRECT ENERGY CONVERSION,POWER TRANSMISSION AND DI↗

DOE OSTI2020

Advances in Kriging-Based Autonomous X-Ray Scattering Experiments

Autonomous experimentation is an emerging paradigm for scientific discovery, wherein measurement instruments are augmented with decision-making algorithms, allowing them to autonomously explore parameter spaces of interest. We have recently demonstrated a generalized approach to autonomous experimental control, based on generating a surrogate model to interpolate experimental data, and a corresponding uncertainty model, which are computed using a Gaussian process regression known as ordinary Kriging (OK). We demonstrated the successful application of this method to exploring materials science problems using x-ray scattering measurements at a synchrotron beamline. Here, we report several improvements to this methodology that overcome limitations of traditional Kriging methods. The variogram underlying OK is global and thus insensitive to local data variation. We augment the Kriging variance with model-based measures, for instance providing local sensitivity by including the gradient of the surrogate model. As with most statistical regression methods, OK minimizes the number of measurements required to achieve a particular model quality. However, in practice this may not be the most stringent experimental constraint; e.g. the goal may instead be to minimize experiment duration or material usage. We define an adaptive cost function, allowing the autonomous method to balance information gain against measured experimental cost. We provide synthetic and experimental demonstrations, validating that this improved algorithm yields more efficient autonomous data collection.

36 MATERIALS SCIENCE↗

NASA NTRSDate not supplied

Strategic and Tactical Functions in an Autonomous Air Traffic Management System

This paper evaluates, by means of fast-time simulation, performance of a candidate system for autonomous air traffic management. Advancing towards autonomy in air traffic management may be necessary in order for new air vehicle types such as electric Vertical Take Off and Landing (eVTOL) to operate safely and efficiently in airspace shared with conventional traffic. To account for uncertain prediction, autonomous air traffic management was divided into two integrated and coordinated subsystems: strategic scheduling, performed at predeparture, and tactical conflict detection and resolution, performed throughout the flight. The conflict detection and resolution subsystem contained a second tactical scheduling function that applied to flights operating in the airspace near the destination airport. This paper compares and contrasts the two subsystems and uses fast-time simulation to demonstrate the comparisons. A scenario of 54 flights inbound to Newark Liberty International Airport was simulated multiple times with different parameters. The scenario was created using flight plans recorded from the National Airspace System on a low weather, average traffic day in April 2018. Whereas the routes were not changed, the departure times of the flights were modified to increase arrival rates at the Newark runway and arrival meter fixes. Results of the simulations showed that the autonomous air traffic management system was able to safely manage the traffic, even with prediction uncertainty. In addition, they showed the importance of including flight holding maneuvers, in addition to path stretching, in conflict detection and resolution and of coordinating strategic and tactical scheduling. Finally, a tradeoff between absorbing the delay calculated by strategic scheduling on the ground versus in the air showed that taking most of the delay on the ground is cost effective for a simple idealized cost function. However, taking a little of the delay in the air prevented throughput on the runway from dropping for short periods due to trajectory prediction uncertainty.

air traffic control↗

NASA NTRS2021

Strategic and Tactical Functions in an Autonomous Air Traffic Management System

air traffic control↗

NASA NTRSDate not supplied

AEGIS: Autonomous Entity Global Intelligence System for Urban Air Mobility

This paper presents a global intelligence system that synthesizes aerial vehicles’ real-time physical data, planned actions, and historical behavior into engineered data frames representing the collective state of the airspace and suitable for efficient machine learning consumption. These data frames are then learnt by a deep neural net to build a prediction model that estimates the expected evolution path of the current state, thereby identifying potential future conflicts. This approach lends itself to an automated early warning system that the aerial vehicles can implement onboard with a suitable edge computing module more efficiently and effectively than non-AI methods, and eventually take preventive or corrective measures towards self/collaborative resolution of the issues. Contrary to a centralized early warning system where all vehicles’ task-space eventually converges to a global optimum state, the presented distributed global intelligence system brings in a balance between local utility functions of each vehicle and the global operating framework. This contributes to effectively handle the potential massive scaling in urban air mobility in the near future.

Artificial Intelligence↗

NASA NTRSDate not supplied

Towards Autonomous Lunar Resource Excavation via Reinforcement Learning

To continue on a sustainable and flexible path, NASA needs to address the challenge of collecting and moving large amounts of regolith at the destination. NASA’s Regolith Advanced Surface Systems Operations Robot (RASSOR) is principally designed to mine and deliver regolith for In-Situ Resource Utilization (ISRU) processing. RASSOR’s design enables it to efficiently collect and deposit regolith, return collected material for processing, and myriad related ISRU activities. To reliably perform these operations on the lunar surface, RASSOR software and sensory systems need to be robust and maximize the information extracted from a reduced sensor payload. Herein, we present preliminary findings from the Intelligent Capabilities Enhanced RASSOR project. We created reduced-order simulation environments to develop autonomous trenching controllers via reinforcement learning and prototype state estimation architectures. The goal of reinforcement learning is for an agent to learn a policy (task strategy) through interactions with an environment. When the agent performs an action, a change occurs in environment state and a numerical reward is received which informs the agent whether the action performed was good or not. Since reinforcement learning algorithms learn through trial-and-error, a simulation is a desirable first environment for development and learning. We developed two simulations, the first is a 2D excavation simulation developed to facilitate parameter selection, and a 3D simulation developed using a game physics engine, to simulate simplified soil interactions and increase the fidelity of the dynamic models of the robotic agents. The development of this 3D simulation has enabled the training of additional sensing capabilities and research both at the granular mechanics and operations levels. We experimented with various virtual sensor payloads to identify a combination that enabled efficient excavation operation and learning. Our reward function is based on how much material is excavated per step. A penalty is also received for leaving the dig site and to smooth the acceleration of the drum arms. We implemented pseudo time-of-flight sensors to report distance from each drum to ground and the height above ground which was found to be more efficient than existing solutions. Our findings suggest that reinforcement learning for autonomous operations has learned viable trenching strategies within 3000 training episodes in our simplified 2D environment and helped identify desirable sensing capabilities, arrangements, and considerations such as the positioning of time-of-flight sensors. Future work includes expanding our simulation to more complex environments and scenarios, and transfer learning from simulation to RASSOR 2.0 hardware for deployment in the Regolith Test Bin at NASA's Kennedy Space Center.

rassor↗

NASA NTRS1994

Human autonomic rhythms: vagal cardiac mechanisms in tetraplegic subjects

1. We studied eight young men (age range: 20-37 years) with chronic, clinically complete high cervical spinal cord injuries and ten age-matched healthy men to determine how interruption of connections between the central nervous system and spinal sympathetic motoneurones affects autonomic cardiovascular control. 2. Baseline diastolic pressures and R-R intervals (heart periods) were similar in the two groups. Slopes of R-R interval responses to brief neck pressure changes were significantly lower in tetraplegic than in healthy subjects, but slopes of R-R interval responses to steady-state arterial pressure reductions and increases were comparable. Plasma noradrenaline levels did not change significantly during steady-state arterial pressure reductions in tetraplegic patients, but rose sharply in healthy subjects. The range of arterial pressure and R-R interval responses to vasoactive drugs (nitroprusside and phenylephrine) was significantly greater in tetraplegic than healthy subjects. 3. Resting R-R interval spectral power at respiratory and low frequencies was similar in the two groups. During infusions of vasoactive drugs, low-frequency R-R interval spectral power was directly proportional to arterial pressure in tetraplegic patients, but was unrelated to arterial pressure in healthy subjects. Vagolytic doses of atropine nearly abolished both low- and respiratory-frequency R-R interval spectral power in both groups. 4. Our conclusions are as follows. First, since tetraplegic patients have significant levels of low-frequency arterial pressure and R-R interval spectral power, human Mayer arterial pressure waves may result from mechanisms that do not involve stimulation of spinal sympathetic motoneurones by brainstem neurones. Second, since in tetraplegic patients, low-frequency R-R interval spectral power is proportional to arterial pressure, it is likely to be mediated by a baroreflex mechanism. Third, since low-frequency R-R interval rhythms were nearly abolished by atropine in both tetraplegic and healthy subjects, these rhythms reflect in an important way rhythmic firing of vagal cardiac motoneurones.

Non-NASA Center↗

DOE OSTI2023

Smart Droplets Stabilized by Designer Surfactants: From Biomimicry to Active Motion to Materials Healing

The science and technologies of emulsion droplets have been a long‐term focus of extensive research endeavors for their practical utility across a breadth of industries, including pharmaceutical products, oil recovery processes, and the food sciences. However, with advances in materials chemistry and characterization tools, new emerging areas are arising with a focus on “smart droplets”. The versatility of emulsion droplets across is based on their ability to partition and create isolated systems with properties defined by the liquid–liquid interface, while preparative routes allow manipulation of droplet size, stability, and encapsulated contents. As described in this article, significant efforts are being devoted to creating new types of droplets by “activating” this interface through the incorporation of reactive structures that trigger droplet response to applied or environmental stimuli (e.g., pH, temperature, salt, or external fields). Moreover, parallels between droplets and live cells inspire efforts to conceive systems that resemble biological motifs or that can produce cellular behaviors that imitate biology (e.g., swarming, communication, or motion). Here, the authors highlight recent advances in smart droplets, with emphasis on organic, polymer, and/or particle surfactants that give rise to inter‐droplet communication (via aggregation, fusion, division, or mass transfer), droplet vehicles for controlled delivery, autonomous droplet motion, and tunable emulsion inversion. Especially emphasized is the macromolecular design to produce reactive and functional surfactants, which are crucial to responsive droplet behavior and their underlying mechanisms. More generally, the exquisite interplay between materials science and biology inspires the review of this research area that provides unique opportunities for insight and inspiration into the capabilities of new droplet designs.

36 MATERIALS SCIENCE↗

DOE OSTI2021

The Value of Watching How Materials Grow: A Multimodal Case Study on Halide Perovskites

Material synthesis is one of the most important aspects in humankinds’ endeavor to discover and create new materials for energy applications. One strategy to tailor materials with desired functions in a rational way is by knowing how functions relate to structure, synthetic variables, arrangement of atoms and molecules, and how functions evolve during synthesis. In order to accelerate materials synthesis, discovery, and optimization by 10 times it is the right time now to integrate computational tools, synthesis, and characterization. One particular barrier to realizing this concept is the understanding of when and how phases form in real time during synthesis, which is challenging to asses by existing theoretical frameworks. In addition, transient or metastable phases with positive free energy above the lowest-free energy ground state can be revealed by such real time (in situ) measurements. Metastable materials are ubiquitous in condensed matter and can show superior properties compared to their equilibrium form. This work discusses the value of emerging multimodal in situ characterizations exemplified on hybrid halide perovskites. Finally, the ways in which the implementation of in situ measurements can advance the materials science synthesis field as well as their role to enable close-loop feedback control and autonomous synthesis are discussed.

36 MATERIALS SCIENCE↗

DOE OSTI2021

Avoiding Excess Computation in Asynchronous Evolutionary Algorithms

Asynchronous evolutionary algorithms are becoming increasingly popular as a means of making full use of many processors while solving computationally expensive search and optimization problems. These algorithms excel at keeping large clusters fully utilized, but may sometimes inefficiently sample an excess of fast-evaluating solutions at the expense of higher-quality, slow-evaluating ones. We introduce a steady-state parent selection strategy, SWEET (“Selection whilE EvaluaTing”), that sometimes selects individuals that are still being evaluated and allows them to reproduce early. This gives slow-evaluating individuals that have higher fitnesses an increased ability to multiply in the population. We find that SWEET appears effective in simulated take-over time analysis, but that its benefit is confined mostly to early in the run, and our preliminary study on an autonomous vehicle controller problem that involves tuning a spiking neural network proves inconclusive.

Scott, Eric↗

DOE OSTI2024

A Behavior Tree Approach for Battery-Aware Inspection of Large Structures Using Drones

Electric multi-rotor drones have been used to inspect several structures, including large buildings and dams. In these inspections, energy consumption is a concern. To prevent the drone from running out of battery, commercial drones usually come back to their home position when the battery level reaches a minimum threshold. The pilots then need to replace the battery and use their own experience to restart the inspection mission approximately from where it ended before the drone returned home. Instead of relying on the human operator, in this paper, we automate this process using behavior trees, which is an effective way to perform autonomous mission control and supervision. By integrating battery management strategies into a behavior tree framework, this paper demonstrates the drone’s adaptive and resilient decision-making when confronted with limited power constraints. We implemented our methodology using a commercial drone and tested the proposed ideas in a photogrammetry-based inspection task.

42 ENGINEERING↗

DOE OSTI2022

Avoiding excess computation in asynchronous evolutionary algorithms

Abstract Asynchronous evolutionary algorithms are becoming increasingly popular as a means of making full use of many processors while solving computationally expensive search and optimization problems. These algorithms excel at keeping large clusters fully utilized, but may sometimes inefficiently sample an excess of fast‐evaluating solutions at the expense of higher‐quality, slow‐evaluating ones. We have previously introduced a steady‐state parent selection strategy, SWEET (“Selection whilE EvaluaTing”), that sometimes selects individuals that are still being evaluated and allows them to reproduce early. We perform a takeover‐time analysis that confirms that this strategy gives slow‐evaluating individuals that have higher fitnesses an increased ability to multiply in the population. We also find that SWEET appears effective at improving optimization performance on problems in which solution quality is positively correlated with evaluation time. We evaluate our approach on six simulated real‐valued optimization problems and three real‐world applications: an autonomous vehicle controller problem that involves tuning a spiking neural network and two adversarial EA problems. We further evaluate SWEET versus a basic asynchronous process in a simulated setting. We present evidence that SWEET outperforms basic asynchronous processes in a use‐case in which performance is positively correlated with evaluation time, and performs comparably (and often better) than basic asynchronous processes in several use‐cases where performance is negatively correlated with evaluation time. That said, in the cases where performance and evaluation time are negatively correlated the variance of outcomes for SWEET is notably high.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Caldera Infrastructure Charge Module (ICM)

Caldera ICM is part of Caldera software platform, a suite of collective, open-source tools that was developed to improve the state of the art in modeling the impacts of Electric Vehicle (EV) charging on the grid. The foundation of Caldera ICM is it’s first-of-its-kind library of high-fidelity charging models for a wide variety of vehicles, validated by test data under a range of operating conditions. The charging models are used to accurately model the EV charging on an electric vehicle supply equipment (EVSE) – also known as a charger. ICM uses as inputs, the EV characteristics such as battery size, battery chemistry (i.e. NMC, LTO), watt hour per mile, inverter efficiency and max charge rate; as well as EVSE characteristics such as max current and supply equipment type (i.e. L2 vs XFC). Using these inputs Caldera ICM creates an uncontrolled charging profile curve for each compatible EV-EVSE pair. These charge profiles can be used stand alone to estimate charge duration given start State Of Charge (SOC) and end SOC or charge energy size given start SOC and charge duration. In Caldera Grid, another tool in the Caldera software platform, these charge profiles are used to represent EV charging as a load on the grid using charge event data such as EV type, SE type, start SOC, final SOC, park start time and park end time. ICM currently supports energy shifting Smart Charge Management (SCM) strategies such as "Time Of Use (TOU) immediate”, “TOU random” and “random start” by delaying the charge to start at a preferable time with respect to the strategy and, one voltage support SCM strategy named autonomous voltage control strategy by providing reactive power back to the electric grid.

Sundarrajan, ManojKumar Cebol↗

DOE OSTI2025

Development of Automated Atom Probe Tomography capability to study the influence of applied voltage and laser power on the final apparent composition of the analyzed specimen

This study presents the development and implementation of an autonomous Bayesian optimization (BO) framework for controlling and optimizing experimental parameters in Atom Probe Tomography (APT). Using commercial silicon needle samples as a benchmark system, we demonstrate that BO can efficiently navigate the complex parameter space of voltage and laser power to achieve target charge state ratios (specifically Si + /(Si + +Si 2+ )) with minimal experimental evaluations. Our implementation integrates Gaussian Process modeling with the CAMECA atom probe control framework, enabling autonomous adjustment of experimental conditions in real-time. Results show that the algorithm successfully converges to target ratios under different scenarios: maintaining a reference ratio, increasing the ratio (favoring Si 1+ ), and decreasing the ratio (favoring Si 2+ ). The system adapts to specimen evolution during analysis, compensating for changes in apex geometry while maintaining optimization targets. This work establishes a proof of concept for AI-driven optimization in APT, addressing the traditional challenges of manual parameter tuning and paving the way for applications to more complex materials where compositional accuracy is critical.

36 MATERIALS SCIENCE↗

DOE OSTI2026

Solar Energy CommUnity Resiliency (Final Technical Report)

Final Technical Report for DE-EE0009336 Solar Energy CommUnity Resiliency (SECURE) The Solar Energy CommUnity Resiliency (SECURE) project aimed to support development of resilient community microgrids to improve grid reliability and maintain power during times of crisis. The SECURE project approached this objective by addressing key technical and business challenges impeding implementation of resilient community microgrids. To achieve the goals of this project, we pursued several specific objectives through comprehensive design and requirements development.

24 POWER TRANSMISSION AND DISTRIBUTION↗