Search NASA⌕ Search

SEARCH · Search NASA

Results for “agentic systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 415 records · Page 23

Reusable Autonomy

Currently, spacecraft ground systems have a well defined and somewhat standard architecture and operations concept. Based on domain analysis studies of various control centers conducted over the years it is clear that ground systems have core capabilities and functionality that are common across all ground systems. This observation alone supports the realization of reuse. Additionally, spacecraft ground systems are increasing in their ability to do things autonomously. They are being engineered using advanced expert systems technology to provide automated support for operators. A clearer understanding of the possible roles of agent technology is advancing the prospects of greater autonomy for these systems. Many of their functional and management tasks are or could be supported by applied agent technology, the dynamics of the ground system's infrastructure could be monitored by agents, there are intelligent agent-based approaches to user-interfaces, etc. The premise of this paper is that the concepts associated with software reuse, applicable in consideration of classically-engineered ground systems, can be updated to address their application in highly agent-based realizations of future ground systems. As a somewhat simplified example consider the following situation, involving human agents in a ground system context. Let Group A of controllers be working on Mission X. They are responsible for the command, control and health and safety of the Mission X spacecraft. Let us suppose that mission X successfully completes it mission and is turned off. Group A could be dispersed or perhaps move to another Mission Y. In this case there would be reuse of the human agents from Mission X to Mission Y. The Group A agents perform their well-understood functions in a somewhat but related context. There will be a learning or familiarization process that the group A agents go through to make the new context, determined by the new Mission Y, understood. This simplified scenario highlights some of the major issues that need to be addressed when considering the situation where Group A is composed of software-based agents (not their human counterparts) and they migrate from one mission support system to another. This paper will address: - definition of an agent architecture appropriate to support reuse; - identification of non-mission-specific agent capabilities required; - appropriate knowledge representation schemes for mission-specific knowledge; - agent interface with mission-specific knowledge (a type of Learning); development of a fully-operational group of cooperative software agents for ground system support; architecture and operation of a repository of reusable agents that could be the source of intelligent components for realizing an autonomous (or nearly autonomous) agent-based ground system, and an agent-based approach to repository management and operation (an intelligent interface for human use of the repository in a ground-system development activity).

Truszkowski, Walt↗

Using CONFIG for Simulation of Operation of Water Recovery Subsystems for Advanced Control Software Evaluation

A hybrid discrete/continuous simulation tool, CONFIG, has been developed to support evaluation of the operability life support systems. CON FIG simulates operations scenarios in which flows and pressures change continuously while system reconfigurations occur as discrete events. In simulations, intelligent control software can interact dynamically with hardware system models. CONFIG simulations have been used to evaluate control software and intelligent agents for automating life support systems operations. A CON FIG model of an advanced biological water recovery system has been developed to interact with intelligent control software that is being used in a water system test at NASA Johnson Space Center

Malin, Jane T.↗

Buyers Collusion in Incentivized Forwarding Networks: A Multi-Agent Reinforcement Learning Study

We present the issue of monetarily incentivized forwarding in a multi-hop mesh network architecture from an economic perspective. It is anticipated that credit-incentivized forwarding and relaying will be a simple method of exchanging transmission power and spectrum for connectivity. However, gateways and forwarding nodes, like any other free market, may create an oligopolistic market for the users they serve. In this study, a coalition scheme between buyers aims to address price control by gateways or nodes closer to gateways. In a Stackelberg competition game, buyer agents (users) and sellers (gateways) make decisions using reinforcement learning (RL), with decentralized Deep Q-Networks to buy and sell forwarding resources. We allow communication links between the buyers with a limited messaging space, without defining a collusion mechanism. The idea is to demonstrate that through messaging, and RL tacit collusion can emerge between agents in a decentralized setup. The multi-agent reinforcement learning (MARL) system is presented and analyzed from a machine-learning perspective. Moreover, MARL dynamics are discussed via mean field analysis to better understand divergence causes and make implementation recommendations for such systems. Finally, the simulation results show the results of coordination among the users.

42 ENGINEERING↗

Complexity for Survival of Living Systems

A logical connection between the survivability of living systems and the complexity of their behavior (equivalently, mental complexity) has been established. This connection is an important intermediate result of continuing research on mathematical models that could constitute a unified representation of the evolution of both living and non-living systems. Earlier results of this research were reported in several prior NASA Tech Briefs articles, the two most relevant being Characteristics of Dynamics of Intelligent Systems (NPO- 21037), NASA Tech Briefs, Vol. 26, No. 12 (December 2002), page 48; and Self-Supervised Dynamical Systems (NPO- 30634) NASA Tech Briefs, Vol. 27, No. 3 (March 2003), page 72. As used here, living systems is synonymous with active systems and intelligent systems. The quoted terms can signify artificial agents (e.g., suitably programmed computers) or natural biological systems ranging from single-cell organisms at one extreme to the whole of human society at the other extreme. One of the requirements that must be satisfied in mathematical modeling of living systems is reconciliation of evolution of life with the second law of thermodynamics. In the approach followed in this research, this reconciliation is effected by means of a model, inspired partly by quantum mechanics, in which the quantum potential is replaced with an information potential. The model captures the most fundamental property of life - the ability to evolve from disorder to order without any external interference. The model incorporates the equations of classical dynamics, including Newton s equations of motion and equations for random components caused by uncertainties in initial conditions and by Langevin forces. The equations of classical dynamics are coupled with corresponding Liouville or Fokker-Planck equations that describe the evolutions of probability densities that represent the uncertainties. The coupling is effected by fictitious information-based forces that are gradients of the information potential, which, in turn, is a function of the probability densities. The probability densities are associated with mental images both self-image and nonself images (images of external objects that can include other agents). The evolution of the probability densities represents mental dynamics. Then the interaction between the physical and metal aspects of behavior is implemented by feedback from mental to motor dynamics, as represented by the aforementioned fictitious forces. The interaction of a system with its self and nonself images affords unlimited capacity for increase of complexity. There is a biological basis for this model of mental dynamics in the discovery of mirror neurons that learn by imitation. The levels of complexity attained by use of this model match those observed in living systems. To establish a mechanism for increasing the complexity of dynamics of an active system, the model enables exploitation of a chain of reflections exemplified by questions of the form, "What do you think that I think that you think...?" Mathematically, each level of reflection is represented in the form of an attractor performing the corresponding level of abstraction with more details removed from higher levels. The model can be used to describe the behaviors, not only of biological systems, but also of ecological, social, and economics ones.

Zak, Michail↗

Agentic artificial intelligence for multistage physics experiments at a large-scale user facility particle accelerator

We present a language-model-driven agentic artificial intelligence (AI) system to autonomously execute multistage physics experiments on a production synchrotron light source. Implemented at the Advanced Light Source particle accelerator, the system translates natural language user prompts into structured execution plans that combine archive data retrieval, control-system channel resolution, automated script generation, controlled machine interaction, and analysis. In a representative machine physics task, we show that preparation time was reduced by 2 orders of magnitude relative to manual scripting even for a system expert, while operator-standard safety constraints were strictly upheld. Core architectural features, plan-first orchestration, bounded tool access, and dynamic capability selection, enable transparent, auditable execution with fully reproducible artifacts. These results establish a blueprint for the safe integration of agentic AI into accelerator experiments and demanding machine physics studies, as well as routine operations, with direct portability across accelerators worldwide and, more broadly, to other large-scale scientific infrastructures.

Accelerator/storage ring control systems↗

Privacy-Preserving Average Consensus With Beaver Triple and Communication Obfuscation

A privacy-preserving average consensus algorithm is proposed that synergizes the Beaver triple in secret sharing theory and noise obfuscation. The algorithm safeguards the initial values of agents against passive adversaries in a multiagent system. It is proved that the proposed algorithm can concurrently ensure average consensus and privacy, while also reducing the online computation and communication overhead compared to encryption-based ones. In addition, it imposes a less stringent condition for privacy preservation compared to certain noise-obfuscation techniques.

Beaver triple↗

An Agent Inspired Reconfigurable Computing Implementation of a Genetic Algorithm

Many software systems have been successfully implemented using an agent paradigm which employs a number of independent entities that communicate with one another to achieve a common goal. The distributed nature of such a paradigm makes it an excellent candidate for use in high speed reconfigurable computing hardware environments such as those present in modem FPGA's. In this paper, a distributed genetic algorithm that can be applied to the agent based reconfigurable hardware model is introduced. The effectiveness of this new algorithm is evaluated by comparing the quality of the solutions found by the new algorithm with those found by traditional genetic algorithms. The performance of a reconfigurable hardware implementation of the new algorithm on an FPGA is compared to traditional single processor implementations.

Weir, John M.↗

Mitigation of Silver Ion Loss from Solution by Polymer Coating of Metal Surfaces

Spacecraft potable water systems require a biocidal agent that effectively provides both immediate and residual disinfection over long periods of time. Ionic silver (Ag+) is a leading candidate for this application, but suffers from rapid concentration loss due interactions with the metal storage containers and tubing. In order to maintain biocidal efficacy in systems with long periods of dormancy and to reduce the required rate of Ag+ injection, it is necessary to develop alternative materials and coatings for certified metal alloys that significantly reduce the Ag+ loss. In this work, we investigate the performance of two unusual polymers, Teflon AF 2400 and parylene-AF4, as barrier coatings under immersion in 400 ppb Ag+. We show that 25 m-thick parylene-AF4 is a promising coating with Ag+ losses similar to PTFE. Key challenges with this material include maintenance of adhesion under long-term immersion and control of deposition during the internal coating of high-aspect ratio tubing. Solutions to these problems may including surface structuring of substrates for mechanical anchoring or an alternative parylene-C chemistry (with more stable adhesion), and dynamic spatio-temporal control of substrate temperature, respectively.

water↗

Mitigation of Silver Ion Loss from Solution by Polymer Coating of Metal Surfaces, Part II

“Spacecraft potable water systems require a biocidal agent that effectively provides both immediate and residual disinfection over long periods of time. Ionic silver (Ag+) is a leading candidate for this application, but suffers from rapid concentration loss due to interactions with the metal storage containers and tubing. In order to maintain biocidal efficacy in systems with long periods of dormancy and to reduce the required rate of Ag+ injection, it is necessary to develop alternative materials and coatings for certified metal alloys that significantly reduce the Ag+loss.”1In this work, we continue our investigation of vapor-deposited parylene (AF4, and now C) polymers as conformal barrier coatings under long-term (ca. 1-year) immersion in ca. 400 ppb Ag+. The performanceof internal coatings in tubing/two-ferrule fitting systems is characterized. We report successful “aging” and high concentration Ag+pretreatment of parylene coatings for quantitative reduction of Ag+loss rates. In addition, we observe long-term blister-free adhesion of mechanically anchored parylene-AF4 on nano-structured Ti-6Al-4V alloy and chemically bonded parylene-C on 316L stainless steel. Finally, we report preliminary experiments with mechanical and chemical anchoring of laboratory-deposited parylene-C on 316L.

Silver↗

Mitigation of Silver Ion Loss from Solution by Polymer Coating of Metal Surfaces, Part IV

“Spacecraft potable water systems require a biocidal agent that effectively provides both immediate and residual disinfection over long periods of time. Ionic silver (Ag+) is a leading candidate for this application, but suffers from rapid concentration loss due to interactions with the metallic storage containers and tubing. In order to maintain biocidal efficacy in systems with long periods of dormancy and to reduce the required rate of Ag+ injection, it is necessary to develop alternative materials and coatings for certified metal alloys that significantly reduce the Ag+ loss.” In previous reports, we have described our investigations addressing Ag+ loss mitigation and adhesion performance of parylene barrier coatings on coupons of several metal alloys and 316L tubing under static immersion. In such conditions, parylene-C and AF4 coatings have shown excellent Ag+ loss mitigation performance, and mixed long-term adhesion performance, depending on parylene species and substrate surface chemistry/structure. In Part IV of this series, we begin to address the performance of parylene-C barrier coatings under more challenging and realistic conditions, in order to evaluate potential suitability in flight systems. Using two testbeds, we characterized coating performance under dynamic mechanical operation. In the Flow/Pressure Testbed System, Ag+ solution is pumped through internally coated 316L tubing, with optional pressure cycling. In the Bellows Tank Testbed System, an internally coated edge-welded 316L bellows containing Ag+ solution is cyclically extended and compressed, analogous to the operation of bellows tanks used for potable water storage and delivery on the International Space Station. Periodic determinations of Ag+ loss with testbed cycling/time and visual observation of the parylene-C coatings were conducted. In addition, we characterized parylene-C coating resilience and Ag+ loss with 316L tubing and multiple fitting types under long-term immersion and repeated fitting dis/reassembly.

Lance Dean Delzeit↗

CLEANing the Reward: Counterfactual Actions to Remove Exploratory Action Noise in Multiagent Learning

Learning in multiagent systems can be slow because agents must learn both how to behave in a complex environment and how to account for the actions of other agents. The inability of an agent to distinguish between the true environmental dynamics and those caused by the stochastic exploratory actions of other agents creates noise in each agent's reward signal. This learning noise can have unforeseen and often undesirable effects on the resultant system performance. We define such noise as exploratory action noise, demonstrate the critical impact it can have on the learning process in multiagent settings, and introduce a reward structure to effectively remove such noise from each agent's reward signal. In particular, we introduce Coordinated Learning without Exploratory Action Noise (CLEAN) rewards and empirically demonstrate their benefits

Reinforcement Learning↗

Simultaneous Control of Unburned NH 3 and NO x Emissions From High Load Dual-Fuel Ammonia Operation on a High-Speed Diesel Engine Using a Cu-SCR System

Dual-fuel ammonia strategies are being investigated as a promising way to utilize NH 3 as an alternative fuel for internal combustion engines in the maritime sector. One of the remaining barriers to implementing dual-fuel NH 3 combustion strategies is understanding ways to minimize unburned NH 3 and nitrogen oxide (NO x ) emissions from these engines, both of which are elevated relative to a conventional diesel baseline. Selective catalytic reduction (SCR) systems are widely used for lean NO x emission controls for engines across transportation and stationary energy applications. SCR systems use a reducing agent, such as NH 3 , to react with NO x in the exhaust, converting it into nitrogen and water. Typically, NH 3 is injected into the exhaust as a urea solution. In dual-fuel NH 3 engines, where unburned NH 3 is present in the exhaust, an SCR system could be used to mitigate both NH 3 and NO x emissions. The presented work evaluates a commercial copper-zeolite SCR and ammonia slip catalyst system, designed for on-road diesel engine applications, for controlling unburned NH 3 and NO x emissions from a dual-fuel NH 3 combustion engine. The aftertreatment system was installed downstream of a single-cylinder four-stroke diesel engine that has been modified for dual-fuel ammonia use. Furthermore, the emissions were characterized by using a Fourier transform infrared spectrometer for both late- and early-injection diesel pilot strategies over three air–fuel equivalence ratios spanning from 1.6 to 1.0 at 1200 rpm and 12.6 bar IMEP g condition (with greater than 95% ammonia energy fraction). Initial findings indicate that the SCR achieves more than 99% NO x conversion with less than 50 ppm NH 3 slip at air–fuel equivalence ratios greater than 1.4 at the operating conditions investigated. However, these benefits are accompanied by additional N 2 O emissions that are formed over the Cu-SCR.

Catalysts↗

Fine-Water-Mist Multiple-Orientation-Discharge Fire Extinguisher

A fine-water-mist fire-suppression device has been designed so that it can be discharged uniformly in any orientation via a high-pressure gas propellant. Standard fire extinguishers used while slightly tilted or on their side will not discharge all of their contents. Thanks to the new design, this extinguisher can be used in multiple environments such as aboard low-gravity spacecraft, airplanes, and aboard vehicles that may become overturned prior to or during a fire emergency. Research in recent years has shown that fine water mist can be an effective alternative to Halons now banned from manufacture. Currently, NASA uses carbon dioxide for fire suppression on the International Space Station (ISS) and Halon chemical extinguishers on the space shuttle. While each of these agents is effective, they have drawbacks. The toxicity of carbon dioxide requires that the crew don breathing apparatus when the extinguishers are deployed on the ISS, and Halon use in future spacecraft has been eliminated because of international protocols on substances that destroy atmospheric ozone. A major advantage to the new system on occupied spacecraft is that the discharged system is locally rechargeable. Since the only fluids used are water and nitrogen, the system can be recharged from stores of both carried aboard the ISS or spacecraft. The only support requirement would be a pump to fill the water and a compressor to pressurize the nitrogen propellant gas. This system uses a gaseous agent to pressurize the storage container as well as to assist in the generation of the fine water mist. The portable fire extinguisher hardware works like a standard fire extinguisher with a single storage container for the agents (water and nitrogen), a control valve assembly for manual actuation, and a discharge nozzle. The design implemented in the proof-of-concept experiment successfully extinguished both open fires and fires in baffled enclosures.

Butz, James R.↗

A solid phase enzyme-linked immunosorbent assay for the antigenic detection of Legionella pneumophila (serogroup 1): A compliment for the space station diagnostic capability

It is necessary that an adequate microbiology capability be provided as part of the Health Maintenance Facility (HMF) to support expected microbial disease events and environmental monitoring during long periods of space flight. The application of morphological and biochemical studies to confirm the presence of certain bacterial and fungal disease agents are currently available and under consideration. This confirmation would be facilitated through employment of serological methods to aid in the identification of bacterial, fungal, and viral agents. A number of serological approaches are currently being considered, including the use of Enzyme Linked Immunosorbent Assay (ELISA) technology, which could be utilized during microgravity conditions. A solid phase, membrane supported ELISA for the detection of Legionella pneumophila, an expected disease agent, was developed to show a potential model system that would meet the HMF requirements and specifications for the future space station. These studies demonstrate the capability of membrane supported ELISA systems for identification of expected microbial disease agents as part of the HMF.

Hejtmancik, Kelly E.↗

Distributed environmental control

We present an architecture of distributed, independent control agents designed to work with the Computer Aided System Engineering and Analysis (CASE/A) simulation tool. CASE/A simulates behavior of Environmental Control and Life Support Systems (ECLSS). We describe a lattice of agents capable of distributed sensing and overcoming certain sensor and effector failures. We address how the architecture can achieve the coordinating functions of a hierarchical command structure while maintaining the robustness and flexibility of independent agents. These agents work between the time steps of the CASE/A simulation tool to arrive at command decisions based on the state variables maintained by CASE/A. Control is evaluated according to both effectiveness (e.g., how well temperature was maintained) and resource utilization (the amount of power and materials used).

Cleveland, Gary A.↗

Concepts for the Design of Human-Autonomy Systems

Over the last two years a number of workshops or similar meetings have been held under the auspice of NASA Ames Research Center that, although dealing with different primary foci, considered at some level the cross-cutting topic of humans-autonomous systems and the partnership between them. This publication presents findings from the reports of these meetings as they inform the process of designing autonomous systems to work in conjunction with humans. Some workshops were highly relevant to this question, others less so. Drawing from conclusions in these reports, this publication presents, at a high level, a summary of issues that could usefully be considered in the design process of automated systems working with human agents. Although differing in emphases, reports from the several workshops reflect many similar beliefs regarding human-autonomy teaming (HAT). Conclusions can be viewed as generally applicable to various aviation venues—air, ground, and air-ground interactions. The objective of the workshops was primarily to identify issues, concerns, and research needs associated with evolving human-autonomy systems—not in providing solutions. The analysis herewithin is generally limited to the findings in the workshop reports. And, since there was often commonality in findings among the several reports, no attempt is made to ascribe particular findings or observations to particular reports.

autonomy↗

Mechanisms of deterioration of intermediate moisture food systems

A study of shelf stability in intermediate moisture foods was made. Major efforts were made to control lipid oxidation and nonenzymatic browning. In order to determine means of preventing these reactions, model systems were developed having the same water activity content relationship of intermediate moisture foods. Models were based on a cellulose-lipid and protein-lipid system with glycerol added as the humectant. Experiments with both systems indicate that lipid oxidation is promoted significantly in the intermediate moisture range. The effect appeared to be related to increased mobility of either reactants or catalysts, since when the amount of water in the system reached a level where capillary condensation occurred and thus free water was present, the rates of oxidation increased. With added glycerol, which is water soluble and thus increases the amount of mobile phase, the increase in oxidation rate occurs at a lower relative humidity. The rates of oxidation were maximized at 61% RH and decreased again at 75% RH probably due to dilution. No significant non-enzymatic browning occurred in the protein-lipid systems. Prevention of oxidation by the use of metal chelating agents was enhanced in the cellulose system, whereas, with protein present, the lipid soluble chain terminating antioxidants (such as BHA) worked equally as well. Preliminary studies of foods adjusted to the intermediate moisture range bear out the results of oxidation in model systems. It can be concluded that for most fat containing intermediate moisture foods, rancidity will be the reaction most limiting stability.

Labuza, T. P.↗

Application of Gaussian Bayes classifier to differentiate chlorine-based chemical agents

The Portable Isotopic Neutron Spectroscopy (PINS) is a commercialized system developed by Idaho National Laboratory (INL) to examine chemical warfare agents (CWA) non-destructively, utilizing Prompt Gamma Neutron Activation Analysis (PGNAA) techniques. The PINS system takes advantage of a high-resolution gamma-ray spectrum from a mechanically-cooled high-purity germanium (HPGe) detector. One of the difficult technical challenges is to discriminate the chlorine-based chemical agents. Especially, CN, CNB, CNS and CG have similar chemical compositions to make it hard to discriminate them with a higher confidence. Current identification algorithms for PINS systems with 252-Cf sources have been improved and updated continuously as more field data became available, and new algorithms was studied to complement the current algorithms by adopting the Gaussian Bayes classifier. These new algorithms were intended to be applied to a subset of chlorine-based chemical agents, and their main goal is discriminate CN, CNB, CNS and CG with their ratios of the chlorine neutron inelastic 1763keV peak to the chlorine thermal neutron capture 1959keV peak, which is referred to as the “Cl i/c” or “clic” ratio in this study. The Cl i/c ratios were assumed to follow Gaussian distributions with the means and the standard deviations unique to their corresponding chemical agents. The prior probabilities of these four chemical agents were optimized with a collection of field data to achieve the best performance in terms of precision or positive predictive value (PPV). Finally, their posterior probabilities as functions of the Cl i/c ratio were implemented in the current version of PINS analysis software in order to be tested with more field data.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗