Search NASA⌕ Search

SEARCH · Search NASA

Results for “multiple agents”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Co-orchestration of multiple instruments to uncover structure–property relationships in combinatorial libraries

The rapid growth of automated and autonomous instrumentation brings forth opportunities for the co-orchestration of multimodal tools that are equipped with multiple sequential detection methods or several characterization techniques to explore identical samples. This is exemplified by combinatorial libraries that can be explored in multiple locations via multiple tools simultaneously or downstream characterization in automated synthesis systems. In co-orchestration approaches, information gained in one modality should accelerate the discovery of other modalities. Correspondingly, an orchestrating agent should select the measurement modality based on the anticipated knowledge gain and measurement cost. Herein, we propose and implement a co-orchestration approach for conducting measurements with complex observables, such as spectra or images. The method relies on combining dimensionality reduction by variational autoencoders with representation learning for control over the latent space structure and integration into an iterative workflow via multi-task Gaussian Processes (GPs). This approach further allows for the native incorporation of the system's physics via a probabilistic model as a mean function of the GPs. We illustrate this method for different modes of piezoresponse force microscopy and micro-Raman spectroscopy on a combinatorial Sm-BiFeO3 library. However, the proposed framework is general and can be extended to multiple measurement modalities and arbitrary dimensionality of the measured signals.

47 OTHER INSTRUMENTATION↗

Fingerprints of External Forcing Agents on Sahel Rainfall: Aerosols, Greenhouse Gases, and Model-Observation Discrepancies

Over the 20th and 21st centuries, both anthropogenic greenhouse gas increases and changes in anthropogenic aerosols have affected rainfall in the Sahel. Using multiple characteristics of Sahel precipitation, we construct a multivariate fingerprint that allows us to distinguish between the model-predicted responses to greenhouse gases and anthropogenic aerosols. Models project the emergence of a detectable signal of aerosol forcing in the middle of the 20th century and a detectable signal of greenhouse gas forcing at the beginning of the 21st. However, the signals of both aerosol and greenhouse gas forcing in observations emerge earlier and are stronger than in the models, far stronger in the case of aerosols. The similarity between the response to aerosol forcing and the leading mode of internal variability makes it difficult to attribute this model-observation discrepancy to errors in the forcing, errors in the forced response, model inability to capture the amplitude of internal variability, or some combination of these. For greenhouse gases, however, the forced response is distinct from internal variability as estimated by models, and the observations are largely commensurate with the model projections.

Sahel↗

Time-Coordination Strategies and Control Laws for Multi-Agent Unmanned Systems

Time-critical coordination tools for unmanned systems can be employed to enforce the type of temporal constraints required in terminal control areas, ensure minimum distance requirements among vehicles are satisfied, and successfully perform coordinated missions. In comparison with previous literature, this paper presents an ampler spectrum of coordination and temporal specifications for unmanned systems, and proposes a general control law that can enforce this range of constraints. The constraint classification presented con- siders the nature of the desired arrival window and the permissible coordination errors to define six different types of time-coordination strategies. The resulting decentralized coordination control law allows the vehicles to negotiate their speeds along their paths in response to information exchanged over the communication network. This control law organizes the different members in the fleet hierarchically per their behavior and informational needs as reference agent, leaders, and followers. Examples and simulation results for all the coordination strategies presented demonstrate the applicability and efficacy of the coordination control law for multiple unmanned systems.

Puig-Navarro, Javier↗

Agent Based Software for the Autonomous Control of Formation Flying Spacecraft

Distributed satellite systems is an enabling technology for many future NASA/DoD earth and space science missions, such as MMS, MAXIM, Leonardo, and LISA [1, 2, 3]. While formation flying offers significant science benefits, to reduce the operating costs for these missions it will be essential that these multiple vehicles effectively act as a single spacecraft by performing coordinated observations. Autonomous guidance, navigation, and control as part of a coordinated fleet-autonomy is a key technology that will help accomplish this complex goal. This is no small task, as most current space missions require significant input from the ground for even relatively simple decisions such as thruster burns. Work for the NMP DS1 mission focused on the development of the New Millennium Remote Agent (NMRA) architecture for autonomous spacecraft control systems. NMRA integrates traditional real-time monitoring and control with components for constraint-based planning, robust multi-threaded execution, and model-based diagnosis and reconfiguration. The complexity of using an autonomous approach for space flight software was evident when most of its capabilities were stripped off prior to launch (although more capability was uplinked subsequently, and the resulting demonstration was very successful).

How, Jonathan P.↗

Summary of Technical Interchange Meetings (TIMs) Designed to Enable Earth Independent Medical Operations (EIMO)

The Exploration Medical Capability Element (ExMC) in NASA’s Human Research Program hosted a series of TIMs in 2023-2024 designed to stimulate discussion around specific topics with the goal of enabling EIMO. In context of the thematic constituent elements of EIMO, namely pre-mission planning, acute/emergent/prolonged medical decision making, supply/resource management and task load management, subject matter experts from industry, academia and government (NASA and other Agencies) provided valuable and actionable guidance and recommendations. Earth-based medical experts will remain indispensable for pre-mission planning, however, management of acute/emergent medical contingencies will require a gradual transition of medical care and decision making from terrestrial to space-based assets to enable support of astronaut health and performance and reduce overall mission risk. Key to achieving these enhancements is providing an integrated data system platform capable of utilizing multiple data streams in concert with a variety of on-board databases and passive monitoring of video and wearable sensors to enable a multi-modal, agentic AI-based clinical decision support system (CDSS) to support crew medical officer (CMO) medical decision-making. The EIMO series of TIMs (I-V) have proven to be instructive and portend a significant paradigm shift will be necessary to maintain crew health and performance on exploration class missions. Importantly, since the expected paradigm shift will be significantly different from the methods of operation that have been employed for the majority of missions from the inception of human spaceflight to date, any proposed methods must be deployed in the setting of ongoing operations early and be “tested, reviewed and practiced” while reliable back-up is available to facilitate an Enterprise-wide level of comfort and acceptance. Serious constraints on data transmission coupled with a large and expanding universe of on-board medical informatics data streams will necessitate implementation of a CDSS to supplant the current reliance on support provided by ground-based SMEs. Establishment of trust in the system by CMO/crew and the ground-based medical support team will be essential. Co-development of a CDSS with industry partners will assure that state of the art tools can be employed, and industry efficiencies can be leveraged. Training regimens, materials and tools must evolve to be responsive (just-in-time training) and facilitate autonomous execution of procedures. Proficiency metrics should be established and be based on validated competencies or milestones as opposed to a prescribed number of training hours. Training should be prioritized for broad, translatable skills that have universal application across a variety of medical conditions. Repetition was deemed to be the key to achieving proficiency and emphasis should lie in procedural training which is known to extinguish more rapidly than diagnostic skills. Advanced tools, e.g., extended reality, can provide more realistic and effective training. Use of advanced probabilistic risk assessment tools will be essential to optimize the medical system capability while carefully balancing risk relative to mass/power/volume limitations. Importance of factoring use-life of medical supplies and maintaining awareness of redundancy and opportunity to re-purpose under off nominal situations was emphasized. Consideration of adopting optimized performance standards vs. “good-enough” performance thresholds is warranted. The use of legacy systems as opposed to creating new systems may be preferable. Managing task load and associated cognitive load will be essential to maintain operational safety and behavioral health. ExMC aspires to create a shared EIMO paradigm and strategic vision for advancing medical system design through novel technologies, training, protocols, and support capabilities, built upon the spirit of successful strategies and innovations over the past six decades of space medicine operations.

Jay Lemery↗

Joint Communication Resource Allocation and Velocity Selection in Urban Air Mobility via Multi-agent Reinforcement Learning

With traffic congestion problems becoming more severe in urban areas, the National Aeronautics and Space Administration promotes the Urban Air Mobility (UAM) concept, which envisages a safe and efficient air transportation system. However, the increased communication demands in UAM can exacerbate the spectrum scarcity. Therefore, a new communication resource allocation solution is necessary. In this paper, we focus on uplink UAM communications, where multiple aerial vehicles (AV) perform cargo/passenger delivery tasks. With predefined flight paths, AVs make decisions on communication resource allocation and velocity selection to complete their missions under safety constraints. Accordingly, we formulate a joint optimization problem to minimize the weighted sum of the total travel time and communication outage time. We first model the optimization problem as a Markov game and propose a multi-agent reinforcement learning based solution. Simulation results corroborate the effectiveness of the proposed solution.

Ruixuan Han↗

Circulation-Enhancing Device Improves CPR

Advanced Circulatory Systems, Inc. and NASA's Kennedy Space Center collaborated for five years on impedance threshold device technology. The resulting technology is encapsulated in a device called the ResQPOD Circulatory Enhancer, which improves the standard of care provided to patients with a variety of clinical conditions due to low blood flow. ResQPOD generates negative intrathoracic pressure during respiration to increase blood flow to the body's vital organs. It is unique in that it non-invasively enhances the body's biophysical performance without depending on pharmaceutical or other outside agents. ResQPOD uses the relationship of the heart, brain, lungs and chest cavity in a manner similar to a bellows to increase venous blood return to the heart. Multiple studies have shown a significant improvement in cardiac output and blood flow to the brain with the use of the impedance threshold device, as well as the device's ability to prevent shock secondary to blood loss. ResQPOD has been added to the set of medical equipment that is available for returning astronaut crews, and commercial applications have fallen into two categories: Non-spontaneously breathing patients who can benefit from enhanced circulation, and spontaneously breathing patients who suffer from transient hypotension or low blood pressure.

Source record↗

A Real-Time Rover Executive based On Model-Based Reactive Planning

This paper reports on the experimental verification of the ability of IDEA (Intelligent Distributed Execution Architecture) effectively operate at multiple levels of abstraction in an autonomous control system. The basic hypothesis of IDEA is that a large control system can be structured as a collection of interacting control agents, each organized around the same fundamental structure. Two IDEA agents, a system-level agent and a mission-level agent, are designed and implemented to autonomously control the K9 rover in real-time. The system is evaluated in the scenario where the rover must acquire images from a specified set of locations. The IDEA agents are responsible for enabling the rover to achieve its goals while monitoring the execution and safety of the rover and recovering from dangerous states when necessary. Experiments carried out both in simulation and on the physical rover, produced highly promising results.

Bias, M. Bernardine↗

Large File Transfers from Space Using Multiple Ground Terminals and Delay-Tolerant Networking

We use Delay-Tolerant Networking (DTN) to break control loops between space-ground communication links and ground-ground communication links to increase overall file delivery efficiency, as well as to enable large files to be proactively fragmented and received across multiple ground stations. DTN proactive fragmentation and reactive fragmentation were demonstrated from the UK-DMC satellite using two independent ground stations. The files were reassembled at a bundle agent, located at Glenn Research Center in Cleveland Ohio. The first space-based demonstration of this occurred on September 30 and October 1, 2009. This paper details those experiments. Communication, delay-tolerant networking, DTN, satellite, Internet, protocols, bundle, IP, TCP.

Ivancic, William D.↗

Autoplan: A self-processing network model for an extended blocks world planning environment

Self-processing network models (neural/connectionist models, marker passing/message passing networks, etc.) are currently undergoing intense investigation for a variety of information processing applications. These models are potentially very powerful in that they support a large amount of explicit parallel processing, and they cleanly integrate high level and low level information processing. However they are currently limited by a lack of understanding of how to apply them effectively in many application areas. The formulation of self-processing network methods for dynamic, reactive planning is studied. The long-term goal is to formulate robust, computationally effective information processing methods for the distributed control of semiautonomous exploration systems, e.g., the Mars Rover. The current research effort is focusing on hierarchical plan generation, execution and revision through local operations in an extended blocks world environment. This scenario involves many challenging features that would be encountered in a real planning and control environment: multiple simultaneous goals, parallel as well as sequential action execution, action sequencing determined not only by goals and their interactions but also by limited resources (e.g., three tasks, two acting agents), need to interpret unanticipated events and react appropriately through replanning, etc.

Dautrechy, C. Lynne↗

Dynamic Spectrum Allocation in Urban Air Transportation System via Deep Reinforcement Learning

The emerging concepts of Urban Air Mobility (UAM) and Advanced Air Mobility (AAM) open a new paradigm for urban air transportation. A big challenge is that these new aerial vehicles will quickly saturate the already crowded aviation spectrum, which is an essential resource to ensure reliable communications for safe operations. In this paper, we consider an air transportation system where multiple aerial vehicles are operated to transport passengers or cargo from different sources to destinations along their pre-defined paths. During the flight, the minimum communication Quality of Service (QoS) requirement must be achieved to ensure flight safety. Our objective is to minimize the average mission completion time by jointly optimizing the velocity selection and spectrum allocation for all aerial vehicles. We formulate the optimization problem as a multi-stage Markov Decision Process (MDP) where the optimization variables are coupled together. A multi-agent Deep Reinforcement Learning (DRL) based solution is proposed where Value Decomposition Networks (VDN) algorithm is utilized to take discrete actions. Additionally, we propose a heuristic greedy algorithm as a baseline solution. Simulation results show that our learning based solution outperforms the heuristic greedy algorithm and another Orthogonal Multiple Access (OMA) solution in minimizing the mission completion time.

Ruixuan Han↗

Dynamic Spectrum Allocation in Urban Air Transportation System via Deep Reinforcement Learning

The emerging concepts of Urban Air Mobility (UAM) and Advanced Air Mobility (AAM) open a new paradigm for urban air transportation. A big challenge is that these new aerial vehicles will quickly saturate the already crowded aviation spectrum, which is an essential resource to ensure reliable communications for safe operations. In this paper, we consider an air transportation system where multiple aerial vehicles are operated to transport passengers or cargo from different sources to destinations along their pre-defined paths. During the flight, the minimum communication Quality of Service (QoS) requirement must be achieved to ensure flight safety. Our objective is to minimize the average mission completion time by jointly optimizing the velocity selection and spectrum allocation for all aerial vehicles. We formulate the optimization problem as a multi-stage Markov Decision Process (MDP) where the optimization variables are coupled together. A multi-agent Deep Reinforcement Learning (DRL) based solution is proposed where Value Decomposition Networks (VDN) algorithm is utilized to take discrete actions. Additionally, we propose a heuristic greedy algorithm as a baseline solution. Simulation results show that our learning based solution outperforms the heuristic greedy algorithm and another Orthogonal Multiple Access (OMA) solution in minimizing the mission completion time.

Ruixuan Han↗

Filling the cellulosic bio-economy gap by utilizing a wedge approach combined with stakeholder collaboration

The price gap between the market and breakeven prices of cellulosic biomass for farmers represents a significant barrier to the development of a low-carbon cellulosic bioeconomy. Using a bottom-up, agent-based modeling tool that replicates the behaviors and interactions of key stakeholders, this study analyzes the emergence of a cellulosic bioeconomy at the local scale through a wedge approach that examines an integrated portfolio of multiple policy options, including subsidies for small-scale bioproducts and environmental credits. Here, the role of collaboration among multiple stakeholders, such as biomass producers (farmers), bio-refinery industry, government, and society, is assessed for filling the price gap. Using the Sangamon River Basin as a case study site, we evaluate the effectiveness of the wedge approach by comparing simulation results from multiple scenarios, each incorporating different combinations of bioeconomy wedges, with and without stakeholder collaboration. Results underscore that active collaboration among stakeholders acts as a catalyst enlarging the effectiveness of bioeconomy wedges. Including the carbon credits and environmental value in the policy portfolio is found to bridge the price gap through collective contributions from diverse stakeholders, where the cellulosic biofuel and bioproduct industry plays a pivotal role. Although this study is conducted at the local watershed scale, the methodology and findings offer valuable insights for market development in other watersheds and the potential scaling of local markets to regional and national levels.

09 BIOMASS FUELS↗

A potential cause for kidney stone formation during space flights: enhanced growth of nanobacteria in microgravity

BACKGROUND: Although some information is available regarding the cellular/molecular changes in immune system exposed to microgravity, little is known about the reasons of the increase in the kidney stone formation in astronauts during and/or after long duration missions at zero gravity (0 g). In our earlier studies, we have assessed a unique agent, nanobacteria (NB), in kidney stones and hypothesized that NB have an active role in calcium phosphate-carbonate deposition in kidney. In this research we studied effect of microgravity on multiplication and calcification of NB in vitro. METHODS: We examined NB cultures in High Aspect Rotating Vessels (HARVs) designed at the NASA's Johnson Space Center, which are designed to stimulate some aspects of microgravity. Multiplication rate and calcium phosphate composition of those NB were compared with NB cultured on stationary and shaker flasks. Collected aliquots of the cultures from different incubation periods were analyzed using spectrophotometer, SEM, TEM, EDX, and x-ray diffraction techniques. RESULTS: The results showed that NB multiplied 4.6x faster in HARVs compared to stationary cultures, and 3.2x faster than shaker flask conditions. X-ray diffraction and EDX analysis showed that the degree of apatite crystal formation and the properties of the apatite depend on the specific culture conditions used. CONCLUSION: We now report an increased multiplication rate of NB in microgravity-simulated conditions. Thus, NB infection may have a potential role in kidney stone formation in crew members during space flights. For further proof to this hypothesis, screening of the NB antigen and antibody level in flight crew before and after flight would be necessary.

Weightlessness↗

Using Diffusion Bonding in Making Piezoelectric Actuators

A technique for the fabrication of piezoelectric actuators that generate acceptably large forces and deflections at relatively low applied voltages involves the stacking and diffusion bonding of multiple thin piezoelectric layers coated with film electrodes. The present technique stands in contrast to an older technique in which the layers are bonded chemically, by use of urethane or epoxy agents. The older chemical-bonding technique entails several disadvantages, including the following: It is difficult to apply the bonding agents to the piezoelectric layers. It is difficult to position the layers accurately and without making mistakes. There is a problem of disposal of hazardous urethane and epoxy wastes. The urethane and epoxy agents are nonpiezoelectric materials. As such, they contribute to the thickness of a piezoelectric laminate without contributing to its performance; conversely, for a given total thickness, the performance of the laminate is below that of a unitary piezoelectric plate of the same thickness. The figure depicts some aspects of the fabrication of a laminated piezoelectric actuator by the present diffusion- bonding technique. First, stock sheets of the piezoelectric material are inspected and tested. Next, the hole pattern shown in the figure is punched into the sheets. Alternatively, if the piezoelectric material is not a polymer, then the holes are punched in thermoplastic films. Then both faces of each punched piezoelectric sheet or thermoplastic film are coated with a silver-ink electrode material by use of a silkscreen printer. The electrode and hole patterns are designed for minimal complexity and minimal waste of material. After a final electrical test, all the coated piezoelectric layers (or piezoelectric layers and coated thermoplastic films) are stacked in an alignment jig, which, in turn, is placed in a curved press for the diffusion-bonding process. In this process, the stack is pressed and heated at a specified curing temperature and pressure for a specified curing time. The pressure, temperature, and time depend on the piezoelectric material selected. At the end of the diffusion-bonding process, the resulting laminated piezoelectric actuator is tested to verify the adequacy of the mechanical output as a function of an applied DC voltage.

Sager, Frank E.↗

Harnessing Machine Learning for Agnostic Biodetection

The United States’ current list-based approach to biodefense is limited because it considers only known biological agents. Alternatively, developing and adopting a system based on agent-agnostic signatures would enable detection and characterization of both known and novel agents, thereby engendering greater adaptability in the face of an evolving threat landscape. Machine learning (ML) could aid in such a transition, as it can recognize and encode highly complex patterns from multiple input data modalities and has already demonstrated success in many healthcare and defense applications. Functionalizing ML for environmental biodetection requires understanding current technical capabilities. In this article, we provide a systematic review of existing ML platforms and discuss anticipated development efforts needed to achieve effective ML-enabled, agnostic biodetection.

60 APPLIED LIFE SCIENCES↗

Application of Human-Autonomy Teaming to an Advanced Ground Station for Reduced Crew Operations

Within human factors there is burgeoning interest in the "human-autonomy teaming" (HAT) concept as a way to address the challenges of interacting with complex, increasingly autonomous systems. The HAT concept comes out of an aspiration to interact with increasingly autonomous systems as a team member, rather than simply use automation as a tool. The authors, and others, have proposed core tenets for HAT that include bi-directional communication, automation and system transparency, and advanced coordination between human and automated teammates via predefined, dynamic task sequences known as "plays." It is believed that, with proper implementation, HAT should foster appropriate teamwork, thus increasing trust and reliance on the system, which in turn will reduce workload, increase situation awareness, and improve performance. To this end, HAT has been demonstrated and/or studied in multiple applications including search and rescue operations, healthcare and medicine, autonomous vehicles, photography, and aviation. The current paper presents one such effort to apply HAT. It details the design of a HAT agent, developed by Human Automation Teaming Solutions, Inc., to facilitate teamwork between the automation and the human operator of an advanced ground dispatch station. This dispatch station was developed to support a NASA project investigating a concept called Reduced Crew Operations (RCO); consequently, we have named the agent R-HATS. Part of the RCO concept involves a ground operator providing enhanced support to a large number of aircraft with a single pilot on the flight deck. When assisted by R-HATS, operators can monitor and support or manage a large number of aircraft and use plays to respond in real-time to complicated, workload-intensive events (e.g., an airport closure). A play is a plan that encapsulates goals, tasks, and a task allocation strategy appropriate for a particular situation. In the current implementation, when a play is initiated by a user, R-HATS determines what tasks need to be completed and has the ability to autonomously execute them (e.g., determining diversion options and uplinking new routes to aircraft) when it is safe and appropriate. R-HATS has been designed to both support end users and researchers in RCO and HAT. Additionally, R-HATS and its underlying architecture were developed with generalizability in mind as a modular software applicable outside of RCO/aviation domains. This paper will also discuss future further development and testing of RHATS.

automation↗

A Survey of Collectives

Due to the increasing sophistication and miniaturization of computational components, complex, distributed systems of interacting agents are becoming ubiquitous. Such systems, where each agent aims to optimize its own performance, but where there is a well-defined set of system-level performance criteria, are called collectives. The fundamental problem in analyzing/designing such systems is in determining how the combined actions of self-interested agents leads to 'coordinated' behavior on a iarge scale. Examples of artificial systems which exhibit such behavior include packet routing across a data network, control of an array of communication satellites, coordination of multiple deployables, and dynamic job scheduling across a distributed computer grid. Examples of natural systems include ecosystems, economies, and the organelles within a living cell. No current scientific discipline provides a thorough understanding of the relation between the structure of collectives and how well they meet their overall performance criteria. Although still very young, research on collectives has resulted in successes both in understanding and designing such systems. It is eqected that as it matures and draws upon other disciplines related to collectives, this field will greatly expand the range of computationally addressable tasks. Moreover, in addition to drawing on them, such a fully developed field of collective intelligence may provide insight into already established scientific fields, such as mechanism design, economics, game theory, and population biology. This chapter provides a survey to the emerging science of collectives.

Tumer, Kagan↗