SEARCH · Search NASA

Results for “Human in the Loop”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14

All sources NASA NTRS DOE OSTI

NASA NTRS2017

Quantifying Pilot Contribution to Flight Safety During an In-Flight Airspeed Failure

Accident statistics cite the flight crew as a causal factor in over 60% of large transport fatal accidents. Yet a well-trained and well-qualified crew is acknowledged as the critical center point of aircraft systems safety and an integral component of the entire commercial aviation system. A human-in-the-loop test was conducted using a Level D certified Boeing 737-800 simulator to evaluate the pilot's contribution to safety-of-flight during routine air carrier flight operations and in response to system failures. To quantify the human's contribution, crew complement was used as an independent variable in a between-subjects design. This paper details the crew's actions and responses while dealing with an in-flight airspeed failure. Accident statistics often cite flight crew error (Baker, 2001) as the primary contributor in accidents and incidents in transport category aircraft. However, the Air Line Pilots Association (2011) suggests "a well-trained and well-qualified pilot is acknowledged as the critical center point of the aircraft systems safety and an integral safety component of the entire commercial aviation system." This is generally acknowledged but cannot be verified because little or no quantitative data exists on how or how many accidents/incidents are averted by crew actions. Anecdotal evidence suggest crews handle failures on a daily basis and Aviation Safety Action Program data generally supports this assertion, even if the data is not released to the public. However without hard evidence, the contribution and means by which pilots achieve safety of flight is difficult to define. Thus, ways to improve the human ability to contribute or overcome deficiencies are ill-defined.

Etherington, Timothy J.↗

DOE OSTI2020

On-the-fly closed-loop materials discovery via Bayesian active learning

Active learning—the field of machine learning (ML) dedicated to optimal experiment design—has played a part in science as far back as the 18th century when Laplace used it to guide his discovery of celestial mechanics. In this work, we focus a closed-loop, active learning-driven autonomous system on another major challenge, the discovery of advanced materials against the exceedingly complex synthesis-processes-structure-property landscape. We demonstrate an autonomous materials discovery methodology for functional inorganic compounds which allow scientists to fail smarter, learn faster, and spend less resources in their studies, while simultaneously improving trust in scientific results and machine learning tools. This robot science enables science-over-the-network, reducing the economic impact of scientists being physically separated from their labs. The real-time closed-loop, autonomous system for materials exploration and optimization (CAMEO) is implemented at the synchrotron beamline to accelerate the interconnected tasks of phase mapping and property optimization, with each cycle taking seconds to minutes. We also demonstrate an embodiment of human-machine interaction, where human-in-the-loop is called to play a contributing role within each cycle. This work has resulted in the discovery of a novel epitaxial nanocomposite phase-change memory material.

36 MATERIALS SCIENCE↗

NASA NTRS2002

CATS-based Air Traffic Controller Agents

This report describes intelligent agents that function as air traffic controllers. Each agent controls traffic in a single sector in real time; agents controlling traffic in adjoining sectors can coordinate to manage an arrival flow across a given meter fix. The purpose of this research is threefold. First, it seeks to study the design of agents for controlling complex systems. In particular, it investigates agent planning and reactive control functionality in a dynamic environment in which a variety perceptual and decision making skills play a central role. It examines how heuristic rules can be applied to model planning and decision making skills, rather than attempting to apply optimization methods. Thus, the research attempts to develop intelligent agents that provide an approximation of human air traffic controller behavior that, while not based on an explicit cognitive model, does produce task performance consistent with the way human air traffic controllers operate. Second, this research sought to extend previous research on using the Crew Activity Tracking System (CATS) as the basis for intelligent agents. The agents use a high-level model of air traffic controller activities to structure the control task. To execute an activity in the CATS model, according to the current task context, the agents reference a 'skill library' and 'control rules' that in turn execute the pattern recognition, planning, and decision-making required to perform the activity. Applying the skills enables the agents to modify their representation of the current control situation (i.e., the 'flick' or 'picture'). The updated representation supports the next activity in a cycle of action that, taken as a whole, simulates air traffic controller behavior. A third, practical motivation for this research is to use intelligent agents to support evaluation of new air traffic control (ATC) methods to support new Air Traffic Management (ATM) concepts. Current approaches that use large, human-in-the-loop simulations are unquestionably valuable for this purpose, but pose considerable logistical, fiscal, and experimental control problems. First, data analysis is extremely complicated, owing simply to the large number of participants and data sources in such simulations. In addition, experienced human air traffic controllers working adjacent sectors tend to flexibly adapt to the evolving control problem - potentially shifting to other strategies than those under investigation. In addition, their performance is tightly coupled to the control interface, which in the development phase may support some concepts and supporting strategies better than others. A simple shift in strategy by one controller can change the character of a particular traffic scenario dramatically, which makes experimental comparison of ATC performance under different traffic scenarios difficult. Training a given team of controllers on operations under a new ATM concept for a sufficient period of time could avert such difficulties, but instituting an adequate training program is expensive and logistically difficult.

Callantine, Todd J.↗

NASA NTRS2017

Quantifying Pilot Contribution to Flight Safety during Hydraulic Systems Failure

Accident statistics cite the flight crew as a causal factor in over 60% of large transport aircraft fatal accidents. Yet, a well-trained and well-qualified pilot is acknowledged as the critical center point of aircraft systems safety and an integral safety component of the entire commercial aviation system. The latter statement, while generally accepted, cannot be verified because little or no quantitative data exists on how and how many accidents/incidents are averted by crew actions. A joint NASA/FAA high-fidelity motion-base human-in-the-loop test was conducted using a Level D certified Boeing 737-800 simulator to evaluate the pilot's contribution to safety-of-flight during routine air carrier flight operations and in response to aircraft system failures. To quantify the human's contribution, crew complement (two-crew, reduced crew, single pilot) was used as the independent variable in a between-subjects design. This paper details the crew's actions, including decision-making, and responses while dealing with a hydraulic systems leak - one of 6 total non-normal events that were simulated in this experiment.

Kramer, Lynda J.↗

NASA NTRS2015

Human Factors Assessment of Disturbances to Scheduled Performance-Based Navigation Arrival Operations

The introduction of Performance-Based Navigation (PBN) specifications to air traffic management has resulted in many benefits during nominal operations, including shorter flight paths, reduced fuel costs, and improved terminal area arrival rates. However, these benefits become less noticeable during off-nominal operations where aircraft are routinely interrupted from staying on PBN procedures due to disturbances such as missed approaches. This human-in-the-loop (HITL) study used multiple types of disturbance events to perturb the arrival schedule. Perturbed schedules were managed with different types of schedule adjustments, including a condition with no adjustments. The study collected data on a host of dependent variables, including human factors measures on controller workload and system performance measures such as schedule nonconformance (nc). Initial analyses showed strong correlations between aggregated controller workload and aggregated nc, as well as benefits of both automatic and manual schedule adjustments for increasing system performance, such as reduced PBN procedure interruptions. The goal of this paper is to further test these initial findings. The results indicated that an increase in schedule nonconformance correlated with an increase in controller workload at specific time intervals, and automated schedule adjustments consistently reduced controller workload associated with nonconformance.

Human factors↗

NASA NTRS1979

A rationale for human operator pulsive control behavior

When performing tracking tasks which involve demanding controlled elements such as those with K/s-squared dynamics, the human operator often develops discrete or pulsive control outputs. A dual-loop model of the human operator is discussed, the dominant adaptive feature of which is the explicit appearance of an internal model of the manipulator-controlled element dynamics in an inner feedback loop. Using this model, a rationale for pulsive control behavior is offered which is based upon the assumption that the human attempts to reduce the computational burden associated with time integration of sensory inputs. It is shown that such time integration is a natural consequence of having an internal representation of the K/s-squared-controlled element dynamics in the dual-loop model. A digital simulation is discussed in which a modified form of the dual-loop model is shown to be capable of producing pulsive control behavior qualitively comparable to that obtained in experiment.

Hess, R. A.↗

NASA NTRS2016

SC-228 Inclusion of DAA Warning Alert for TCAS Interoperability

This white paper summarizes NASA research results that have informed Special Committee 228 (SC-228) discussions and decisions regarding the inclusion of a warning-level alert within the detect and avoid (DAA) alerting structure for unmanned aircraft systems (UAS). For UAS, the removal of the pilot from onboard the aircraft has eliminated the ability of the ground-based pilot in command (PIC) to use out-the-window visual information to make judgments about a potential threat of a loss of well clear with another aircraft. As a result, the DAA traffic display will be the primary source of information that the PIC can use to execute the three primary well clear functions: 1) detect a potential loss of well clear, 2) determine a resolution maneuver, and 3) upload that maneuver to the aircraft via the ground control station (GCS). In addition, pilots are required to coordinate with air traffic control (ATC) prior to maneuvering off of their approved flight plan. In determining an appropriate resolution maneuver to avoid a loss of well clear, the PIC must decide both when and how to maneuver, and both the timeliness and the accuracy (i.e., correctness) of the maneuver are critical to reducing the likelihood and/or severity of a loss of well clear. Alerting information is one of three critical components of the DAA display, along with traffic information elements (e.g., relative heading, speed and altitude) and maneuver guidance. Alerting information and maneuver guidance, in particular, have been found to have a significant impact, both statistically and practically, on pilots' ability to avoid and minimize the severity of losses of well clear While all three display components are key to pilots performing the traffic avoidance task of remaining well clear, in general, alerting information provides crucial information about when a resolution maneuver is required while maneuver guidance assists the pilot in determining how best to maneuver. A fundamental task of the DAA alerting system is to provide critical timing information to the pilot about the potential for a loss of well clear with another aircraft. This is done by employing both temporal and spatial thresholds that indicate to the pilot the likelihood and imminence of a loss of well clear. The design of the DAA alerting thresholds is a balancing act between eliciting the desired pilot response in real loss of well clear threat events and reducing excessive, unnecessary, and/or uncoordinated UAS maneuvering within the air traffic environment; larger thresholds, both spatially and temporally, may increase the likelihood of a pilot avoiding a loss of well clear, but it can also increase the frequency of maneuvering - especially in cases where a maneuver is not actually needed to maintain well clear. A series of human in the loop (HITL) simulations have been conducted as part of NASA's Unmanned Aircraft Systems (UAS) Integration in the National Airspace System (NAS) project. The purpose of these HITLs has been to provide empirical results in order to inform development of the minimum human-machine interface requirements for the DAA system. This white paper will present those results which provide evidence of a human performance benefit (in terms of response times and ability to remain well clear of other aircraft) of the DAA warning alert both with and without a collision avoidance system on board the aircraft.

TCAS interoperability↗

NASA NTRS2016

Heart Rate Variability as a Measure of Airport Ramp-Traffic Controllers Workload

Heart Rate Variability (HRV) has been reported to reflect the person's cognitive and emotional stress levels, and may offer an objective measure of human-operator's workload levels, which are recorded continuously and unobtrusively to the task performance. The present paper compares the HRV data collected during a human-in-the-loop simulation of airport ramp-traffic control operations with the controller participants' own verbal self-reporting ratings of their workload.

workload↗

NASA NTRS2018

SAM 3.0 Workshop Alliance SV Lab

Nissan is building a Seamless Autonomy Mobility (SAM) which is a cloud-based system of artificial intelligence that manages a fleet of autonomous vehicles. It pairs artificial intelligence with human intelligence in order to create a seamless solution that allows autonomous drive to be viable and marketable. They have created a Mobility Manager function which is a laborer who executed human-in-the-loop functions within SAM system. Nissan invited the HAT Lab to discuss NASA's lessons learned on remote operator support and to participate in a workshop discussion of one of their use cases. This presentation covers some of the HAT Lab's work on a human-autonomy teaming Agent and previous Reduced Crew Operations ground station development.

Human-Autonomy Teaming↗

NASA NTRSDate not supplied

M:N Operations NASA/Uber Collaboration

In this presentation, current approaches to enable multiple-operator, multiple vehicle (M:N) operations are reviewed together with recent collaborative efforts between NASA and Uber. Topics include a review of human-automation teaming (HAT) concepts, including plays and working agreements, and a particular task-allocation method called Automation Level-based Task Allocation (ALTA). Following introductory material on HAT, an overview of a recent (July 2020) cognitive walkthrough study of M:N operations in the context of a food delivery via small-Unmanned Aircraft Systems application is provided. Initial results from this cognitive walkthrough detailing operator feedback on displays, operator and supervisor roles and responsibilities, and the overall concept of operation are reviewed. The presentation concludes with a description of a future, human-in-the-loop simulation experiment of M:N operations in a high-fidelity environment, which will examine the effects of high workload and assistive automation/tools on operator performance.

human-automation teaming↗

DOE OSTI2023

Predicting Deposition Rate and Closing the Loop on Aerosol Jet Printing with In‐Line Light Scattering Measurements

Aerosol jet printing is a compelling noncontact, digital manufacturing technology for flexible, hybrid, and conformal electronics, but batch‐to‐batch variability and process drift inhibit systematic study and translation to production environments. Emerging measurement techniques for the aerosol volume fraction, a key parameter governing deposition rate, have shown promise for real‐time response, including a recent demonstration of human‐in‐the‐loop control. By integrating improved light scattering measurements with custom software, a robust environment for real‐time monitoring is established and fully automated closed‐loop control over the deposition rate during printing is enabled. The physical basis for scattering measurements as a feedback source is examined and the quantitative insight this provides for ink development and fundamental process studies is highlighted. Three candidate process variables for closed‐loop control, namely the atomizer voltage, carrier gas flow rate, and print speed, are then evaluated. The atomizer voltage demonstrates the best extended duration validity because it addresses atomization variability directly, but carrier gas flow rate and print speed provide faster and more deterministic responses. This methodology is then demonstrated for electrical properties using a silver nanoparticle ink, maintaining 98% of printed patterns within 10% of the mean resistance value over 3 h of printing.

36 MATERIALS SCIENCE↗

NASA NTRS2011

Crew Office Evaluation of a Precision Lunar Landing System

A representative Human System Interface for a precision lunar landing system, ALHAT, has been developed as a platform for prototype visualization and interaction concepts. This facilitates analysis of crew interaction with advanced sensors and AGNC systems. Human-in-the-loop evaluations with representatives from the Crew Office (i.e. astronauts) and Mission Operations Directorate (MOD) were performed to refine the crew role and information requirements during the final phases of landing. The results include a number of lessons learned from Shuttle that are applicable to the design of a human supervisory landing system and cockpit. Overall, the results provide a first order analysis of the tasks the crew will perform during lunar landing, an architecture for the Human System Interface based on these tasks, as well as details on the information needs to land safely.

Major, Laura M.↗

DOE OSTI2023

Autonomy Loops for Monitoring, Operational Data Analytics, Feedback, and Response in HPC Operations

Many High Performance Computing (HPC) facilities have developed and deployed frameworks in support of continuous monitoring and operational data analytics (MODA) to help improve efficiency and throughput. Because of the complexity and scale of systems and workflows and the need for low-latency response to address dynamic circumstances, automated feedback and response have the potential to be more effective than current human-in-the-loop approaches which are laborious and error prone. Progress has been limited, however, by factors such as the lack of infrastructure and feedback hooks, and successful deployment is often site- and case-specific. In this position paper we report on the outcomes and plans from a recent Dagstuhl Seminar, seeking to carve a path for community progress in the development of autonomous feedback loops for MODA, based on the established formalism of similar (MAPE-K) loops in autonomous computing and self-adaptive systems. By defining and developing such loops for significant cases experienced across HPC sites, we seek to extract commonalities and develop conventions that will facilitate interoperability and interchangeability with system hardware, software, and applications across different sites, and will motivate vendors and others to provide telemetry interfaces and feedback hooks to enable community development and pervasive deployment of MODA autonomy loops.

autonomy loops↗

NASA NTRS2014

Controller Inhibition of Automated Conflict Resolutions in a Maximum NextGen Condition

With the continued projection of increases in air traffic density, operations in the National Airspace System are expected to exceed human capabilities in the near future. In order to address the bottleneck of human workload capacity, highly automated safety-critical systems are under development to support air traffic controllers. A human-in-the-loop experiment examined controllers transition through four NextGen automation stages: Current-Day, Minimum, Moderate, and Maximum. Maximum NextGen simulated a fully automated environment where the automation was responsible for detecting and resolving conflicts within simulation parameters in high-density airspace. By allocating these tasks to the automation, the controllers task changed. The human moved to primarily a supervisory position- typically only regaining control over separation assurance tasks during conflict situations deferred by the automation. While tasks were allocated a-priori between the controller and automated agent, controllers maintained authority to inhibit the automation from interacting with particular aircraft. Preliminary work is complete, where significant differences were found in inhibition frequency between simulation participants. However, the contexts in which the controllers inhibited the automation, and their reasons for doing so, remain unclear. This analysis attempts to identity factors contributing to human controllers inhibition of the automation in the Maximum NextGen condition.

adaptable automation↗

DOE OSTI2026

Operating advanced scientific instruments with AI agents that learn on the job

Advanced scientific user facilities, such as next generation X-ray light sources and self-driving laboratories, are revolutionizing scientific discovery by automating routine tasks and enabling rapid experimentation and characterizations. However, these facilities must continuously evolve to support new experimental workflows, adapt to diverse user projects, and meet growing demands for more intricate instruments and experiments. This continuous development introduces significant operational complexity, necessitating a focus on usability, reproducibility, and intuitive human-instrument interaction. In this work, we explore the integration of agentic AI, powered by Large Language Models (LLMs), as a transformative tool to achieve this goal. We present our approach to developing a human-in-the-loop pipeline for operating advanced instruments including an X-ray nanoprobe beamline and an autonomous robotic station dedicated to the design and characterization of materials. Specifically, we evaluate the potential of various LLMs as trainable scientific assistants for orchestrating complex, multi-task workflows, which also include multimodal data, optimizing their performance through optional human input and iterative learning. We demonstrate the ability of AI agents to bridge the gap between advanced automation and user-friendly operation, paving the way for more adaptable and intelligent scientific facilities.

Large Language Models↗

NASA NTRS2018

Semi-Autonomous Rodent Habitat for Deep Space Exploration

NASA has flown animals to space as part of trailblazing missions and to understand the biological responses to spaceflight. Mice traveled in the Lunar Module with the Apollo 17 astronauts and now mice are frequent research subjects in LEO on the ISS. The ISS rodent missions have focused on unravelling biological mechanisms, better understanding risks to astronaut health, and testing candidate countermeasures. A critical barrier for longer-duration animal missions is the need for humans-in-the-loop to perform animal husbandry and perform routine tasks during a mission. Using autonomous or telerobotic systems to alleviate some of these tasks would enable longer-duration missions to be performed at the Deep Space Gateway. Rodent missions performed using the Gateway as a platform could address a number of critical risks identified by the Human Research Program (HRP), as well as Space Biology Program questions identified by NRC Decadal Survey on Biological and Physical Sciences in Space, (2011). HRP risk areas of potentially greatest relevance that the Gateway rodent missions can address include those related to visual impairment (VIIP) and radiation risks to central nervous system, cardiovascular disease, as well as countermeasure testing. Space Biology focus areas addressed by the Gateway rodent missions include mechanisms and combinatorial effects of microgravity and radiation. The objectives of the work proposed here are to 1) develop capability for semi-autonomous rodent research in cis-lunar orbit, 2) conduct key experiments for testing countermeasures against low gravity and space radiation. The hardware and operations system developed will enable experiments at least one month in duration, which potentially could be extended to one year in duration. To gain novel insights into the health risks to crew of deep space travel (i.e., exposure to space radiation), results obtained from Gateway flight rodents can be compared to ground control groups and separate groups of mice exposed to simulated Galactic Cosmic Radiation (at the NASA Space Radiation Lab). Results can then be compared to identical experiments conducted on the ISS. Together results from Gateway, ground-based, and ISS rodent experiments will provide novel insight into the effects of space radiation.

deep space gateway↗

NASA NTRS2026

In-suit CO2 Washout Test System (ICWTS) for CO2 Washout Verification in Spacesuits

Since the time of Mercury, Gemini, and Apollo, NASA has been performing CO 2 washout verification of spacesuits with Human in the Loop (HITL) test methods. Classically, the only instrumentation both with the accuracy and response time necessary was that of external mass spectrometers or medical gas analyzers fed by a long capillary line from the oro-nasal region within the suit. The helmet CO 2 washout configuration including the challenges posed by variation of a suited human subject frequently created difficulty in capturing adequate breath by breath data. For example, a nasal cannula could be worn with reasonable comfort however it posed the following challenges: (1) impeded the test subject’s ability to do a proper Valsalva maneuver; (2) frequently provided a corrupted waveform with relative movement; (3) precluded the ability to evaluate the Flow Weighted Average (FWA) at subject interface. A mouthpiece could be used in lieu of a cannula but posed challenges as well: (1) created potential disturbances of the flow field; (2) precluded the test subject from speaking during usage; and (3) presented comfort issues limiting the duration of test points. These challenges made it impractical to use a mouthpiece for anything other than short lab ambient environment tests. Technology development and NASA investment have afforded new capabilities to address some of these measurements providing improved data collection and are implemented in the In-suit CO 2 Washout Test System (ICWTS) which provides suit inlet/outlet pressure, temperature, relative humidity, partial pressure of oxygen, partial pressure of CO 2 , and flow measurement coupled with the acquisition of the inspired PPCO 2 including the ability for FWA measurement. This test system, coupled with use of the In-suit Respiration Mannequin Assembly (IRMA) and Computational Fluid Dynamics (CFD) combine to provide a full picture of the in-suit oro-nasal flow field and effectiveness of CO 2 washout in a spacesuit design.

Colin Campbell↗

NASA NTRS2026

In-suit CO 2 Washout Test System (ICWTS) for CO 2 Washout Verification in Spacesuits

Colin Campbell↗