Search NASA⌕ Search

SEARCH · Search NASA

Results for “Human in the Loop”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

A dynamic Bayesian optimized active recommender system for curiosity-driven partially Human-in-the-loop automated experiments

Optimization of experimental materials synthesis and characterization through active learning methods has been growing over the last decade, with examples ranging from measurements of diffraction on combinatorial alloys at synchrotrons, to searches through chemical space with automated synthesis robots for perovskites. In virtually all cases, the target property of interest for optimization is defined a priori with the ability to shift the trajectory of the optimization based on human-identified findings during the experiment is lacking. Thus, to highlight the best of both human operators and AI-driven experiments, here we present the development of a human–AI collaborated experimental workflow, via a Bayesian optimized active recommender system (BOARS), to shape targets on the fly with human real-time feedback. Here, the human guidance overpowers AI at early iteration when prior knowledge (uncertainty) is minimal (higher), while the AI overpowers the human during later iterations to accelerate the process with the human-assessed goal. We showcase examples of this framework applied to pre-acquired piezoresponse force spectroscopy of a ferroelectric thin film, and in real-time on an atomic force microscope, with human assessment to find symmetric hysteresis loops. It is found that such features appear more affected by subsurface defects than the local domain structure. This work shows the utility of human–AI approaches for curiosity driven exploration of systems across experimental domains.

36 MATERIALS SCIENCE↗

Human-in-the-Loop Operations over Time Delay: NASA Analog Missions Lessons Learned

Teams at NASA have conducted studies of time-delayed communications as it effects human exploration. In October 2012, the Advanced Exploration Systems (AES) Analog Missions project conducted a Technical Interchange Meeting (TIM) with the primary stakeholders to share information and experiences of studying time delay, to build a coherent picture of how studies are covering the problem domain, and to determine possible forward plans (including how to best communicate study results and lessons learned, how to inform future studies and mission plans, and how to drive potential development efforts). This initial meeting s participants included personnel from multiple NASA centers (HQ, JSC, KSC, ARC, and JPL), academia, and ESA. It included all of the known studies, analog missions, and tests of time delayed communications dating back to the Apollo missions including NASA Extreme Environment Mission Operations (NEEMO), Desert Research and Technology Studies (DRATS/RATS), International Space Station Test-bed for Analog Research (ISTAR), Pavilion Lake Research Project (PLRP), Mars 520, JPL Mars Orbiters/Rovers, Advanced Mission Operations (AMO), Devon Island analog missions, and Apollo experiences. Additionally, the meeting attempted to capture all of the various functional perspectives via presentations by disciplines including mission operations (flight director and mission planning), communications, crew, Capcom, Extra-Vehicular Activity (EVA), Behavioral Health and Performance (BHP), Medical/Surgeon, Science, Education and Public Outreach (EPO), and data management. The paper summarizes the descriptions and results from each of the activities discussed at the TIM and includes several recommendations captured in the meeting for dealing with time delay in human exploration along with recommendations for future development and studies to address this issue.

Rader, Steven N.↗

Small Unmanned Aircraft Systems Integration into the National Airspace System Visual-Line-of-Sight Human-in-the-Loop Experiment

As part of the Unmanned Aircraft Systems (UAS) in the National Airspace System (NAS) project, research on integrating small UAS (sUAS) into the NAS was underway by a human-systems integration (HSI) team at the NASA Langley Research Center. Minimal to no research has been conducted on the safe, effective, and efficient manner in which to integrate these aircraft into the NAS. sUAS are defined as aircraft weighing 55 pounds or less. The objective of this human system integration team was to build a UAS Ground Control Station (GCS) and to develop a research test-bed and database that provides data, proof of concept, and human factors guidelines for GCS operations in the NAS. The objectives of this experiment were to evaluate the effectiveness and safety of flying sUAS in Class D and Class G airspace utilizing manual control inputs and voice radio communications between the pilot, mission control, and air traffic control. The design of the experiment included three sets of GCS display configurations, in addition to a hand-held control unit. The three different display configurations were VLOS, VLOS + Primary Flight Display (PFD), and VLOS + PFD + Moving Map (Map). Test subject pilots had better situation awareness of their vehicle position, altitude, airspeed, location over the ground, and mission track using the Map display configuration. This configuration allowed the pilots to complete the mission objectives with less workload, at the expense of having better situation awareness of other aircraft. The subjects were better able to see other aircraft when using the VLOS display configuration. However, their mission performance, as well as their ability to aviate and navigate, was reduced compared to runs that included the PFD and Map displays.

Trujillo, Anna C.↗

A Remote, Human-in-the-Loop Evaluation of a Multiple-Drone Delivery Operation

Over time, advances in unmanned aircraft systems (UAS) have enabled a shift in the operational paradigm from one operator managing one aircraft to that of multiple operators working together to manage multiple aircraft. This shift has highlighted the need for effective human-autonomy teaming methods to maintain manageable workload levels for operators as well as high standards of system performance and safety. This paper presents a study aimed at evaluating whether automation can help operators manage workload during small UAS (sUAS) package delivery scenarios featuring contingency situations. These contingency situations, resulting from unplanned UAS Volume Reservations (UVRs), required flight path reroutes for multiple aircraft simultaneously. The study manipulated the number of aircraft affected by the UVRs and the level of automation support. The presence of terrain conflicts was also controlled within each scenario. Due to the COVID-19 pandemic, subjects were not able to gain direct access to the Ground Control System (GCS). Therefore, the study was conducted using a subject-surrogate paradigm that required subjects to relay commands through a verbal protocol from remote locations outside of the lab to a researcher surrogate who had direct control of the GCS interfaces at the lab location. Results show that the automated support condition was associated with faster reroute response times, more efficient reroute maneuvers, and significantly lower levels of perceived workload than the manual reroute condition. However, the automation support level did not significantly impact pilots’ ability to avoid the UVR successfully; pilots were overwhelmingly capable of avoiding the UVR in all conditions. The presence of terrain conflicts primarily impacted pilot performance by leading to multiple uploads per vehicle, which was not typically required when pilots only needed to maneuver laterally. Although subjects did not have direct control over the GCS, subjective ratings indicate that the displays under test provided them with sufficient information to manage their aircraft and promptly respond to the unplanned UVRs. Overall, the objective and subjective data strongly suggest that the verbal protocol and subject-surrogate paradigm were effective methods for collecting data remotely amid the COVID-19 pandemic.

multi-UAS↗

Data Comm Flight Deck Human-in-the-Loop Simulation

This presentation discusses an upcoming simulation for data comm in the terminal area. The purpose of the presentation is to provide the REDAC committee with a summary of some of the work in Data Comm that is being sponsored by the FAA. The focus of the simulation is upon flight crew human performance variables, such as crew procedures, timing and errors. The simulation is scheduled to be conducted in Sept 2012.

Lozito, Sandra↗

The future of self-driving laboratories: from human in the loop interactive AI to gamification

Recent developments in artificial intelligence (AI) and machine learning (ML), implemented through self-driving laboratories (SDLs), are rapidly creating unprecedented opportunities for the accelerated discovery and optimization of materials. This paper provides a joint analysis of SDLs from both academic and industry perspectives, highlighting the importance of integrating human intelligence in these systems. It discusses the necessity of careful planning in SDL design across physical, data, and workflow dimensions, including instrumental setup, experimental workflow, data management, and human–SDL interaction. The significance of integrating human input within SDLs, especially as the focus shifts from individual tools and tasks to the creation and management of complex workflows, is emphasized. The paper stresses on the crucial role of reward function design in developing forward-looking workflows and examines the interplay between hardware evolution, ML application across chemical processes, and the influence of reward systems in research. Ultimately, the article advocates for a future where SDLs blend human intuition in hypothesis formulation with AI's precision, speed, and data-handling capabilities.

97 MATHEMATICS AND COMPUTING↗

A dual-loop model of the human controller in single-axis tracking tasks

A dual loop model of the human controller in single axis compensatory tracking tasks is introduced. This model possesses an inner-loop closure which involves feeding back that portion of the controlled element output rate which is due to control activity. The sensory inputs to the human controller are assumed to be system error and control force. The former is assumed to be sensed via visual, aural, or tactile displays while the latter is assumed to be sensed in kinesthetic fashion. A nonlinear form of the model is briefly discussed. This model is then linearized and parameterized. A set of general adaptive characteristics for the parameterized model is hypothesized. These characteristics describe the manner in which the parameters in the linearized model will vary with such things as display quality. It is demonstrated that the parameterized model can produce controller describing functions which closely approximate those measured in laboratory tracking tasks for a wide variety of controlled elements.

Hess, R. A.↗

Human-in-the-Loop Evaluation of Dynamic Multi-Flight Common Route Advisories

Flights often experience large delays when they are routed around weather. Multi-flight common route advisories provide delay recovery by suggesting time-saving re-routes for groups of flights whose current weather-avoidance routes have become outdated because the weather has dissipated and/or moved away. A laboratory evaluation of these advisories was conducted by four subject matter experts having extensive experience in traffic flow management operations. These experts provided a total of 120 data points in the airspace of Houston Center. The multi-flight common route tool provides time-saving route change advisories taking into account flight plans, wind fields, and the spatio-temporal evolution of predicted convective weather. It is not designed to account for complex operational factors such as non-standard sector traversal and interactions with local traffic management initiatives; hence a relatively low percentage (37%) of advisories generated by the tool were rated as acceptable. However, a high percentage (81%) of advisories were rated as acceptable after the subject matter experts used the tool's user interface to make route modifications that accounted for relevant operational factors not considered by the tool. The workload associated with using the tool, as measured by the NASA Task Load Index, was quite low (1.1 on a scale of 0 to 10). The results of this evaluation make a good case for human-automation teaming to design operationally valid weather re-routes for delay recovery.

Traffic Flow Management↗

Human-in-the-Loop Evaluation of Dynamic Multi-Flight Common Route Advisories

Flights often experience large delays when they are routed around weather. Multi-flight common route advisories provide delay recovery by suggesting time-saving re-routes for groups of flights whose current weather-avoidance routes have become outdated because the weather has dissipated and/or moved away. A laboratory evaluation of these advisories was conducted by four subject matter experts having extensive experience in traffic flow management operations. These experts provided a total of 120 data points in the airspace of Houston Center. The multi-flight common route tool provides time-saving route change advisories taking into account flight plans, wind fields, and the spatio-temporal evolution of predicted convective weather. It is not designed to account for complex operational factors such as non-standard sector traversal and interactions with local traffic management initiatives; hence a relatively low percentage (37%) of advisories generated by the tool were rated as acceptable. However, a high percentage (81%) of advisories were rated as acceptable after the subject matter experts used the tool's user interface to make route modifications that accounted for relevant operational factors not considered by the tool. The workload associated with using the tool, as measured by the NASA Task Load Index, was quite low (1.1 on a scale of 0 to 10). The results of this evaluation make a good case for human-automation teaming to design operationally valid weather re-routes for delay recovery.

Traffic Flow Management↗

A Tale of Two Simulators—A Comparative Human-in-the-Loop Nuclear Power Plant Operations Study on Thermal Power Dispatch for Hydrogen Production

A study was designed for a reconfigurable, full-scale, full-scope nuclear power plant control room simulator to compare two different thermal power dispatch systems, on separate simulator platforms, demonstrating a TPD concept of operation. A TPD system can provide a desirable alternative revenue source for utilities but requires addressing new and unique operational issues. The selection of representative scenarios and the scenario-based experimental design are presented as key elements to capture evidence for validating the developed TPD concept of operations overcome these operational issues.

Ulrich, Thomas A.↗

Evaluation of Airborne Precision Spacing in a Human-in-the-Loop Experiment

A significant bottleneck in the current air traffic system occurs at the runway. Expanding airports and adding new runways will help solve this problem; however, this comes with significant costs: financially, politically and environmentally. A complementary solution is to safely increase the capacity of current runways. This can be achieved by precisely spacing aircraft at the runway threshold, with a resulting reduction in the spacing bu er required under today s operations. At NASA's Langley Research Center, the Airspace Systems program has been investigating airborne technologies and procedures that will assist the flight crew in achieving precise spacing behind another aircraft. A new spacing clearance allows the pilot to follow speed cues from a new on-board guidance system called Airborne Merging and Spacing for Terminal Arrivals (AMSTAR). AMSTAR receives Automatic Dependent Surveillance-Broadcast (ADS-B) reports from an assigned, leading aircraft and calculates the appropriate speed for the ownship to fly to achieve the desired spacing interval, time- or distance-based, at the runway threshold. Since the goal is overall system capacity, the speed guidance algorithm is designed to provide system-wide benefits and stability to a string of arriving aircraft. An experiment was recently performed at the NASA Langley Air Traffic Operations Laboratory (ATOL) to test the flexibility of Airborne Precision Spacing operations under a variety of operational conditions. These included several types of merge and approach geometries along with the complementary merging and in-trail operations. Twelve airline pilots and four controllers participated in this simulation. Performance and questionnaire data were collected from a total of eighty-four individual arrivals. The pilots were able to achieve precise spacing with a mean error of 0.5 seconds and a standard deviation of 4.7 seconds. No statistically significant di erences in spacing performance were found between in-trail and merging operations or among the three modeled airspaces. Questionnaire data showed general acceptance for both pilots and controllers. These results reinforce previous findings from full-mission simulation and flight evaluation of the in-trail operations. This paper reviews the results of this simulation in detail.

Barmore, Bryan E.↗

Human in the Loop Tests: Experiences in Space Suit Testing

What is a space suit? Space suit testing; How and why we test them; hardware design vs. user functionality; Data collection lessons learned; Challenges of objective and subjective data; Personal experience from 2 perspectives: test director and test subject

Ross, Amy J.↗