Search NASA⌕ Search

SEARCH · Search NASA

Results for “Human in the Loop”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 649 records · Page 36

Toward autonomous spacecraft

Ways in which autonomous behavior of spacecraft can be extended to treat situations wherein a closed loop control by a human may not be appropriate or even possible are explored. Predictive models that minimize mean least squared error and arbitrary cost functions are discussed. A methodology for extracting cyclic components for an arbitrary environment with respect to usual and arbitrary criteria is developed. An approach to prediction and control based on evolutionary programming is outlined. A computer program capable of predicting time series is presented. A design of a control system for a robotic dense with partially unknown physical properties is presented.

Fogel, L. J.↗

Real-Time Embedded Software Verification and Validation 2001

As the space applications become more complex and timing constraints on control actions are more stringent, the task of integrating and testing NASA's real-time systems (such as X-38 Crew Return Vehicle, and certain International Space Station autonomous systems) has become a great challenge. A testing environment where can preserve consistent temporal behaviors as in the target execution must be established for system-level verification and software quality assurance. Our goal is to develop an analysis suite for validation and verification of real-time systems that are used to perform human- in-the-loop control operations during safety-critical missions. The suite will be able to carry out quantitative approaches of coverage diagnostic and temporal behavior evaluation in order to measure test coverage, to optimize test utilization, and to verify timing correctness.

Lee, Yann-Hang↗

Piloted Full-Motion Simulation with Simulink®

A recent experiment at NASA Ames Research Center’s Vertical Motion Simulator (VMS) successfully combined a real-time, human in-the-loop architecture with the flexibility of operating in the Simulink® graphical model-based engineering environment. The VMS is a large amplitude flight simulator designed to be adaptable to provide rapid integration and development of a wide variety of vehicles and support diverse aeronautical investigations. Math models are often programmed in Simulink. Typically, to run Simulink models in real time, they are converted to C code. However, the conversion and integration process can be time consuming and cumbersome. Thus, the VMS facility capabilities were expanded to allow a Simulink vehicle math model to run in the MathWorks’ MATLAB environment during a piloted full-motion simulation experiment. The MATLAB Simulink based approach to driving the VMS was found to decrease development time by allowing quick integration of math model changes and providing the ability to run the same version of the model on researcher’s desktop computers. This accomplishment demonstrated that the development ease of the graphical Simulink environment could be retained, while working within the real-time environment of the VMS architecture and maintaining the unique flexibility of the VMS.

hardware in-the-loop↗

Piloted Full-Motion Simulation in Simulink®

A recent experiment at NASA Ames Research Center’s Vertical Motion Simulator (VMS) successfully combined a real-time, human in-the-loop architecture with the flexibility of operating in the Simulink® graphical model-based engineering environment. The VMS is a large amplitude flight simulator designed to be adaptable to provide rapid integration and development of a wide variety of vehicles and support diverse aeronautical investigations. Math models are often programmed in Simulink. Typically, to run Simulink models in real time, they are converted to C code. However, the conversion and integration process can be time consuming and cumbersome. Thus, the VMS facility capabilities were expanded to allow a Simulink vehicle math model to run in the MathWorks’ MATLAB environment during a piloted full-motion simulation experiment. The MATLAB Simulink based approach to driving the VMS was found to decrease development time by allowing quick integration of math model changes and providing the ability to run the same version of the model on researcher’s desktop computers. This accomplishment demonstrated that the development ease of the graphical Simulink environment could be retained, while working within the real-time environment of the VMS architecture and maintaining the unique flexibility of the VMS.

Lewis, Emily K.↗

Permutations of the Exploration Extra-vehicular Mobility Unit (xEMU) for Mission Specific Objectives

The Advanced Portable Life Support System began first with NASA investment during the Constellation Program focused on new technologies that were central to the new architecture but with a consideration for development of the most flexible and adaptable design to address the varied future needs for Extra-Vehicular Activity (EVA) capability by the agency as part of the exploration of the moon and beyond. Since that time, the Portable Life Support System (PLSS) architecture has been demonstrated at bread-board level, packaged prototype level with Human In-The Loop (HITL) testing, and has now matured into what has become known as the Exploration Extravehicular Mobility Unit (xEMU) PLSS focused on a demonstration on the International Space Station (ISS) and support for initial lunar missions. The xEMU completed Preliminary Design Review (PDR) and the associated Safety Review Panel (SRP) Phase I reviews in 2019-2020 and is progressing through the Design Verification Test (DVT) phase in 2021. As the agency updates planning for lunar both near term, long term, and beyond, there are many possible permutations of the existing architecture that can be accommodated to enable varied mission objectives. This paper will discuss the current baseline DVT design for xEMU as well as potential permutations of the PLSS architecture to accomplish an Apollo style short-duration down and out mission, a long term lunar ultra-lightweight approach, as well as a potential SuitPort accommodating architecture.

Colin Campbell↗

The Cooling Loop A Anomaly of 2013: A Case Study in Human-Systems Resilience

Throughout the history of human spaceflight, NASA has employed an operational paradigm of 24/7 dependence on experts in Mission Control Center (MCC). In addition to nominal flight control and mission operations, these 85+ experts per shift manage anomaly detection, diagnosis, and response, and support the crew in real-time in performing maintenance and repair, procedure execution, and other complex mission operations. Future long-duration exploration missions (LDEMs) beyond low-Earth orbit (LEO) will not operate successfully using this same Human-Systems Integration Architecture (HSIA) where crew rely on ground controllers, have ready access to resupply, and have a fallback plan of evacuation. As distance from Earth increases and the communication delay grows, crews will need to respond independently and adequately to time-critical vehicle malfunctions. It will not always be sufficient or even possible to ‘safe the system’ and then wait upon ground intervention. A new and radically different HSIA is needed to accommodate the paradigm shift of deep-space travel. Historical International Space Station (ISS) data show that for a 30-day mission, the likelihood of a high-consequence vehicle anomaly of uncertain origin that requires rapid response is greater than 10%. The likelihood of such an event is 50% by the fourth month of the mission, and it grows exponentially with time. Our team has conducted in-depth investigations into these events and their corresponding anomaly resolution activities. Using MCC and Mission Evaluation Room (MER) anomaly resolution artifacts (including meeting summaries, caution and warning data, and ISS daily summaries), we created timelines detailing ground actions and in-orbit events for two significant anomalies. We then mapped these timelines onto Mars transit conditions, introducing a ground-crew communications time delay and shifting immediate response, time-critical task execution, and vehicle commanding to the crew. In detailing successful anomaly resolution in transit to Mars, the timelines highlight where effective resolution requires drastically evolved onboard capabilities. Though this research has yielded a rich data set based on ground response in past missions, there is still insufficient knowledge to assess the potential impact of inflight anomalies on a small autonomous crew on future LDEMs beyond LEO. To begin building an evidence base that will inform future HSIA standards and requirements, we are developing an approach to systematically capture crew anomaly response and procedure execution during early Artemis missions. Being the first human spaceflight beyond LEO since Apollo, early Artemis missions provide a rare and unique opportunity to serve as a testbed for Mars missions. Our work aims to capitalize on planned data collection to derive crew operational responses to anomalous events in real-time. Our team is also researching the level of simulation fidelity required for empirically validating proposed HSIA standards and evaluating HSIA implementations for LDEMs beyond LEO. This work will produce a trade space study of HSIA simulation objectives and fidelity requirements. Ultimately, these research efforts will assist in developing the standards and technologies needed to build a next-generation HSIA for LDEMs beyond LEO.

human-systems integration architecture↗

Names Don't Fly: Smart Filters for Profanity Detection and Classification in User-Generated Content

Generally, names associate with a person’s identity. But what if in the pretext of a legitimate name and given the opportunity, users of software provide names to online web forms that carry along offensive language, slurs, and other profanity that is then sent to Mars ? The answer is simple: they don’t fly. In this paper,we perform model explorations to detect and classify inappropriate content in the names submitted from people across the world to ‘Send Your Names to MARS’ public engagement campaign.We propose a novel pipeline approach, that can effectively overcome the issues of lack of negative samples, noisy labels by gathering expert knowledge over time with human(s) in the loop and data augmentation, and achieve high accuracy in classifying inappropriate names with very little or no context. We describe cloud-based infrastructure to deploy our application and run predictions on large-scale data through our pipeline and achieve significant speedup over offline processes, with enhanced reliability and security.

Soderstrom, Tomas↗

Man-in-the-control-loop simulation of manipulators

A method to achieve man-in-the-control-loop simulation is presented. Emerging real-time dynamics simulation suggests a potential for creating an interactive design workstation with a human operator in the control loop. The recursive formulation for multibody dynamics simulation is studied to determine requirements for man-in-the-control-loop simulation. High speed computer graphics techniques provides realistic visual cues for the simulator. Backhoe and robot arm simulations are implemented to demonstrate the capability of man-in-the-control-loop simulation.

Chang, J. L.↗

Results of the International Space Station Interim Resistance Exercise Device Man-in-the-Loop Test

The Interim Resistance Exercise Device (iRED), developed for the International Space Station (ISS), was evaluated using human subjects for a Man-In-The-Loop Test (MILT). Thirty-two human subjects exercised using the iRED in a test that was conducted over a 63-working-day period. The subjects performed the same exercises will be used on board ISS, and the iRED operating constraints that are to be used on ISS were followed. In addition, eight of the subjects were astronauts who volunteered to be in the evaluation in order to become familiar with the iRED and provide a critique of the device. The MILT was scheduled to last for 57,000 exercise repetitions on the iRED. This number of repetitions was agreed to as a number typical of that expected during a 3-person, 17-week ISS Increment. One of the canisters of the iRED failed at the 49,683- repetition mark (87.1% of targeted goal). The remaining canister was operated using the plan for operations if one canister fails during flight (contingency operations). This canister remained functional past the 57,000-repetition mark. This report details the results of the iRED MILT, and lists specific recommendations regarding both operation of the iRED and future resistance exercise device development.

Moore, A. D., Jr.↗

Telepresence and telerobotics

The capability for a single operator to simultaneously control complex remote multi degree of freedom robotic arms and associated dextrous end effectors is being developed. An optimal solution within the realm of current technology, can be achieved by recognizing that: (1) machines/computer systems are more effective than humans when the task is routine and specified, and (2) humans process complex data sets and deal with the unpredictable better than machines. These observations lead naturally to a philosophy in which the human's role becomes a higher level function associated with planning, teaching, initiating, monitoring, and intervening when the machine gets into trouble, while the machine performs the codifiable tasks with deliberate efficiency. This concept forms the basis for the integration of man and telerobotics, i.e., robotics with the operator in the control loop. The concept of integration of the human in the loop and maximizing the feed-forward and feed-back data flow is referred to as telepresence.

Garin, John↗

Air Force research in human sensory feedback for telepresence

Telepresence operations require high quality information transfer between the human master and the remotely located slave. Present Air Force research focuses on the human aspects of the information needed to complete the control/feedback loop. Work in three key areas of human sensory feedback for manipulation of objects are described. Specific projects in each key area are outlined, including research tools (hardware), planned research, and test results. Nonmanipulative feedback technologies are mentioned to complete the advanced teleoperation discussions.

Julian, Ronald G.↗

Closed loop models for analyzing the effects of simulator characteristics

The optimal control model of the human operator is used to develop closed loop models for analyzing the effects of (digital) simulator characteristics on predicted performance and/or workload. Two approaches are considered: the first utilizes a continuous approximation to the discrete simulation in conjunction with the standard optimal control model; the second involves a more exact discrete description of the simulator in a closed loop multirate simulation in which the optimal control model simulates the pilot. Both models predict that simulator characteristics can have significant effects on performance and workload.

Baron, S.↗

Humans as Failsafe

Automation often relies on the human to "jump" into the loop and solve problems when the automation can’t due to conditions outside of which it was designed for or automaton failure. This talk proposes a methodology (Human Autonomy Assistant) to address that situation. Examples are provided from a wild fire context.

multi-vehicle control↗

Making ROBONAUT an Intelligent Assistant for Humans

This presentation is an overview of the Robonaut project. Robonaut is a humanoid robot designed by the Automation, Robotics, and Simulation Division at NASA's Johnson Space Center. The Robonaut project seeks to develop and demonstrate a robotic system that can function as an EVA astronaut equivalent. Robonaut jumps generations ahead by eliminating the robotic scars (e.g., special robotic grapples and targets) and specialized robotic tools of traditional on-orbit robotics. However, it still keeps the human operator in the control loop through its telepresence control system. Robonaut is being designed for "EVA" tasks, i.e., those that were not specifically designed for robots. Our challenge is to build machines that can help humans work and explore in space. Working side by side with humans, or going where the risks are too great for people, machines like Robonaut will expand our ability for construction and discovery. Central to that effort is a capability we call dexterous manipulation, embodied by an ability to use ones hand to do work, and our challenge is to build machines with dexterity that exceeds that of a suited astronaut.

Savely, Robert T.↗

Towards Validation of an Adaptive Flight Control Simulation Using Statistical Emulation

Traditional validation of flight control systems is based primarily upon empirical testing. Empirical testing is sufficient for simple systems in which a.) the behavior is approximately linear and b.) humans are in-the-loop and responsible for off-nominal flight regimes. A different possible concept of operation is to use adaptive flight control systems with online learning neural networks (OLNNs) in combination with a human pilot for off-nominal flight behavior (such as when a plane has been damaged). Validating these systems is difficult because the controller is changing during the flight in a nonlinear way, and because the pilot and the control system have the potential to co-adapt in adverse ways traditional empirical methods are unlikely to provide any guarantees in this case. Additionally, the time it takes to find unsafe regions within the flight envelope using empirical testing means that the time between adaptive controller design iterations is large. This paper describes a new concept for validating adaptive control systems using methods based on Bayesian statistics. This validation framework allows the analyst to build nonlinear models with modal behavior, and to have an uncertainty estimate for the difference between the behaviors of the model and system under test.

He, Yuning↗

Evolution of Thyroglobulin Loop Kinetics in EpCAM

Epithelial cell-activating molecule (EpCAM) is an important cancer biomarker and therapeutic target given its elevated expression in epithelial cancers. EpCAM is a type I transmembrane protein that forms cis-dimers along the thyroglobulin type-1A-like domain (TYD) in the extracellular region. The thyroglobulin loop (TY loop) within the TYD is structurally dynamic in the monomer state of human EpCAM, binding reversibly to a TYD site. However, it is not known if this flexibility is prevalent across different species. Here, we conduct over 17 μs of all-atom molecular dynamics simulations to study EpCAM TY loop kinetics of five different species, including human, mouse, chicken, frog, and fish. We find that the TY loop remains dynamic across evolution. In addition to the TYD binding site, we discover a second binding site for the TY loop in the C-terminal domain (CTD). Calculations of the dissociation rate constants from the simulation trajectories suggest a differential binding pattern of fish EpCAM and other organisms. Whereas fish TY loop has comparable binding for both TYD and CTD sites, the TY loops of other species preferably bind the TYD site. A hybrid construct of fish EpCAM with human TY loop restores the TYD binding preference, suggesting robust effects of the TY loop sequence on its dynamic behavior. Our findings provide insights into the structural dynamics of EpCAM and its implication in physiological functions.

59 BASIC BIOLOGICAL SCIENCES↗

Unraveling the impact of initial choices and in-loop interventions on learning dynamics in autonomous scanning probe microscopy

The current focus in Autonomous Experimentation (AE) is on developing robust workflows to conduct the AE effectively. This entails the need for well-defined approaches to guide the AE process, including strategies for hyperparameter tuning and high-level human interventions within the workflow loop. This paper presents a comprehensive analysis of the influence of initial experimental conditions and in-loop interventions on the learning dynamics of Deep Kernel Learning (DKL) within the realm of AE in scanning probe microscopy. We explore the concept of the “seed effect,” where the initial experiment setup has a substantial impact on the subsequent learning trajectory. Additionally, we introduce an approach of the seed point interventions in AE allowing the operator to influence the exploration process. Using a dataset from Piezoresponse Force Microscopy on PbTiO 3 thin films, we illustrate the impact of the “seed effect” and in-loop seed interventions on the effectiveness of DKL in predicting material properties. The study highlights the importance of initial choices and adaptive interventions in optimizing learning rates and enhancing the efficiency of automated material characterization. This work offers valuable insights into designing more robust and effective AE workflows in microscopy with potential applications across various characterization techniques.

47 OTHER INSTRUMENTATION↗