Sensory feedback in human posture control
Control model for sensory feedback in human posture control
Nashner, L. M.↗
SEARCH · Search NASA
Results for “SENSORY FEEDBACK”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Precise computer controlled positioning of robot end effectors using sensory feedback
A preliminary study of the combined position/force control using sensory feedback for a one-dimensional manipulator model, which may count for the spacecraft docking problem or to be extended to the multijoint robot manipulator problem, has been performed. The additional degrees of freedom introduced by the compliant force sensor is included in the system dynamics in the design of precise position control. State feedback based on pole placement method and with integral control is used to design the position controller. A simple constant gain force controller is used as an example to illustrate the dependence of the stability and steady-state accuracy of the overall position/force control on the design of the inner position controller. Supportive simulation results are also provided.
Wang, J. C.↗
Modeling and sensory feedback control for space manipulators
The positioning control problem of the endtip of space manipulators whose base are uncontrolled is examined. In such a case, the conventional control method for industrial robots based on a local feedback at each joint is not applicable, because a solution of the joint displacements that satisfies a given position and orientation of the endtip is not decided uniquely. A sensory feedback control scheme for space manipulators based on an artificial potential defined in a task-oriented coordinates is proposed. Using this scheme, the controller can easily determine the input torque of each joint from the data of an external sensor such as a visual device. Since the external sensor is mounted on the unfixed base, the manipulator must track the moving image of the target in sensor coordinates. Moreover the dynamics of the base and the manipulator are interactive. However, the endtip is proven to asymptotically approach the stationary target in an inertial coordinate frame by the Liapunov's method. Finally results of computer simulation for a 6-link space manipulator model show the effectiveness of the proposed scheme.
Masutani, Yasuhiro↗
Air Force research in human sensory feedback for telepresence
Telepresence operations require high quality information transfer between the human master and the remotely located slave. Present Air Force research focuses on the human aspects of the information needed to complete the control/feedback loop. Work in three key areas of human sensory feedback for manipulation of objects are described. Specific projects in each key area are outlined, including research tools (hardware), planned research, and test results. Nonmanipulative feedback technologies are mentioned to complete the advanced teleoperation discussions.
Julian, Ronald G.↗
Sensory-Feedback Exoskeletal Arm Controller
An electromechanical exoskeletal arm apparatus has been designed for use in controlling a remote robotic manipulator arm. The apparatus, called a force-feedback exoskeleton arm master (F-EAM) is comfortable to wear and easy to don and doff. It provides control signals from the wearer s arm to a robot arm or a computer simulator (e.g., a virtual-reality system); it also provides force and torque feedback from sensors on the robot arm or from the computer simulator to the wearer s arm. The F-EAM enables the wearer to make the robot arm gently touch objects and finely manipulate them without exerting excessive forces. The F-EAM features a lightweight design in which the motors and gear heads that generate force and torque feedback are made smaller than they ordinarily would be: this is achieved by driving the motors to power levels greater than would ordinarily be used in order to obtain higher torques, and by providing active liquid cooling of the motors to prevent overheating at the high drive levels. The F-EAM (see figure) includes an assembly that resembles a backpack and is worn like a backpack, plus an exoskeletal arm mechanism. The FEAM has five degrees of freedom (DOFs) that correspond to those of the human arm: 1. The first DOF is that of the side-to-side rotation of the upper arm about the shoulder (rotation about axis 1). The reflected torque for this DOF is provided by motor 1 via drum 1 and a planar four-bar linkage. 2. The second DOF is that of the up-and-down rotation of the arm about the shoulder. The reflected torque for this DOF is provided by motor 2 via drum 2. 3. The third DOF is that of twisting of the upper arm about its longitudinal axis. This DOF is implemented in a cable remote-center mechanism (CRCM). The reflected torque for this DOF is provided by motor 3, which drives the upper-arm cuff and the mechanism below it. A bladder inflatable by gas or liquid is placed between the cuff and the wearer s upper arm to compensate for misalignment between the exoskeletal mechanism and the shoulder. 4. The fourth DOF is that of flexion and extension of the elbow. The reflected torque for this DOF is provided by motor 4 and drum 4, which are mounted on a bracket that can slide longitudinally by a pin-and-slot engagement with the upper-arm cuff to compensate for slight variations in the position of the kinematic center of the elbow. Attached to drum 4 is an adapter plate to which is attached a CRCM for the lower arm. 5. The lower-arm CRCM implements the fifth DOF, which is the twist of the forearm about its longitudinal axis. Motor 5 provides the reflected torque for this DOF by driving the lower-arm cuff. A rod transmits twist and torsion between the lower-arm cuff and the hand cuff. With this system, the motion of the wearer s joints and the reflected torques applied to these joints can be measured and controlled in a relatively simple manner. This is because the anthropomorphic design of the mechanism imitates the kinematics of the human arm, eliminating the need for kinematic conversion of joint-torque and joint-angle data.
An, Bin↗
The human factors of workstation telepresence
The term workstation telepresence has been introduced to describe human-telerobot compliance, which enables the human operator to effectively project his/her body image and behavioral skills to control of the telerobot itself. Major human-factors considerations for establishing high fidelity workstation telepresence during human-telerobot operation are discussed. Telerobot workstation telepresence is defined by the proficiency and skill with which the operator is able to control sensory feedback from direct interaction with the workstation itself, and from workstation-mediated interaction with the telerobot. Numerous conditions influencing such control have been identified. This raises the question as to what specific factors most critically influence the realization of high fidelity workstation telepresence. The thesis advanced here is that perturbations in sensory feedback represent a major source of variability in human performance during interactive telerobot operation. Perturbed sensory feedback research over the past three decades has established that spatial transformations or temporal delays in sensory feedback engender substantial decrements in interactive task performance, which training does not completely overcome. A recently developed social cybernetic model of human-computer interaction can be used to guide this approach, based on computer-mediated tracking and control of sensory feedback. How the social cybernetic model can be employed for evaluating the various modes, patterns, and integrations of interpersonal, team, and human-computer interactions which play a central role is workstation telepresence are discussed.
Smith, Thomas J.↗
CRCNS21 Computational Models of Multisensory Integration by Upper Limb in Humanoids and Amputees
This international collaborative research project between Johns Hopkins University (JHU) and the Technical University of Munich (TUM) investigated how the human brain processes and integrates multiple types of sensory information, such as touch and force, with the goal of improving prosthetic limbs for amputees and advancing sensory capabilities in humanoid robots. The research advanced our understanding of how the brain responds to sensory feedback in upper-limb amputees. Through experiments in which amputees received electrical stimulation while performing phantom hand movements, we demonstrated that sensory feedback activates the cortical sensorimotor and multisensory regions, and that these regions communicate dynamically during stimulation. Experiments with intact-limb participants explored the integration of visual, haptic, and force feedback, as well as in virtual reality motor training, further showing how the brain processes multimodal sensory information. In addition, this research inspired work on examining the reliability of where amputees perceive sensations over time, which contributed to a successful doctoral fellowship for continued investigation. Our collaborators at TUM improved multimodal sensor technology combining tactile and thermal feedback for humanoid robots, demonstrating the feasibility of integrating multiple sensor types into a unified system for detecting and responding to environmental stimuli. The experimental methods and analysis techniques developed across both teams, including functional network analysis and multimodal sensor integration, provide a foundation for future research in prosthetics and robotics. This research benefits the public by generating knowledge about how amputees process restored sensory information. Advances in humanoid sensing contribute to safer human-robot interaction. The project also fostered international collaboration and cross-disciplinary training: one TUM doctoral student spent a summer at JHU working on multimodal sensor integration, while two JHU students traveled to TUM to host workshops on neuromorphic sensory encoding and sensory integration.
42 ENGINEERING↗
Vision Based Autonomous Robotic Control for Advanced Inspection and Repair
The advanced inspection system is an autonomous control and analysis system that improves the inspection and remediation operations for ground and surface systems. It uses optical imaging technology with intelligent computer vision algorithms to analyze physical features of the real-world environment to make decisions and learn from experience. The advanced inspection system plans to control a robotic manipulator arm, an unmanned ground vehicle and cameras remotely, automatically and autonomously. There are many computer vision, image processing and machine learning techniques available as open source for using vision as a sensory feedback in decision-making and autonomous robotic movement. My responsibilities for the advanced inspection system are to create a software architecture that integrates and provides a framework for all the different subsystem components; identify open-source algorithms and techniques; and integrate robot hardware.
sensory feedback↗
The WCSAR telerobotics test bed
Component technologies for use in telerobotic systems for space are being developed. As part of this effort, a test bed was established in which these technologies can be verified and integrated into telerobotic systems. The facility consists of two slave industrial robots, an articulated master arm controller, a cartesian coordinate master arm controller, and a variety of sensors, displays and stimulators for feedback to human operators. The controller of one of the slave robots remains in its commercial state, while the controller of the other robot has been replaced with a new controller that achieves high-performance in telerobotic operating modes. A dexterous slave hand which consists of two fingers and a thumb is being developed, along with a number of force-reflecting and non-force reflecting master hands, wrists and arms. A tactile sensing finger tip based on piezo-film technology has been developed, along with tactile stimulators and CAD-based displays for sensory feedback and sensory substitution. The telerobotics test bed and its component technologies are described, as well as the integration of these component technologies into telerobotic systems, and their performance in conjunction with human operators.
Duffie, N.↗
Aspects of body self-calibration
The representation of body orientation and configuration is dependent on multiple sources of afferent and efferent information about ongoing and intended patterns of movement and posture. Under normal terrestrial conditions, we feel virtually weightless and we do not perceive the actual forces associated with movement and support of our body. It is during exposure to unusual forces and patterns of sensory feedback during locomotion that computations and mechanisms underlying the ongoing calibration of our body dimensions and movements are revealed. This review discusses the normal mechanisms of our position sense and calibration of our kinaesthetic, visual and auditory sensory systems, and then explores the adaptations that take place to transient Coriolis forces generated during passive body rotation. The latter are very rapid adaptations that allow body movements to become accurate again, even in the absence of visual feedback. Muscle spindle activity interpreted in relation to motor commands and internally modeled reafference is an important component in permitting this adaptation. During voluntary rotary movements of the body, the central nervous system automatically compensates for the Coriolis forces generated by limb movements. This allows accurate control to be maintained without our perceiving the forces generated.
NASA Discipline Neuroscience↗
"Smart" Electromechanical Shock Absorber
Shock-absorbing apparatus includes electromechanical actuator and digital feedback control circuitry rather than springs and hydraulic damping as in conventional shock absorbers. Device not subject to leakage and requires little or no maintenance. Attenuator parameters adjusted in response to sensory feedback and predictive algorithms to obtain desired damping characteristic. Device programmed to decelerate slowly approaching vehicle or other large object according to prescribed damping characteristic.
Stokes, Lebarian↗
Automatic inspection of analog and digital meters in a robot vision system
A critical limitation of most of the robots utilized in industrial environments arises due to their inability to utilize sensory feedback. This forces robot operation into totally preprogrammed or teleoperation modes. In order to endow the new generation of robots with higher levels of autonomy techniques for sensing of their work environments and for accurate and efficient analysis of the sensory data must be developed. In this paper detailed development of vision system modules for inspecting various types of meters, both analog and digital, encountered in a robotic inspection and manipulation tasks are described. These modules are tested using industrial robots having multisensory input capability.
Trivedi, Mohan M.↗
Sensor Control of Robot Arc Welding
The potential for using computer vision as sensory feedback for robot gas-tungsten arc welding is investigated. The basic parameters that must be controlled while directing the movement of an arc welding torch are defined. The actions of a human welder are examined to aid in determining the sensory information that would permit a robot to make reproducible high strength welds. Special constraints imposed by both robot hardware and software are considered. Several sensory modalities that would potentially improve weld quality are examined. Special emphasis is directed to the use of computer vision for controlling gas-tungsten arc welding. Vendors of available automated seam tracking arc welding systems and of computer vision systems are surveyed. An assessment is made of the state of the art and the problems that must be solved in order to apply computer vision to robot controlled arc welding on the Space Shuttle Main Engine.
Sias, F. R., Jr.↗
Implementation of a three degree of freedom, motor/brake hybrid force output device for virtual environment control tasks
The advent of high resolution, physical model based computer graphics has left a gap in the design of input/output technology appropriate for interacting with such complex virtual world models. Since virtual worlds consist of physical models, it is appropriate to output the inherent force information necessary for the simulation to the user. The detailed design, construction, and control of a three degree freedom force output joystick will be presented. A novel kinematic design allows all three axes to be uncoupled, so that the system inertia matrix is diagonal. The two planar axes are actuated through an offset gimbal, and the third through a sleeved cable. To compensate for friction and inertia effects, this transmission is controlled by a force feedforward and a closed force feedback proportional loop. Workspace volume is a cone of 512 cubic inches, and the device bandwidth is maximized at 60 Hz for the two planar and 30 Hz for the third axis. Each axis is controlled by a motor/proportional magnetic particle brake combination fixed to the base. The innovative use of motors and brakes allows objects with high resistive torque requirements to be simulated without the stability and related safety issues involved with high torque, energy storing motors alone. Position, velocity, and applied endpoint force are sensed directly. Different control strategies are discussed and implemented, with an emphasis on how virtual environment force information, generated by the MIT Media Lab Computer Graphics and Animation Group BOLIO system, is transmitted to the device controller. The design constraints for a kinesthetic force feedback device can be summarized as: How can the symbiosis between the sense of presence in the virtual environment be maximized without compromising the interaction task under the constraints of the mechanical device limitations? Research in this field will yield insights to the optimal human sensory feedback mix for a wide spectrum of control and interaction problems. A flexible research tool that is designed as an easily reproducible product prototype has been constructed to explore the variety of possible force interaction.
Russo, Massimo↗
Developing an Earth-Fixed Visual Reference to Aid Stability, Readaptation, and Egress After A Water Landing
Water landings present the worst possible sensory conditions for crews trying to orient and stabilize themselves immediately after long-duration spaceflight. Of the three sensory feedback systems involved in maintaining stability (i.e., proprioceptive, vestibular, and visual), none will provide reliable orientation information under the current water landing scenarios. The proprioceptive and vestibular systems are affected during spaceflight by disuse and adaptation to microgravity. Vision may not suffer the same degradation, but the visual environment within the enclosed space of a capsule, or interior room of a recovery ship, induces instability during wave motion. In addition to an increased fall risk, sensory readaptation is delayed until inputs from the three sensory systems can be synchronized with one another and aligned with Earth’s gravity. An Earth-fixed visual reference (EFVR) can be provided to increase crewmember stability and allow for earlier readaptation initiation.
B.T. Peters↗
Developing An Earth-Fixed Visual Reference to Aid Stability, Readaptation and Egress After a Water Landing
INTRODUCTION Water landings present the worst possible sensory conditions for crews trying to orient and stabilize themselves immediately after long-duration spaceflight. Of the three sensory feedback systems involved in maintaining stability (i.e., proprioceptive, vestibular, and visual), none will provide reliable orientation information under the current water landing scenarios. The proprioceptive and vestibular systems are affected during spaceflight by disuse and adaptation to microgravity. Vision may not suffer the same degradation, but the visual environment within the enclosed space of a capsule, or interior room of a recovery ship, is disorienting when subject to wave-induced motion. The result is an increased risk of fall-related injury. In a prior study, 70% (21 of 30) of nonimpaired subjects reported that the presence of an Earth-fixed horizontal line helped them stabilize when their visually enclosed environment was exposed to wave motion. In addition to aiding stability, sensory re-adaptation occurs when inputs from the three sensory systems are synchronized with one another and aligned with Earth’s gravity. The earlier an Earth-fixed visual reference can be introduced the sooner the readaptation process can begin. The goal of this project is to identify the optimal features of a device that visually presents gravitational reference cues to support stability and readaptation. METHODS The capsule sensory-condition simulator is a three-sided enclosure atop a six degree-of-freedom motion platform. A sum-of-sines equation is used to drive the motion platform, producing the simulated wave motion. The equation was derived using the frequency range present in inertial measurement unit (IMU) data collected during open-water Orion mock-up testing. The enclosure creates the nature of a floating visual environment where the walls move in relation to the standing surface. To more accurately represent the condition of postflight crewmembers, galvanic vestibular stimulation (GVS) is applied to disrupt normal vestibular function and standing on a compliant surface attenuates proprioceptive feedback. An instrumented handhold allows the subjects to stabilize themselves and serves as the primary dependent variable. Subjects are instructed to minimize handhold use so the higher forces applied to the handhold correspond to greater instability. Various forms of a visual reference have been explored. Passive systems, such as mechanical gimbals and weighted plumb bobs were eliminated from consideration because of the intertia-induced oscillations that the wave-motion causes. Laser lines presented as horizontal, vertical, or the combination of both are being used to provide the Earth-fixed visual reference. These are presented in the central visual field or periphery from laser sources that are mounted either from within or outside the visual enclosure. RESULTS Data collection for this study is currently in progress. CONCLUSIONS This study will determine whether a visual reference system can help improve stability during challenging sensory conditions and define the optimal chacteristics for such a system.
Brian T Peters↗
Integration of advanced teleoperation technologies for control of space robots
Teleoperated robots require one or more humans to control actuators, mechanisms, and other robot equipment given feedback from onboard sensors. To accomplish this task, the human or humans require some form of control station. Desirable features of such a control station include operation by a single human, comfort, and natural human interfaces (visual, audio, motion, tactile, etc.). These interfaces should work to maximize performance of the human/robot system by streamlining the link between human brain and robot equipment. This paper describes development of a control station testbed with the characteristics described above. Initially, this testbed will be used to control two teleoperated robots. Features of the robots include anthropomorphic mechanisms, slaving to the testbed, and delivery of sensory feedback to the testbed. The testbed will make use of technologies such as helmet mounted displays, voice recognition, and exoskeleton masters. It will allow tor integration and testing of emerging telepresence technologies along with techniques for coping with control link time delays. Systems developed from this testbed could be applied to ground control of space based robots. During man-tended operations, the Space Station Freedom may benefit from ground control of IVA or EVA robots with science or maintenance tasks. Planetary exploration may also find advanced teleoperation systems to be very useful.
Stagnaro, Michael J.↗
DEVELOPING AN EARTH-FIXED VISUAL REFERENCE TO AID STABILITY, READAPTATION, AND EGRESS AFTER A WATER LANDING
Water landings present the worst possible sensory conditions for crews trying to orient and stabilize themselves immediately after long-duration spaceflight. Of the three sensory feedback systems involved in maintaining stability (i.e., proprioceptive, vestibular, and visual), none will provide reliable orientation information under the current water landing scenarios. Although the visual system is likely not affected by the disuse and adaptation to microgravity that affect the proprioceptive and vestibular systems, the visual environment within an enclosed space that is subject to wave-induced rocking will prevent the crewmember from using vision to determine which direction is up. This is true whether enclosed in the capsule or in a room on the recovery ship. The result is an increased risk of fall-related injury. In a prior study, 70% (21 of 30) of nonimpaired subjects reported that the presence of an Earth-fixed horizontal line helped them stabilize when their visually enclosed environment was exposed to wave motion. In addition to aiding stability, an Earth-fixed visual reference also can assist in the readaptation process. Sensory re-adaptation occurs when the three sensory systems are synchronized with one another and aligned with Earth’s gravity. The earlier an Earth-fixed visual reference can be introduced the sooner the readaptation process can begin. The goal of this project is to identify the optimal features of a device that visually presents gravitational reference cues to support egress, stability and readaptation. **Remainder of abstract in document preview or downloadable version
B. T. Peters↗