Sensory feedback in human posture control
Control model for sensory feedback in human posture control
Nashner, L. M.↗
SEARCH · Search NASA
Results for “sensory feedback”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Precise computer controlled positioning of robot end effectors using sensory feedback
A preliminary study of the combined position/force control using sensory feedback for a one-dimensional manipulator model, which may count for the spacecraft docking problem or to be extended to the multijoint robot manipulator problem, has been performed. The additional degrees of freedom introduced by the compliant force sensor is included in the system dynamics in the design of precise position control. State feedback based on pole placement method and with integral control is used to design the position controller. A simple constant gain force controller is used as an example to illustrate the dependence of the stability and steady-state accuracy of the overall position/force control on the design of the inner position controller. Supportive simulation results are also provided.
Wang, J. C.↗
Modeling and sensory feedback control for space manipulators
The positioning control problem of the endtip of space manipulators whose base are uncontrolled is examined. In such a case, the conventional control method for industrial robots based on a local feedback at each joint is not applicable, because a solution of the joint displacements that satisfies a given position and orientation of the endtip is not decided uniquely. A sensory feedback control scheme for space manipulators based on an artificial potential defined in a task-oriented coordinates is proposed. Using this scheme, the controller can easily determine the input torque of each joint from the data of an external sensor such as a visual device. Since the external sensor is mounted on the unfixed base, the manipulator must track the moving image of the target in sensor coordinates. Moreover the dynamics of the base and the manipulator are interactive. However, the endtip is proven to asymptotically approach the stationary target in an inertial coordinate frame by the Liapunov's method. Finally results of computer simulation for a 6-link space manipulator model show the effectiveness of the proposed scheme.
Masutani, Yasuhiro↗
Air Force research in human sensory feedback for telepresence
Telepresence operations require high quality information transfer between the human master and the remotely located slave. Present Air Force research focuses on the human aspects of the information needed to complete the control/feedback loop. Work in three key areas of human sensory feedback for manipulation of objects are described. Specific projects in each key area are outlined, including research tools (hardware), planned research, and test results. Nonmanipulative feedback technologies are mentioned to complete the advanced teleoperation discussions.
Julian, Ronald G.↗
Sensory-Feedback Exoskeletal Arm Controller
An electromechanical exoskeletal arm apparatus has been designed for use in controlling a remote robotic manipulator arm. The apparatus, called a force-feedback exoskeleton arm master (F-EAM) is comfortable to wear and easy to don and doff. It provides control signals from the wearer s arm to a robot arm or a computer simulator (e.g., a virtual-reality system); it also provides force and torque feedback from sensors on the robot arm or from the computer simulator to the wearer s arm. The F-EAM enables the wearer to make the robot arm gently touch objects and finely manipulate them without exerting excessive forces. The F-EAM features a lightweight design in which the motors and gear heads that generate force and torque feedback are made smaller than they ordinarily would be: this is achieved by driving the motors to power levels greater than would ordinarily be used in order to obtain higher torques, and by providing active liquid cooling of the motors to prevent overheating at the high drive levels. The F-EAM (see figure) includes an assembly that resembles a backpack and is worn like a backpack, plus an exoskeletal arm mechanism. The FEAM has five degrees of freedom (DOFs) that correspond to those of the human arm: 1. The first DOF is that of the side-to-side rotation of the upper arm about the shoulder (rotation about axis 1). The reflected torque for this DOF is provided by motor 1 via drum 1 and a planar four-bar linkage. 2. The second DOF is that of the up-and-down rotation of the arm about the shoulder. The reflected torque for this DOF is provided by motor 2 via drum 2. 3. The third DOF is that of twisting of the upper arm about its longitudinal axis. This DOF is implemented in a cable remote-center mechanism (CRCM). The reflected torque for this DOF is provided by motor 3, which drives the upper-arm cuff and the mechanism below it. A bladder inflatable by gas or liquid is placed between the cuff and the wearer s upper arm to compensate for misalignment between the exoskeletal mechanism and the shoulder. 4. The fourth DOF is that of flexion and extension of the elbow. The reflected torque for this DOF is provided by motor 4 and drum 4, which are mounted on a bracket that can slide longitudinally by a pin-and-slot engagement with the upper-arm cuff to compensate for slight variations in the position of the kinematic center of the elbow. Attached to drum 4 is an adapter plate to which is attached a CRCM for the lower arm. 5. The lower-arm CRCM implements the fifth DOF, which is the twist of the forearm about its longitudinal axis. Motor 5 provides the reflected torque for this DOF by driving the lower-arm cuff. A rod transmits twist and torsion between the lower-arm cuff and the hand cuff. With this system, the motion of the wearer s joints and the reflected torques applied to these joints can be measured and controlled in a relatively simple manner. This is because the anthropomorphic design of the mechanism imitates the kinematics of the human arm, eliminating the need for kinematic conversion of joint-torque and joint-angle data.
An, Bin↗
The human factors of workstation telepresence
The term workstation telepresence has been introduced to describe human-telerobot compliance, which enables the human operator to effectively project his/her body image and behavioral skills to control of the telerobot itself. Major human-factors considerations for establishing high fidelity workstation telepresence during human-telerobot operation are discussed. Telerobot workstation telepresence is defined by the proficiency and skill with which the operator is able to control sensory feedback from direct interaction with the workstation itself, and from workstation-mediated interaction with the telerobot. Numerous conditions influencing such control have been identified. This raises the question as to what specific factors most critically influence the realization of high fidelity workstation telepresence. The thesis advanced here is that perturbations in sensory feedback represent a major source of variability in human performance during interactive telerobot operation. Perturbed sensory feedback research over the past three decades has established that spatial transformations or temporal delays in sensory feedback engender substantial decrements in interactive task performance, which training does not completely overcome. A recently developed social cybernetic model of human-computer interaction can be used to guide this approach, based on computer-mediated tracking and control of sensory feedback. How the social cybernetic model can be employed for evaluating the various modes, patterns, and integrations of interpersonal, team, and human-computer interactions which play a central role is workstation telepresence are discussed.
Smith, Thomas J.↗
Variational and phase response analysis for limit cycles with hard boundaries, with applications to neuromechanical control problems
Motor systems show an overall robustness, but because they are highly nonlinear, understanding how they achieve robustness is difficult. In many rhythmic systems, robustness against perturbations involves response of both the shape and the timing of the trajectory. This makes the study of robustness even more challenging. To understand how a motor system produces robust behaviors in a variable environment, we consider a neuromechanical model of motor patterns in the feeding apparatus of the marine mollusk Aplysia californica (Shaw et al. in J Comput Neurosci 38(1):25–51, 2015; Lyttle et al. in Biol Cybern 111(1):25–47, 2017). We established in (Wang et al. in SIAM J Appl Dyn Syst 20(2):701–744, 2021. https://doi.org/10.1137/20M1344974) the tools for studying combined shape and timing responses of limit cycle systems under sustained perturbations and here apply them to study robustness of the neuromechanical model against increased mechanical load during swallowing. Interestingly, we discover that nonlinear biomechanical properties confer resilience by immediately increasing resistance to applied loads. In contrast, the effect of changed sensory feedback signal is significantly delayed by the firing rates’ hard boundary properties. Our analysis suggests that sensory feedback contributes to robustness in swallowing primarily by shifting the timing of neural activation involved in the power stroke of the motor cycle (retraction). This effect enables the system to generate stronger retractor muscle forces to compensate for the increased load, and hence achieve strong robustness. The approaches that we are applying to understanding a neuromechanical model in Aplysia, and the results that we have obtained, are likely to provide insights into the function of other motor systems that encounter changing mechanical loads and hard boundaries, both due to mechanical and neuronal firing properties.
59 BASIC BIOLOGICAL SCIENCES↗
CRCNS21 Computational Models of Multisensory Integration by Upper Limb in Humanoids and Amputees
This international collaborative research project between Johns Hopkins University (JHU) and the Technical University of Munich (TUM) investigated how the human brain processes and integrates multiple types of sensory information, such as touch and force, with the goal of improving prosthetic limbs for amputees and advancing sensory capabilities in humanoid robots. The research advanced our understanding of how the brain responds to sensory feedback in upper-limb amputees. Through experiments in which amputees received electrical stimulation while performing phantom hand movements, we demonstrated that sensory feedback activates the cortical sensorimotor and multisensory regions, and that these regions communicate dynamically during stimulation. Experiments with intact-limb participants explored the integration of visual, haptic, and force feedback, as well as in virtual reality motor training, further showing how the brain processes multimodal sensory information. In addition, this research inspired work on examining the reliability of where amputees perceive sensations over time, which contributed to a successful doctoral fellowship for continued investigation. Our collaborators at TUM improved multimodal sensor technology combining tactile and thermal feedback for humanoid robots, demonstrating the feasibility of integrating multiple sensor types into a unified system for detecting and responding to environmental stimuli. The experimental methods and analysis techniques developed across both teams, including functional network analysis and multimodal sensor integration, provide a foundation for future research in prosthetics and robotics. This research benefits the public by generating knowledge about how amputees process restored sensory information. Advances in humanoid sensing contribute to safer human-robot interaction. The project also fostered international collaboration and cross-disciplinary training: one TUM doctoral student spent a summer at JHU working on multimodal sensor integration, while two JHU students traveled to TUM to host workshops on neuromorphic sensory encoding and sensory integration.
42 ENGINEERING↗
Vision Based Autonomous Robotic Control for Advanced Inspection and Repair
The advanced inspection system is an autonomous control and analysis system that improves the inspection and remediation operations for ground and surface systems. It uses optical imaging technology with intelligent computer vision algorithms to analyze physical features of the real-world environment to make decisions and learn from experience. The advanced inspection system plans to control a robotic manipulator arm, an unmanned ground vehicle and cameras remotely, automatically and autonomously. There are many computer vision, image processing and machine learning techniques available as open source for using vision as a sensory feedback in decision-making and autonomous robotic movement. My responsibilities for the advanced inspection system are to create a software architecture that integrates and provides a framework for all the different subsystem components; identify open-source algorithms and techniques; and integrate robot hardware.
sensory feedback↗
The WCSAR telerobotics test bed
Component technologies for use in telerobotic systems for space are being developed. As part of this effort, a test bed was established in which these technologies can be verified and integrated into telerobotic systems. The facility consists of two slave industrial robots, an articulated master arm controller, a cartesian coordinate master arm controller, and a variety of sensors, displays and stimulators for feedback to human operators. The controller of one of the slave robots remains in its commercial state, while the controller of the other robot has been replaced with a new controller that achieves high-performance in telerobotic operating modes. A dexterous slave hand which consists of two fingers and a thumb is being developed, along with a number of force-reflecting and non-force reflecting master hands, wrists and arms. A tactile sensing finger tip based on piezo-film technology has been developed, along with tactile stimulators and CAD-based displays for sensory feedback and sensory substitution. The telerobotics test bed and its component technologies are described, as well as the integration of these component technologies into telerobotic systems, and their performance in conjunction with human operators.
Duffie, N.↗
Aspects of body self-calibration
The representation of body orientation and configuration is dependent on multiple sources of afferent and efferent information about ongoing and intended patterns of movement and posture. Under normal terrestrial conditions, we feel virtually weightless and we do not perceive the actual forces associated with movement and support of our body. It is during exposure to unusual forces and patterns of sensory feedback during locomotion that computations and mechanisms underlying the ongoing calibration of our body dimensions and movements are revealed. This review discusses the normal mechanisms of our position sense and calibration of our kinaesthetic, visual and auditory sensory systems, and then explores the adaptations that take place to transient Coriolis forces generated during passive body rotation. The latter are very rapid adaptations that allow body movements to become accurate again, even in the absence of visual feedback. Muscle spindle activity interpreted in relation to motor commands and internally modeled reafference is an important component in permitting this adaptation. During voluntary rotary movements of the body, the central nervous system automatically compensates for the Coriolis forces generated by limb movements. This allows accurate control to be maintained without our perceiving the forces generated.
NASA Discipline Neuroscience↗
"Smart" Electromechanical Shock Absorber
Shock-absorbing apparatus includes electromechanical actuator and digital feedback control circuitry rather than springs and hydraulic damping as in conventional shock absorbers. Device not subject to leakage and requires little or no maintenance. Attenuator parameters adjusted in response to sensory feedback and predictive algorithms to obtain desired damping characteristic. Device programmed to decelerate slowly approaching vehicle or other large object according to prescribed damping characteristic.
Stokes, Lebarian↗
Sensory integration for neuroprostheses: from functional benefits to neural correlates
In the field of sensory neuroprostheses, one ultimate goal is for individuals to perceive artificial somatosensory information and use the prosthesis with high complexity that resembles an intact system. To this end, research has shown that stimulation elicited somatosensory information improves prosthesis perception and task performance. While studies strive to achieve sensory integration, a crucial phenomenon that entails naturalistic interaction with the environment, this topic has not been commensurately reviewed. Therefore, here we present a perspective for understanding sensory integration in neuroprostheses. First, we review the engineering aspects and functional outcomes in sensory neuroprosthesis studies. In this context, we summarize studies that have suggested sensory integration. We focus on how they have used stimulation-elicited percepts to maximize and improve the reliability of somatosensory information. Next, we review studies that have suggested multisensory integration. These works have demonstrated that congruent and simultaneous multisensory inputs provided cognitive benefits such that an individual experiences a greater sense of authority over prosthesis movements (i.e., agency) and perceives the prosthesis as part of their own (i.e., ownership). Thereafter, we present the theoretical and neuroscience framework of sensory integration. We investigate how behavioral models and neural recordings have been applied in the context of sensory integration. Sensory integration models developed from intact-limb individuals have led the way to sensory neuroprosthesis studies to demonstrate multisensory integration. Neural recordings have been used to show how multisensory inputs are processed across cortical areas. Lastly, we discuss some ongoing research and challenges in achieving and understanding sensory integration in sensory neuroprostheses. Here, resolving these challenges would help to develop future strategies to improve the sensory feedback of a neuroprosthetic system.
60 APPLIED LIFE SCIENCES↗
Automatic inspection of analog and digital meters in a robot vision system
A critical limitation of most of the robots utilized in industrial environments arises due to their inability to utilize sensory feedback. This forces robot operation into totally preprogrammed or teleoperation modes. In order to endow the new generation of robots with higher levels of autonomy techniques for sensing of their work environments and for accurate and efficient analysis of the sensory data must be developed. In this paper detailed development of vision system modules for inspecting various types of meters, both analog and digital, encountered in a robotic inspection and manipulation tasks are described. These modules are tested using industrial robots having multisensory input capability.
Trivedi, Mohan M.↗
Sensor Control of Robot Arc Welding
The potential for using computer vision as sensory feedback for robot gas-tungsten arc welding is investigated. The basic parameters that must be controlled while directing the movement of an arc welding torch are defined. The actions of a human welder are examined to aid in determining the sensory information that would permit a robot to make reproducible high strength welds. Special constraints imposed by both robot hardware and software are considered. Several sensory modalities that would potentially improve weld quality are examined. Special emphasis is directed to the use of computer vision for controlling gas-tungsten arc welding. Vendors of available automated seam tracking arc welding systems and of computer vision systems are surveyed. An assessment is made of the state of the art and the problems that must be solved in order to apply computer vision to robot controlled arc welding on the Space Shuttle Main Engine.
Sias, F. R., Jr.↗
Implementation of a three degree of freedom, motor/brake hybrid force output device for virtual environment control tasks
The advent of high resolution, physical model based computer graphics has left a gap in the design of input/output technology appropriate for interacting with such complex virtual world models. Since virtual worlds consist of physical models, it is appropriate to output the inherent force information necessary for the simulation to the user. The detailed design, construction, and control of a three degree freedom force output joystick will be presented. A novel kinematic design allows all three axes to be uncoupled, so that the system inertia matrix is diagonal. The two planar axes are actuated through an offset gimbal, and the third through a sleeved cable. To compensate for friction and inertia effects, this transmission is controlled by a force feedforward and a closed force feedback proportional loop. Workspace volume is a cone of 512 cubic inches, and the device bandwidth is maximized at 60 Hz for the two planar and 30 Hz for the third axis. Each axis is controlled by a motor/proportional magnetic particle brake combination fixed to the base. The innovative use of motors and brakes allows objects with high resistive torque requirements to be simulated without the stability and related safety issues involved with high torque, energy storing motors alone. Position, velocity, and applied endpoint force are sensed directly. Different control strategies are discussed and implemented, with an emphasis on how virtual environment force information, generated by the MIT Media Lab Computer Graphics and Animation Group BOLIO system, is transmitted to the device controller. The design constraints for a kinesthetic force feedback device can be summarized as: How can the symbiosis between the sense of presence in the virtual environment be maximized without compromising the interaction task under the constraints of the mechanical device limitations? Research in this field will yield insights to the optimal human sensory feedback mix for a wide spectrum of control and interaction problems. A flexible research tool that is designed as an easily reproducible product prototype has been constructed to explore the variety of possible force interaction.
Russo, Massimo↗
Transcriptome and secretome profiling of sensory neurons reveals sex differences in pathways relevant to insulin sensing and insulin secretion
Sensory neurons in the dorsal root ganglia (DRG) convey somatosensory and metabolic cues to the central nervous system and release substances from stimulated terminal endings in peripheral organs. Sex-biased variations driven by the sex chromosome complement (XX and XY) have been implicated in the sensory–islet crosstalk. However, the molecular underpinnings of these male–female differences are not known. Here, we aim to characterize the molecular repertoire and the secretome profile of the lower thoracic spinal sensory neurons and to identify molecules with sex-biased insulin sensing- and/or insulin secretion-modulating activity that are encoded independently of circulating gonadal sex hormones. We used transcriptomics and proteomics to uncover differentially expressed genes and secreted molecules in lower thoracic T5-12 DRG sensory neurons derived from sexually immature 3-week-old male and female C57BL/6J mice. Comparative transcriptome and proteome analyses revealed differential gene expression and protein secretion in DRG neurons in males and females. Furthermore, the transcriptome analysis identified, among others, higher insulin signaling/sensing capabilities in female DRG neurons; secretome screening uncovered several sex-specific candidate molecules with potential regulatory functions in pancreatic β cells. Together, these data suggest a putative role of sensory interoception of insulin in the DRG–islet crosstalk with implications in sensory feedback loops in the regulation of β-cell activity in a sex-biased manner. Finally, we provide a valuable resource of molecular and secretory targets that can be leveraged for understanding insulin interoception and insulin secretion and inform the development of novel studies/approaches to fathom the role of the sensory–islet axis in the regulation of energy balance in males and females.
59 BASIC BIOLOGICAL SCIENCES↗
Developing an Earth-Fixed Visual Reference to Aid Stability, Readaptation, and Egress After A Water Landing
Water landings present the worst possible sensory conditions for crews trying to orient and stabilize themselves immediately after long-duration spaceflight. Of the three sensory feedback systems involved in maintaining stability (i.e., proprioceptive, vestibular, and visual), none will provide reliable orientation information under the current water landing scenarios. The proprioceptive and vestibular systems are affected during spaceflight by disuse and adaptation to microgravity. Vision may not suffer the same degradation, but the visual environment within the enclosed space of a capsule, or interior room of a recovery ship, induces instability during wave motion. In addition to an increased fall risk, sensory readaptation is delayed until inputs from the three sensory systems can be synchronized with one another and aligned with Earth’s gravity. An Earth-fixed visual reference (EFVR) can be provided to increase crewmember stability and allow for earlier readaptation initiation.
B.T. Peters↗