Search NASA⌕ Search

SEARCH · Search NASA

Results for “Human Interfaces”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 541 records · Page 30

Ubiquitous Wireless Smart Sensing and Control

Need new technologies to reliably and safely have humans interact within sensored environments (integrated user interfaces, physical and cognitive augmentation, training, and human-systems integration tools). Areas of focus include: radio frequency identification (RFID), motion tracking, wireless communication, wearable computing, adaptive training and decision support systems, and tele-operations. The challenge is developing effective, low cost/mass/volume/power integrated monitoring systems to assess and control system, environmental, and operator health; and accurately determining and controlling the physical, chemical, and biological environments of the areas and associated environmental control systems.

Wagner, Raymond↗

Ubiquitous Wireless Smart Sensing and Control. Pumps and Pipes JSC: Uniquely Houston

Need new technologies to reliably and safely have humans interact within sensored environments (integrated user interfaces, physical and cognitive augmentation, training, and human-systems integration tools).Areas of focus include: radio frequency identification (RFID), motion tracking, wireless communication, wearable computing, adaptive training and decision support systems, and tele-operations. The challenge is developing effective, low cost/mass/volume/power integrated monitoring systems to assess and control system, environmental, and operator health; and accurately determining and controlling the physical, chemical, and biological environments of the areas and associated environmental control systems.

Wagner, Raymond↗

Integration Process for the Habitat Demonstration Unit

The Habitat Demonstration Unit (HDU) is an experimental exploration habitat technology and architecture test platform designed for analog demonstration activities. The HDU previously served as a test bed for testing technologies and sub-systems in a terrestrial surface environment. in 2010 in the Pressurized Excursion Module (PEM) configuration. Due to the amount of work involved to make the HDU project successful, the HDU project has required a team to integrate a variety of contributions from NASA centers and outside collaborators The size of the team and number of systems involved With the HDU makes Integration a complicated process. However, because the HDU shell manufacturing is complete, the team has a head start on FY--11 integration activities and can focus on integrating upgrades to existing systems as well as integrating new additions. To complete the development of the FY-11 HDU from conception to rollout for operations in July 2011, a cohesive integration strategy has been developed to integrate the various systems of HDU and the payloads. The highlighted HDU work for FY-11 will focus on performing upgrades to the PEM configuration, adding the X-Hab as a second level, adding a new porch providing the astronauts a larger work area outside the HDU for EVA preparations, and adding a Hygiene module. Together these upgrades result in a prototype configuration of the Deep Space Habitat (DSH), an element under evaluation by NASA's Human Exploration Framework Team (HEFT) Scheduled activates include early fit-checks and the utilization of a Habitat avionics test bed prior to installation into HDU. A coordinated effort to utilize modeling and simulation systems has aided in design and integration concept development. Modeling tools have been effective in hardware systems layout, cable routing, sub-system interface length estimation and human factors analysis. Decision processes on integration and use of all new subsystems will be defined early in the project to maximize the efficiency of both integration and field operations. In addition a series of tailored design reviews are utilized to quickly define the systems and their integration into the DSH configuration. These processes are necessary to ensure activities, such as partially reversing integration of the X-Hab second story of the HDU and deploying and stowing the new work porch for transportation to the JSC Rock Yard and to the Arizona Black Point Lava Flow Site are performed with minimal or no complications. In addition, incremental test operations leading up to an Integrated systems test allows for an orderly systems test program. For FY-11 activities, the HDU DSH will act as a laboratory utilizing a new X-Hab inflatable second floor with crew habitation features. In addition to the day to day operations involving maintenance of the HDU and exploring the surrounding terrain, testing and optimizing the use of the new X-Hab, work porch, Hygiene Module, and other sub-system enhancements will be the focus of the FY-11 test objectives. The HDU team requires a successful integration strategy using a variety of tools and approaches to prepare the DSH for these test objectives. In a challenging environment where the prototyping influences the system design, as well as Vice versa, results of the HDU DSH field tests will influence future designs of habitat systems.

Gill, Tracy↗

A Distributed Simulation Facility to Support Human Factors Research in Advanced Air Transportation Technology

A distributed real-time simulation of the civil air traffic environment developed to support human factors research in advanced air transportation technology is presented. The distributed environment is based on a custom simulation architecture designed for simplicity and flexibility in human experiments. Standard Internet protocols are used to create the distributed environment, linking all advanced cockpit simulator, all Air Traffic Control simulator, and a pseudo-aircraft control and simulation management station. The pseudo-aircraft control station also functions as a scenario design tool for coordinating human factors experiments. This station incorporates a pseudo-pilot interface designed to reduce workload for human operators piloting multiple aircraft simultaneously in real time. The application of this distributed simulation facility to support a study of the effect of shared information (via air-ground datalink) on pilot/controller shared situation awareness and re-route negotiation is also presented.

Amonlirdviman, Keith↗

Motion sickness and proprioceptive aftereffects following virtual environment exposure

To study the potential aftereffects of virtual environments (VE), tests of visually guided behavior and felt limb position (pointing with eyes open and closed) along with self-reports of motion sickness-like discomfort were administered before and after 30 min exposure of 34 subjects. When post- discomfort was compared to a pre-baseline, the participants reported more sickness afterward (p < 0.03). The change in felt limb position resulted in subjects pointing higher (p < 0.038) and slightly to the left, although the latter difference was not statistically significant (p = 0.08). When findings from a second study using a different VE system were compared, they essentially replicated the results of the first study with higher sickness afterward (p < 0.001) and post- pointing errors were also up (p < 0.001) and to the left (p < 0.001). While alternative explanations (e.g. learning, fatigue, boredom, habituation, etc.) of these outcomes cannot be ruled out, the consistency of the post- effects on felt limb position changes in the two VE implies that these recalibrations may linger once interaction with the VE has concluded, rendering users potentially physiologically maladapted for the real world when they return. This suggests there may be safety concerns following VE exposures until pre-exposure functioning has been regained. The results of this study emphasize the need for developing and using objective measures of post-VE exposure aftereffects in order to systematically determine under what conditions these effects may occur.

NASA Discipline Neuroscience↗

NASA Earth Systems Digital Twins (ESDT)

"Similarly to artificial intelligence, which is now revolutionizing many aspects of our daily lives, Earth system digital twin technologies have the potential to revolutionize the way Earth Science research will be conducted in the future, and how results and knowledge from this research will provide information to support decision making and yield impactful societal benefits. An Earth System Digital Twin or ESDT is a dynamic and interactive information system that first provides a digital replica of the past and current states of the Earth or Earth system as accurately and timely as possible; second, allows for computing forecasts of future states under nominal assumptions and based on the current replica; and third, offers the capability to investigate many hypothetical scenarios under varying impact assumptions. In other words, an ESDT provides the integrated What-Now, What-Next, and What-If pictures of the Earth or Earth system, by continuously ingesting newly observed data and by leveraging multiple interconnected models, machine learning as well advanced computing and visualization capabilities. Digital twins have been developed in engineering since 2002, but the interest in digital twins for the Earth domain is more recent and stems from the convergence of several developments: - The huge amount of diverse data that has now been collected continuously for more than 50 years, and that is becoming more and more difficult to access, understand, and utilize. - At the same time, because of climate change and its impacts the information produced by all of this data is becoming of interest to many new non-traditional users for analyzing and predicting various phenomena. - Because of advances in computational and visualization capabilities and the parallel unprecedented development of machine learning (ML), extracting relevant information from these large amounts of data and running complex models faster has become possible. As a result, it is becoming necessary and possible to build intuitive and interactive frameworks that will enable users with various skill levels and/or organizational hierarchy levels to easily access large amounts of targeted information along with the relevant tools and models (Earth system and human activity models), to support them in analyzing and visualizing this information, to help them understand interactions among models, to visualize the potential outcomes of various impacts, and to support decision or policy making. The full power of digital twins is that, through an integrated representation and standardized tools and software technologies, the same digital replica can address the needs of multiple users at various resolutions (spatial and temporal) and for various applications (science, economic, policy, etc.) – “from farmer to scientist”. With all these interests at stake, the challenges of building optimal digital twins are many and complex. The first challenge is to determine if a Digital Twin should be global or local, and multi-domain or thematic. For example, some domains such as Climate or Weather will require a global Digital Twin or Digital Twin capabilities while science areas such as Biodiversity might be more local. We can also envision that multiple thematic ESDTs, e.g., Air Quality, Wildfires, Hydrology could be federated or provide input to other ESDTs, either on a regional level or to a more global ESDT. Overall, we can imagine a future “web” of Digital Twins co-existing in a hierarchy or in a network, and capable of being connected or federated depending on the needs. This last point brings up the very important challenge of interoperability, including standards and protocols that will need to be built into these systems from the beginning. Each individual digital twin would have full flexibility in internal construction but would need standards-based interfaces (input and output) or hooks to make it compatible with others. Another challenge when building digital twins will be to decide how to organize each digital replica. Based on the applications targeted by the DT under implementation, various amounts and types of raw data, Analysis Ready Data (ARD) and information will need to be incorporated. Depending on the required latencies and needs of the users, various solutions can be considered, including Data Cubes, Data Lakes, pointers, or computing information on demand. We envision that each ESDT will choose a solution adapted to its specific objectives. Another important challenge is the type(s) of visualization that will be used, as well as the level of interactivity and refresh rate that will be required. Again, this will depend on the objectives of the ESDT, but also on the various users’ needs. In most cases, several types of visualizations and human interfaces will need to be offered depending on the projected users of that system. In parallel to the challenges highlighted above, there are also many tools and technologies that will need to be developed or improved for all types of digital twins. Among those are improved machine learning technologies, for example providing explainability, but also ML techniques for causality and providing a better integration of physics models. Additionally, reliable uncertainty quantification methods will be needed for all ESDT components, from validating data fusion and assimilation to assessing the accuracy of ML models and weighing the values of decisions supported by those systems. This presentation introduces the ESDT concept, presents several ESDT use cases, and a proposed ESDT architecture framework, as well as various technologies being developed by the Advanced Information Systems Technology (AIST) Program."

Earth Science Remote Sensing; Information Systems↗

Modeling and simulation for space medicine operations: preliminary requirements considered

The NASA Space Medicine program is now developing plans for more extensive use of high-fidelity medical simulation systems. The use of simulation is seen as means to more effectively use the limited time available for astronaut medical training. Training systems should be adaptable for use in a variety of training environments, including classrooms or laboratories, space vehicle mockups, analog environments, and in microgravity. Modeling and simulation can also provide the space medicine development program a mechanism for evaluation of other medical technologies under operationally realistic conditions. Systems and procedures need preflight verification with ground-based testing. Traditionally, component testing has been accomplished, but practical means for "human in the loop" verification of patient care systems have been lacking. Medical modeling and simulation technology offer potential means to accomplish such validation work. Initial considerations in the development of functional requirements and design standards for simulation systems for space medicine are discussed.

Non-programmatic↗

Generalized analytical and numerical modeling of optical second harmonic generation in anisotropic crystals and complex heterostructures using #SHAARP package

Optical second harmonic generation (SHG) is a nonlinear optical effect widely used for nonlinear optical microscopy and laser frequency conversion. The closed-form analytical solution of the nonlinear optical responses is essential for evaluating the optical responses of new materials whose optical properties are unknown a priori. Many approximations have therefore been employed in the existing analytical approaches, such as slowly varying approximation, weak reflection of the nonlinear polarization, transparent medium, high crystallographic symmetry, Kleinman symmetry, easy crystal orientation along a high-symmetry direction, phase matching conditions and negligible interference among nonlinear waves, which may lead to large errors in the reported material properties. To avoid these approximations, here we have developed an open-source package named Second Harmonic Analysis of Anisotropic Rotational Polarimetry (#SHAARP) for single interface (si) and in multilayers (ml) for homogeneous crystals. The reliability and accuracy are established by experimentally benchmarking with both the SHG polarimetry and Maker fringes predicted from the package using standard materials. SHAARP.si and SHAARP.ml are available through GitHub https://github.com/Rui-Zu/SHAARP and https://github.com/bzw133/SHAARP.ml, respectively.

complex systems↗

Skin-integrated stretchable actuators toward skin-compatible haptic feedback and closed-loop human-machine interactions

Abstract Skin-integrated haptic interfaces that can relay a wealth of information from the machine to the human are of great interest. However, existing haptic devices are not yet able to produce haptic cues that are compatible with the skin. In this work, we present the stretchable soft actuators for haptic feedback, which can match the perception range, spatial resolution, and stretchability of the skin. Pressure-amplification structures are fabricated using a scalable self-assembly process to ensure an output pressure beyond the skin perception threshold. Due to the minimized device size, the actuator array can be fabricated with a sufficiently high spatial resolution, which makes the haptic device applicable for skin locations with the highest spatial acuity. A haptic feedback system is demonstrated by employing the developed soft actuators and highly sensitive pressure sensors. Two proof-of-concept applications are developed to illustrate the capability of transferring information related to surface textures and object shapes acquired at the robot side to the user side.

Chen, Si↗

Safety Analysis of FMS/CTAS Interactions During Aircraft Arrivals

This grant funded research on human-computer interaction design and analysis techniques, using future ATC environments as a testbed. The basic approach was to model the nominal behavior of both the automated and human procedures and then to apply safety analysis techniques to these models. Our previous modeling language, RSML, had been used to specify the system requirements for TCAS II for the FAA. Using the lessons learned from this experience, we designed a new modeling language that (among other things) incorporates features to assist in designing less error-prone human-computer interactions and interfaces and in detecting potential HCI problems, such as mode confusion. The new language, SpecTRM-RL, uses "intent" abstractions, based on Rasmussen's abstraction hierarchy, and includes both informal (English and graphical) specifications and formal, executable models for specifying various aspects of the system. One of the goals for our language was to highlight the system modes and mode changes to assist in identifying the potential for mode confusion. Three published papers resulted from this research. The first builds on the work of Degani on mode confusion to identify aspects of the system design that could lead to potential hazards. We defined and modeled modes differently than Degani and also defined design criteria for SpecTRM-RL models. Our design criteria include the Degani criteria but extend them to include more potential problems. In a second paper, Leveson and Palmer showed how the criteria for indirect mode transitions could be applied to a mode confusion problem found in several ASRS reports for the MD-88. In addition, we defined a visual task modeling language that can be used by system designers to model human-computer interaction. The visual models can be translated into SpecTRM-RL models, and then the SpecTRM-RL suite of analysis tools can be used to perform formal and informal safety analyses on the task model in isolation or integrated with the rest of the modeled system. We had hoped to be able to apply these modeling languages and analysis tools to a TAP air/ground trajectory negotiation scenario, but the development of the tools took more time than we anticipated.

Nancy G. Leveson↗

A graphical, rule based robotic interface system

The ability of a human to take control of a robotic system is essential in any use of robots in space in order to handle unforeseen changes in the robot's work environment or scheduled tasks. But in cases in which the work environment is known, a human controlling a robot's every move by remote control is both time consuming and frustrating. A system is needed in which the user can give the robotic system commands to perform tasks but need not tell the system how. To be useful, this system should be able to plan and perform the tasks faster than a telerobotic system. The interface between the user and the robot system must be natural and meaningful to the user. A high level user interface program under development at the University of Alabama, Huntsville, is described. A graphical interface is proposed in which the user selects objects to be manipulated by selecting representations of the object on projections of a 3-D model of the work environment. The user may move in the work environment by changing the viewpoint of the projections. The interface uses a rule based program to transform user selection of items on a graphics display of the robot's work environment into commands for the robot. The program first determines if the desired task is possible given the abilities of the robot and any constraints on the object. If the task is possible, the program determines what movements the robot needs to make to perform the task. The movements are transformed into commands for the robot. The information defining the robot, the work environment, and how objects may be moved is stored in a set of data bases accessible to the program and displayable to the user.

Mckee, James W.↗

A Polymer Canvas with the Stiffness of the Bone Matrix to Study and Control Mesenchymal Stem Cell Response

Reproducing in vitro the complex multiscale physical features of human tissues creates novel biomedical opportunities and fundamental understanding of cell–environment interfaces and interactions. While stiffness has been recognized as a key driver of cell behavior, systematic studies on the role of stiffness have been limited to values in the KPa–MPa range, significantly below the stiffness of bone. Here, in this work, a platform enabling the tuning of the stiffness of a biocompatible polymeric interface up to values characteristic of human bone is reported, which are in the GPa range, by using extremely thin polymer films on glass and cross-linking the films using ultraviolet (UV) light irradiation. It is shown that a higher stiffness is related to better adhesion, proliferation, and osteogenic differentiation, and that it is possible to switch on/off cell attachment and growth by solely tuning the stiffness of the interface, without any surface chemistry or topography modification. Since the stiffness is tuned directly by UV irradiation, this platform is ideal for rapid and simple fabrication of stiffness patterns and gradients, thus representing an innovative tool for combinatorial studies of the synergistic effect of tissue environmental cues on cell behavior, and creates new opportunities for next-generation biosensors, single-cell patterning, and lab-on-a-chip devices.

60 APPLIED LIFE SCIENCES↗

Software systems for modeling articulated figures

Research in computer animation and simulation of human task performance requires sophisticated geometric modeling and user interface tools. The software for a research environment should present the programmer with a powerful but flexible substrate of facilities for displaying and manipulating geometric objects, yet insure that future tools have a consistent and friendly user interface. Jack is a system which provides a flexible and extensible programmer and user interface for displaying and manipulating complex geometric figures, particularly human figures in a 3D working environment. It is a basic software framework for high-performance Silicon Graphics IRIS workstations for modeling and manipulating geometric objects in a general but powerful way. It provides a consistent and user-friendly interface across various applications in computer animation and simulation of human task performance. Currently, Jack provides input and control for applications including lighting specification and image rendering, anthropometric modeling, figure positioning, inverse kinematics, dynamic simulation, and keyframe animation.

Phillips, Cary B.↗

Multi-level manual and autonomous control superposition for intelligent telerobot

Space telerobots are recognized to require cooperation with human operators in various ways. Multi-level manual and autonomous control superposition in telerobot task execution is described. The object model, the structured master-slave manipulation system, and the motion understanding system are proposed to realize the concept. The object model offers interfaces for task level and object level human intervention. The structured master-slave manipulation system offers interfaces for motion level human intervention. The motion understanding system maintains the consistency of the knowledge through all the levels which supports the robot autonomy while accepting the human intervention. The superposing execution of the teleoperational task at multi-levels realizes intuitive and robust task execution for wide variety of objects and in changeful environment. The performance of several examples of operating chemical apparatuses is shown.

Hirai, Shigeoki↗

Using Arm and Hand Gestures to Command Robots during Stealth Operations

Command of support robots by the warfighter requires intuitive interfaces to quickly communicate high degree-of-freedom (DOF) information while leaving the hands unencumbered. Stealth operations rule out voice commands and vision-based gesture interpretation techniques, as they often entail silent operations at night or in other low visibility conditions. Targeted at using bio-signal inputs to set navigation and manipulation goals for the robot (say, simply by pointing), we developed a system based on an electromyography (EMG) "BioSleeve", a high density sensor array for robust, practical signal collection from forearm muscles. The EMG sensor array data is fused with inertial measurement unit (IMU) data. This paper describes the BioSleeve system and presents initial results of decoding robot commands from the EMG and IMU data using a BioSleeve prototype with up to sixteen bipolar surface EMG sensors. The BioSleeve is demonstrated on the recognition of static hand positions (e.g. palm facing front, fingers upwards) and on dynamic gestures (e.g. hand wave). In preliminary experiments, over 90% correct recognition was achieved on five static and nine dynamic gestures. We use the BioSleeve to control a team of five LANdroid robots in individual and group/squad behaviors. We define a gesture composition mechanism that allows the specification of complex robot behaviors with only a small vocabulary of gestures/commands, and we illustrate it with a set of complex orders.

stealth operations↗

RAD51C-XRCC3 structure and cancer patient mutations define DNA replication roles

$RAD51C$ is an enigmatic predisposition gene for breast, ovarian, and prostate cancer. Currently, missing structural and related functional understanding limits patient mutation interpretation to homology-directed repair (HDR) function analysis. Here we report the RAD51C-XRCC3 (CX3) X-ray co-crystal structure with bound ATP analog and define separable RAD51C replication stability roles informed by its three-dimensional structure, assembly, and unappreciated polymerization motif. Mapping of cancer patient mutations as a functional guide confirms ATP-binding matching RAD51 recombinase yet highlights distinct CX3 interfaces. Analyses of CRISPR/Cas9-edited human cells with $RAD51C$ mutations combined with single-molecule, single-cell and biophysics measurements uncover discrete CX3 regions for DNA replication fork protection, restart and reversal, accomplished by separable functions in DNA binding and implied 5’ RAD51 filament capping. Collective findings establish CX3 as a cancer-relevant replication stress response complex, show how HDR-proficient variants could contribute to tumor development, and identify regions to aid functional testing and classification of cancer mutations.

59 BASIC BIOLOGICAL SCIENCES↗

Achieving tissue-level softness on stretchable electronics through a generalizable soft interlayer design

Soft and stretchable electronics have emerged as highly promising tools for biomedical diagnosis and biological studies, as they interface intimately with the human body and other biological systems. Most stretchable electronic materials and devices, however, still have Young’s moduli orders of magnitude higher than soft bio-tissues, which limit their conformability and long-term biocompatibility. Here, we present a design strategy of soft interlayer for allowing the use of existing stretchable materials of relatively high moduli to versatilely realize stretchable devices with ultralow tissue-level moduli. We have demonstrated stretchable transistor arrays and active-matrix circuits with moduli below 10 kPa—over two orders of magnitude lower than the current state of the art. Benefiting from the increased conformability to irregular and dynamic surfaces, the ultrasoft device created with the soft interlayer design realizes electrophysiological recording on an isolated heart with high adaptability, spatial stability, and minimal influence on ventricle pressure. In vivo biocompatibility tests also demonstrate the benefit of suppressing foreign-body responses for long-term implantation. With its general applicability to diverse materials and devices, this soft-interlayer design overcomes the material-level limitation for imparting tissue-level softness to a variety of bioelectronic devices.

42 ENGINEERING↗

Additive and Subtractive Manufacturing Augmented Reality Interface (ASMARI)

Industry 4.0 represents the next evolution of industrial technology. Some of the key characteristics of Industry 4.0 include augmented reality and additive manufacturing. In support of this evolution, researchers at Oak Ridge National Lab created a prototype augmented reality (AR) interface, ASMARI. This prototype acts as a common interface for both industrial additive and subtractive machines. Additionally, in the changing industrial workspace of Industry 4.0, the role of humans will also change. This interface focuses on increasing productivity and situational awareness, while providing new interaction modalities for interacting with hardware. The prototype was also evaluated by multiple users who provided positive feedback on the system. Ultimately, the prototype represents a first step towards significant integration between augmented reality and additive manufacturing.

Borish, Michael↗