Search NASA⌕ Search

SEARCH · Search NASA

Results for “Voice control”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2005

Automating CapCom Using Mobile Agents and Robotic Assistants

We have developed and tested an advanced EVA communications and computing system to increase astronaut self-reliance and safety, reducing dependence on continuous monitoring and advising from mission control on Earth. This system, called Mobile Agents (MA), is voice controlled and provides information verbally to the astronauts through programs called personal agents. The system partly automates the role of CapCom in Apollo-including monitoring and managing EVA navigation, scheduling, equipment deployment, telemetry, health tracking, and scientific data collection. EVA data are stored automatically in a shared database in the habitat/vehicle and mirrored to a site accessible by a remote science team. The program has been developed iteratively in the context of use, including six years of ethnographic observation of field geology. Our approach is to develop automation that supports the human work practices, allowing people to do what they do well, and to work in ways they are most familiar. Field experiments in Utah have enabled empirically discovering requirements and testing alternative technologies and protocols. This paper reports on the 2004 system configuration, experiments, and results, in which an EVA robotic assistant (ERA) followed geologists approximately 150 m through a winding, narrow canyon. On voice command, the ERA took photographs and panoramas and was directed to move and wait in various locations to serve as a relay on the wireless network. The MA system is applicable to many space work situations that involve creating and navigating from maps (including configuring equipment for local topology), interacting with piloted and unpiloted rovers, adapting to environmental conditions, and remote team collaboration involving people and robots.

Clancey, William J.↗
NASA NTRS1987

Multimodal user input to supervisory control systems - Voice-augmented keyboard

The use of a voice-augmented keyboard input modality is evaluated in a supervisory control application. An implementation of voice recognition technology in supervisory control is proposed: voice is used to request display pages, while the keyboard is used to input system reconfiguration commands. Twenty participants controlled GT-MSOCC, a high-fidelity simulation of the operator interface to a NASA ground control system, via a workstation equipped with either a single keyboard or a voice-augmented keyboard. Experimental results showed that in all cases where significant performance differences occurred, performance with the voice-augmented keyboard modality was inferior to and had greater variance than the keyboard-only modality. These results suggest that current moderately priced voice recognition systems are an inappropriate human-computer interaction technology in supervisory control systems.

Mitchell, Christine M.↗
NASA NTRS2000

Robotic Surgery

The Automated Endoscopic System for Optimal Positioning, or AESOP, was developed by Computer Motion, Inc. under a SBIR contract from the Jet Propulsion Lab. AESOP is a robotic endoscopic positioning system used to control the motion of a camera during endoscopic surgery. The camera, which is mounted at the end of a robotic arm, previously had to be held in place by the surgical staff. With AESOP the robotic arm can make more precise and consistent movements. AESOP is also voice controlled by the surgeon. It is hoped that this technology can be used in space repair missions which require precision beyond human dexterity. A new generation of the same technology entitled the ZEUS Robotic Surgical System can make endoscopic procedures even more successful. ZEUS allows the surgeon control various instruments in its robotic arms, allowing for the precision the procedure requires.

Source record↗
NASA NTRS1975

Location and acquisition of objects in unpredictable locations

A teleoperator system with a computer for manipulator control to combine the capabilities of both man and computer to accomplish a task is described. This system allows objects in unpredictable locations to be successfully located and acquired. By using a method of characterizing the work-space together with man's ability to plan a strategy and coarsely locate an object, the computer is provided with enough information to complete the tedious part of the task. In addition, the use of voice control is shown to be a useful component of the man/machine interface.

Sword, A. J.↗
NASA NTRS1992

Operator vision aids for space teleoperation assembly and servicing

This paper investigates concepts for visual operator aids required for effective telerobotic control. Operator visual aids, as defined here, mean any operational enhancement that improves man-machine control through the visual system. These concepts were derived as part of a study of vision issues for space teleoperation. Extensive literature on teleoperation, robotics, and human factors was surveyed to definitively specify appropriate requirements. This paper presents these visual aids in three general categories of camera/lighting functions, display enhancements, and operator cues. In the area of camera/lighting functions concepts are discussed for: (1) automatic end effector or task tracking; (2) novel camera designs; (3) computer-generated virtual camera views; (4) computer assisted camera/lighting placement; and (5) voice control. In the technology area of display aids, concepts are presented for: (1) zone displays, such as imminent collision or indexing limits; (2) predictive displays for temporal and spatial location; (3) stimulus-response reconciliation displays; (4) graphical display of depth cues such as 2-D symbolic depth, virtual views, and perspective depth; and (5) view enhancements through image processing and symbolic representations. Finally, operator visual cues (e.g., targets) that help identify size, distance, shape, orientation and location are discussed.

Brooks, Thurston L.↗
NASA NTRS1996

STS-78 Flight Day 15

On this fifteenth day of the STS-78 mission, the 4th of July, Cmdr. Terence T. Henricks, Pilot Kevin R. Kregel, Payload Cmdr. Susan J. Helms, Mission Specialists Richard M. Linnehan, Charles E. Brady, Jr., and Payload Specialists Jean-Jacques Favier, Ph.D. and Robert B. Thirsk, M.D., are awakened with Bruce Springsteen's 'Born in the USA' and Lee Greenwood's 'I'm Proud to be an American' to begin another a day on orbit. Mission Commander Tom Henricks responded to Mission Control's wake up call by saying that the five US-born crew members were very proud to be Americans, particularly on the day America celebrates its 220th anniversary. Work in the Spacelab module will continue with investigations into the effects of microgravity on muscle strength and endurance, lung function, and adaptation of the neurovestibular system to a microgravity environment. Henricks and Pilot Kevin Kregel will complete work with a laptop computer designed to test the crew's critical thinking skills and reaction time. They also will test a voice control system that allows them to reposition Columbia's closed-circuit television cameras with verbal cues, keeping their hands free to perform other tasks.

Source record↗
NASA NTRSDate not supplied

Towards Understanding Data Requirements for Developing Automatic Speech Recognition Systems for Air Traffic Control

In recent years, the application of automatic speech recognition has gained popularity across diverse industries, including aviation. Given the many applications focusing on transcribing air traffic control and management communication, this paper explores the training of OpenAI's Whisper model across multiple existing public and private air traffic control voice datasets in an effort to improve robustness. Combining roughly 60+ hours of various air traffic datasets, our goal is to train a unified Whisper model and expect an average word error rate reduction across testing datasets. Furthermore, this work aims to understand the data quantity requirements for achieving state-of-the art results by comprehensively training Whisper on varying dataset sizes. This work has the potential to improve automatic speech recognition performance across the domain, improve understanding of the quantity of data required by an aviation speech recognition system, and lastly provide metrics to compare and improve upon in future research.

ATC↗
DOE OSTI2025

VISION: a modular AI assistant for natural human-instrument interaction at scientific user facilities

Scientific user facilities, such as synchrotron beamlines, are equipped with a wide array of hardware and software tools that require a codebase for human-computer-interaction. This often necessitates developers to be involved to establish connection between users/researchers and the complex instrumentation. The advent of generative AI presents an opportunity to bridge this knowledge gap, enabling seamless communication and efficient experimental workflows. Here we present a modular architecture for the Virtual Scientific Companion by assembling multiple AI-enabled cognitive blocks that each scaffolds large language models (LLMs) for a specialized task. With VISION, we performed LLM-based operation on the beamline workstation with low latency and demonstrated the first voice-controlled experiment at an x-ray scattering beamline. The modular and scalable architecture allows for easy adaptation to new instruments and capabilities. Development on natural language-based scientific experimentation is a building block for an impending future where a science exocortex—a synthetic extension to the cognition of scientists—may radically transform scientific practice and discovery.

36 MATERIALS SCIENCE↗
NASA NTRS1967

Commercial spacecraft technology survey.

Commercial spacecraft technology, discussing requirements for navigation/traffic control, voice broadcast, earth resources survey and Applications Technology Satellites

Jaffe, L.↗
NASA NTRS1971

Concepts and system design of a space emergency re-entry vehicle.

Discussion of the spectrum of remedial concepts and realistic mission constraints. A vehicle design is presented which is offered as the 'best' solution among a number of alternative designs in terms of its cost effectiveness. The probability of the safe reentry and recovery of one to three stranded astronauts is 0.80. The vehicle is symmetrical and lenticular in shape, and exhibits a modest lift-to-drag ratio of 0.5, allowing it to reenter a two-skip trajectory with minimal gravity forces on the astronauts. Attitude control, voice and beacon communication, and impact attenuation are also provided. The vehicle could be delivered in a docked position on the Apollo Applications Program multiple docking adapter.

Huang, C. J.↗
NASA NTRS1987

The flight demonstration program and selection process

The Orbital Refueling System (ORS); force torque sensor; Plasma Motor/Generator (PMG) proof of function; voice controlled system; infrared intercommunications; superfluid helium on orbit transfer; laser docking sensor; and the Small Expendable Deployment System (SEDS) are summarized.

Levin, G. M.↗
NASA NTRS1990

Cockpit display of hazardous wind shear information

Information on cockpit display of wind shear information is given in viewgraph form. Based on the current status of windshear sensors and candidate data dissemination systems, the near-term capabilities for windshear avoidance will most likely include: (1) Ground-based detection: TDWR (Terminal Doppler Weather Radar), LLWAS (Low-Level Windshear Alert System), Automated PIREPS; (2) Ground-Air datalinks: Air traffic control voice channels, Mode-S digital datalink, ACARS alphanumeric datalink. The possible datapaths for integration of these systems are illustrated in a diagram. In the future, airborne windshear detection systems such as lidars, passive IR detectors, or airborne Doppler radars may also become available. Possible future datalinks include satellite downlink and specialized en route weather channels.

Wanke, Craig↗
NASA NTRS1989

A helmet mounted display demonstration unit for a Space Station application

Under NASA guidance an advanced development helmet mounted display (HMD) has been designed and fabricated. Delivery has been made of an extravehicular mobility unit (EMU) HMD demonstration unit as an alternative to the current low-resolution, chest-mounted display, and cuff-mounted checklists. Important design goals achieved with this HMD include the use of transmissive liquid display image sources with fairly high resolution (text, graphics, and video compatible), binocular viewing with total image overlap, virtual image projection, low profile packaging, low power design, and demonstration of voice control of the HMD data. Test results showed that the HMD program successfully demonstrated the feasibility of the concept and operated as designed, meeting the necessary program requirements.

Gernux, Carolyn G.↗
NASA NTRS1989

Three-dimensional visualization and display technologies; Proceedings of the Meeting, Los Angeles, CA, Jan. 18-20, 1989

Special attention was given to problems of stereoscopic display devices, such as CAD for enhancement of the design process in visual arts, stereo-TV improvement of remote manipulator performance, a voice-controlled stereographic video camera system, and head-mounted displays and their low-cost design alternatives. Also discussed was a novel approach to chromostereoscopic microscopy, computer-generated barrier-strip autostereography and lenticular stereograms, and parallax barrier three-dimensional TV. Additional topics include processing and user interface isssues and visualization applications, including automated analysis and fliud flow topology, optical tomographic measusrements of mixing fluids, visualization of complex data, visualization environments, and visualization management systems.

Robbins, Woodrow E.↗
NASA NTRS1986

Ocular attention-sensing interface system

The purpose of the research was to develop an innovative human-computer interface based on eye movement and voice control. By eliminating a manual interface (keyboard, joystick, etc.), OASIS provides a control mechanism that is natural, efficient, accurate, and low in workload.

Zaklad, Allen↗
NASA NTRS1993

A simulation system for Space Station extravehicular activity

America's next major step into space will be the construction of a permanently manned Space Station which is currently under development and scheduled for full operation in the mid-1990's. Most of the construction of the Space Station will be performed over several flights by suited crew members during an extravehicular activity (EVA) from the Space Shuttle. Once fully operational, EVA's will be performed from the Space Station on a routine basis to provide, among other services, maintenance and repair operations of satellites currently in Earth orbit. Both voice recognition and helmet-mounted display technologies can improve the productivity of workers in space by potentially reducing the time, risk, and cost involved in performing EVA. NASA has recognized this potential and is currently developing a voice-controlled information system for Space Station EVA. Two bench-model helmet-mounted displays and an EVA simulation program have been developed to demonstrate the functionality and practicality of the system.

Marmolejo, Jose A.↗