Search NASA⌕ Search

SEARCH · Search NASA

Results for “Audio”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Concept of Operations Evaluation for Mitigating Space Flight-Relevant Medical Issues in a Planetary Habitat

Introduction: Analogue environments assist the NASA Human Research Program (HRP) in developing capabilities to mitigate high risk issues to crew health and performance for space exploration. The Habitat Demonstration Unit (HDU) is an analogue habitat used to assess space-related products for planetary missions. The Exploration Medical Capability (ExMC) element at the NASA Johnson Space Center (JSC) was tasked with developing planetary-relevant medical scenarios to evaluate the concept of operations for mitigating medical issues in such an environment. Methods: Two medical scenarios were conducted within the simulated planetary habitat with the crew executing two space flight-relevant procedures: Eye Examination with a corneal injury and Skin Laceration. Remote guidance for the crew was provided by a flight surgeon (FS) stationed at a console outside of the habitat. Audio and video data were collected to capture the communication between the crew and the FS, as well as the movements of the crew executing the procedures. Questionnaire data regarding procedure content and remote guidance performance also were collected from the crew immediately after the sessions. Results: Preliminary review of the audio, video, and questionnaire data from the two scenarios conducted within the HDU indicate that remote guidance techniques from an FS on console can help crew members within a planetary habitat mitigate planetary-relevant medical issues. The content and format of the procedures were considered concise and intuitive, respectively. Discussion: Overall, the preliminary data from the evaluation suggest that use of remote guidance techniques by a FS can help HDU crew execute space exploration-relevant medical procedures within a habitat relevant to planetary missions, however further evaluations will be needed to implement this strategy into the complete concept of operations for conducting general space medicine within similar environments

Barsten, Kristina↗

Visual Image Sensor Organ Replacement: Implementation

Method and system for enhancing or extending visual representation of a selected region of a visual image, where visual representation is interfered with or distorted, by supplementing a visual signal with at least one audio signal having one or more audio signal parameters that represent one or more visual image parameters, such as vertical and/or horizontal location of the region; region brightness; dominant wavelength range of the region; change in a parameter value that characterizes the visual image, with respect to a reference parameter value; and time rate of change in a parameter value that characterizes the visual image. Region dimensions can be changed to emphasize change with time of a visual image parameter.

Maluf, A. David↗

Passing the Baton: An Experimental Study of Shift Handover

Shift handovers occur in many safety-critical environments, including aviation maintenance, medicine, air traffic control, and mission control for space shuttle and space station operations. Shift handovers are associated with increased risk of communication failures and human error. In dynamic industries, errors and accidents occur disproportionately after shift handover. Typical shift handovers involve transferring information from an outgoing shift to an incoming shift via written logs, or in some cases, face-to-face briefings. The current study explores the possibility of improving written communication with the support modalities of audio and video recordings, as well as face-to-face briefings. Fifty participants participated in an experimental task which mimicked some of the critical challenges involved in transferring information between shifts in industrial settings. All three support modalities, face-to-face, video, and audio recordings, reduced task errors significantly over written communication alone. The support modality most preferred by participants was face-to-face communication; the least preferred was written communication alone.

Parke, Bonny↗

Internet-Based System for Voice Communication With the ISS

The Internet Voice Distribution System (IVoDS) is a voice-communication system that comprises mainly computer hardware and software. The IVoDS was developed to supplement and eventually replace the Enhanced Voice Distribution System (EVoDS), which, heretofore, has constituted the terrestrial subsystem of a system for voice communications among crewmembers of the International Space Station (ISS), workers at the Payloads Operations Center at Marshall Space Flight Center, principal investigators at diverse locations who are responsible for specific payloads, and others. The IVoDS utilizes a communication infrastructure of NASA and NASArelated intranets in addition to, as its name suggests, the Internet. Whereas the EVoDS utilizes traditional circuitswitched telephony, the IVoDS is a packet-data system that utilizes a voice over Internet protocol (VOIP). Relative to the EVoDS, the IVoDS offers advantages of greater flexibility and lower cost for expansion and reconfiguration. The IVoDS is an extended version of a commercial Internet-based voice conferencing system that enables each user to participate in only one conference at a time. In the IVoDS, a user can receive audio from as many as eight conferences simultaneously while sending audio to one of them. The IVoDS also incorporates administrative controls, beyond those of the commercial system, that provide greater security and control of the capabilities and authorizations for talking and listening afforded to each user.

Chamberlain, James↗

Development of the ISS EMU Dashboard Software

The EMU (Extra-Vehicular Mobility Unit) Dashboard was developed at NASA s Johnson Space Center to aid in real-time mission support for the ISS (International Space Station) and Shuttle EMU space suit by time synchronizing down-linked video, space suit data and audio from the mission control audio loops. Once the input streams are synchronized and recorded, the data can be replayed almost instantly and has proven invaluable in understanding in-flight hardware anomalies and playing back information conveyed by the crew to missions control and the back room support. This paper will walk through the development from an engineer s idea brought to life by an intern to real time mission support and how this tool is evolving today and its challenges to support EVAs (Extra-Vehicular Activities) and human exploration in the 21st century.

Bernard, Craig↗

Virtual Ultrasound Guidance for Inexperienced Operators

Medical ultrasound or echocardiographic studies are highly operator-dependent and generally require lengthy training and internship to perfect. To obtain quality echocardiographic images in remote environments, such as on-orbit, remote guidance of studies has been employed. This technique involves minimal training for the user, coupled with remote guidance from an expert. When real-time communication or expert guidance is not available, a more autonomous system of guiding an inexperienced operator through an ultrasound study is needed. One example would be missions beyond low Earth orbit in which the time delay inherent with communication will make remote guidance impractical. The Virtual Ultrasound Guidance system is a combination of hardware and software. The hardware portion includes, but is not limited to, video glasses that allow hands-free, full-screen viewing. The glasses also allow the operator a substantial field of view below the glasses to view and operate the ultrasound system. The software is a comprehensive video program designed to guide an inexperienced operator through a detailed ultrasound or echocardiographic study without extensive training or guidance from the ground. The program contains a detailed description using video and audio to demonstrate equipment controls, ergonomics of scanning, study protocol, and scanning guidance, including recovery from sub-optimal images. The components used in the initial validation of the system include an Apple iPod Classic third-generation as the video source, and Myvue video glasses. Initially, the program prompts the operator to power-up the ultrasound and position the patient. The operator would put on the video glasses and attach them to the video source. After turning on both devices and the ultrasound system, the audio-video guidance would then instruct on patient positioning and scanning techniques. A detailed scanning protocol follows with descriptions and reference video of each view along with advice on technique. The program also instructs the operator regarding the types of images to store and how to overcome pitfalls in scanning. Images can be forwarded to the ground or other site when convenient. Following study completion, the video glasses, video source, and ultrasound system are powered down and stored. Virtually any equipment that can play back video can be used to play back the program. This includes a DVD player, personal computer, and some MP3 players.

Caine, Timothy↗

Wireless Augmented Reality Communication System

The system of the present invention is a highly integrated radio communication system with a multimedia co-processor which allows true two-way multimedia (video, audio, data) access as well as real-time biomedical monitoring in a pager-sized portable access unit. The system is integrated in a network structure including one or more general purpose nodes for providing a wireless-to-wired interface. The network architecture allows video, audio and data (including biomedical data) streams to be connected directly to external users and devices. The portable access units may also be mated to various non-personal devices such as cameras or environmental sensors for providing a method for setting up wireless sensor nets from which reported data may be accessed through the portable access unit. The reported data may alternatively be automatically logged at a remote computer for access and viewing through a portable access unit, including the user's own.

Devereaux, Ann↗

Wireless Augmented Reality Communication System

The system of the present invention is a highly integrated radio communication system with a multimedia co-processor which allows true two-way multimedia (video, audio, data) access as well as real-time biomedical monitoring in a pager-sized portable access unit. The system is integrated in a network structure including one or more general purpose nodes for providing a wireless-to-wired interface. The network architecture allows video, audio and data (including biomedical data) streams to be connected directly to external users and devices. The portable access units may also be mated to various non-personal devices such as cameras or environmental sensors for providing a method for setting up wireless sensor nets from which reported data may be accessed through the portable access unit. The reported data may alternatively be automatically logged at a remote computer for access and viewing through a portable access unit, including the user's own.

Devereaux, Ann↗

Wireless Augmented Reality Communication System

The system of the present invention is a highly integrated radio communication system with a multimedia co-processor which allows true two-way multimedia (video, audio, data) access as well as real-time biomedical monitoring in a pager-sized portable access unit. The system is integrated in a network structure including one or more general purpose nodes for providing a wireless-to-wired interface. The network architecture allows video, audio and data (including biomedical data) streams to be connected directly to external users and devices. The portable access units may also be mated to various non-personal devices such as cameras or environmental sensors for providing a method for setting up wireless sensor nets from which reported data may be accessed through the portable access unit. The reported data may alternatively be automatically logged at a remote computer for access and viewing through a portable access unit, including the user's own.

Devereaux, Ann↗

Autonomous Diagnostic Imaging Performed by Untrained Operators using Augmented Reality as a Form of "Just-in-Time" Training

We will address the Human Factors and Performance Team, "Risk of performance errors due to training deficiencies" by improving the JIT training materials for ultrasound and OCT imaging by providing advanced guidance in a detailed, timely, and user-friendly manner. Specifically, we will (1) develop an audio-visual tutorial using AR that guides non-experts through an abdominal trauma ultrasound protocol; (2) develop an audio-visual tutorial using AR to guide an untrained operator through the acquisition of OCT images; (3) evaluate the quality of abdominal ultrasound and OCT images acquired by untrained operators using AR guidance compared to images acquired using traditional JIT techniques (laptop-based training conducted before image acquisition); and (4) compare the time required to complete imaging studies using AR tutorials with images acquired using current JIT practices to identify areas for time efficiency improvements. Two groups of subjects will be recruited to participate in this study. Operator-subjects, without previous experience in ultrasound or OCT, will be asked to perform both procedures using either the JIT training with AR technology or the traditional JIT training via laptop. Images acquired by inexperienced operator-subjects will be scored by experts in that imaging modality for diagnostic and research quality; experts will be blinded to the form of JIT used to acquire the images. Operator-subjects also will be asked to submit feedback to improve the training modules used during the scans to improve future training modules. Scanned-subjects will be a small group individuals from whom all images will be acquired.

Martin, D. S.↗

Autonomous Diagnostic Imaging Performed by Untrained Operator Using Augmented Reality as a Form of "Just-in-Time" Training

We will address the Human Factors and Performance Team, "Risk of performance errors due to training deficiencies" by improving the JIT training materials for ultrasound and OCT imaging by providing advanced guidance in a detailed, timely, and user-friendly manner. Specifically, we will (1) develop an audio-visual tutorial using AR that guides non-experts through an abdominal trauma ultrasound protocol; (2) develop an audio-visual tutorial using AR to guide an untrained operator through the acquisition of OCT images; (3) evaluate the quality of abdominal ultrasound and OCT images acquired by untrained operators using AR guidance compared to images acquired using traditional JIT techniques (laptop-based training conducted before image acquisition); and (4) compare the time required to complete imaging studies using AR tutorials with images acquired using current JIT practices to identify areas for time efficiency improvements. Two groups of subjects will be recruited to participate in this study. Operator-subjects, without previous experience in ultrasound or OCT, will be asked to perform both procedures using either the JIT training with AR technology or the traditional JIT training via laptop. Images acquired by inexperienced operator-subjects will be scored by experts in that imaging modality for diagnostic and research quality; experts will be blinded to the form of JIT used to acquire the images. Operator-subjects also will be asked to submit feedback to improve the training modules used during the scans to improve future training modules. Scanned-subjects will be a small group individuals from whom all images will be acquired.

Martin, David S.↗

Engineering a Live UHD Program from the International Space Station

The first-ever live downlink of Ultra-High Definition (UHD) video from the International Space Station (ISS) was the highlight of a “Super Session” at the National Association of Broadcasters (NAB) Show in April 2017. Ultra-High Definition is four times the resolution of “full HD” or “1080P” video. Also referred to as “4K”, the Ultra-High Definition video downlink from the ISS all the way to the Las Vegas Convention Center required considerable planning, pushed the limits of conventional video distribution from a space-craft, and was the first use of High Efficiency Video Coding (HEVC) from a space-craft. The live event at NAB will serve as a pathfinder for more routine downlinks of UHD as well as use of HEVC for conventional HD downlinks to save bandwidth. A similar demonstration was conducted in 2006 with the Discovery Channel to demonstrate the ability to stream HDTV from the ISS. This paper will describe the overall work flow and routing of the UHD video, how audio was synchronized even though the video and audio were received many seconds apart from each other, and how the demonstration paves the way for not only more efficient video distribution from the ISS, but also serves as a pathfinder for more complex video distribution from deep space. The paper will also describe how a “live” event was staged when the UHD video coming from the ISS had a latency of 10+ seconds. In addition, the paper will touch on the unique collaboration between the inherently governmental aspects of the ISS, commercial partners Amazon and Elemental, and the National Association of Broadcasters.

Grubbs, Rodney↗

Live Ultra-High Definition from the International Space Station

The first ever live downlink of Ultra-High Definition (UHD) video from the International Space Station (ISS) was the highlight of a 'Super Session' at the National Association of Broadcasters (NAB) in April 2017. The Ultra-High Definition video downlink from the ISS all the way to the Las Vegas Convention Center required considerable planning, pushed the limits of conventional video distribution from a space-craft, and was the first use of High Efficiency Video Coding (HEVC) from a space-craft. The live event at NAB will serve as a pathfinder for more routine downlinks of UHD as well as use of HEVC for conventional HD downlinks to save bandwidth. HEVC may also enable live Virtual Reality video downlinks from the ISS. This paper will describe the overall work flow and routing of the UHD video, how audio was synchronized even though the video and audio were received many seconds apart from each other, and how the demonstration paves the way for not only more efficient video distribution from the ISS, but also serves as a pathfinder for more complex video distribution from deep space. The paper will also describe how a 'live' event was staged when the UHD coming from the ISS had a latency of 10+ seconds. Finally, the paper will discuss how NASA is leveraging commercial technologies for use on-orbit vs. creating technology as was required during the Apollo Moon Program and early space age.

Grubbs, Rodney↗

The Sun and Space Weather

Audio and video provided as separate files. • CHART 3 audio – “SrFeb022013_1954ut28.21_Ashcraft.mp3” • CHART 9 Sun video – “IA18167_304Whip_best.mpg” • CHART 15 sun animation – “Sun_Animation_Mar23A.mp4” • CHART 33 SDO plus SOHO C2 video – “X2_C2_combo.mov”

Sun↗

Bone Conduction Headphone Research and Human-in-the-Loop Test Results

The new space suit being developed for exploration EVAs on the surface of the Moon and in microgravity environments is called xEMU. A government reference model had been developed and had undergone testing. This suit contains new upgrades from the current EMU on ISS, such as integrated speakers and microphones, eliminating the need for astronauts to wear a Communications Carrier Assembly (CCA) on their head during spacewalks. However, upon testing, it was noticed that this feature causes acoustic coupling, that results in communications echo and feedback. A proposed solution to this issue is to have the astronaut wear a bone conduction headset for audio capabilities while on EVA to receive incoming voice communications from Mission Control and other EVA or IVA crew members. This would eliminate the acoustic coupling and echo effect while being more ergonomically sound than the current CCA and leave the ear open to suit ambient sound for situational awareness. A human-in-the-loop evaluation was performed, comparing five commercially available bone conduction headsets, to evaluate comfort, fit, and adjustability for long-duration wear. Five engineering test subjects with different head sizes were utilized to wear the headsets for six hours and provide succinct feedback and score the headsets on a variety of factors, to help determine which of the headsets performed the best and could advance to future bone conduction audio testing. Three of the headsets were well-received among the diverse group of subjects, and at least one of these will advance to further testing to be considered for future use under the xEMU helmet for exploration EVAs. Rating results and evaluation methods for this bone conduction headset evaluation will be presented.

Bridget M Cavanaugh↗

Enhancing Air Traffic Control Planning with Automatic Speech Recognition

The decisions made during the Federal Aviation Administration Air Traffic Control System Command Center's planning teleconferences hold significant sway over the National Airspace System. Held every two hours, these teleconferences convene air traffic managers and stakeholders from across the nation to discuss airspace conditions, weather, and constraints, leading to the formulation and adjustment of traffic management initiatives. Given the critical nature of these decisions, the need for accurate and efficient record-keeping is paramount. In recent years, the application of automatic speech recognition has gained popularity across diverse industries, including aviation. While traditional applications focus on transcribing air traffic control communication, this paper explores a unique application of automatic speech recognition by converting the audio from planning teleconferences into text transcriptions. This innovative approach addresses key challenges in the field, presenting potential benefits for quality assurance, real-time participation, and downstream natural language processing tasks. A notable breakthrough in the machine learning community, namely the transformer neural network architecture, forms the backbone of the proposed solution in this paper. The transformer architecture's role in this research represents a paradigm shift in the efficiency of automatic speech recognition models. By reducing the amount of in-domain training data required, this architecture allows for the fine-tuning of such models like Whisper, originally pretrained on vast English speech datasets. The adaptability of the transformer architecture proves invaluable in capturing the nuances of aviation terminology and specific language used in planning teleconferences. Leveraging the Whisper model as a baseline, our research details the fine-tuning and validation using a dataset comprising 20 hours of meticulously transcribed planning teleconferences. Notably, the baseline pretrained Whisper model exhibited a word error rate of 18.77%. Through the fine-tuning process, the model achieved a substantial improvement, demonstrating an impressive performance with a reduced word error rate of 6.82%. This substantial decrease in WER not only highlights the effectiveness of the transformer architecture but also emphasizes the practical advancements achieved through the application of automatic speech recognition in this specific domain. The utilization of automatic speech recognition in planning teleconferences in this work introduces several novelties. Firstly, the creation of text transcriptions offers a valuable tool for quality assurance and facilitates the efficient review of teleconferences. This is an important aspect of the proposed solution, given the time-sensitive and high-stakes nature of decisions made during these meetings. Furthermore, text-searchable transcriptions provide a streamlined approach for locating and validating critical information, potentially saving hours of manual effort in searching through audio recordings. Moreover, our research identifies a key use case for external facilities and stakeholders. In situations where attendance at the planning teleconference is not feasible, having access to text transcriptions in real-time or shortly after the teleconference ends, proves to be a time-saving and informative resource. This feature enhances collaboration and ensures that stakeholders can stay abreast of important discussions and decisions even in their absence. Despite the efficiency gains facilitated by the transformer architecture in automatic speech recognition technology, it is essential to acknowledge the human factors in data creation. Subject matter experts play a crucial role in accurately transcribing planning teleconferences due to the specificity and complexity of the information discussed. The research dataset, consisting of 20 hours of transcribed planning teleconferences, forms the foundation for fine-tuning and validating the Whisper model. The achieved word error rate of 6.82% demonstrates promising advancements, particularly in recognizing essential aviation terminology within the teleconferences. In conclusion, this paper presents a comprehensive exploration of the application of automatic speech recognition in Air Traffic Control System Command Center planning teleconferences, leveraging the transformer architecture for enhanced efficiency. The novel contributions lie in the improved accessibility of decision-making records, real-time participation opportunities for external stakeholders, and the potential for downstream natural language processing advancements. As the aviation industry continues to evolve, the integration of automatic speech recognition technologies holds the promise of revolutionizing decision-making processes and contributing to the overall safety and efficiency of air traffic management.

ATM↗

Bone Conduction Headphone Research and Testing for xEMU Communications Applications

The new space suit being developed for exploration EVAs on the surface of the Moon and in microgravity environments is referred to as xEMU. A government reference model had been developed and has undergone extensive functional and environmental testing. This suit contains new upgrades from the current EMU on ISS, such as integrated speakers and microphones, eliminating the need for astronauts to wear a Communications Carrier Assembly (CCA) on their heads during spacewalks. However, this design approach results in speaker-to-microphone acoustic coupling and communications echo and feedback. A proposed solution to this issue is to replace the integrated open speakers with an astronaut worn bone conduction headset for audio capabilities while on EVA to receive incoming voice communications from Mission Control and other EVA or IVA crew members. This would eliminate the acoustic coupling and echo effect while being more ergonomically sound than the current CCA and leave the ear open to suit-ambient sound for situational awareness. A human-in-the-loop evaluation was performed, comparing five commercially available bone conduction headsets, to evaluate comfort, fit, and adjustability for long-duration wear. Five engineering test subjects with different head sizes were utilized to wear the headsets for six hours and provide succinct feedback and score the headsets on a variety of factors, to help determine which of the headsets performed the best and could advance to future bone conduction audio testing. Three of the headsets were well-received among the diverse group of subjects, and at least one of these will advance to further testing to be considered for future use under the xEMU helmet for exploration EVAs. Rating results and evaluation methods for this bone conduction headset evaluation will be presented.

Bridget Cavanaugh↗