Search NASA⌕ Search

SEARCH · Search NASA

Results for “Speech”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 307 records · Page 17
All sourcesNASA NTRSDOE OSTI
NASA NTRS2015

Collaborating with Autonomous Agents

With the anticipated increase of small unmanned aircraft systems (sUAS) entering into the National Airspace System, it is highly likely that vehicle operators will be teaming with fleets of small autonomous vehicles. The small vehicles may consist of sUAS, which are 55 pounds or less that typically will y at altitudes 400 feet and below, and small ground vehicles typically operating in buildings or defined small campuses. Typically, the vehicle operators are not concerned with manual control of the vehicle; instead they are concerned with the overall mission. In order for this vision of high-level mission operators working with fleets of vehicles to come to fruition, many human factors related challenges must be investigated and solved. First, the interface between the human operator and the autonomous agent must be at a level that the operator needs and the agents can understand. This paper details the natural language human factors e orts that NASA Langley's Autonomy Incubator is focusing on. In particular these e orts focus on allowing the operator to interact with the system using speech and gestures rather than a mouse and keyboard. With this ability of the system to understand both speech and gestures, operators not familiar with the vehicle dynamics will be able to easily plan, initiate, and change missions using a language familiar to them rather than having to learn and converse in the vehicle's language. This will foster better teaming between the operator and the autonomous agent which will help lower workload, increase situation awareness, and improve performance of the system as a whole.

Trujillo, Anna C.↗
NASA NTRS2016

Using Natural Language to Enhance Mission Effectiveness

The availability of highly capable, yet relatively cheap, unmanned aerial vehicles (UAVs) is opening up new areas of use for hobbyists and for professional-related activities. The driving function of this research is allowing a non-UAV pilot, an operator, to define and manage a mission. This paper describes the preliminary usability measures of an interface that allows an operator to define the mission using speech to make inputs. An experiment was conducted to begin to enumerate the efficacy and user acceptance of using voice commands to define a multi-UAV mission and to provide high-level vehicle control commands such as "takeoff." The primary independent variable was input type - voice or mouse. The primary dependent variables consisted of the correctness of the mission parameter inputs and the time needed to make all inputs. Other dependent variables included NASA-TLX workload ratings and subjective ratings on a final questionnaire. The experiment required each subject to fill in an online form that contained comparable required information that would be needed for a package dispatcher to deliver packages. For each run, subjects typed in a simple numeric code for the package code. They then defined the initial starting position, the delivery location, and the return location using either pull-down menus or voice input. Voice input was accomplished using CMU Sphinx4-5prealpha for speech recognition. They then inputted the length of the package. These were the option fields. The subject had the system "Calculate Trajectory" and then "Takeoff" once the trajectory was calculated. Later, the subject used "Land" to finish the run. After the voice and mouse input blocked runs, subjects completed a NASA-TLX. At the conclusion of all runs, subjects completed a questionnaire asking them about their experience in inputting the mission parameters, and starting and stopping the mission using mouse and voice input. In general, the usability of voice commands is acceptable. With a relatively well-defined and simple vocabulary, the operator can input the vast majority of the mission parameters using simple, intuitive voice commands. However, voice input may be more applicable to initial mission specification rather than for critical commands such as the need to land immediately due to time and feedback constraints. It would also be convenient to retrieve relevant mission information using voice input. Therefore, further on-going research is looking at using intent from operator utterances to provide the relevant mission information to the operator. The information displayed will be inferred from the operator's utterances just before key phrases are spoken. Linguistic analysis of the context of verbal communication provides insight into the intended meaning of commonly heard phrases such as "What's it doing now?" Analyzing the semantic sphere surrounding these common phrases enables us to predict the operator's intent and supply the operator's desired information to the interface. This paper also describes preliminary investigations into the generation of the semantic space of UAV operation and the success at providing information to the interface based on the operator's utterances.

Trujillo, Anna C.↗
NASA NTRS2017

Creative Analytics of Mission Ops Event Messages

Historically, tremendous effort has been put into processing and displaying mission health and safety telemetry data; and relatively little attention has been paid to extracting information from missions time-tagged event log messages. Todays missions may log tens of thousands of messages per day and the numbers are expected to dramatically increase as satellite fleets and constellations are launched, as security monitoring continues to evolve, and as the overall complexity of ground system operations increases. The logs may contain information about orbital events, scheduled and actual observations, device status and anomalies, when operators were logged on, when commands were resent, when there were data drop outs or system failures, and much much more. When dealing with distributed space missions or operational fleets, it becomes even more important to systematically analyze this data. Several advanced information systems technologies make it appropriate to now develop analytic capabilities which can increase mission situational awareness, reduce mission risk, enable better event-driven automation and cross-mission collaborations, and lead to improved operations strategies: Industry Standard for Log Messages. The Object Management Group (OMG) Space Domain Task Force (SDTF) standards organization is in the process of creating a formal standard for industry for event log messages. The format is based on work at NASA GSFC. Open System Architectures. The DoD, NASA, and others are moving towards common open system architectures for mission ground data systems based on work at NASA GSFC with the full support of the commercial product industry and major integration contractors. Text Analytics. A specific area of data analytics which applies statistical, linguistic, and structural techniques to extract and classify information from textual sources. This presentation describes work now underway at NASA to increase situational awareness through the collection of non-telemetry mission operations information into a common log format and then providing display and analytics tools to provide in-depth assessment of the log contents. The work includes: Common interface formats for acquiring time-tagged text messages Conversion of common files for schedules, orbital events, and stored commands to the common log format Innovative displays to depict thousands of messages on a single display Structured English text queries against the log message data store, extensible to a more mature natural language query capability Goal of speech-to-text and text-to-speech additions to create a personal mission operations assistant to aid on-console operations. A wide variety of planned uses identified by the mission operations teams will be discussed.

events↗
NASA NTRS2018

NASA: 60 Years and Counting...

Sputnik launched on 4 Oct 1057. On July 29, 1958, Eisenhower signed the National Aeronautics and Space Act, the creation of NASA. The Soviets launched the first human into orbit, Yuri Gagarin, on April 12, 1961. On 5 May 1961, Alan Shepard's Freedom 7 Mercury capsule lifted off at 9:34 a.m. from Launch Complex 5 at Cape Canaveral Air Force Station, and flew a suborbital trajectory lasting 15 minutes and 22 seconds, America's first man in space. On 25 May 1961, Kennedy delivered a speech to a joint session of Congress. In that speech, he stated "I believe that this nation should commit itself to achieving the goal, before this decade is out, of landing a man on the moon and returning him safely to the earth." The rest, as they say, is history. Project Mercury, the first U.S. program to put humans in space, made 25 flights, six of which carried astronauts between 1961 and 1963. The Gemini program primarily tested equipment and mission procedures and trained astronauts and ground crews for future Apollo missions to the Moon. Exactly eight years, one month and 26 days after President Kennedy challenged Americans to reach for the Moon, Project Apollo landed the first humans on the lunar surface and returned them safely to Earth. In 1973, Skylab expeditions paved the way for the International Space Station. Over 30 years, NASA's space shuttle fleet, ”Columbia, Challenger, Discovery, Atlantis and Endeavour,” flew 135 missions and carried 355 different people to space. The space shuttle carried people into orbit repeatedly; launched, recovered and repaired satellites; conducted cutting-edge research; and built the largest structure in space, the International Space Station. Tragically, NASA lost two crews of seven in the 1986 Challenger accident and the 2003 Columbia accident. The International Space Station is a model for global cooperation and scientific advancements that is enabling growth of private industry in low-Earth orbit and development of new technologies to advance human space exploration. Built between 1998 and 2011, the space station has housed humans continuously since Nov. 2, 2000. NASA has contracted with commercial companies SpaceX, Orbital ATK, and Sierra Nevada Corporation to deliver science investigations, cargo, and supplies to the crews living in space, and soon Boeing and SpaceX will transport astronauts to and from the station. Today, NASA is working on many fronts to advance man's presence in space. NASA's Exploration Campaign will establish U.S. preeminence in cislunar space through the operations and the deployment of a U.S.-led Lunar Orbital Platform-Gateway (LOPG). Together with the Orion and SLS Programs, the LOPG is central to advancing and sustaining human space exploration goals, and is the unifying single stepping off point for human cislunar operations, lunar surface access and missions to Mars. As one might expect, EMC for all this activity is challenging, to say the least. In the next half-hour or so, I will talk about some of those challenges and how the different programs are meeting them.

Scully, Bob↗
NASA NTRS2018

Space Resources and Mining: Current Objectives, Plans, and Missions

Why are Space Resources and Their Use Important? There are many reasons why people and nations want to explore space, and there are many different ways in which space can be explored. A critical interface linking both the ‘why’ and the ‘how’ of space exploration is the identification, extraction, and use of resources in space. In both NASA’s Journey to Mars: Pioneering Next Steps in Space Exploration released in October of 2015 and the Global Exploration Roadmap released in August 2013, the ability to find, quantify, extract, process, and use space resources was identified as a critical objective by NASA and over 14 other space agencies for achieving affordable and sustainable human exploration beyond Earth’s orbit, encouraging and creating new commercial entities and markets based on space activities, and increasing the terrestrial economy and quality-of-life benefits for all humankind. Robotic and especially human space exploration up to this point in time can be considered to be ‘Earth reliant’ in that everything needed to support and enable the mission is launched from Earth. The past Apollo missions to the Moon and the International Space Station currently in orbit above the Earth all rely on hardware, habitats, power, transportation, and life support consumables sent from Earth to keep the crew alive and working. As the distance from Earth increases, the cost of transportation and the risks due to failures and logistics disruptions also increases. By using resources found at the site of exploration to make mission critical consumables (such as propellants, fuel cell reactants and life support commodities), spare parts, and infrastructure needed to support surface activities (such as landing pads, roads, habitats/shelters, and power/thermal systems) commonly referred to as In Situ Resource Utilization, a significant amount of launch mass and cost can be saved and risk reduced. The ability to do these things also changes how exploration is performed from Earth Reliant to NASA’s goal of ‘Earth Independent’ exploration. After the US Apollo program was over, people began to recognize that it had been an inspiration for a generation of young students to go into Science, Technology, Engineering and Math (STEM) fields, and that the US industry and economy had significantly grown and lived off these students and the technological advances made to achieve these missions for decades. Space exploration should no longer be focused solely on scientific advancement or national pride, but for economic growth and population standard of living advancement. Considering the economic value of human exploration and how it could expand the economy of the US was brought to full light in a speech by John Marburger, the director of US Office of Science and Technology Policy under George W Bush at the Goddard Symposium in 2006. In his speech he highlighted that the ultimate goal was not to just Explore space but to Use space for the benefit of mankind. He further stated that the use of off-planet resources, in this case from the Moon, should be a critical architectural consideration for human space exploration to make it more affordable and sustainable. This could be achieved in two ways. The first is to start by encouraging and commercializing the extraction and production of transportation and life support related products from space resources, which could than lead to other resource uses once an affordable transportation architecture is established. The second is to encourage the spin-in of terrestrial technologies into space applications and spin-off of space technologies into terrestrial applications to increase the efficiency and profitability of terrestrial industries.

Sanders, Gerald B.↗
NASA NTRSDate not supplied

Exploring Multimodal Interactions in Human-Autonomy Teaming Using a Natural User Interface

The creation of a multimodal, natural user interface to facilitate multi-agent interaction is essential to establishing trust among human and machine teammates in multi-agent systems. Trust is being researched, along with trustworthiness, as a path to certification of autonomous systems by the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project at NASA. The Autonomous Mission Experimental Logistics Interactive Assistant (AMELIA) is a natural user interface that enables multimodal interaction and is designed for rapid mission planning. AMELIA is an intelligent system that considers the user’s preferred communication strategies, as well as the time-critical aspect of the multi-agent system decision-making process. Twenty-four participants planned a multi-agent search and rescue mission, with the aid of an intelligent assistant. The results show that while the combined use of touch and speech was faster than speech alone, the single modality, touch, was still the most efficient. Future research should investigate additional input technologies.

Lisa R Le Vie↗
NASA NTRSDate not supplied

Exploring Multimodal Interactions in Human-Autonomy Teaming Using a Natural User Interface

The creation of a multimodal, natural user interface to facilitate multi-agent interaction is essential to establishing trust among human and machine teammates in multi-agent systems. Trust is being researched, along with trustworthiness, as a path to certification of autonomous systems by the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project at NASA. The Autonomous Mission Experimental Logistics Interactive Assistant (AMELIA) is a natural user interface that enables multimodal interaction and is designed for rapid mission planning. AMELIA is an intelligent system that considers the user’s preferred communication strategies, as well as the time-critical aspect of the multi-agent system decision-making process. Twenty-four participants planned a multi-agent search and rescue mission, with the aid of an intelligent assistant. The results show that while the combined use of touch and speech was faster than speech alone, the single modality, touch, was still the most efficient. Future research should investigate additional input technologies.

Lisa Renee Le Vie↗
NASA NTRSDate not supplied

Applying NASA’s Human Systems Integration Methodology in Implementing Voice-Control of Future Spacecraft Systems

Through the NASA Artemis program, a new era of space exploration will serve to lead humanity towards sustained lunar exploration in preparation for the next giant leap-human exploration of Mars. These crewed spacecraft and habitats will require more automation and autonomy to support these complex missions. Crew size will be small and therefore a more efficient command and control input method is desired. Speech recognition along with visual or auditory feedback is an alternative, providing an extra pair of hands and eyes for the crew. Yet, speech recognition demands a highly integrated development approach to ensure a successful system implementation. To ensure the voice control application is developed correctly will require a Human Systems Integration (HSI) approach. This paper provides an insight into the development of a speech/voice control application for a spacecraft system that encompasses automation and autonomy through an HSI approach. Results of the voice control experiment of the Space Shuttle camera system are provided as lessons learned about using voice control on a spacecraft. Limitations and challenges of the technology are addressed as well as how HSI along with Human Readiness Level can help successfully develop voice control command and control systems.

Systems Engineering↗
NASA NTRSDate not supplied

Inverse Text Normalization of Air Traffic Control System Command Center Planning Telecon Transcriptions

We present a hybrid neural network and rule-based Inverse Text Normalization (ITN) method for domains containing unique technical phraseology, specifically ATCSCC planning telecon audio transcriptions. The Air Traffic Control System Command Center (ATCSCC) hosts bihourly planning telephone conferences (or planning telecons) to ensure smooth operations within the National Airspace (NAS). Access to both live and post meeting transcripts of this speech audio would enable quick review of meetings. ITN is the process of converting un-formatted "raw'' speech-to-text transcripts into a human (expert) readable written form. Our hybrid ITN framework utilizes a neural network to format conversational English, and rule-based methods to format domain-specific aviation text. With a preliminary overall Word Error Rate with Punctuation and Capitalization (WER PC) of 8.26, we show that this method has vast potential in being applied to ATCSCC planning telecon audio and other audio/text based data available in ATM.

Air Traffic Management↗
NASA NTRSDate not supplied

Inverse Text Normalization of Air Traffic Control System Command Center Planning Telecon Transcriptions

We present a hybrid neural network and rule-based Inverse Text Normalization (ITN) method for domains containing unique technical phraseology, specifically Air Traffic Control System Command Center (ATCSCC) planning telecon audio transcriptions. The ATCSCC hosts bi-hourly planning telephone conferences (or planning telecons) to ensure smooth operations within the National Airspace (NAS). Access to both live and post meeting transcripts of this speech audio would enable quick review of meetings. Provided speech transcripts, ITN is the process of converting unformatted raw Automated Speaker Recognition (ASR) model transcripts into a human (expert) readable written form. Our hybrid ITN framework utilizes a fine-tuned Bidirectional Encoder Representations from Transformers neural network to format conversational English, and rule-based methods to format domain-specific aviation text. With an overall Punctuation Error Rate (PER) of 25.56 and Word Error Rate with Punctuation and Capitalization (WER PC) of 5.47, we show that this method has vast potential in being applied to ATCSCC planning telecon audio and other audio/text based data available in ATM.

ATM↗
NASA NTRSDate not supplied

Inverse Text Normalization of Air Traffic Control System Command Center Planning Telecon Transcriptions

We present a hybrid neural network and rule-based Inverse Text Normalization (ITN) method for domains containing unique technical phraseology, specifically Air Traffic Control System Command Center (ATCSCC) planning telecon audio transcriptions. The ATCSCC hosts bi-hourly planning telephone conferences (or planning telecons) to ensure smooth operations within the National Airspace (NAS). Access to both live and post meeting transcripts of this speech audio would enable quick review of meetings. Provided speech transcripts, ITN is the process of converting unformatted raw Automated Speaker Recognition (ASR) model transcripts into a human (expert) readable written form. Our hybrid ITN framework utilizes a fine-tuned Bidirectional Encoder Representations from Transformers neural network to format conversational English, and rule-based methods to format domain-specific aviation text. With an overall Punctuation Error Rate (PER) of 25.56 and Word Error Rate with Punctuation and Capitalization (WER PC) of 5.47, we show that this method has vast potential in being applied to ATCSCC planning telecon audio and other audio/text based data available in ATM.

ATM↗
DOE OSTI2022

SplitML

SplitML (Signal Processing Library for Interference rejecTion by Machine Learning) is a code repository for a set of tools for interference rejection in complex time-domain signals. The goal of the tools is to provide machine learning modeling capabilities for rejecting interference. Recent related machine learning algorithms for signal processing have focused mostly on speech enhancement or multi-speaker speech separation; the tools in SplitML will extend these innovations to generic time-domain signals of interest. SplitML includes tools for generating synthetic noisy signals, code for customized machine learning models applicable to interference rejection, and tools for evaluating such algorithms against standard signal processing techniques. These components are written in Python, a high-level programming language that takes advantage of the Python ecosystem of high-quality open-source packages for machine learning and signal processing.

Klein, Natalie↗
DOE OSTI2021

Behavior Change in Response to Subreddit Bans and External Events

As more people flock to social media to connect with others to form virtual communities, it is important to understand how members of these groups interact to understand human behavior on the Web. In response to the rise in hate speech, harassment and other antisocial behavior many social media companies have implemented different content and user moderation policies. On Reddit, for example, communities, \ie, subreddits, are occasionally banned for violating these policies. We study the effect of these regulatory actions as well as when a community experiences a significant external event like an election or a market crash. Overall, we find that subreddit bans prompt a small, but statistically significant, number of active users to leave the platform or change their posting behavior; the effect of external events varies with the type of event. We conclude with a discussion on the effectiveness of the bans and wider implications for the online content moderation.

60 APPLIED LIFE SCIENCES↗
NASA NTRS1998

Virtual acoustics, aeronautics, and communications

An optimal approach to auditory display design for commercial aircraft would utilize both spatialized (3-D) audio techniques and active noise cancellation for safer operations. Results from several aircraft simulator studies conducted at NASA Ames Research Center are reviewed, including Traffic alert and Collision Avoidance System (TCAS) warnings, spoken orientation "beacons" for gate identification and collision avoidance on the ground, and hardware for improved speech intelligibility. The implications of hearing loss among pilots is also considered.

NASA Center ARC↗
DOE OSTI2025

Elastomeric Nanocomposite with Solvent‐Free, One Step, In Situ Shear Exfoliation of Graphite to Graphene

A graphene nanoflake (GNF)‐enhanced elastomeric nanocomposite (G‐EMC) is fabricated following an innovative, cost‐effective, single‐step, in situ shear exfoliation (ISE) method from low‐cost bulk material, graphite, where uniform mixing happens simultaneously within the elastomer matrix. Electron microscopy, atomic force microscopy, and photo‐induced force microscopy results show good dispersion of GNFs with exfoliation to a few layers and uniform distribution in the elastomer matrix. X‐ray photoelectron spectroscopy analysis shows less than 1% oxygen‐containing functional groups/impurity, enhanced bonding through the formation of edge sites as fracture occurs across the GNF basal plane, and pi‐pi interactions with newly exfoliated planar basal plane surfaces of the GNFs. Raman spectroscopy results confirm the formation of GNFs with only a few layers of graphene formed by the ISE process. Fabricated 10 wt.% G‐EMC nanocomposites show a 400%–500% increase in strength and fracture toughness. And 35 wt.% G‐EMCs provide an electrical conductivity of 25.64 S m −1 and a sensor gauge factor of 45. The resulting intrinsic piezo resistivity of the fabricated nanocomposite has been exploited to fabricate a multi‐functional wired and wireless sensor for detecting different body movements, speech, human vital functions, solvents, and biomolecules.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Deep Generative Models in Energy System Applications: Review, Challenges, and Future Directions

In recent years, with the advent of mature machine learning products like ChatGPT, Stable Diffusion, and Sora, the world has witnessed tremendous changes driven by the rapid development of generative artificial intelligence (GAI). Beyond applications in text, speech, image, and video creation, deep generative models (DGMs) underpinning these cutting-edge technologies have also been employed by domain researchers to address scientific and engineering challenges. This paper aims to fill a gap in the research community by providing a systematic review of how DGMs have been utilized in energy system applications. After introducing four most popular DGMs, we review and categorize 196 research articles into five focus areas: data generation, forecasting, situational awareness, modeling, and optimal decision-making. Through this classification, we uncover trends in how DGMs are employed for each type of problem, highlighting GAI techniques that contribute to breakthroughs over traditional methods. We discuss limitations in existing literature, engineering challenges, and propose future directions, all tailored to the unique nature of problems in energy system engineering. Our goal is to offer insights for energy system domain researchers, providing a comprehensive view of existing studies and potential future opportunities.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗