Search NASA⌕ Search

SEARCH · Search NASA

Results for “human activity recognition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Efficient human activity recognition with spatio-temporal spiking neural networks

In this study, we explore Human Activity Recognition (HAR), a task that aims to predict individuals' daily activities utilizing time series data obtained from wearable sensors for health-related applications. Although recent research has predominantly employed end-to-end Artificial Neural Networks (ANNs) for feature extraction and classification in HAR, these approaches impose a substantial computational load on wearable devices and exhibit limitations in temporal feature extraction due to their activation functions. To address these challenges, we propose the application of Spiking Neural Networks (SNNs), an architecture inspired by the characteristics of biological neurons, to HAR tasks. SNNs accumulate input activation as presynaptic potential charges and generate a binary spike upon surpassing a predetermined threshold. This unique property facilitates spatio-temporal feature extraction and confers the advantage of low-power computation attributable to binary spikes. We conduct rigorous experiments on three distinct HAR datasets using SNNs, demonstrating that our approach attains competitive or superior performance relative to ANNs, while concurrently reducing energy consumption by up to 94%.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Robustness of topological persistence in knowledge distillation for wearable sensor data

Topological data analysis (TDA) has shown great success in various applications involving wearable sensor data. However, there are difficulties in leveraging topological features in machine learning and wearable sensors because of the large time consumption and computational resources required to extract the features. To address this problem, knowledge distillation (KD) is utilized to generate a small model and accommodate topological features with persistence image (PI) representations from the raw time series data. Deploying topological knowledge in KD enables the student to achieve better performance compared to the one trained solely on raw time series data. However, it is not yet known if there are coherent characteristics for topological features in PI, which can aid in improving the performance during KD. In this paper, we investigate the suitability and challenges of utilizing topological features in KD for wearable sensor data, thereby contributing to the advancement of the field. Our study explores the impact of transferred topological features by comparing the Teacher-to-Student framework with Multiple Teachers-to-Student where teachers utilize both time series data and persistence images obtained by TDA as inputs. Additionally, we conduct a rigorous examination of topological knowledge effects by testing under various corruptions, knowledge types, and learning strategies in the context of human activity recognition tasks. Our analysis of topological features in KD presents the optimal strategy for incorporating these features. This study includes datasets of varying scales, window lengths, and activity classes, providing a comprehensive evaluation. Our results demonstrate that leveraging topological features in KD to enhance performance across databases.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

The HHV-6B U20 glycoprotein binds ULBP1, masking it from recognition by NKG2D and interfering with natural killer cell activation

Human Herpesvirus 6B (HHV-6B) impedes host immune responses by downregulating class I MHC molecules (MHC-I), hindering antigen presentation to CD8+ T cells. Downregulation of MHC-I disengages inhibitory receptors on natural killer (NK) cells, resulting in activation and killing of the target cell if NK cell activating receptors such as NKG2D have engaged stress ligands upregulated on the target cells. Previous work has shown that HHV-6B downregulates three MHC-like stress ligands MICB, ULBP1, and ULBP3, which are recognized by NKG2D. The U20 glycoprotein of the related virus HHV-6A has been implicated in the downregulation of ULBP1, but the precise mechanism remains undetermined. We set out to investigate the role of HHV-6B U20 in modulating NK cell activity. We used HHV-6B U20 expressed as a recombinant protein or transduced into target cells, as well as HHV-6B infection, to investigate binding interactions with NK cell ligands and receptors and to assess effects on NK cell activation. Small-angle X-ray scattering was used to align molecular models derived from machine-learning approaches. We demonstrate that U20 binds directly to ULBP1 with sub-micromolar affinity. Transduction of U20 decreases NKG2D binding to ULBP1 at the cell surface but does not decrease ULBP1 protein levels, either at the cell surface or in toto. HHV-6B infection and soluble U20 have the same effect. Transduction of U20 blocks NK cell activation in response to cell-surface ULBP1. Structural modeling of the U20 – ULBP1 complex indicates some similarities to the m152-RAE1γ complex.

60 APPLIED LIFE SCIENCES↗
NASA NTRSDate not supplied

Lunar Mining and Processing: Considerations for Responsible Space Mining & Connections to Terrestrial Mining

The National Aeronautics and Space Administration (NASA) of the United States of America (US) has initiated the Artemis Moon to Mars program to send astronauts (the first woman and person of color) back to the lunar surface, create a sustainable human lunar exploration program, and lead the first human exploration mission to the Mars surface in the late 2030’s [1]. Besides reinvigorating human exploration beyond low Earth orbit not seen since the Apollo program and enabling new scientific activities and discoveries, a major objective of this program is to characterize the resources that exist on the Moon and Mars, and learn how to utilize them for human exploration and the commercialization of cis-lunar space. Commonly known as In Situ Resource Utilization (ISRU), the search for, acquisition, and processing of resources in space has the potential to greatly reduce the dependency on transporting mission consumables and infrastructure from Earth, thereby reducing mission costs, risks, and dependency on Earth. With the launch of Artemis I in November 2022 and the anticipation of several robotic missions to the Moon under the Commercial Lunar Payload Services (CLPS) program, greater recognition and excitement about NASA’s Artemis program and lunar exploration activities is growing in the public. With the recognition that past statements and concept videos of human exploration of the Moon are actually becoming real, there is also a growing awareness of the possible positive and negative consequences and impacts these exploration activities may have on the Moon and Mars. On the positive side, the development of ISRU and lunar mining and processing can enable and grow lunar surface exploration and cis-lunar commercial activities, as well as provide benefits to terrestrial industries through spin-in and spin-back of advanced technologies and autonomous operations. On the negative side, there is a perception that space mining will impact the lunar surface and environment negatively for science, and that cultural beliefs about the Moon need to be addressed and considered before these operations occur. This paper will begin to explore the potential driving attributes and guidelines that will address how best to maximize the lessons and connections to terrestrial mining to reduce the risk and cost of lunar ISRU and space commercial activities, enhance efforts to achieve the terrestrial ‘mine of the future’, and provide viable markets for space-derived technologies until commercial space mining is established. This paper will also begin to explore the potential driving attributes and guidelines that could address how to minimize the environmental and surface impacts of lunar ISRU and foster ‘responsible’ space mining that can be implemented until more official agreements and treaties are signed. The existing robust mining regulations adopted globally will be used as a basis for this examination and suggestions will be presented to adopt these agreements for use in space mining.

ISRU↗
NASA NTRS2010

Speech Acquisition and Automatic Speech Recognition for Integrated Spacesuit Audio Systems

A voice-command human-machine interface system has been developed for spacesuit extravehicular activity (EVA) missions. A multichannel acoustic signal processing method has been created for distant speech acquisition in noisy and reverberant environments. This technology reduces noise by exploiting differences in the statistical nature of signal (i.e., speech) and noise that exists in the spatial and temporal domains. As a result, the automatic speech recognition (ASR) accuracy can be improved to the level at which crewmembers would find the speech interface useful. The developed speech human/machine interface will enable both crewmember usability and operational efficiency. It can enjoy a fast rate of data/text entry, small overall size, and can be lightweight. In addition, this design will free the hands and eyes of a suited crewmember. The system components and steps include beam forming/multi-channel noise reduction, single-channel noise reduction, speech feature extraction, feature transformation and normalization, feature compression, model adaption, ASR HMM (Hidden Markov Model) training, and ASR decoding. A state-of-the-art phoneme recognizer can obtain an accuracy rate of 65 percent when the training and testing data are free of noise. When it is used in spacesuits, the rate drops to about 33 percent. With the developed microphone array speech-processing technologies, the performance is improved and the phoneme recognition accuracy rate rises to 44 percent. The recognizer can be further improved by combining the microphone array and HMM model adaptation techniques and using speech samples collected from inside spacesuits. In addition, arithmetic complexity models for the major HMMbased ASR components were developed. They can help real-time ASR system designers select proper tasks when in the face of constraints in computational resources.

Huang, Yiteng↗
NASA NTRS1993

Monitoring issues from a modeling perspective

Recognition that earth's climate and biogeophysical conditions are likely changing due to human activities has led to a heightened awareness of the need for improved long-term global monitoring. The present long-term measurement efforts tend to be spotty in space, inadequately calibrated in time, and internally inconsistent with respect to other instruments and measured quantities. In some cases, such as most of the biosphere, most chemicals, and much of the ocean, even a minimal monitoring program is not available. Recently, it has become painfully evident that emerging global change issues demand information and insights that the present global monitoring system simply cannot supply. This is because a monitoring system must provide much more than a statement of change at a given level of statistical confidence. It must describe changes in diverse parts of the entire earth system on regional to global scales. It must be able to provide enough input to allow an integrated physical characterization of the changes that have occurred. Finally, it must allow a separation of the observed changes into their natural and anthropogenic parts. The enormous policy significance of global change virtually guarantees an unprecedented level of scrutiny of the changes in the earth system and why they are happening. These pressures create a number of emerging challenges and opportunities. For example, they will require a growing partnership between the observational programs and the theory/modeling community. Without this partnership, the scientific community will likely fall short in the monitoring effort. The monitoring challenge before us is not to solve the problem now, but rather to set appropriate actions in motion so as to create the required framework for solution. Each individual piece needs to establish its role in the large problem and how the required interactions are to take place. Below, we emphasize some of the needs and opportunities that could and should be addressed through participation by the theoreticians and modelers in the global change monitoring effort.

Mahlman, Jerry D.↗
NASA NTRS2015

Automatic Speech Acquisition and Recognition for Spacesuit Audio Systems

NASA has a widely recognized but unmet need for novel human-machine interface technologies that can facilitate communication during astronaut extravehicular activities (EVAs), when loud noises and strong reverberations inside spacesuits make communication challenging. WeVoice, Inc., has developed a multichannel signal-processing method for speech acquisition in noisy and reverberant environments that enables automatic speech recognition (ASR) technology inside spacesuits. The technology reduces noise by exploiting differences between the statistical nature of signals (i.e., speech) and noise that exists in the spatial and temporal domains. As a result, ASR accuracy can be improved to the level at which crewmembers will find the speech interface useful. System components and features include beam forming/multichannel noise reduction, single-channel noise reduction, speech feature extraction, feature transformation and normalization, feature compression, and ASR decoding. Arithmetic complexity models were developed and will help designers of real-time ASR systems select proper tasks when confronted with constraints in computational resources. In Phase I of the project, WeVoice validated the technology. The company further refined the technology in Phase II and developed a prototype for testing and use by suited astronauts.

Ye, Sherry↗
NASA NTRS1996

Long-term modifications of synaptic efficacy in the human inferior and middle temporal cortex

The primate temporal cortex has been demonstrated to play an important role in visual memory and pattern recognition. It is of particular interest to investigate whether activity-dependent modification of synaptic efficacy, a presumptive mechanism for learning and memory, is present in this cortical region. Here we address this issue by examining the induction of synaptic plasticity in surgically resected human inferior and middle temporal cortex. The results show that synaptic strength in the human temporal cortex could undergo bidirectional modifications, depending on the pattern of conditioning stimulation. High frequency stimulation (100 or 40 Hz) in layer IV induced long-term potentiation (LTP) of both intracellular excitatory postsynaptic potentials and evoked field potentials in layers II/III. The LTP induced by 100 Hz tetanus was blocked by 50-100 microM DL-2-amino-5-phosphonovaleric acid, suggesting that N-methyl-D-aspartate receptors were responsible for its induction. Long-term depression (LTD) was elicited by prolonged low frequency stimulation (1 Hz, 15 min). It was reduced, but not completely blocked, by DL-2-amino-5-phosphonovaleric acid, implying that some other mechanisms in addition to N-methyl-DL-aspartate receptors were involved in LTD induction. LTD was input-specific, i.e., low frequency stimulation of one pathway produced LTD of synaptic transmission in that pathway only. Finally, the LTP and LTD could reverse each other, suggesting that they can act cooperatively to modify the functional state of cortical network. These results suggest that LTP and LTD are possible mechanisms for the visual memory and pattern recognition functions performed in the human temporal cortex.

NASA Discipline Neuroscience↗
NASA NTRS2001

Multimodal Neuroelectric Interface Development

This project aims to improve performance of NASA missions by developing multimodal neuroelectric technologies for augmented human-system interaction. Neuroelectric technologies will add completely new modes of interaction that operate in parallel with keyboards, speech, or other manual controls, thereby increasing the bandwidth of human-system interaction. We recently demonstrated the feasibility of real-time electromyographic (EMG) pattern recognition for a direct neuroelectric human-computer interface. We recorded EMG signals from an elastic sleeve with dry electrodes, while a human subject performed a range of discrete gestures. A machine-teaming algorithm was trained to recognize the EMG patterns associated with the gestures and map them to control signals. Successful applications now include piloting two Class 4 aircraft simulations (F-15 and 757) and entering data with a "virtual" numeric keyboard. Current research focuses on on-line adaptation of EMG sensing and processing and recognition of continuous gestures. We are also extending this on-line pattern recognition methodology to electroencephalographic (EEG) signals. This will allow us to bypass muscle activity and draw control signals directly from the human brain. Our system can reliably detect P-rhythm (a periodic EEG signal from motor cortex in the 10 Hz range) with a lightweight headset containing saline-soaked sponge electrodes. The data show that EEG p-rhythm can be modulated by real and imaginary motions. Current research focuses on using biofeedback to train of human subjects to modulate EEG rhythms on demand, and to examine interactions of EEG-based control with EMG-based and manual control. Viewgraphs on these neuroelectric technologies are also included.

Trejo, Leonard J.↗
NASA NTRS2003

Multimodal neuroelectric interface development

We are developing electromyographic and electroencephalographic methods, which draw control signals for human-computer interfaces from the human nervous system. We have made progress in four areas: 1) real-time pattern recognition algorithms for decoding sequences of forearm muscle activity associated with control gestures; 2) signal-processing strategies for computer interfaces using electroencephalogram (EEG) signals; 3) a flexible computation framework for neuroelectric interface research; and d) noncontact sensors, which measure electromyogram or EEG signals without resistive contact to the body.

Evaluation Studies↗
DOE OSTI2023

Template and target-site recognition by human LINE-1 in retrotransposition

The long interspersed element-1 (LINE-1, hereafter L1) retrotransposon has generated nearly one-third of the human genome and serves as an active source of genetic diversity and human disease. L1 spreads through a mechanism termed target-primed reverse transcription, in which the encoded enzyme (ORF2p) nicks the target DNA to prime reverse transcription of its own or non-self RNAs. Here we purified full-length L1 ORF2p and biochemically reconstituted robust target-primed reverse transcription with template RNA and target-site DNA. We report cryo-electron microscopy structures of the complete human L1 ORF2p bound to structured template RNAs and initiating cDNA synthesis. The template polyadenosine tract is recognized in a sequence-specific manner by five distinct domains. Among them, an RNA-binding domain bends the template backbone to allow engagement of an RNA hairpin stem with the L1 ORF2p C-terminal segment. Moreover, structure and biochemical reconstitutions demonstrate an unexpected target-site requirement: L1 ORF2p relies on upstream single-stranded DNA to position the adjacent duplex in the endonuclease active site for nicking of the longer DNA strand, with a single nick generating a staggered DNA break. Our research provides insights into the mechanism of ongoing transposition in the human genome and informs the engineering of retrotransposon proteins for gene therapy.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS1988

A simulation system for Space Station extravehicular activity

A simulation program has been developed which addresses the human factors required to provide a crewmember with productive information during Space Station EVA. The operation of the voice recognition and control system and helmet-mounted projection display in the Space Station Extravehicular Mobility Unit (EMU) is reviewed. The features of the simulation program are discussed, including logic flow, information types, and the man-machine interface techniques used in the simulation program, voice recognizer, and helmet-mounted display.

Marmolejo, Jose A.↗
NASA NTRS2004

NASA Johnson Space Center Usability Testing and Analysis Facility (UTAF) Overview

The Usability Testing and Analysis Facility (UTAF) is part of the Space Human Factors Laboratory at the NASA Johnson Space Center in Houston, Texas. The facility provides support to the Office of Biological and Physical Research, the Space Shuttle Program, the International Space Station Program, and other NASA organizations. In addition, there are ongoing collaborative research efforts with external businesses and universities. The UTAF provides human factors analysis, evaluation, and usability testing of crew interfaces for space applications. This includes computer displays and controls, workstation systems, and work environments. The UTAF has a unique mix of capabilities, with a staff experienced in both cognitive human factors and ergonomics. The current areas of focus are: human factors applications in emergency medical care and informatics; control and display technologies for electronic procedures and instructions; voice recognition in noisy environments; crew restraint design for unique microgravity workstations; and refinement of human factors processes. This presentation will provide an overview of ongoing activities, and will address how the projects will evolve to meet new space initiatives.

Whitmore, M.↗
NASA NTRS2004

NASA Johnson Space Center Usability Testing and Analysis Facility (WAF) Overview

The Usability Testing and Analysis Facility (UTAF) is part of the Space Human Factors Laboratory at the NASA Johnson Space Center in Houston, Texas. The facility provides support to the Office of Biological and Physical Research, the Space Shuttle Program, the International Space Station Program, and other NASA organizations. In addition, there are ongoing collaborative research efforts with external businesses and universities. The UTAF provides human factors analysis, evaluation, and usability testing of crew interfaces for space applications. This includes computer displays and controls, workstation systems, and work environments. The UTAF has a unique mix of capabilities, with a staff experienced in both cognitive human factors and ergonomics. The current areas of focus are: human factors applications in emergency medical care and informatics; control and display technologies for electronic procedures and instructions; voice recognition in noisy environments; crew restraint design for unique microgravity workstations; and refinement of human factors processes. This presentation will provide an overview of ongoing activities, and will address how the projects will evolve to meet new space initiatives.

Whitmore, M.↗
NASA NTRS2005

NASA Johnson Space Center Usability Testing and Analysis facility (UTAF) Overview

The Usability Testing and Analysis Facility (UTAF) is part of the Space Human Factors Laboratory at the NASA Johnson Space Center in Houston, Texas. The facility performs research for NASA's HumanSystems Integration Program, under the HumanSystems Research and Technology Division. Specifically, the UTAF provides human factors support for space vehicles, including the International Space Station, the Space Shuttle, and the forthcoming Crew Exploration Vehicle. In addition, there are ongoing collaborative research efforts with external corporations and universities. The UTAF provides human factors analysis, evaluation, and usability testing of crew interfaces for space applications. This includes computer displays and controls, workstation systems, and work environments. The UTAF has a unique mix of capabilities, with a staff experienced in both cognitive human factors and ergonomics. The current areas of focus are: human factors applications in emergency medical care and informatics; control and display technologies for electronic procedures and instructions; voice recognition in noisy environments; crew restraint design for unique microgravity workstations; and refinement of human factors processes and requirements. This presentation will provide an overview of ongoing activities, and will address how the UTAF projects will evolve to meet new space initiatives.

Whitmore, Mihriban↗
NASA NTRSDate not supplied

Risks of Increased Earth Independence

As human space exploration begins to extend beyond the immediate vicinity of Earth, the ability of expertise on the ground to support operations will progressively decrease. Ground control expertise has been the primary countermeasure preventing loss of life and mission over the past sixty years and it will be gradually stripped away as expeditions reach further into space. The large, flexible and adaptive teams of experts on the ground, provide not only engineering analysis and problem-solving but also greatly increased work capacity. Monitoring of the large and fast moving stream of telemetry data is carried out around the clock by 20-30 flight controllers per shift. Analysis of that data and troubleshooting is carried out by an additional 50-100 engineers per shift. Artificial intelligence capabilities will need to be part of the solution but will not the entire solution. As progress continues to be made on intelligent systems, especially those for use in complex, dynamic environments where humans will remain a part of the activity, there is an ever increasing need to focus on how those systems will interact with the humans. Although capabilities such as natural language processing and facial recognition have become common place, even basic aspects of problem-solving, causal reasoning and generative decision-making remain well-beyond of our current capabilities. Advanced data visualization, procedure execution support, and new training approaches will be needed to close the gap between what is currently provided by experts on the ground and what the crew will need to do in increasingly autonomous ways with greater distance from Earth.

human-systems integration architecture↗