Search NASA⌕ Search

SEARCH · Search NASA

Results for “action recognition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Video Summarization Using Deep Action Recognition Features and Robust Principal Components Analysis

In an instance where desired pre-defined actions, behaviors, or other categories are known a priori, various video classification and recognition models can be trained to discover those classifications and their location within the video. Absent that information, one might still be tasked with identifying interesting portions within a video, a process which—if done manually—is onerous and time-consuming as it requires manual inspection of the video itself. Recognizing high-level interesting segments within a whole video has been a general area of interest due to the ubiquity of video data. However the size of the data makes storage, retrieval, and inspection of large collections of videos cumbersome. This problem motivates the task of generating shortened clips highlighting the primary content of a video, relieving the burden of having to watch the entire video. This paper presents an unsupervised method of creating shortened clips of videos, enabling the rapid review of the most interesting content within a video. Our method uses features extracted from pre-trained action recognition models as input to online moving window robust principal component analysis to generate summaries. The procedure is tested on a publicly available video summarization dataset and demonstrates comparable performance to state-of-the-art in an un-augmented setting while requiring no training.

Claborne, Daniel M.↗
NASA NTRS2011

Process Algebra Approach for Action Recognition in the Maritime Domain

The maritime environment poses a number of challenges for autonomous operation of surface boats. Among these challenges are the highly dynamic nature of the environment, the onboard sensing and reasoning requirements for obeying the navigational rules of the road, and the need for robust day/night hazard detection and avoidance. Development of full mission level autonomy entails addressing these challenges, coupled with inference of the tactical and strategic intent of possibly adversarial vehicles in the surrounding environment. This paper introduces PACIFIC (Process Algebra Capture of Intent From Information Content), an onboard system based on formal process algebras that is capable of extracting actions/activities from sensory inputs and reasoning within a mission context to ensure proper responses. PACIFIC is part of the Behavior Engine in CARACaS (Cognitive Architecture for Robotic Agent Command and Sensing), a system that is currently running on a number of U.S. Navy unmanned surface and underwater vehicles. Results from a series of experimental studies that demonstrate the effectiveness of the system are also presented.

process algebras↗
DOE OSTI2023

CholecTriplet2021: A benchmark challenge for surgical action triplet recognition

Context-aware decision support in the operating room can foster surgical safety and efficiency by leveraging real-time feedback from surgical workflow analysis. Most existing works recognize surgical activities at a coarse-grained level, such as phases, steps or events, leaving out fine-grained interaction details about the surgical activity; yet those are needed for more helpful AI assistance in the operating room. Recognizing surgical actions as triplets of ‹ instrument, verb, target › combination delivers more comprehensive details about the activities taking place in surgical videos. This paper presents CholecTriplet2021: an endoscopic vision challenge organized at MICCAI 2021 for the recognition of surgical action triplets in laparoscopic videos. Here, the challenge granted private access to the large-scale CholecT50 dataset, which is annotated with action triplet information. In this paper, we present the challenge setup and the assessment of the state-of-the-art deep learning methods proposed by the participants during the challenge. Here, a total of 4 baseline methods from the challenge organizers and 19 new deep learning algorithms from the competing teams are presented to recognize surgical action triplets directly from surgical videos, achieving mean average precision (mAP) ranging from 4.2% to 38.1%. This study also analyzes the significance of the results obtained by the presented approaches, performs a thorough methodological comparison between them, in-depth result analysis, and proposes a novel ensemble method for enhanced recognition. Our analysis shows that surgical workflow analysis is not yet solved, and also highlights interesting directions for future research on fine-grained surgical activity recognition which is of utmost importance for the development of AI in surgery.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Overview of RFID Applications Utilizing Neural Networks

As Radio Frequency Identification (RFID) methods continue to evolve to higher levels of complexity, one form of machine learning is making its appearance. The use of Neural Networks (NN) in the RFID field is steadily increasing, and in the fields of localization and activity recognition, promising results are being shown from a variety of research. RFID applications fall primarily under two types of problems including regression and classification. We analyze RIFD localization techniques which fall under regression, and activity recognition which falls under classification. Many works don’t classify themselves as activity recognition methods, but because they fall under the classification category, we still consider them as activity recognition techniques. This research overviews the Neural Network models in the localization field based on whether they can perform independently of the environment in which they were tested. For activity recognition and accessory fields, the major methods involve tag-based and tag-free approaches. In conclusion, after the models are surveyed, a comparison study is given to examine what may be the cause for increased accuracy between different Neural Network models.

42 ENGINEERING↗
DOE OSTI2024

Functional anatomy of zinc finger antiviral protein complexes

Abstract ZAP is an antiviral protein that binds to and depletes viral RNA, which is often distinguished from vertebrate host RNA by its elevated CpG content. Two ZAP cofactors, TRIM25 and KHNYN, have activities that are poorly understood. Here, we show that functional interactions between ZAP, TRIM25 and KHNYN involve multiple domains of each protein, and that the ability of TRIM25 to multimerize via its RING domain augments ZAP activity and specificity. We show that KHNYN is an active nuclease that acts in a partly redundant manner with its homolog N4BP1. The ZAP N-terminal RNA binding domain constitutes a minimal core that is essential for antiviral complex activity, and we present a crystal structure of this domain that reveals contacts with the functionally required KHNYN C-terminal domain. These contacts are remote from the ZAP CpG binding site and would not interfere with RNA binding. Based on our dissection of ZAP, TRIM25 and KHNYN functional anatomy, we could design artificial chimeric antiviral proteins that reconstitute the antiviral function of the intact authentic proteins, but in the absence of protein domains that are otherwise required for activity. Together, these results suggest a model for the RNA recognition and action of ZAP-containing antiviral protein complexes.

Science & Technology - Other Topics↗
DOE OSTI2023

Integration of urban science and urban climate adaptation research: opportunities to advance climate action

There is a growing recognition that responding to climate change necessitates urban adaptation. We sketch a transdisciplinary research effort, arguing that actionable research on urban adaptation needs to recognize the nature of cities as social networks embedded in physical space. Given the pace, scale and socioeconomic outcomes of urbanization in the Global South, the specificities and history of its cities must be central to the study of how well-known agglomeration effects can facilitate adaptation. The proposed effort calls for the co-creation of knowledge involving scientists and stakeholders, especially those historically excluded from the design and implementation of urban development policies.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS1999

A model of EcoRII restriction endonuclease action: the active complex is most likely formed by one protein subunit and one DNA recognition site

To elucidate the mechanism of interaction of restriction endonuclease EcoRII with DNA, we studied by native gel electrophoresis the binding of this endonuclease to a set of synthetic DNA-duplexes containing the modified or canonical recognition sequence 5'-d(CCA/TGG)-3'. All binding substrate or substrate analogues tested could be divided into two major groups: (i) duplexes that, at the interaction with endonuclease EcoRII, form two types of stable complexes on native gel in the absence of Mg2+ cofactor; (ii) duplexes that form only one type of complex, observed both in the presence and absence of Mg2+. Unlike the latter, duplexes under the first group can be hydrolyzed by endonuclease. Data obtained suggest that the active complex is most likely formed by one protein subunit and one DNA recognition sequence. A model of EcoRII endonuclease action is presented.

Oligodeoxyribonucleotides/chemistry/metabolism↗
DOE OSTI2023

Methods for Measuring Carbon Dioxide Uptake and Permanence: Review and Implications for Macroalgae Aquaculture

Carbon dioxide removal (CDR) is gaining recognition as a necessary action in addition to emissions reduction to prevent some of the worst effects of climate change. Macroalgae aquaculture has been identified as a potential CDR strategy and significant research investments have been made in this area. This article reviews current methods for monitoring carbon to assess the potential for application in the context of macroalgae aquaculture as a CDR strategy. In total, 382 papers were included in the review and categorized by carbon uptake methods, carbon permanence methods, and comprehensive frameworks for assessing carbon capture. While methods for measuring carbon uptake are well established, methods to assess the permanence of carbon in the natural life cycle of macroalgae and in products following harvest are lacking. To achieve the full benefit of macroalgae cultivation as a climate solution, monitoring, reporting, and verification standards and improved methods for assessing carbon uptake and permanence need to be developed.

59 BASIC BIOLOGICAL SCIENCES↗
NASA NTRS2015

A Fast Goal Recognition Technique Based on Interaction Estimates

Goal Recognition is the task of inferring an actor's goals given some or all of the actor's observed actions. There is considerable interest in Goal Recognition for use in intelligent personal assistants, smart environments, intelligent tutoring systems, and monitoring user's needs. In much of this work, the actor's observed actions are compared against a generated library of plans. Recent work by Ramirez and Geffner makes use of AI planning to determine how closely a sequence of observed actions matches plans for each possible goal. For each goal, this is done by comparing the cost of a plan for that goal with the cost of a plan for that goal that includes the observed actions. This approach yields useful rankings, but is impractical for real-time goal recognition in large domains because of the computational expense of constructing plans for each possible goal. In this paper, we introduce an approach that propagates cost and interaction information in a plan graph, and uses this information to estimate goal probabilities. We show that this approach is much faster, but still yields high quality results.

gola recognition↗
NASA NTRSDate not supplied

NASA’s Role in Putting Earth Science Information to Use in Decision-Making

The demand for decision-relevant climate information is continually growing, both because of the severity and intensity of climate change impacts and because of the growing recognition that people can take actions today that will mitigate the risk from future climate impacts. Agencies across the federal government are responding to this need by working together to support the Nation in becoming more resilient to climate change. NASA Earth Science has been a key engine of understanding global climate change and how it impacts people around the world. Additionally, for over two decades, the Agency has worked, via partnerships, to connect NASA Earth Science knowledge with decision support needs, often taking a service-oriented approach by working with boundary organizations and climate service providers. In this presentation, we describe NASA’s unique role in enabling new and practical uses of Earth science information, and how the Agency supports public and private sector partners. We highlight several key examples of NASA projects and activities that support local to regional climate resilience efforts. In addition, we discuss how NASA’s new Earth Information Center, a partnership among several federal agencies, enables in-person and virtual visitors to see how our planet is changing in ways that affect their lives and livelihoods. Lastly, we discuss plans for how NASA Earth Science will continue to help build a more climate resilient future.

earth science↗
NASA NTRS2017

Incorporating Speech Recognition into a Natural User Interface

The Augmented/ Virtual Reality (AVR) Lab has been working to study the applicability of recent virtual and augmented reality hardware and software to KSC operations. This includes the Oculus Rift, HTC Vive, Microsoft HoloLens, and Unity game engine. My project in this lab is to integrate voice recognition and voice commands into an easy to modify system that can be added to an existing portion of a Natural User Interface (NUI). A NUI is an intuitive and simple to use interface incorporating visual, touch, and speech recognition. The inclusion of speech recognition capability will allow users to perform actions or make inquiries using only their voice. The simplicity of needing only to speak to control an on-screen object or enact some digital action means that any user can quickly become accustomed to using this system. Multiple programs were tested for use in a speech command and recognition system. Sphinx4 translates speech to text using a Hidden Markov Model (HMM) based Language Model, an Acoustic Model, and a word Dictionary running on Java. PocketSphinx had similar functionality to Sphinx4 but instead ran on C. However, neither of these programs were ideal as building a Java or C wrapper slowed performance. The most ideal speech recognition system tested was the Unity Engine Grammar Recognizer. A Context Free Grammar (CFG) structure is written in an XML file to specify the structure of phrases and words that will be recognized by Unity Grammar Recognizer. Using Speech Recognition Grammar Specification (SRGS) 1.0 makes modifying the recognized combinations of words and phrases very simple and quick to do. With SRGS 1.0, semantic information can also be added to the XML file, which allows for even more control over how spoken words and phrases are interpreted by Unity. Additionally, using a CFG with SRGS 1.0 produces a Finite State Machine (FSM) functionality limiting the potential for incorrectly heard words or phrases. The purpose of my project was to investigate options for a Speech Recognition System. To that end I attempted to integrate Sphinx4 into a user interface. Sphinx4 had great accuracy and is the only free program able to perform offline speech dictation. However it had a limited dictionary of words that could be recognized, single syllable words were almost impossible for it to hear, and since it ran on Java it could not be integrated into the Unity based NUI. PocketSphinx ran much faster than Sphinx4 which would've made it ideal as a plugin to the Unity NUI, unfortunately creating a C# wrapper for the C code made the program unusable with Unity due to the wrapper slowing code execution and class files becoming unreachable. Unity Grammar Recognizer is the ideal speech recognition interface, it is flexible in recognizing multiple variations of the same command. It is also the most accurate program in recognizing speech due to using an XML grammar to specify speech structure instead of relying solely on a Dictionary and Language model. The Unity Grammar Recognizer will be used with the NUI for these reasons as well as being written in C# which further simplifies the incorporation.

Chapa, Nicholas↗
NASA NTRS1993

Aircraft icing problems - After 50 years

With the possible exception of tailplane-ice hazards, understanding of aircraft icing processes and their performance penalties and hazards has not changed fundamentally in 40-50 years. A survey is presently conducted of the aircraft design criteria, ice-detection and deicing hardware, and flight procedures, that have been developed to cope with icing phenomena. Attention is given to pilot icing conditions flight-training requirements, which are essential for the recognition of icing situations requiring corrective action.

Perkins, Porter J.↗
NASA NTRS2005

Opportunities for Launch Site Integrated System Health Engineering and Management

The launch site processing flow involves operations such as functional verification, preflight servicing and launch. These operations often include hazards that must be controlled to protect human life and critical space hardware assets. Existing command and control capabilities are limited to simple limit checking durig automated monitoring. Contingency actions are highly dependent on human recognition, decision making, and execution. Many opportunities for Integrated System Health Engineering and Management (ISHEM) exist throughout the processing flow. This paper will present the current human-centered approach to health management as performed today for the shuttle and space station programs. In addition, it will address some of the more critical ISHEM needs, and provide recommendations for future implementation of ISHEM at the launch site.

Waterman, Robert D.↗
NASA NTRS1992

Clustering of tethered satellite system simulation data by an adaptive neuro-fuzzy algorithm

Recent developments in neuro-fuzzy systems indicate that the concepts of adaptive pattern recognition, when used to identify appropriate control actions corresponding to clusters of patterns representing system states in dynamic nonlinear control systems, may result in innovative designs. A modular, unsupervised neural network architecture, in which fuzzy learning rules have been embedded is used for on-line identification of similar states. The architecture and control rules involved in Adaptive Fuzzy Leader Clustering (AFLC) allow this system to be incorporated in control systems for identification of system states corresponding to specific control actions. We have used this algorithm to cluster the simulation data of Tethered Satellite System (TSS) to estimate the range of delta voltages necessary to maintain the desired length rate of the tether. The AFLC algorithm is capable of on-line estimation of the appropriate control voltages from the corresponding length error and length rate error without a priori knowledge of their membership functions and familarity with the behavior of the Tethered Satellite System.

Mitra, Sunanda↗
NASA NTRS2000

Aspect-Oriented Programming is Quantification and Obliviousness

This paper proposes that the distinguishing characteristic of Aspect-Oriented Programming (AOP) systems is that they allow programming by making quantified programmatic assertions over programs written by programmers oblivious to such assertions. Thus, AOP systems can be analyzed with respect to three critical dimensions: the kinds of quantifications allowed, the nature of the actions that can be asserted, and the mechanism for combining base-level actions with asserted actions. Consequences of this perspective are the recognition that certain systems are not AOP and that some mechanisms are expressive enough to allow programming an AOP system within them. A corollary is that while AOP can be applied to Object-Oriented Programming, it is an independent concept applicable to other programming styles.

Filman, Robert E.↗
NASA NTRS1996

Stress and Aeronautical Team Decision Making: Strengthening the Weak Links

A model that characterizes pilots'decision making in flight will be presented. Elements of the model that appear most vulnerable to stress will be examined in light of accidents and incidents. The model includes two major components: Situation assessment and choice of a course of action. While based on Klein's Recognition-Primed Decision Making, it is tailored to the aviation environment which includes certain features that may be common to other domains: Primarily, aviation is highly proceduralized and options are generally well known. What appears to make decisions difficult are ambiguity, time pressure, and risk. In addition, decisions must often be made while carrying out the standard procedures of flight, including checklists, review of approach plates, standard briefings, and communication with air traffic controllers or cabin crew. The effects of stressors on decision making by pilots with varying levels of expertise will be explored, along with strategies for strengthening the weak links.

Orasanu, Judith↗
NASA NTRS2001

Aspect-Oriented Programming is Quantification and Implicit Invocation

We propose that the distinguishing characteristic of Aspect-Oriented Programming (AOP) languages is that they allow programming by making quantified programmatic assertions over programs that lack local notation indicating the invocation of these assertions. This suggests that AOP systems can be analyzed with respect to three critical dimensions: the kinds of quantifications allowed, the nature of the interactions that can be asserted, and the mechanism for combining base-level actions with asserted actions. Consequences of this perspective are the recognition that certain systems are not AOP and that some mechanisms are metabolism: they are sufficiently expressive to allow straightforwardly programming an AOP system within them.

Filman, Robert E.↗