Search NASA⌕ Search

SEARCH · Search NASA

Results for “Activity recognition”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Geolocation tracking for human identification and activity recognition using radar deep transfer learning

Abstract Human identification and activity recognition (HIAR) is crucial for many applications, such as surveillance, smart homes, and assisted living. As a sensing modality, radar has many unique characteristics including privacy protection, and contactless sensing. Single classification systems have shown to be accurate, but for long‐term solutions both human identification (ID) and human activity recognition (HAR) will need to be integrated in one system where it can be utilised simultaneously. In this article, a novel radar‐based human tracking system is presented where three classifiers are utilised to identify the subject and his/her behaviour. For any kind of motion, the system tracks the subject and detect the type of his/her motion. Based on the detected type of motion, the three classifiers are utilised for identification and activity recognition. The classifiers are built utilising deep transfer learning where three radar datasets are established to train and validate each of the deep networks. To recognise six activities and 10 human subjects, the three classifiers, namely, HAR, Gait ID, and Heart sound ID, achieve superior performance compared to the best reported results in literature with classification accuracies of 97.6%, 100%, and 41.8% respectively. Three successful examples are presented to demonstrate the introduced concept.

Alkasimi, Ahmad↗
DOE OSTI2023

Efficient human activity recognition with spatio-temporal spiking neural networks

In this study, we explore Human Activity Recognition (HAR), a task that aims to predict individuals' daily activities utilizing time series data obtained from wearable sensors for health-related applications. Although recent research has predominantly employed end-to-end Artificial Neural Networks (ANNs) for feature extraction and classification in HAR, these approaches impose a substantial computational load on wearable devices and exhibit limitations in temporal feature extraction due to their activation functions. To address these challenges, we propose the application of Spiking Neural Networks (SNNs), an architecture inspired by the characteristics of biological neurons, to HAR tasks. SNNs accumulate input activation as presynaptic potential charges and generate a binary spike upon surpassing a predetermined threshold. This unique property facilitates spatio-temporal feature extraction and confers the advantage of low-power computation attributable to binary spikes. We conduct rigorous experiments on three distinct HAR datasets using SNNs, demonstrating that our approach attains competitive or superior performance relative to ANNs, while concurrently reducing energy consumption by up to 94%.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Overview of RFID Applications Utilizing Neural Networks

As Radio Frequency Identification (RFID) methods continue to evolve to higher levels of complexity, one form of machine learning is making its appearance. The use of Neural Networks (NN) in the RFID field is steadily increasing, and in the fields of localization and activity recognition, promising results are being shown from a variety of research. RFID applications fall primarily under two types of problems including regression and classification. We analyze RIFD localization techniques which fall under regression, and activity recognition which falls under classification. Many works don’t classify themselves as activity recognition methods, but because they fall under the classification category, we still consider them as activity recognition techniques. This research overviews the Neural Network models in the localization field based on whether they can perform independently of the environment in which they were tested. For activity recognition and accessory fields, the major methods involve tag-based and tag-free approaches. In conclusion, after the models are surveyed, a comparison study is given to examine what may be the cause for increased accuracy between different Neural Network models.

42 ENGINEERING↗
DOE OSTI2020

Csx3 is a cyclic oligonucleotide phosphodiesterase associated with type III CRISPR–Cas that degrades the second messenger cA 4

Cas10 is the signature gene for type III CRISPR–Cas surveillance complexes. Unlike type I and type II systems, type III systems do not require a protospacer adjacent motif and target nascent RNA associated with transcriptionally active DNA. Further, target RNA recognition activates the cyclase domain of Cas10, resulting in the synthesis of cyclic oligoadenylate second messengers. These second messengers are recognized by ancillary Cas proteins harboring CRISPR-associated Rossmann fold (CARF) domains and regulate the activities of these proteins in response to invading nucleic acid. Csx3 is a distant member of the CARF domain superfamily previously characterized as a Mn 2+ -dependent deadenylation exoribonuclease. However, its specific role in CRISPR–Cas defense remains to be determined. Here we show that Csx3 is strongly associated with type III systems and that Csx3 binds cyclic tetra-adenylate (cA 4 ) second messenger with high affinity. Further, Csx3 harbors cyclic oligonucleotide phosphodiesterase activity that quickly degrades this cA 4 signal. In addition, structural analysis identifies core elements that define the CARF domain fold, and the mechanistic basis for ring nuclease activity is discussed. Overall, the work suggests that Csx3 functions within CRISPR–Cas as a counterbalance to Cas10 to regulate the duration and amplitude of the cA 4 signal, providing an off ramp from the programmed cell death pathway in cells that successfully cure viral infection.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Identifying Modular Construction Worker Tasks Using Computer Vision

Modular construction is increasingly being seen as an attractive method for delivering building projects due to advantages in safety, quality, and lead-time. Despite these benefits, this method still relies heavily on human labor, which causes variability in factory assembly-line performance that can erode performance benefits of modular construction. Continuous improvement methods can alleviate some of these issues, but they also require continuous monitoring of human workers' performance. Due to limitations of manual time study and automated sensor-based monitoring methods, recently computer vision-based methods have gained momentum in identifying the activities of construction workers from the videos of onsite construction. Therefore, this paper explores the use of computer vision-based human activity recognition techniques to identify and classify worker activities in modular construction videos. Computer vision-based tracking method has been used to track the human workers in each frame, and Resnet-50 network has been used to classify the activity of tracked workers. Evaluation of this framework has achieved higher than 90% accuracy and recall in testing.

computer vision↗
DOE OSTI2024

Robustness of topological persistence in knowledge distillation for wearable sensor data

Topological data analysis (TDA) has shown great success in various applications involving wearable sensor data. However, there are difficulties in leveraging topological features in machine learning and wearable sensors because of the large time consumption and computational resources required to extract the features. To address this problem, knowledge distillation (KD) is utilized to generate a small model and accommodate topological features with persistence image (PI) representations from the raw time series data. Deploying topological knowledge in KD enables the student to achieve better performance compared to the one trained solely on raw time series data. However, it is not yet known if there are coherent characteristics for topological features in PI, which can aid in improving the performance during KD. In this paper, we investigate the suitability and challenges of utilizing topological features in KD for wearable sensor data, thereby contributing to the advancement of the field. Our study explores the impact of transferred topological features by comparing the Teacher-to-Student framework with Multiple Teachers-to-Student where teachers utilize both time series data and persistence images obtained by TDA as inputs. Additionally, we conduct a rigorous examination of topological knowledge effects by testing under various corruptions, knowledge types, and learning strategies in the context of human activity recognition tasks. Our analysis of topological features in KD presents the optimal strategy for incorporating these features. This study includes datasets of varying scales, window lengths, and activity classes, providing a comprehensive evaluation. Our results demonstrate that leveraging topological features in KD to enhance performance across databases.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

cGAS-like receptors sense RNA and control 3'2'-cGAMP signalling in Drosophila

Cyclic GMP–AMP synthase (cGAS) is a cytosolic DNA sensor that produces the second messenger cG[2'–5']pA[3'–5']p (2'3'-cGAMP) and controls activation of innate immunity in mammalian cells. Animal genomes typically encode multiple proteins with predicted homology to cGAS, but the function of these uncharacterized enzymes is unknown. Here we show that cGAS-like receptors (cGLRs) are innate immune sensors that are capable of recognizing divergent molecular patterns and catalysing synthesis of distinct nucleotide second messenger signals. Crystal structures of human and insect cGLRs reveal a nucleotidyltransferase signalling core shared with cGAS and a diversified primary ligand-binding surface modified with notable insertions and deletions. We demonstrate that surface remodelling of cGLRs enables altered ligand specificity and used a forward biochemical screen to identify cGLR1 as a double-stranded RNA sensor in the model organism Drosophila melanogaster. We show that RNA recognition activates Drosophila cGLR1 to synthesize the novel product cG[3'–5']pA[2'–5']p (3'2'-cGAMP). A crystal structure of Drosophila stimulator of interferon genes (dSTING) in complex with 3'2'-cGAMP explains selective isomer recognition, and 3'2'-cGAMP induces an enhanced antiviral state in vivo that protects from viral infection. Similar to radiation of Toll-like receptors in pathogen immunity, our results establish cGLRs as a diverse family of metazoan pattern recognition receptors.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Transfer learning for smart buildings: A critical review of algorithms, applications, and future perspectives

Smart buildings play a crucial role toward decarbonizing society, as globally buildings emit about one-third of greenhouse gases. In the last few years, machine learning has achieved a notable momentum that, if properly harnessed, may unleash its potential for advanced analytics and control of smart buildings, enabling the technique to scale up for supporting the decarbonization of the building sector. In this perspective, transfer learning aims to improve the performance of a target learner exploiting knowledge in related environments. The present work provides a comprehensive overview of transfer learning applications in smart buildings, classifying and analyzing 77 papers according to their applications, algorithms, and adopted metrics. The study identified four main application areas of transfer learning: (1) building load prediction, (2) occupancy detection and activity recognition, (3) building dynamics modeling, and (4) energy systems control. Furthermore, the review highlighted the role of deep learning in transfer learning applications that has been used in more than half of the analyzed studies. The paper also discusses how to integrate transfer learning in a smart building's ecosystem, identifying, for each application area, the research gaps and guidelines for future research directions.

Pinto, G↗
DOE OSTI2021

Coal-dependent Communities in Transition: Identifying Best Practices to Ensure Equitable Outcomes

The U.S. coal industry is experiencing a sharp increase in the numbers of retired and/or decommissioned coal-fired power plants across the U.S. In the years between 2010-2019, around 102 gigawatts (GW) of coal-fired generating capacity has been announced to be decommissioned, representing more than 546 coal-fired power plant units, and an additional 17 GW is planned to be decommissioned by 2025. This change in the energy production landscape presents an impact on the social, environmental, and economic prospects of coal-dependent communities. This report examined the role of communities in the coal power plant decommissioning process and provided community-identified best practices to ensure an equitable process. The experiences of four coal-dependent communities—Wise County, VA, Muskegon, MI, Anderson County, TN, and Becker, MN—are presented as case studies to understand the impacts of the decommissioning process, and associated best practices, from the communities’ perspective. The report results highlight the need to recognize that the decommissioning decision-making process must be community-based to be equitable. Each community’s input is key to the transition away from coal power because there is no one-size-fits-all development plan. In other words, each community’s trajectory through the decommissioning process—from the retirement decision-making stage to the final site redevelopment phase—is unique because each community has distinct needs and wants from the energy transition. What is best for one community may not be suited for another. Ultimately, the framework for site development and community revitalization post-decommissioning cannot be universal because each community’s profile—from a social, cultural, and economic perspective—is different. Community impacts of power plant decommissioning are not limited to job and revenue losses. Communities are likely to be impacted culturally, socially, environmentally, and have long-term health-based impacts that should be acknowledged and addressed in post-retirement plans. Commonly identified decommissioning best practices include: Early and continued engagement throughout, with a number of mediums for communication and feedback (e.g., in-person sessions, virtual meetings, written comment opportunities); Early planning of post-decommissioning projects to replace lost jobs, revenue, and economic activity; Recognition (and mitigation, if possible) of social impacts on the community due to plant closure; Transparency throughout the process, with trusted information being provided about the decommissioning process and timeline; potential impacts on the workforce, economy, and environment; and the feasibility of alternative site uses; Identification of funding sources, technical experts, and/or strategic partnerships to support decommissioning and the affected communities upfront; and, Acknowledgment of communities as stakeholders who have a role in the conversation and right to determine their futures. Three key areas for assisting coal-dependent communities affected by the energy transition: Technical assistance: assessment of site feasibility for alternative uses or to repower with new technologies; Cross-partnership engagement and collaboration: facilitate knowledge-sharing of “lessons learned” about the decommissioning process between communities and provide guidance for decision-making processes; and, Financial assistance: access to grant and/or loan programs to assist with redevelopment survey, bolster community economic security through job creation, and cover environmental clean-up costs. Technical assistance, cross-partnership engagement, and financial aid can be mobilized to help communities throughout various stages of the decommissioning process, including the retirement decision, the site reclamation phase, and eventual revitalization of the site and surrounding community.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2024

A Computational Review of Privacy-Preserving Mechanisms for the Smart Grid

Smart grid technologies have rapidly become one of the largest and most comprehensive sources of data for the modern utility. For the most part, data streams are seen as an essential tool that enable utilities to carry their day-to-day business operations, but they also create the need for efficient and secure data management strategies. In the context of the smart grid, ensuring data privacy is becoming an increasing concern due to a combination of factors that range from shifts in operational paradigms and rapid technology evolution to changes in legislation. Furthermore, researchers have highlighted the risks associated with improperly protected energy records. For example, energy consumption data from homes could be used to infer the behaviors and habits of home occupants through activity recognition or user profiling (Fan, 2017), which may lead to unfair service pricing, targeted advertising, or other personal security violations. Similarly, Electric Vehicles’ (EVs) charging metadata could be used to reveal private information about the owner such as their payment methods, preferred charging stations, and other locational and timing information that could be used to reconstruct the vehicle owner’s behaviors. The privacy of user data, even when used for statistical analysis or machine learning training processes, also needs to be carefully considered, as an individual’s private traits may still be vulnerable if their inclusion/exclusion greatly impacts the result or could be linked to a public dataset through cross-reference. The breach of user privacy also has severe impacts for organizations that store, transmit, or work on the data in the form of diminishing the public’s trust in them while potentially incurring legal consequences (e.g., fines and suspensions under the European Union General Data Protection Regulation, Health Insurance Portability and Accountability Act, etc.). Because of these risks, several privacy-preserving mechanisms are available to help organizations comply with privacy legislations and prevent the unauthorized and malicious use of user data. In light of these concerns, this report focuses on performing a computational review of privacy-preserving mechanisms that have received a significant amount of interest in literature. It specifically focuses on 1) homomorphic encryption, 2) zero-knowledge proofs, 3) differential privacy, and 4) federated learning. It is worth noting that although many of the methods presented in this document rely on cryptographic primitives, their intent is not to provide perfect secrecy, but rather to enable users to maintain privacy, and thus they shall not be compared or equated to other constructs that are aimed to address cybersecurity constructs.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2023

Sharing leaky-integrate-and-fire neurons for memory-efficient spiking neural networks

Spiking Neural Networks (SNNs) have gained increasing attention as energy-efficient neural networks owing to their binary and asynchronous computation. However, their non-linear activation, that is Leaky-Integrate-and-Fire (LIF) neuron, requires additional memory to store a membrane voltage to capture the temporal dynamics of spikes. Although the required memory cost for LIF neurons significantly increases as the input dimension goes larger, a technique to reduce memory for LIF neurons has not been explored so far. To address this, we propose a simple and effective solution, EfficientLIF-Net, which shares the LIF neurons across different layers and channels. Our EfficientLIF-Net achieves comparable accuracy with the standard SNNs while bringing up to ~4.3× forward memory efficiency and ~21.9× backward memory efficiency for LIF neurons. We conduct experiments on various datasets including CIFAR10, CIFAR100, TinyImageNet, ImageNet-100, and N-Caltech101. Furthermore, we show that our approach also offers advantages on Human Activity Recognition (HAR) datasets, which heavily rely on temporal information. The code has been released at https://github.com/Intelligent-Computing-Lab-Yale/EfficientLIF-Net.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Diversity in the Common Fold: Structural Insights into Class D β-Lactamases from Gram-Negative Pathogens

Class D β-lactamases (DBLs) represent a major threat to antibiotic efficacy by hydrolyzing β-lactam drugs, including last-resort carbapenems, thereby driving antimicrobial resistance in Gram-negative bacteria. The enzymes share a structurally conserved two-domain α/β architecture with seven active-site motifs and three flexible extended loops (the P-loop, Ω-loop, and newly designated B-loop) that surround the active site. While each of these loops is known to influence enzyme function, their coordinated roles have not been fully elucidated. To investigate the significance of their interplay, we compared the sequences and crystal structures of 40 DBLs from clinically relevant Gram-negative pathogens and performed molecular dynamics simulations on selected representatives. Combined structural and dynamical analyses revealed a strong correlation between B-loop architecture and carbapenemase activity in the pathogens Klebsiella and Acinetobacter, particularly regarding loop length and spatial organization. These findings emphasize the B-loop’s critical contribution, in concert with the P- and Ω-loops, in tuning active site versatility, substrate recognition, catalytic activity, and structural stability. A deeper understanding of how these motifs and loops govern DBL function may inform the development of novel antibiotics and inhibitors targeting this class of enzymes.

antibiotic resistance↗
DOE OSTI2022

Analysis of Orthogonal Efflux and Permeation Properties of Compounds Leads to the Discovery of New Efflux Pump Inhibitors

Optimization of compound permeation into Gram-negative bacteria is one of the most challenging tasks in the development of antibacterial agents. Two permeability barriers–the passive diffusion barrier of the outer membrane (OM) and active drug efflux–act synergistically to protect cells from the antibacterial action of compounds. In Escherichia coli (E. coli) and relatives, these two barriers sieve compounds based on different physicochemical properties that are defined by their interactions with OM porins and efflux pumps, respectively. In this study, we critically tested the hypothesis that the best substrates and inhibitors of efflux pumps are compounds that can effectively permeate the OM and are available at relatively high concentrations in the periplasm. For this purpose, we filtered a large subset of the ZINC15 database of commercially available compounds for compounds containing a primary amine, a chemical feature known to facilitate the uptake through E. coli general porins. The assembled library was screened by ensemble docking to AcrA, the periplasmic component of the AcrAB-TolC efflux pump, followed by experimental testing of the top predicted binders for antibacterial activities, efflux recognition, and inhibition. In this work, we found that the filtered primary amine library is a rich source of compounds with efflux-inhibiting activities and identified efflux pump inhibitors with novel chemical scaffolds effective against E. coli AcrAB-TolC and efflux pumps of multidrug-resistant clinical isolates of Acinetobacter baumannii. However, primary amines are not required for the recognition of compounds by efflux pumps and their efflux-inhibitory activities.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Transcriptomic and Proteomic Insights into Host Immune Responses in Pediatric Severe Malarial Anemia: Dysregulation in HSP60-70-TLR2/4 Signaling and Altered Glutamine Metabolism

Severe malarial anemia (SMA, Hb < 6.0 g/dL) is a leading cause of childhood morbidity and mortality in holoendemic Plasmodium falciparum transmission zones. This study explored the entire expressed human transcriptome in whole blood from 66 Kenyan children with non-SMA (Hb ≥ 6.0 g/dL, n = 41) and SMA (n = 25), focusing on host immune response networks. RNA-seq analysis revealed 6862 differentially expressed genes, with equally distributed up-and down-regulated genes, indicating a complex host immune response. Deconvolution analyses uncovered leukocytic immune profiles indicative of a diminished antigenic response, reduced immune priming, and polarization toward cellular repair in SMA. Weighted gene co-expression network analysis revealed that immune-regulated processes are central molecular distinctions between non-SMA and SMA. A top dysregulated immune response signaling network in SMA was the HSP60-HSP70-TLR2/4 signaling pathway, indicating altered pathogen recognition, innate immune activation, stress responses, and antigen recognition. Validation with high-throughput gene expression from a separate cohort of Kenyan children (n = 50) with varying severities of malarial anemia (n = 38 non-SMA and n = 12 SMA) confirmed the RNA-seq findings. Proteomic analyses in 35 children with matched transcript and protein abundance (n = 19 non-SMA and n = 16 SMA) confirmed dysregulation in the HSP60-HSP70-TLR2/4 signaling pathway. Additionally, glutamine transporter and glutamine synthetase genes were differentially expressed, indicating altered glutamine metabolism in SMA. This comprehensive analysis underscores complex immune dysregulation and novel pathogenic features in SMA.

Microbiology↗
DOE OSTI2021

Evaluating Automated Face Identity-Masking Methods with Human Perception and a Deep Convolutional Neural Network

Face de-identification (or “masking”) algorithms have been developed in response to the prevalent use of video recordings in public places. Here, we evaluated the success of face identity masking for human perceivers and a deep convolutional neural network (DCNN). Eight de-identification algorithms were applied to videos of drivers’ faces, while they actively operated a motor vehicle. These masks were pre-selected to be applicable to low-quality video and to maintain coarse information about facial actions. Humans studied high-resolution images to learn driver identities and were tested on their recognition of active drivers in low-resolution videos. Faces in the videos were either unmasked or were masked by one of the eight algorithms. When participants were tested immediately after learning (Experiment 1), all masks reduced identification, with six of eight masks reducing identification to extremely poor performance. In a second experiment, two of the most effective masks were tested after a delay of 7 or 28 days. The delay did not further reduce identification of the masked faces. In all masked conditions, participants maintained stringent decision criteria, with low confidence in recognition, further indicating the effectiveness of the masks. Next, the DCNN performed an identity-matching task between high-resolution images and masked videos—a task analogous to that done by humans. The pattern of accuracy for the DCNN mirrored some, but not all, aspects of human performance, highlighting the need to test the effectiveness of identity masking for both humans and machines. The DCNN was also tested on its ability to match identity between masked and unmasked versions of the same video, based only on the face. DCNN performance for the eight masks offers insight into the nature of the information in faces that is coded in these networks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

“The structure of the Type III secretion system export gate with CdsO, an ATPase lever arm”

Type III protein secretion systems (T3SS) deliver effector proteins from the Gram-negative bacterial cytoplasm into a eukaryotic host cell through a syringe-like, multi-protein nanomachine. Cytosolic components of T3SS include a portion of the export apparatus, which traverses the inner membrane and features the opening of the secretion channel, and the sorting complex for substrate recognition and for providing the energetics required for protein secretion. Two components critical for efficient effector export are the export gate protein and the ATPase, which are proposed to be linked by the central stalk protein of the ATPase. We present the structure of the soluble export gate homo-nonamer, CdsV, in complex with the central stalk protein, CdsO, of its cognate ATPase, both derived from Chlamydia pneumoniae. This structure defines the interface between these essential T3S proteins and reveals that CdsO engages the periphery of the export gate that may allow the ATPase to catalyze an opening between export gate subunits to allow cargo to enter the export apparatus. We also demonstrate through structure-based mutagenesis of the homologous export gate in Pseudomonas aeruginosa that mutation of this interface disrupts effector secretion. These results provide novel insights into the molecular mechanisms governing active substrate recognition and translocation through a T3SS.

59 BASIC BIOLOGICAL SCIENCES↗