SEARCH · Search NASA
Results for “Visual attention”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
A deep learning approach to programmable RNA switches
Engineered RNA elements are programmable tools capable of detecting small molecules, proteins, and nucleic acids. Predicting the behavior of these synthetic biology components remains a challenge, a situation that could be addressed through enhanced pattern recognition from deep learning. Here, we investigate Deep Neural Networks (DNN) to predict toehold switch function as a canonical riboswitch model in synthetic biology. To facilitate DNN training, we synthesize and characterize in vivo a dataset of 91,534 toehold switches spanning 23 viral genomes and 906 human transcription factors. DNNs trained on nucleotide sequences outperform (R 2 = 0.43–0.70) previous state-of-the-art thermodynamic and kinetic models (R 2 = 0.04–0.15) and allow for human-understandable attention-visualizations (VIS4Map) to identify success and failure modes. This work shows that deep learning approaches can be used for functionality predictions and insight generation in RNA synthetic biology.
Using Eye Tracking to Elucidate the Mechanisms Underlying Stimulation-Enhanced Visual Target Detection
Transcranial direct current stimulation (tDCS) is a noninvasive form of brain stimulation that involves passing a weak electrical current between electrodes on the scalp to modulate underlying neural tissue. TDCS has been shown to modulate cognition in a variety of domains, including memory, attention, and visual processing. Prior work from our laboratory has shown positive effects of tDCS on learning to detect target objects hidden in complex naturalistic visual scenes and learn rules for categorizing images, though the mechanism for these benefits remains unknown. One possibility is that tDCS optimizes visual search by modulating visual attention or via the reduction in search errors. One method of quantifying visual attention is to use eye tracking to record search patterns to determine if and how visual search is adjusted under verum stimulation conditions. Eye tracking data allows classification of errors into error types, including sampling errors (failing to look in the relevant region), recognition errors (looking at the critical portion of a scene, but failing to recognize it as such as evidenced by visual fixation), and decision-making errors (fixating on the relevant portion of a scene, but making the wrong determination). Our results indicate that the benefit tDCS confers on visual search for targets stems from the reduction in decision-making errors when targets are present (Cohen’s d = 0.86). Also reported is a replication of previous findings showing a tDCS-dependent improvement in learning this task, learning score (Cohen’s d = 0.88); d’ (Cohen’s d = 1.00). This provides support for moving tDCS into the application space by pairing it with analysts who are concerned with the type of search error that is corrected via stimulation.
Multi-Label Visual Feature Learning with Attentional Aggregation
Explore the source record for details and available documents.
Industrial Energy Assessment Training Effectiveness Evaluation: An Eye-Tracking Study
It is essential to understand the effectiveness of any training program so it can be improved accordingly. Various studies have applied standard metrics for the evaluation of visual behavior to recognize the areas of interest that attract individuals’ attention as there is a high correlation between attentional behavior and where one is focusing on. However, through reviewing the literature, we believe that studies that applied eye-tracking technologies for training purposes are still limited, especially in the industrial energy assessment training field. In this paper, the effectiveness of industrial energy assessment training was quantitatively evaluated by measuring the attentional allocation of trainees using eye-tracking technology. Moreover, this study identifies the areas that require more focus based on evaluating the performance of subjects after receiving the training. Additionally, this research was conducted in a controlled environment to remove the distractions that may be caused by environmental factors to only concentrate on variables that influence the learning behavior of subjects. The experiment results showed that after receiving the training, the subjects’ performance in energy assessment was significantly improved in two areas: production, and recycling and waste management, and the designed training program enhanced the knowledge of participants in identifying energy-saving opportunities to the knowledge level of experienced participants.
DeepGRN: prediction of transcription factor binding site across cell-types using attention-based deep neural networks
Abstract Background Due to the complexity of the biological systems, the prediction of the potential DNA binding sites for transcription factors remains a difficult problem in computational biology. Genomic DNA sequences and experimental results from parallel sequencing provide available information about the affinity and accessibility of genome and are commonly used features in binding sites prediction. The attention mechanism in deep learning has shown its capability to learn long-range dependencies from sequential data, such as sentences and voices. Until now, no study has applied this approach in binding site inference from massively parallel sequencing data. The successful applications of attention mechanism in similar input contexts motivate us to build and test new methods that can accurately determine the binding sites of transcription factors. Results In this study, we propose a novel tool (named DeepGRN) for transcription factors binding site prediction based on the combination of two components: single attention module and pairwise attention module. The performance of our methods is evaluated on the ENCODE-DREAM in vivo Transcription Factor Binding Site Prediction Challenge datasets. The results show that DeepGRN achieves higher unified scores in 6 of 13 targets than any of the top four methods in the DREAM challenge. We also demonstrate that the attention weights learned by the model are correlated with potential informative inputs, such as DNase-Seq coverage and motifs, which provide possible explanations for the predictive improvements in DeepGRN. Conclusions DeepGRN can automatically and effectively predict transcription factor binding sites from DNA sequences and DNase-Seq coverage. Furthermore, the visualization techniques we developed for the attention modules help to interpret how critical patterns from different types of input features are recognized by our model.
A Dynamic Hierarchical Attention Framework for Multimodal Malware Detection
The increasing use of Android in the worldwide mobile ecosystem has come along with a significant increase in advanced malware, highlighting the critical necessity for efficient, scalable, and adaptable detection systems. Despite recent advancements in machine learning improving malware detection, the majority of current solutions are limited to one, two, or three data modalities, hence neglecting the comprehensive behavioral spectrum of contemporary multi-vector threats. This thesis presents the first comprehensive multimodal framework for Android malware detection, which combines textual, time-series (temporal), graph-based (structural), and visual information using an innovative hierarchical attention mechanism and Dynamic Fusion Controller (DFC). Our methodology consistently classifies and processes modalities as either sequential or structural, facilitating content-adaptive weighting and resilient cross-modal representation learning. We advance the implementation of cutting-edge time series techniques, such as MiniRocket, for malware detection, hence creating new opportunities for temporal analysis in cybersecurity. Comprehensive experimental assessment shows that our framework performs exceptionally well, with 99.46% classification accuracy and 97.15% detection accuracy, significantly outperforming existing approaches through effective multimodal integration and hierarchical attention mechanisms.
Contrast Mechanisms in Secondary Electron e-Beam-Induced Current (SEEBIC) Imaging
Abstract Over the last few years, a new mode for imaging in the scanning transmission electron microscope (STEM) has gained attention as it permits the direct visualization of sample conductivity and electrical connectivity. When the electron beam (e-beam) is focused on the sample in the STEM, secondary electrons (SEs) are generated. If the sample is conductive and electrically connected to an amplifier, the SE current can be measured as a function of the e-beam position. This scenario is similar to the better-known scanning electron microscopy-based technique, electron beam-induced current imaging, except that the signal in the STEM is generated by the emission of SEs, hence the name secondary electron e-beam-induced current (SEEBIC), and in this case, the current flows in the opposite direction. Here, we provide a brief review of recent work in this area, examine the various contrast generation mechanisms associated with SEEBIC, and illustrate its use for the characterization of graphene nanoribbon devices.
Data-driven selection and spectral classification of white dwarf stars
The next generation of spectroscopic surveys is expected to provide spectra for hundreds of thousands of white dwarf (WD) candidates in the upcoming years. Currently, spectroscopic classification of white dwarfs is mostly done by visual inspection, requiring substantial amounts of expert attention. We propose a data-driven pipeline for fast, automatic selection, and spectroscopic classification of WD candidates, trained using spectroscopically confirmed objects with available Gaia astrometry, photometry, and Sloan Digital Sky Survey (SDSS) spectra with signal-to-noise ratios ≥9. The pipeline selects WD candidates with improved accuracy and completeness over existing algorithms, classifies their primary spectroscopic type with ≥ 90 % accuracy, and spectroscopically detects main sequence companions with similar performance. We apply our pipeline to the Gaia Data Release 3 cross-matched with the SDSS Data Release 17 (DR17), identifying 424 096 high-confidence WD candidates and providing the first catalogue of automated and quantifiable classification for 36 523 WD spectra. Both the catalogue and pipeline are made available online. Such a tool will prove particularly useful for the undergoing SDSS-V survey, allowing for rapid classification of thousands of spectra at every data release.
Biomass-derived carbon dots as emerging visual platforms for fluorescent sensing
Biomass-derived carbon dots (CDs) are non-toxic and fluorescently stable, making them suitable for extensive application in fluorescence sensing. The use of cheap and renewable materials not only improves the utilization rate of waste resources, but it is also drawing increasing attention to and interest in the production of biomass-derived CDs. Visual fluorescence detection based on CDs is the focus of current research. This method offers high sensitivity and accuracy and can be used for rapid and accurate determination under complex conditions. Here, this paper describes the biomass precursors of CDs, including plants, animal remains and microorganisms. The factors affecting the use of CDs as fluorescent probes are also discussed, and a brief overview of enhancements made to the preparation process of CDs is provided. In addition, the application prospects and challenges related to biomass-derived CDs are demonstrated.
Sensory stimulation for upper limb amputations modulates adaptability of cortical large-scale systems and combination of somatosensory and visual inputs
Abstract Touch-like phantom limb sensations can be elicited through targeted transcutaneous electrical nerve stimulation (tTENS) in individuals with upper limb amputation. The corresponding impact of sensory stimulation on cortical activity remains an open question. Brain network research shows that sensorimotor cortical activity is supported by dynamic changes in functional connections between relevant brain regions. These groups of interconnected regions are functional modules whose architecture enables specialized function and related neural processing supporting individual task needs. Using electroencephalographic (EEG) signals to analyze modular functional connectivity, we investigated changes in the modular architecture of cortical large-scale systems when participants with upper limb amputations performed phantom hand movements before, during, and after they received tTENS. We discovered that tTENS substantially decreased the flexibility of the default mode network (DMN). Furthermore, we found increased interconnectivity (measured by a graph theoretic integration metric) between the DMN, the somatomotor network (SMN) and the visual network (VN) in the individual with extensive tTENS experience. While for individuals with less tTENS experience, we found increased integration between DMN and the attention network. Our results provide insights into how sensory stimulation promotes cortical processing of combined somatosensory and visual inputs and help develop future tools to evaluate sensory combination for individuals with amputations.
Optical super-resolution microscopy in polymer science
The advent of optical super-resolution microscopy (OSRM) over two decades ago has transformed light-mediated interrogation of systems down to the nanoscale. This innovative set of approaches to optics breaks the so-called diffraction limit of light (~200 nm), allowing for the first time to use optics in the far field to visualize behavior on nanoscopic length scales. While these visualization tools have rapidly found widespread use in biology and related fields, their implementation in materials and, more specifically, in polymer science has been far slower. To overcome possible barriers and highlight possible future directions, we present in this paper an introduction to OSRM for polymer scientists, beginning with an overview of relevant techniques and existing optical probes. We then show and examine the first examples of OSRM adaptation across major areas of polymer science, including: polymerization and structural characterization, self-assembly and solution behavior, bulk structure and behavior, crystallization, gel structure and behavior, phase transitions, and biofunctionality. We hope and anticipate that the discussions provided in this review will draw the attention of the polymer community to the capacities of these hitherto underexplored optical visualization techniques to further transform polymer science.
Adaptive stretching of representations across brain regions and deep learning model layers
Prefrontal cortex (PFC) is known to modulate the visual system to favor goal-relevant information by accentuating task-relevant stimulus dimensions. Does the brain broadly re-configures itself to optimize performance by stretching visual representations along task-relevant dimensions? We considered a task that required monkeys to selectively attend on a trial-by-trial basis to one of two dimensions (color or motion direction) to make a decision. Although effects were most prominent in frontal areas, representations stretched along task-relevant dimensions in all sites considered: V4, MT, lateral PFC, frontal eye fields (FEF), lateral intraparietal cortex (LIP), and inferotemporal cortex (IT). Spike timing was crucial to this code. A deep learning model was trained on the same visual input and rewards as the monkeys. Despite lacking an explicit selective attention or other control mechanism, by minimizing error during learning, the model’s representations stretched along task-relevant dimensions, indicating that stretching is an adaptive strategy.
Laser scattering by submicron droplets formed during the electrical explosion of thin metal wires
Abstract This paper presents the results of studying dispersed media formation during the electrical explosion of thin metal wires in vacuum by using low-current generators (~1–10 kA). Particular attention is paid to the analysis of the composition and structure of the corresponding explosion products as well as to the problem of their visualization using simultaneous laser interferometry and shadow imaging at two wavelengths (1.064 µ m and 0.532 µ m). Our findings indicate the important role in the visualization of the explosion products that belongs to multiple scattering by submicron droplets of dense condensed matter, which are mixed with metal vapor. The hypothesis on the existence of submicron droplets in the products of exploding metal wires correlates with the results obtained by soft x-ray radiography combined with a laser probing technique. Taking into account the multiple scattering by submicron droplets, it is possible to significantly clarify the parameters of the explosion products visualized via laser probing techniques as well as to gain a deeper insight into the physics behind the electrical wire explosion.
Atomic-scale visualization of a cascade of magnetic orders in the layered antiferromagnet GdTe3
Abstract GdTe 3 is a layered antiferromagnet which has attracted attention due to its exceptionally high mobility, distinctive unidirectional incommensurate charge density wave (CDW), superconductivity under pressure, and a cascade of magnetic transitions between 7 and 12 K, with as yet unknown order parameters. Here, we use spin-polarized scanning tunneling microscopy to directly image the charge and magnetic orders in GdTe 3 . Below 7 K, we find a striped antiferromagnetic phase with twice the periodicity of the Gd lattice and perpendicular to the CDW. As we heat the sample, we discover a spin density wave with the same periodicity as the CDW between 7 and 12 K; the viability of this phase is supported by our Landau free energy model. Our work reveals the order parameters of the magnetic phases in GdTe 3 and shows how the interplay between charge and spin can generate a cascade of magnetic orders.
Transparent Object Tracking Benchmark
Visual tracking has achieved considerable progress in recent years. However, current research in the field mainly focuses on tracking of opaque objects, while little attention is paid to transparent object tracking. In this paper, we make the first attempt in exploring this problem by proposing a Transparent Object Tracking Benchmark (TOTB). Specifically, TOTB consists of 225 videos (86K frames) from 15 diverse transparent object categories. Each sequence is manually labeled with axis-aligned bounding boxes. To the best of our knowledge, TOTB is the first benchmark dedicated to transparent object tracking. In order to understand how existing trackers perform and to provide comparison for future research on TOTB, we extensively evaluate 25 state-of-the-art tracking algorithms. The evaluation results exhibit that more efforts are needed to improve transparent object tracking. Besides, we observe some nontrivial findings from the evaluation that are discrepant with some common beliefs in opaque object tracking. For example, we find that deeper features are not always good for improvements. Moreover, to encourage future research, we introduce a novel tracker, named TransATOM, which leverages transparency features for tracking and surpasses all 25 evaluated approaches by a large margin. By releasing TOTB, we expect to facilitate future research and application of transparent object tracking in both the academia and industry.
Isochronous and period-doubling diagrams for symplectic maps of the plane
Symplectic mappings of the plane serve as key models for exploring the fundamental nature of complex behavior in nonlinear systems. Central to this exploration is the effective visualization of stability regimes, which enables the interpretation of how systems evolve under varying conditions. While the area-preserving quadratic Hénon map has received significant theoretical attention, a comprehensive description of its mixed parameter-space dynamics remain lacking. This limitation arises from early attempts to reduce the full two-dimensional phase space to a one-dimensional projection, a simplification that resulted in the loss of important dynamical features. Consequently, there is a clear need for a more thorough understanding of the underlying qualitative aspects. This paper aims to address this gap by revisiting the foundational concepts of reversibility and associated symmetries, first explored in the early works of G.D. Birkhoff. We extend the original framework proposed by Hénon by adding a period-doubling diagram to his isochronous diagram, which allows to represents the system’s bifurcations and the groups of symmetric periodic orbits that emerge in typical bifurcations of the fixed point. A qualitative and quantitative explanation of the main features of the region of parameters with bounded motion is provided, along with the application of this technique to other symplectic mappings, including cases of multiple reversibility. Modern chaos indicators, such as the Reversibility Error Method (REM) and the Generalized Alignment Index (GALI), are employed to distinguish between various dynamical regimes in the mixed space of variables and parameters. These tools prove effective in differentiating regular and chaotic dynamics, as well as in identifying twistless orbits and their associated bifurcations. Additionally, we discuss the application of these methods to real-world problems, such as visualizing dynamic aperture in accelerator physics, where our findings have direct relevance.
In situ multimodal imaging for nanoscale visualization of tribofilm formation
A third of the energy from fuel combustion in passenger car gasoline engines is lost due to friction. Carefully designed engine lubricants can recover some of these losses by reducing friction and wear by forming a nanometer-scale chemico-physico tribofilm between surfaces. Accordingly, attention has focused on developing oil formulations that form low-friction tribofilms. However, analyses of resultant tribofilms are typically conducted after tribo-tests with conventional characterization tools and do not offer insights into tribofilm formation and evolution, precluding information critical to tuning tribofilm properties. In this work, we developed a unique multimodal methodology based on Atomic Force Microscopy (AFM) with local probe heating for in situ tribological studies that activates friction modifiers and simultaneously captures the evolution of friction and surface roughness, with nanometer resolution. As a platform to demonstrate the ability of this methodology to visualize dynamics of tribofilm formation in situ, we apply it to molybdenum-based friction modifiers to distinguish key factors in their functionality and correlate nanoscale AFM and Friction Force Microscopy data to bench tribo-tests used in the industry. To decode the formation mechanisms observed in situ and underlying chemistry of tribofilms, we performed ab initio Molecular Dynamics (AIMD) simulations at comparable conditions. AIMD simulations confirmed both nanoscale and bench tribo-test results and showed deviations in molecular organization in tribofilms that are formed from different molybdenum-based friction modifiers that corroborates with surface functionality. With this innovative methodology, we demonstrate proof-of-principle in situ formation of molybdenum-based tribofilms directly on steel surfaces that could be applied generally to studying tribofilm formation.