Search NASA⌕ Search

SEARCH · Search NASA

Results for “VISUAL TRACKING”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

TracKlinic: Diagnosis of Challenge Factors in Visual Tracking

Generic visual object tracking is difficult due to many challenge factors (e.g., occlusion, blur, etc.). Each of these factors may cause serious problems for a tracker, and when they work together can make things even more complicated. Despite a great amount of efforts devoted to understanding the behavior of trackers, reliable and quantifiable ways for studying the per factor tracking behavior remain barely available. Addressing this issue, in this paper we contribute to the community a tracking diagnosis toolkit, TracKlinic, for diagnosis of challenge factors of tracking algorithms. TracKlinic consists of two novel components focusing on the data and analysis aspects, respectively. For the data component, we carefully prepare a set of 2,390 annotated videos, each involving one and only one major challenge factor. When analyzing an algorithm for a specific challenge factor, such one-factor-per-sequence rule greatly inhibits the disturbance from other factors and consequently leads to more faithful analysis. For the analysis component, given the tracking results on all sequences, it investigates the behavior of the tracker under each individual factor and generates the report automatically. With TracKlinic, a thorough study is conducted on ten state-of-the-art trackers on nine challenge factors (including two compound ones). The results suggest that, heavy shape variation and occlusion are the two most challenging factors faced by most trackers. Besides, out-of-view, though does not happen frequently, is often fatal. By sharing TracKlinic1, we expect to make it much easier for diagnosing tracking algorithms, and to thus facilitate developing better ones.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2021

Transparent Object Tracking Benchmark

Visual tracking has achieved considerable progress in recent years. However, current research in the field mainly focuses on tracking of opaque objects, while little attention is paid to transparent object tracking. In this paper, we make the first attempt in exploring this problem by proposing a Transparent Object Tracking Benchmark (TOTB). Specifically, TOTB consists of 225 videos (86K frames) from 15 diverse transparent object categories. Each sequence is manually labeled with axis-aligned bounding boxes. To the best of our knowledge, TOTB is the first benchmark dedicated to transparent object tracking. In order to understand how existing trackers perform and to provide comparison for future research on TOTB, we extensively evaluate 25 state-of-the-art tracking algorithms. The evaluation results exhibit that more efforts are needed to improve transparent object tracking. Besides, we observe some nontrivial findings from the evaluation that are discrepant with some common beliefs in opaque object tracking. For example, we find that deeper features are not always good for improvements. Moreover, to encourage future research, we introduce a novel tracker, named TransATOM, which leverages transparency features for tracking and surpasses all 25 evaluated approaches by a large margin. By releasing TOTB, we expect to facilitate future research and application of transparent object tracking in both the academia and industry.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2013

Feature Tracking and Visualization of Madden-Julian Osciallation in Climate Simulation

Madden-Julian Oscillation (MJO) is one of the less understood aspects of tropical meteorology, which plays a significant role in tropical intra-seasonal variations in rain, temperature and winds over the Indian and Pacific Oceans. In this paper, we present an integrated analysis and visualization framework for MJO episodes simulated by a high resolution regional model. To distinguish MJOs from other weather phenomena, our framework utilizes domain knowledge to track MJOs as finding the globally optimized properties in the data. In addition to enhancing the animation with feature tracking, our visualization system also integrates different visualization components such as Virtual Globe and Hovmoller Diagrams to visualize large scale events both in space and time. By linking all of these visualization components on a web-based interface, scientists can identify cloud and environmental processes associated with the initiation and eastward propagation of MJO more easily.

big-data visualization↗
DOE OSTI2020

Geometry-Driven Detection, Tracking and Visual Analysis of Viscous and Gravitational Fingers

Viscous and gravitational flow instabilities cause a displacement front to break up into finger-like fluids. The detection and evolutionary analysis of these fingering instabilities are critical in multiple scientific disciplines such as fluid mechanics and hydrogeology. However, previous detection methods of the viscous and gravitational fingers are based on density thresholding, which provides limited geometric information of the fingers. The geometric structures of fingers and their evolution are important yet little studied in the literature. In this work, we explore the geometric detection and evolution of the fingers in detail to elucidate the dynamics of the instability. Additionally, we propose a ridge voxel detection method to guide the extraction of finger cores from three-dimensional (3D) scalar fields. After skeletonizing finger cores into skeletons, we design a spanning tree based approach to capture how fingers branch spatially from the finger skeletons. Finally, we devise a novel geometric-glyph augmented tracking graph to study how the fingers and their branches grow, merge, and split over time. Feedback from earth scientists demonstrates the usefulness of our approach to performing spatio-temporal geometric analyses of fingers.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

Storyline Visualizations of Eye Tracking of Movie Viewing

Storyline visualizations offer an approach that promises to capture the spatio-temporal characteristics of individual observers and simultaneously illustrate emerging group behaviors. We develop a visual analytics approach to parsing, aligning, and clustering fixation sequences from eye tracking data. Visualization of the results captures the similarities and differences across a group of observers performing a common task. We apply our storyline approach to visualize gaze patterns of people watching dynamic movie clips. Storylines mitigate some of the shortcomings of existent spatio-temporal visualization techniques and, importantly, continue to highlight individual observer behavioral dynamics.

dynamic time warping↗
DOE OSTI2015

SU-E-T-570: New Quality Assurance Method Using Motion Tracking for 6D Robotic Couches

Purpose: To accommodate geometrically accurate patient positioning, a robotic couch that is capable of 6-degrees of freedom has been introduced. However, conventional couch QA methods are not sufficient to enable the necessary accuracy of tests. Therefore, we have developed a camera based motion detection and geometry calibration system for couch QA. Methods: Employing a Visual-Tracking System (VTS, BonitaB10, Vicon, UK) which tracks infrared reflective(IR) markers, camera calibration was conducted using a 5.7 × 5.7 × 5.7 cm{sup 3} cube attached with IR markers at each corner. After positioning a robotic-couch at the origin with the cube on the table top, 3D coordinates of the cube’s eight corners were acquired by VTS in the VTS coordinate system. Next, positions in reference coordinates (roomcoordinates) were assigned using the known relation between each point. Finally, camera calibration was completed by finding a transformation matrix between VTS and reference coordinate systems and by applying a pseudo inverse matrix method. After the calibration, the accuracy of linear and rotational motions as well as couch sagging could be measured by analyzing the continuously acquired data of the cube while the couch moves to a designated position. Accuracy of the developed software was verified through comparison with measurement data when using a Laser tracker (FARO, Lake Mary, USA) for a robotic-couch installed for proton therapy. Results: VTS system could track couch motion accurately and measured position in room-coordinates. The VTS measurements and Laser tracker data agreed within 1% of difference for linear and rotational motions. Also because the program analyzes motion in 3-Dimension, it can compute couch sagging. Conclusion: Developed QA system provides submillimeter/ degree accuracy which fulfills the high-end couch QA. This work was supported by the National Research Foundation of Korea funded by Ministry of Science, ICT & Future Planning. (2013M2A2A7043507 and 2012M3A9B6055201)

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2020

High precision control and deep learning-based corn stand counting algorithms for agricultural robot

This paper presents high precision control and deep learning-based corn stand counting algorithms for a low-cost, ultra-compact 3D printed and autonomous field robot for agricultural operations. Currently, plant traits, such as emergence rate, biomass, vigor, and stand counting, are measured manually. This is highly labor-intensive and prone to errors. The robot, termed TerraSentia, is designed to automate the measurement of plant traits for efficient phenotyping as an alternative to manual measurements. In this paper, we formulate a Nonlinear Moving Horizon Estimator that identifies key terrain parameters using onboard robot sensors and a learning-based Nonlinear Model Predictive Control that ensures high precision path tracking in the presence of unknown wheel-terrain interaction. Moreover, we develop a machine vision algorithm designed to enable an ultra-compact ground robot to count corn stands by driving through the fields autonomously. The algorithm leverages a deep network to detect corn plants in images, and a visual tracking model to re-identify detected objects at different time steps. We collected data from 53 corn plots in various fields for corn plants around 14 days after emergence (stage V3 - V4). The robot predictions have agreed well with the ground truth with C robot =1.02×C human -0.86 and a correlation coefficient R=0.96. The mean relative error given by the algorithm is -3.78%, and the standard deviation is 6.76%. These results indicate a first and significant step towards autonomous robot-based real-time phenotyping using low-cost, ultra-compact ground robots for corn and potentially other crops.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2019

Port Hope Area Initiative: Information Management for A Very Large Radiation Survey - 19567

The Port Hope Area Initiative (PHAI) represents the Government of Canada's commitment to the cleanup and safe, local, long-term management of historic low-level radioactive waste (LLRW) in two Southern Ontario municipalities - Port Hope. The PHAI is based on community-recommended solutions for the cleanup and safe long-term management of approximately 1.7 million cubic meters of LLRW. It is currently one of Canada's largest environmental remediation projects at a cost of over one billion dollars. The PHAI is being implemented by Canadian Nuclear Laboratories (CNL) on behalf of Atomic Energy of Canada Limited, a federal Crown corporation. The waste is the result of radium and uranium processing in Port Hope by the former federal crown corporation Eldorado Nuclear Limited between 1933 and 1988. The waste has been distributed in the Municipality of Port Hope through placement of contaminated materials (e.g. fill), reuse of contaminated objects (e.g. tailings use in concrete, steel posts, structural wood) and air-borne deposition. Signature contaminants of potential concern (COPCs) are Ra-226, Th-230, uranium and arsenic; however, there are an additional 17 COPCs that also need to be considered. A very large amount of information has been collected during the survey and effectively managing and analyzing this information is critical to the success for the property owners, CNL's implementation of the PHAI, and Arcadis. Data collected during the survey includes information pertaining to long-term interior radon gas measurements, interior gamma radiation surveys, contaminated objects and surfaces, exterior gamma radiation and subsurface investigations. exterior gamma radiation surveys. The information management (IM) is structured with SharePoint as a focal point supported by an EQuIS database, mobile data collection and GIS support. The IM process for this project is being advanced using recent software developments to assist with internal activities (e.g. QA) and interactions with CNL including notifications and scheduling and status of property completion. Different applications have been developed to help automate, visualize, actively track, and QA different processes using recent software developments by Microsoft. We have used SharePoint to organize and track our data. Power BI has been used to actively track and visualize our data from Interior gamma surveying to exterior drilling. The creation of dynamic/advanced visualizations in Power BI gathers data daily from our multiple sources and analyzes it for anomalous data and trends. Microsoft Flow syncs with Power BI and has been implemented to automate many processes including the QA of surveys and soil results for identification of LLRW. To tie everything together, our GIS and EQuIS systems are our primary data compilation source that makes our advanced analytics/visualization and automation/tracking our data possible. Specific examples will be discussed, as will challenges encountered during the continuing development of the IM system. The incorporation of software advancements to the existing IM system for Port Hope characterization has improved the quality of the surveys, the tracking of completion, meeting schedule requirements and providing the required data for tracking, report preparation and supporting remediation of contamination on the properties. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2014

Adaptation of the modified Bouc–Wen model to compensate for hysteresis in respiratory motion for the list-mode binning of cardiac SPECT and PET acquisitions: Testing using MRI

Purpose: Binning list-mode acquisitions as a function of a surrogate signal related to respiration has been employed to reduce the impact of respiratory motion on image quality in cardiac emission tomography (SPECT and PET). Inherent in amplitude binning is the assumption that there is a monotonic relationship between the amplitude of the surrogate signal and respiratory motion of the heart. This assumption is not valid in the presence of hysteresis when heart motion exhibits a different relationship with the surrogate during inspiration and expiration. The purpose of this study was to investigate the novel approach of using the Bouc–Wen (BW) model to provide a signal accounting for hysteresis when binning list-mode data with the goal of thereby improving motion correction. The study is based on the authors’ previous observations that hysteresis between chest and abdomen markers was indicative of hysteresis between abdomen markers and the internal motion of the heart. Methods: In 19 healthy volunteers, they determined the internal motion of the heart and diaphragm in the superior–inferior direction during free breathing using MRI navigators. A visual tracking system (VTS) synchronized with MRI acquisition tracked the anterior–posterior motions of external markers placed on the chest and abdomen. These data were employed to develop and test the Bouc–Wen model by inputting the VTS derived chest and abdomen motions into it and using the resulting output signals as surrogates for cardiac motion. The data of the volunteers were divided into training and testing sets. The training set was used to obtain initial values for the model parameters for all of the volunteers in the set, and for set members based on whether they were or were not classified as exhibiting hysteresis using a metric derived from the markers. These initial parameters were then employed with the testing set to estimate output signals. Pearson’s linear correlation coefficient between the abdomen, chest, average of chest and abdomen markers, and Bouc–Wen derived signals versus the true internal motion of the heart from MRI was used to judge the signals match to the heart motion. Results: The results show that the Bouc–Wen model generated signals demonstrated strong correlation with the heart motion. This correlation was slightly larger on average than that of the external surrogate signals derived from the abdomen marker, and average of the abdomen and chest markers, but was not statistically significantly different from them. Conclusions: The results suggest that the proposed model has the potential to be a unified framework for modeling hysteresis in respiratory motion in cardiac perfusion studies and beyond.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2025

Immersive Digital Twin Laboratory for Engineering Education (CRADA Final Report)

This project aimed to create an immersive digital twin laboratory that incorporates advanced tracking and visualization capabilities. In collaboration with Fort Lewis College, NREL designed a state-of-the-art physical visualization laboratory, developed a software platform to enable interaction with tracked physical objects in the laboratory, and provided proof-of-concept curricula that included manipulating these tracked objects. The project was initiated to address the growing need for innovative educational tools in engineering education. As renewable energy systems, particularly solar installations, become more complex, there is a pressing need to bridge the gap between theoretical knowledge and practical application. Traditional methods of teaching solar engineering concepts often fall short of providing students with a comprehensive, hands-on understanding. This immersive digital twin laboratory was conceived to fill that gap by creating a safe, non-energized setting where students can interact with augmented solar installation objects, gaining valuable insights into system performance, design, and maintenance. The project utilized extended reality (XR) technologies, including head-mounted displays (HMDs) and a whole-room optical motion tracking system, to connect physical objects with their digital twins in real time. The laboratory was equipped with MagicLeap 2 HMDs, supported by a Vicon Vero 2.2 Optical Tracking System, which provided precise 6-degrees-of-freedom (6-DOF) tracking. We developed a software platform to manage the interaction between the tracked physical objects and their virtual counterparts, enabling real-time data synchronization, object recognition, and virtual overlays. We designed the system to be flexible and extendable, allowing for future integration of additional objects and curriculum. This research advances the field of engineering education by demonstrating the potential of immersive digital twin environments. The laboratory provides a dynamic learning space where students can experiment, collaborate, and learn without the risks associated with live experimentation. The ability to simulate and manipulate solar installation objects under various conditions has broad implications for workforce development, particularly in renewable energy. The project also highlights the economic feasibility of using XR technologies in educational settings, offering a cost-effective solution for institutions looking to enhance their curriculum. By fostering a deeper understanding of solar energy systems, this work contributes to the broader goal of supporting the global energy transition and preparing the next generation of engineers and technicians.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2018

Exploration of thermal counterflow in He II using particle tracking velocimetry

Flow visualization using particle image velocimetry (PIV) and particularly particle tracking velocimetry (PTV) has been applied to thermal counterflow in He II for nearly two decades now, but the results remain difficult to interpret because tracer particle motion can be influenced by both the normal fluid and superfluid components of He II as well as the quantized vortex tangle. For instance, in one early experiment it was observed (using PTV) that tracer particles move at the normal fluid velocity v n , while in another it was observed (using PIV) that particles move at v n /2. Besides the different visualization methods, the range of applied heat flux investigated by these experiments differed by an order of magnitude. To resolve this apparent discrepancy and explore the statistics of particle motion in thermal counterflow, we apply the PTV method to a wide range of heat flux at a number of different fluid temperatures. In our analysis, we introduce a scheme for analyzing the velocity of particles presumably moving with the normal fluid separately from those presumably influenced by the quantized vortex tangle. Our results show that for lower heat flux there are two distinct peaks in the streamwise particle velocity probability density function (PDF), with one centered at the normal fluid velocity v n (named G2 for convenience) while the other is centered near v n /2 (G1). For higher heat flux there is a single peak centered near v n /2 (G3). Using our separation scheme, we show quantitatively that there is no size difference between the particles contributing to G1 and G2. We also show that nonclassical features of the transverse particle velocity PDF arise entirely from G1, while the corresponding PDF for G2 exhibits the classical Gaussian form. The G2 transverse velocity fluctuation, backed up by second sound attenuation in decaying counterflow, suggests that large-scale turbulence in the normal fluid is absent from the two-peak region. We offer a brief discussion of the physical mechanisms that may be responsible for our observations, revealing that G1 velocity fluctuations may be linked to fluctuations of quantized vortex line velocity, and suggest a number of numerical simulations that may reveal the underlying physics in detail.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2015

Development of a video image-based QA system for the positional accuracy of dynamic tumor tracking irradiation in the Vero4DRT system

Purpose: To develop and evaluate a new video image-based QA system, including in-house software, that can display a tracking state visually and quantify the positional accuracy of dynamic tumor tracking irradiation in the Vero4DRT system. Methods: Sixteen trajectories in six patients with pulmonary cancer were obtained with the ExacTrac in the Vero4DRT system. Motion data in the cranio–caudal direction (Y direction) were used as the input for a programmable motion table (Quasar). A target phantom was placed on the motion table, which was placed on the 2D ionization chamber array (MatriXX). Then, the 4D modeling procedure was performed on the target phantom during a reproduction of the patient’s tumor motion. A substitute target with the patient’s tumor motion was irradiated with 6-MV x-rays under the surrogate infrared system. The 2D dose images obtained from the MatriXX (33 frames/s; 40 s) were exported to in-house video-image analyzing software. The absolute differences in the Y direction between the center of the exposed target and the center of the exposed field were calculated. Positional errors were observed. The authors’ QA results were compared to 4D modeling function errors and gimbal motion errors obtained from log analyses in the ExacTrac to verify the accuracy of their QA system. The patients’ tumor motions were evaluated in the wave forms, and the peak-to-peak distances were also measured to verify their reproducibility. Results: Thirteen of sixteen trajectories (81.3%) were successfully reproduced with Quasar. The peak-to-peak distances ranged from 2.7 to 29.0 mm. Three trajectories (18.7%) were not successfully reproduced due to the limited motions of the Quasar. Thus, 13 of 16 trajectories were summarized. The mean number of video images used for analysis was 1156. The positional errors (absolute mean difference + 2 standard deviation) ranged from 0.54 to 1.55 mm. The error values differed by less than 1 mm from 4D modeling function errors and gimbal motion errors in the ExacTrac log analyses (n = 13). Conclusions: The newly developed video image-based QA system, including in-house software, can analyze more than a thousand images (33 frames/s). Positional errors are approximately equivalent to those in ExacTrac log analyses. This system is useful for the visual illustration of the progress of the tracking state and for the quantification of positional accuracy during dynamic tumor tracking irradiation in the Vero4DRT system.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2015

Tracking single particle rotation: Probing dynamics in four dimensions

Direct visualization and tracking of small particles at high spatial and temporal resolution provides a powerful approach to probing complex dynamics and interactions in chemical and biological processes. Analysis of the rotational dynamics of particles adds a new dimension of information that is otherwise impossible to obtain with conventional 3-D particle tracking. In this review, we survey recent advances in single-particle rotational tracking, with highlights on the rotational tracking of optically anisotropic Janus particles. Furthermore, strengths and weaknesses of the various particle tracking methods, and their applications are discussed.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗