Search NASA⌕ Search

SEARCH · Search NASA

Results for “vehicle detection and tracking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Sensor Fusion-Based Vehicle Detection and Tracking Using a Single Camera and Radar at a Traffic Intersection

Recent advancements in sensor technologies, in conjunction with signal processing and machine learning, have enabled real-time traffic control systems to adapt to varying traffic conditions. This paper introduces a new sensor fusion approach that combines data from a single camera and radar to achieve cost-effective and efficient vehicle detection and tracking. Initially, vehicles are independently detected and classified using the camera and radar. Then, the constant-velocity model within a Kalman filter is employed to predict vehicle locations, while the Hungarian algorithm is used to associate these predictions with sensor measurements. Finally, vehicle tracking is accomplished by merging kinematic information from predictions and measurements through the Kalman filter. A case study conducted at an intersection demonstrates the effectiveness of the proposed sensor fusion method for traffic detection and tracking, including performance comparisons with individual sensors.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Vehicle Tracking

The detection and tracking of vehicles moving at hypersonic speeds (> Mach 5) at altitudes of ~100 km has been of growing interest due to the ongoing development of hypersonic glide vehicles (HGVs) by the U.S., Russia and China. This challenge is notably different from traditional ballistic missile systems whose re-entry vehicles move at hypersonic velocities but at much higher altitudes on a ballistic course. Hypersonic glide vehicles are also designed to be able to make sudden turns along their flight path making prediction of their trajectories difficult. Their ability to maneuver, combined with their high velocity and altitude make them difficult to track. The combination of these characteristics presents a challenge for anyone attempting to defend against a hypersonic glide vehicle attack by generally shortening the time available to react. That reaction can involve moving potential targets or attempting to detect the hypersonic glide vehicle and intercept it before it reaches the intended target. Figure 1 compares the trajectory of hypersonic vehicles compared to that of a traditional ballistic missile.

42 ENGINEERING↗
DOE OSTI2021

Vehicle Tracking with Crop-based Detection

End-to-end production of vehicle tracking data from video in real-time and with high accuracy remains a challenging problem due to the computational cost of object detection on each frame. In this work we present Tracking with Crop-based Detection, a method for speeding object tracking in constrained contexts (with stable cameras and relatively-predictable object motion) such as vehicle traffic monitoring. We leverage this context to provide a strong prior for object locations, which we use to 1.) boost detection speed by detecting objects only in regions corresponding to object priors on most frames and 2.) inform the selection of the detector output for each object. We evaluate Crop-based Detection as an extension to the KIOU object tracker (Crop-KIOU) on the UA-DETRAC dataset. The proposed tracker outperforms all other reported algorithms in terms of PR-MOTA, PR-MOTP, and mostly tracked objects on the UA-DETRAC benchmark, establishing a new state-of-the-art. Relative to tracking by detection with KIOU, Crop-KIOU achieves a 26% higher frame-rate and increases accuracy. Furthermore, Tracking with Crop-based Detection can be combined with frame skipping; we show a 149% increase in framerate relative to KIOU with no decrease in accuracy using this combination of methods.

Gloudemans, Derek↗
DOE OSTI2021

The Modeled Performance of the ORNL Matched Filter Detector for Seismic Signatures of Multi-Axle Tractor Trailers

The MINOS program seeks methods to passively monitor the transfer of special materials, which are reproducible and quantitatively defensible. To date, we have demonstrated that short-period seismometers deployed near vehicle tracks can detect and monitor signatures of multi-axle tractor trailers impacting small road obstacles as means to detect and identify some transfer activities. In this report, we model the seismic velocity signal output from a tractor-trailer impacting a small obstacle (a template waveform) to parameterize a matched filter that identifies signals with similar shapes buried in noise, and that indicate repeating events (target waveforms). We then use this model to perform thousands of synthetic experiments, in which we apply our detector to identify noisy waveforms output from a similarly modeled vehicle data set; we process all data in the same manner as we process real data collected from the Oak Ridge National Laboratory (ORNL) seismic network. Our experiments, while limited, reveal that the matched filter shows a high discrimination capability, and at very low SNR values (at visibility thresholds). This means that template waveforms can match target waveforms that are sourced by models that share the same vehicle speed (target vehicles), and have a low probability of mis-identification. In particular, a matched filter designed to detect a five-axle tractor-trailer will reliably identify that target vehicle down to an SNR of 11.25 dB, and within ±0.1 km/hr, while successfully screening target vehicles with three axles.

42 ENGINEERING↗
DOE OSTI2023

Contextually aware roadside radiation measurement testbed

Here we demonstrate a contextually aware multimodal roadside radiation measurement detection testbed for traffic monitoring applications in nuclear nonproliferation. Many variables in traffic such as vehicle or cargo size, mass, speed, shape, and distance of closest approach can have significant impacts on the radiation measured from a vehicle-transported radiation source. These factors can lead to uncertainties in the analysis of the radiation source, especially for lower-strength radiation sources of interest. Our testbed, known as the Multimodal Measurement System (MMS) uses non-radiation sensors including magnetometers, geophones, radiofrequency receivers, cameras, and LiDAR to extract contextual information about vehicles passing by the system. These contextual data can then be fused with data from radiation measurements to increase the system’s sensitivity and accuracy in nuclear threat detection applications. This work describes the instrumentation of the MMS and its data acquisition pipeline. Furthermore, we describe the pre-analysis performed on the raw multimodal data streams for data fusion, and the high-level machine learning analyses for detection and characterization. The variety of sensors within the MMS provides a valuable testbed that can be used to identify the combinations of contextual sensors that provide the greatest improvements to radiation source detection and characterization within the restrictions for various proliferation detection applications. The MMS is also modular so that additional combinations of sensors can be explored in the future.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Estimation of Arrivals on Green at Signalized Intersections Using Stop-Bar Video Detection

Across the world, traffic congestion is increasing with alarming rapidity. Traffic signal control effectiveness, in coordinated networks, is often investigated in relation to the type of vehicle arrivals at the signalized intersections. Recently, several transportation agencies have switched from traditional loop detectors to video detection. When video cameras are accompanied by computer vision, one can extract more information about traffic “dynamics” than by using traditional inductive loop detectors. Collecting arrival times of multiple vehicles after the first arrival at the stop-bar detector might be challenging when using inductive loop detectors (since after the first arrival, detector status is always occupied). However, emerging video detection systems allow tracking of each vehicle’s entrance time in the detection zone, departure time from the detection zone, and the type of vehicle. This information can be used to estimate vehicular arrival and departure times, which then can be fed into machine learning algorithms to estimate arrivals on green (AOG). However, such research ideas have not been documented so far. Thus, this paper presents an estimation model for AOG, which was developed using multigene genetic programming. A robust experimental dataset was collected from a highly calibrated and validated microsimulation model of an 11-intersection corridor in Chattanooga, TN. The results of the model’s performance analysis showed the high accuracy of the training-, testing-, and validation datasets. The practical benefit of this model is that it can be applied to estimate arrival types at intersections where only stop-bar video detection exists.

Engineering↗
DOE OSTI2021

Biologically Inspired Interception on an Unmanned System

Borrowing from nature, neural-inspired interception algorithms were implemented onboard a vehicle. To maximize success, work was conducted in parallel within a simulated environment and on physical hardware. The intercept vehicle used only optical imaging to detect and track the target. A successful outcome is the proof-of-concept demonstration of a neural-inspired algorithm autonomously guiding a vehicle to intercept a moving target. This work tried to establish the key parameters for the intercept algorithm (sensors and vehicle) and expand the knowledge and capabilities of implementing neural-inspired algorithms in simulation and on hardware.

42 ENGINEERING↗
DOE OSTI2024

Vehicle Position Detection Based on Machine Learning Algorithms in Dynamic Wireless Charging

Dynamic wireless charging (DWC) has emerged as a viable approach to mitigate range anxiety by ensuring continuous and uninterrupted charging for electric vehicles in motion. DWC systems rely on the length of the transmitter, which can be categorized into long-track transmitters and segmented coil arrays. The segmented coil array, favored for its heightened efficiency and reduced electromagnetic interference, stands out as the preferred option. However, in such DWC systems, the need arises to detect the vehicle’s position, specifically to activate the transmitter coils aligned with the receiver pad and de-energize uncoupled transmitter coils. This paper introduces various machine learning algorithms for precise vehicle position determination, accommodating diverse ground clearances of electric vehicles and various speeds. Through testing eight different machine learning algorithms and comparing the results, the random forest algorithm emerged as superior, displaying the lowest error in predicting the actual position.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Detecting the Presence of Intrusive Drilling in Secure Transport Containers Using Non-Contact Millimeter-Wave Radar

We employ a 77–81 GHz frequency-modulated continuous-wave (FMCW) millimeter-wave radar to sense anomalous vibrations during vehicle transport at highway speeds for the first time. Secure metallic containers can be breached during transport by means of drilling into their sidewalls but detecting a drilling signature is difficult because the large vibrations of transport drown out the small vibrations of drilling. For the first time, we demonstrate that it is possible to use a non-contact millimeter-wave radar sensor to detect this micron-scale intrusive drilling while highway-speed vehicle movement shakes the container. With the millimeter-wave radar monitoring the microdoppler signature of the container’s vibrating walls, we create a novel signal-processing pipeline consisting of range–angle tracking, time–frequency analysis, horizontal stripe image convolution, and principal component analysis to create a robust and powerful detection statistic to alarm if drilling is present. To support this pipeline, we develop a statistical model combining the vibrating container and the random vibrations induced by vehicle movement to explore the robustness of the sensor’s detection capabilities. The presented results strongly support the inclusion of a millimeter-wave radar vibration sensor into a transport security system.

Wagner, Samuel↗
DOE OSTI2020

2020 Transportation Research Board Workshop: Infrastructure Spatial Sensing at Intersections: The Potential to Enhance Safety and Enable Automation

The sensing technology that is enabling vehicle automation also can revolutionize traffic intersection safety, control, and efficiency. Infrastructure spatial sensing technology refers to the deployment of sensors that can detect and track all objects in the field of view - for example, mounting lidar sensors, radar, and video imaging at an intersection and fusing the data to produce a three-dimensional dynamic operational awareness. Combining such sensing capability with fail-safe vehicle communications can facilitate applications such as eco-approach and departure, optimizing efficient vehicle-signal coordination, and reducing traffic accidents through increasing safety. Furthermore, evidence is mounting suggesting that infrastructure-based sensing is needed in order to safely deploy automated public mobility alongside the normal vehicle and pedestrian traffic in our cities. Six speakers were invited to present their work from various aspects (safety, efficiency, and automation) addressing infrastructure-based sensing at the workshop on Infrastructure Spatial Sensing hosted in Washington DC as part of the Transportation Research Board Annual Meeting in January 12, 2019. A summary of the presentation are included herein.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Automated Vehicle Multi-Object Tracking at Scale with CAN

Millions of vehicles are on the road with RADAR sensors in use for adaptive cruise control (ACC), and RADAR sen- sors are not tracking all of the objects in the field of view. This work shows a work-in-progress tool to improve track- ing from RADAR and controller area network (CAN) which should be vitally useful for safety of transportation systems and automated vehicle development. The CAN data provides object detections, but there is a lingering data association problem. The contribution of this work in progress is the solution to the data association problem by posing the data association as a minimum cost network flow problem, and doing it at low cost with an eye toward scalable CPS research.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2024

So you think you can track?

This work introduces a multi-camera tracking dataset consisting of 234 hours of video data recorded concurrently from 234 overlapping HD cameras covering a 4.2 mile stretch of 8-10 lane interstate highway near Nashville, TN. Video is recorded in cooperation with Tennessee State Department of Transportation and its policies. The video is recorded during a period of high traffic density with 500+ objects typically visible within the scene and typical object longevities of 3-15 minutes. GPS trajectories from 270 vehicle passes through the scene are manually corrected in the video data to provide a set of ground-truth trajectories for recall-oriented tracking metrics, and object detections are provided for each camera in the scene (159 million total before cross-camera fusion). Initial benchmarking of tracking-by-detection algorithms is performed against the GPS trajectories, and a best HOTA of only 9.5% is obtained (best recall 75.9% at IOU 0.1, 47.9 average IDs per ground truth object), indicating the benchmarked trackers do not perform sufficiently well at the long temporal and spatial durations required for traffic scene understanding. Video data, scene information, and vehicle trajectories are made publicly available at i24motion.org.

42 ENGINEERING↗
DOE OSTI2021

Fast Vehicle Turning-Movement Counting using Localization-based Tracking

Despite the high utility of traffic volume and turning movement data, such data is still hard to come by for the vast majority of roadways and intersections in nearly ev- ery city. Edge computing devices offer a promising tool for recording turning movement data if lightweight algorithms can be designed to run in real-time with relatively modest computational complexity. To that end, this work presents Vehicle Turning-Movement Counting using Localization- based Tracking (LBT-Count). This method is fast because it never performs detection on a full frame. Instead, only a few portions of the image are cropped and used to de- tect objects within the frame. The method achieves com- petitive performance on the public evaluation server for Track 1 of the AI City Challenge (7th overall on the first 50% of data). Furthermore, we show that LBT-Count is 52% faster than an analogous counting algorithm utilizing a traditional tracking-by-detection framework on available challenge data.

42 ENGINEERING↗
DOE OSTI2021

Multi-INT Signature Collection and Exploitation for Security: Improving Discrimination, Analyses, and Passive Tracking Capabilities for Time- and Distance-Varying Signatures in the Seismoacoustic Regime

This project demonstrates the feasibility of a passive tracking capability for ground-based and airborne moving sources using multiple information streams from acoustic and seismic signals. These moving source types are characterized by their variability with time and distance (exemplified but not limited to the familiar doppler shift of a passing vehicle) and the signatures used for detection should have similar characteristics. We have demonstrated that time-varying sensor signatures (TVS) combined with time-stable sensor signatures provide a more complete understanding of moving source behavior. Importantly, we have collected a new, relevant LANL dataset of moving sources (small uncrewed aerial vehicle flights and ground vehicle movement), developed new signatures, and demonstrated the capability to identify, track and forecast the position of these moving sources.

42 ENGINEERING↗
DOE OSTI2025

Descriptor: Infrastructure Perception and Control: Multi-Sensor Object Tracking Dataset (IPC-MSOT)

Traffic intersections are crucial and challenging nodes in transportation networks where multiple lanes of vehicles and pedestrians converge. Traffic accidents often occur at traffic intersections, including a large proportion of traffic fatalities and about one-half of all traffic injuries in the United States. Object detection data were collected in 2024 across three intersections in Colorado Springs, CO, USA, over the course of multiple days and various times to induce a heterogeneous mix of traffic conditions and behaviors. The purpose of the data collection exercises was to learn various attributes about infrastructure sensors and to build a repository of high-resolution, object-level data that can be used for research and development (e.g., to develop multisensor data fusion algorithms). The Infrastructure Perception and Control:Multi-Sensor Object tracking (IPC-MSOT) dataset was collected as part of the U.S. Department of Transportation's Strengthening Mobility and Revolutionizing Transportation (SMART) project, where the city of Colorado Springs, Colorado, and the National Renewable Energy Laboratory collaborated to collect object-level trajectory data from road users using multiple types of infrastructure sensors deployed at different intersections. This dataset allows for testing of late-stage sensor fusion algorithms and their ability to ingest multimodal sensor data, and it can be utilized by traffic engineers to design and evaluate trajectory-based signal control strategies.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

Real-Time Multi-Vehicle Multi-Camera Tracking with Graph-Based Tracklet Features

An essential application in intelligent transportation systems is multi-target multi-camera tracking (MTMCT), where the target’s activity is tracked from different cameras. Although the tracking-by-detection scheme is the primary paradigm in MTMCT, the object association information from the video frames is lost. This is mainly because the multi-camera multi-object matching uses the information from the video frames separately. To solve this problem and leverage this association information, we propose an MTMCT framework, where features are built in the form of a graph and a graph similarity algorithm is used to match multi-camera objects. In this paper, we focus on the real-time scenario, where only the past images are used to match an object. Our method achieves an IDF1 score (the ratio of the number of correctly identified objects to the number of ground truth and average objects) of 0.75 with a rate of 14 frames per second (fps).

Engineering↗
DOE OSTI2024

Safe Operations at Roadway Junctions: Intelligent Roadway Infrastructure as Functional Interlocking

Automated vehicle (AV) technology is quickly maturing, and the corresponding infrastructure systems that evaluate traffic and communicate to vehicles requires sophisticated sensing and perception technologies, referred to as intelligent roadway infrastructure (IRI), to complement emerging AV capabilities. IRI provides signals to vehicles, indicating right-of-way for vehicles and communicating to approaching AVs that no other vehicle is failing to yield. This capability, denoted as safety-affirmative signaling, provides a green light or a green arrow as appropriate and affirms through communication links to connected vehicles when it is safe to proceed. About 36% of collisions occur at intersections, with most occurring upon left turns (22.2%) or crossing over (12.6%), and only a small percentage (1.2%) while turning right at an intersection. Of all intersection crashes about half (52.5%) of those vehicles were traveling through a signalized intersection 2. Safety-affirmative signaling would guarantee safety of AV fleet vehicles, by providing the interlocking principle, a term from automated train control that only allows progression through a railway intersection after affirming no opportunity for a crash exists. IRI through safety-affirmative signaling would bring performance and safety to complex roadway intersections where AV transit fleet service is most needed, as well as safety benefits to traditional, non-automated vehicles and vulnerable road users. The implementation of IRI has functional, programmatic, and technical challenges. Research work performed at the National Renewable Energy Laboratory (NREL) in an integrative approach encapsulating these themes, and termed infrastructure perception and control (IPC) is motivated by improved performance (travel time), improved safety (reduced collisions), and improved energy efficiency (less fuel burned and minimized production of greenhouse gases). IPC is intended not only for roadway and intersection applications but also in extension to inform complementary buildings and grid systems to enable better co-management, as vehicles and their charging needs become increasingly integrated into the built environment. The NREL IPC project presents an open-source framework, architecture, and supporting technology to implement IRI, addressing critical issues such as fusion of data, reliability, standardization of data interfaces, and confidence of detection. The framework is informed by previous experience in U.S. Department of Defense research technology, specifically in the use of radar to detect, identify, and track aerial threats. These principles combined with multi-sensor fusion provides for a complete digital twin with known and measurable confidence and accuracy from which safety-affirmative signaling can be developed and deployed.

ADVANCED PROPULSION SYSTEMS,MATHEMATICS AND COMPUT↗
DOE OSTI2021

Multi-INT Signature Collection and Exploitation for Security Los Alamos LDRD Report

This project demonstrates the feasibility of a 2-D passive tracking capability for ground-based and airborne moving sources using multi-INT signal processing of acoustic and seismic signals. We leveraged the recent DDSTE-supported investment in rapid deployable sensors (the Los Alamos Rapid-deployable Sensor Array—LARSA), and used uncrewed aerial vehicles (UAV) as a data source. Moving source types are characterized by their variability with time (exemplified but not limited to the Doppler shift of a passing vehicle) and the signatures used for detection should have similar characteristics. We have demonstrated that time-varying sensor signatures (TVS) combined with time-stable sensor signatures provide a more complete understanding of moving source behavior and drive towards path prediction. Importantly, we have collected a new, relevant LANL dataset of moving sources (small UAV flights and vehicle movement), developed new signatures, and demonstrated a capability to identify, track and forecast the position of TVS.

42 ENGINEERING↗