Search NASA⌕ Search

SEARCH · Search NASA

Results for “vehicle detection and tracking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Global Positioning System Synchronized Active Light Autonomous Docking System

A Global Positioning System Synchronized Active Light Autonomous Docking System (GPSSALADS) for automatically docking a chase vehicle with a target vehicle comprises at least one active light emitting target which is operatively attached to the target vehicle. The target includes a three-dimensional array of concomitantly flashing lights which flash at a controlled common frequency. The GPSSALADS further comprises a visual tracking sensor operatively attached to the chase vehicle for detecting and tracking the target vehicle. Its performance is synchronized with the flash frequency of the lights by a synchronization means which is comprised of first and second internal clocks operatively connected to the active light target and visual tracking sensor, respectively, for providing timing control signals thereto, respectively. The synchronization means further includes first and second Global Positioning System receivers operatively connected to the first and second internal clocks, respectively, for repeatedly providing simultaneous synchronization pulses to the internal clocks, respectively. In addition, the GPSSALADS includes a docking process controller means which is operatively attached to the chase vehicle and is responsive to the visual tracking sensor for producing commands for the guidance and propulsion system of the chase vehicle.

Howard, Richard↗

Global Positioning System Synchronized Active Light Autonomous Docking System

A Global Positioning System Synchronized Active Light Autonomous Docking System (GPSSALADS) for automatically docking a chase vehicle with a target vehicle comprising at least one active light emitting target which is operatively attached to the target vehicle. The target includes a three-dimensional array of concomitantly flashing lights which flash at a controlled common frequency. The GPSSALADS further comprises a visual tracking sensor operatively attached to the chase vehicle for detecting and tracking the target vehicle. Its performance is synchronized with the flash frequency of the lights by a synchronization means which is comprised of first and second internal clocks operatively connected to the active light target and visual tracking sensor, respectively, for providing timing control signals thereto, respectively. The synchronization means further includes first and second Global Positioning System receivers operatively connected to the first and second internal clocks, respectively, for repeatedly providing simultaneous synchronization pulses to the internal clocks, respectively. In addition, the GPSSALADS includes a docking process controller means which is operatively attached to the chase vehicle and is responsive to the visual tracking sensor for producing commands for the guidance and propulsion system of the chase vehicle.

Howard, Richard T.↗

A sensor for control of arterials and networks

The sensor for control of arterials and networks (SCAN) uses imaging technology and processing technology to jointly provide real-time quantification. The SCAN concept consists of a television camera mounted on a pole to obtain images of the traffic, and a microprocessor to process the image data into traffic parameters. The current activities focus on the development of SCAN for surveillance of arterials or urban highways. If these efforts are successful, an attempt will be made to extend the concept to network applications. The key software developed for the SCAN is a vehicle detection and tracking algorithm which reduces the TV image data to vehicle descriptions and trajectories. These preprocessed trajectory data can be transmitted over a phone line or can be easily reduced to a wide range of traffic parameters. A SCAN breadboard has been implemented and installed in a van which enables remote field tests and evaluations. The SCAN breadboard and its operation, evaluation, and potential applications are described.

Hilbert, E. E.↗

360-Degree Visual Detection and Target Tracking on an Autonomous Surface Vehicle

This paper describes perception and planning systems of an autonomous sea surface vehicle (ASV) whose goal is to detect and track other vessels at medium to long ranges and execute responses to determine whether the vessel is adversarial. The Jet Propulsion Laboratory (JPL) has developed a tightly integrated system called CARACaS (Control Architecture for Robotic Agent Command and Sensing) that blends the sensing, planning, and behavior autonomy necessary for such missions. Two patrol scenarios are addressed here: one in which the ASV patrols a large harbor region and checks for vessels near a fixed asset on each pass and one in which the ASV circles a fixed asset and intercepts approaching vessels. This paper focuses on the ASV's central perception and situation awareness system, dubbed Surface Autonomous Visual Analysis and Tracking (SAVAnT), which receives images from an omnidirectional camera head, identifies objects of interest in these images, and probabilistically tracks the objects' presence over time, even as they may exist outside of the vehicle's sensor range. The integrated CARACaS/SAVAnT system has been implemented on U.S. Navy experimental ASVs and tested in on-water field demonstrations.

ASV (AUTONOMOUS SEA SURFACE VEHICLE)↗

Front Delineation and Tracking with Multiple Underwater Vehicles

This work describes a method for detecting and tracking ocean fronts using multiple autonomous underwater vehicles. Multiple vehicles — equally-spaced along the expected frontal boundary — complete near parallel transects orthogonal to the front. Lateral gradients are used to determine the location of the front crossing from each individual vehicle transect by detecting a change in the observed water property. Adaptive control of the vehicles ensure they remain perpendicular to the estimated front boundary as it evolves over time. This method was demonstrated in and around Monterey Bay, California in May of 2017. We compare the front detection method to previously used methods. We introduce a metric in order to evaluate the adaptive control techniques presented. We show the capability of this method for repeated sampling across a dynamic two-dimensional ocean front using short-range Iver AUVs. This method extends to tracking gradients of different properties using a variety of vehicles.

Chavez, Francisco P.↗

Onboard Stereo Vision for Drone Pursuit or Sense and Avoid

Wedescribeanew,on-board,shortrangeperceptionsystem that enables micro aerial vehicles (MAVs) to detect, track, and follow or avoid nearby drones (within 2-20 meters) in GPS-denied environments. Each vehicle is able to sense its neighborhood and adapt its motion accordingly without use of centralized reasoning or inter-vehicle communication. To enable a lightweight, low power solution, on-board stereo cameras are used for detection and tracking with depth images, while a downward-looking camera and an inertial measurement unit are used to estimate the position of the observer without use of GPS. We illustrate the robustness and accuracy of this approach through real-time, outdoor leader-follower experiments with three quadrotors. Our experiments show that state-of-art trackers are far less robust in detection against cluttered background. This demonstrates that stereo vision is a highly effective approach to perception for safe navigation of multiple MAVs in close proximity.

Matthies, Larry↗

An Integrated System for Autonomous Search and Track with a Small Unmanned Aerial Vehicle

This article presents a framework for searching, detecting, and tracking an object of interest with a small unmanned aerial vehicle (sUAV). The vehicle is given an area to search for an object of interest. Once the object is detected, the sUAV follows the target while maintaining a fixed distance and centered on its image plane. This paper describes an architecture for integrating autonomy capabilities for search and track for sUAVs. The system has been implemented in the Robot Operating System (ROS) framework using the Parrot ARDrone platform. In this paper we present our technical approach, the system architecture and demonstrate the principles of the approach in a simulation environment and indoor flight tests.

Unmanned Aerial Vehicle↗

Vehicular sources in acoustic propagation experiments

One of the most important uses of acoustic propagation models lies in the area of detection and tracking of vehicles. Propagation models are used to compute transmission losses in performance prediction models and to analyze the results of past experiments. Vehicles can also provide the means for cost effective experiments to measure acoustic propagation conditions over significant ranges. In order to properly correlate the information provided by the experimental data and the propagation models, the following issues must be taken into consideration: the phenomenology of the vehicle noise sources must be understood and characterized; the vehicle's location or 'ground truth' must be accurately reproduced and synchronized with the acoustic data; and sufficient meteorological data must be collected to support the requirements of the propagation models. The experimental procedures and instrumentation needed to carry out propagation experiments are discussed. Illustrative results are presented for two cases. First, a helicopter was used to measure propagation losses at a range of 1 to 10 Km. Second, a heavy diesel-powered vehicle was used to measure propagation losses in the 300 to 2200 m range.

Prado, Gervasio↗

Planning and Execution for Front Delineation and Tracking with Multiple Underwater Vehicles

This work describes a planning architecture for a heterogeneous fleet of marine assets as well as a method for detecting and tracking ocean fronts using multiple autonomous underwater vehicles. Multiple vehicles — equally-spaced along the expected frontal boundary — complete near parallel transects orthogonal to the front. Lateral gradients are used to determine the location of the front crossing from each individual vehicle transect by detecting a change in the observed water property. Adaptive control of the vehicles ensure they remain perpendicular to the estimated frontal boundary as it evolves over time. This method was demonstrated in several experiment periods totaling weeks, in and around Monterey Bay, California in May and June of 2017. We discuss the challenges associated with the implementation of the planning system. We show the capability of this method for repeated sampling across a dynamic two-dimensional ocean front using a fleet of three types of platforms: short-range Iver AUVs, Tethys-Class Long-Range AUVs, and Seagliders. This method extends to tracking gradients of different properties using a variety of vehicles.

Chavez, Francisco P.↗

Implementation of Pin Point Landing Vision Components in an FPGA System

Pin-point landing is required to enable missions to land close, typically within 10 meters, to scientifically important targets in generally hazardous terrain. In Pin Point Landing both high accuracy and high speed estimation of position and orientation is needed to provide input to the control system to safely choose and navigate to a safe landing site. A proposed algorithm called VISion aided Inertial NAVigation (VISINAV) has shown that the accuracy requirements can be met. [2][3] VISINAV was shown in software only, and was expected to use FPGA enhancements in the future to improve the computational speed needed for pin point landing during Entry Descent and Landing (EDL). Homography, feature detection and spatial correlation are computationally intensive parts of VISINAV. Homography aligns the map image with the descent image so that small correlation windows can be used, and feature detection provides regions that spatial correlation can track from frame to frame in order to estimate vehicle motion. On MER the image Homography, Feature Detection and Correlation would take approximately 650ms tracking 75 features between frames. We implemented Homography, Feature detection and Correlation on a Virtex 4 LX160 FPGA to run in under 25ms while tracking 500 features to improve algorithm reliability and throughput.

aircraft landing guidance↗

NASA Tech Briefs, March 2014

Topics include: Data Fusion for Global Estimation of Forest Characteristics From Sparse Lidar Data; Debris and Ice Mapping Analysis Tool - Database; Data Acquisition and Processing Software - DAPS; Metal-Assisted Fabrication of Biodegradable Porous Silicon Nanostructures; Post-Growth, In Situ Adhesion of Carbon Nanotubes to a Substrate for Robust CNT Cathodes; Integrated PEMFC Flow Field Design for Gravity-Independent Passive Water Removal; Thermal Mechanical Preparation of Glass Spheres; Mechanistic-Based Multiaxial-Stochastic-Strength Model for Transversely-Isotropic Brittle Materials; Methods for Mitigating Space Radiation Effects, Fault Detection and Correction, and Processing Sensor Data; Compact Ka-Band Antenna Feed with Double Circularly Polarized Capability; Dual-Leadframe Transient Liquid Phase Bonded Power Semiconductor Module Assembly and Bonding Process; Quad First Stage Processor: A Four-Channel Digitizer and Digital Beam-Forming Processor; Protective Sleeve for a Pyrotechnic Reefing Line Cutter; Metabolic Heat Regenerated Temperature Swing Adsorption; CubeSat Deployable Log Periodic Dipole Array; Re-entry Vehicle Shape for Enhanced Performance; NanoRacks-Scale MEMS Gas Chromatograph System; Variable Camber Aerodynamic Control Surfaces and Active Wing Shaping Control; Spacecraft Line-of-Sight Stabilization Using LWIR Earth Signature; Technique for Finding Retro-Reflectors in Flash LIDAR Imagery; Novel Hemispherical Dynamic Camera for EVAs; 360 deg Visual Detection and Object Tracking on an Autonomous Surface Vehicle; Simulation of Charge Carrier Mobility in Conducting Polymers; Observational Data Formatter Using CMOR for CMIP5; Propellant Loading Physics Model for Fault Detection Isolation and Recovery; Probabilistic Guidance for Swarms of Autonomous Agents; Reducing Drift in Stereo Visual Odometry; Future Air-Traffic Management Concepts Evaluation Tool; Examination and A Priori Analysis of a Direct Numerical Simulation Database for High-Pressure Turbulent Flows; and Resource-Constrained Application of Support Vector Machines to Imagery.

Source record↗

Optimization of Second Fault Detection Thresholds to Maximize Mission POS

In order to support manned spaceflight safety requirements, the Space Launch System (SLS) has defined program-level requirements for key systems to ensure successful operation under single fault conditions. To accommodate this with regards to Navigation, the SLS utilizes an internally redundant Inertial Navigation System (INS) with built-in capability to detect, isolate, and recover from first failure conditions and still maintain adherence to performance requirements. The unit utilizes multiple hardware- and software-level techniques to enable detection, isolation, and recovery from these events in terms of its built-in Fault Detection, Isolation, and Recovery (FDIR) algorithms. Successful operation is defined in terms of sufficient navigation accuracy at insertion while operating under worst case single sensor outages (gyroscope and accelerometer faults at launch). In addition to first fault detection and recovery, the SLS program has also levied requirements relating to the capability of the INS to detect a second fault, tracking any unacceptable uncertainty in knowledge of the vehicle's state. This detection functionality is required in order to feed abort analysis and ensure crew safety. Increases in navigation state error and sensor faults can drive the vehicle outside of its operational as-designed environments and outside of its performance envelope causing loss of mission, or worse, loss of crew. The criteria for operation under second faults allows for a larger set of achievable missions in terms of potential fault conditions, due to the INS operating at the edge of its capability. As this performance is defined and controlled at the vehicle level, it allows for the use of system level margins to increase probability of mission success on the operational edges of the design space. Due to the implications of the vehicle response to abort conditions (such as a potentially failed INS), it is important to consider a wide range of failure scenarios in terms of both magnitude and time. As such, the Navigation team is taking advantage of the INS's capability to schedule and change fault detection thresholds in flight. These values are optimized along a nominal trajectory in order to maximize probability of mission success, and reducing the probability of false positives (defined as when the INS would report a second fault condition resulting in loss of mission, but the vehicle would still meet insertion requirements within system-level margins). This paper will describe an optimization approach using Genetic Algorithms to tune the threshold parameters to maximize vehicle resilience to second fault events as a function of potential fault magnitude and time of fault over an ascent mission profile. The analysis approach, and performance assessment of the results will be presented to demonstrate the applicability of this process to second fault detection to maximize mission probability of success.

Anzalone, Evan↗

Tracking Object Existence From an Autonomous Patrol Vehicle

An autonomous vehicle patrols a large region, during which an algorithm receives measurements of detected potential objects within its sensor range. The goal of the algorithm is to track all objects in the region over time. This problem differs from traditional multi-target tracking scenarios because the region of interest is much larger than the sensor range and relies on the movement of the sensor through this region for coverage. The goal is to know whether anything has changed between visits to the same location. In particular, two kinds of alert conditions must be detected: (1) a previously detected object has disappeared and (2) a new object has appeared in a location already checked. For the time an object is within sensor range, the object can be assumed to remain stationary, changing position only between visits. The problem is difficult because the upstream object detection processing is likely to make many errors, resulting in heavy clutter (false positives) and missed detections (false negatives), and because only noisy, bearings-only measurements are available. This work has three main goals: (1) Associate incoming measurements with known objects or mark them as new objects or false positives, as appropriate. For this, a multiple hypothesis tracker was adapted to this scenario. (2) Localize the objects using multiple bearings-only measurements to provide estimates of global position (e.g., latitude and longitude). A nonlinear Kalman filter extension provides these 2D position estimates using the 1D measurements. (3) Calculate the probability that a suspected object truly exists (in the estimated position), and determine whether alert conditions have been triggered (for new objects or disappeared objects). The concept of a probability of existence was created, and a new Bayesian method for updating this probability at each time step was developed. A probabilistic multiple hypothesis approach is chosen because of its superiority in handling the uncertainty arising from errors in sensors and upstream processes. However, traditional target tracking methods typically assume a stationary detection volume of interest, whereas in this case, one must make adjustments for being able to see only a small portion of the region of interest and understand when an alert situation has occurred. To track object existence inside and outside the vehicle's sensor range, a probability of existence was defined for each hypothesized object, and this value was updated at every time step in a Bayesian manner based on expected characteristics of the sensor and object and whether that object has been detected in the most recent time step. Then, this value feeds into a sequential probability ratio test (SPRT) to determine the status of the object (suspected, confirmed, or deleted). Alerts are sent upon selected status transitions. Additionally, in order to track objects that move in and out of sensor range and update the probability of existence appropriately a variable probability detection has been defined and the hypothesis probability equations have been re-derived to accommodate this change. Unsupervised object tracking is a pervasive issue in automated perception systems. This work could apply to any mobile platform (ground vehicle, sea vessel, air vehicle, or orbiter) that intermittently revisits regions of interest and needs to determine whether anything interesting has changed.

Wolf, Michael↗

Optical Tracker For Longwall Coal Shearer

Photographic record yields information for correction of vehicle path. Tracking system records lateral movements of longwall coal-shearing vehicle. System detects lateral and vertical deviations of path of vehicle moving along coal face, shearing coal as it goes. Rides on rails in mine tunnel, advancing on toothed track in one of rails. As vehicle moves, retroreflective mirror rides up and down on teeth, providing series of pulsed reflections to film recorder. Recorded positions of pulses, having horizontal and vertical orientations, indicate vertical and horizontal deviations, respectively, of vehicle.

Poulsen, Peter D.↗

NASA's Marshall Space Flight Center Recent Studies and Technology Developments in the Area of SSA/Orbital Debris

NASA/MSFC has been investigating the various aspects of the growing orbital debris problem since early 2009. Data shows that debris ranging in size from 5 mm to 10 cm presents the greatest threat to operational spacecraft today. Therefore, MSFC has focused its efforts on small orbital debris. Using off-the-shelf analysis packages, like the ESA MASTER software, analysts at MSFC have begun to characterize the small debris environment in LEO to support several spacecraft concept studies and hardware test programs addressing the characterization, mitigation, and ultimate removal, if necessary, of small debris. The Small Orbital Debris Active Removal (SODAR) architectural study investigated the overall effectiveness of removing small orbital debris from LEO using a low power, space-based laser. The Small Orbital Debris Detection, Acquisition, and Tracking (SODDAT) conceptual technology demonstration spacecraft was developed to address the challenges of in-situ small orbital debris environment classification including debris observability and instrument requirements for small debris observation. Work is underway at MSFC in the areas of hardware and testing. By combining off the shelf digital video technology, telescope lenses, and advanced video image FPGA processing, MSFC is building a breadboard of a space based, passive orbital tracking camera that can detect and track faint objects (including small debris, satellites, rocket bodies, and NEOs) at ranges of tens to hundreds of kilometers and speeds in excess of 15 km/sec,. MSFC is also sponsoring the development of a one-of-a-kind Dynamic Star Field Simulator with a high resolution large monochrome display and a custom collimator capable of projecting realistic star images with simple orbital debris spots (down to star magnitude 11-12) into a passive orbital detection and tracking system with simulated real-time angular motions of the vehicle mounted sensor. The dynamic star field simulator can be expanded for multiple sensors (including advanced star trackers), real-time vehicle pointing inputs, and more complex orbital debris images. This system is also adaptable to other sensor optics, missions, and installed sensor testing.

Wiegmann, Bruce M.↗

Airborne Radar for sUAS Sense and Avoid

A primary challenge for the safe integration of small UAS operations into the National Airspace System (NAS) is traffic deconfliction, both from manned and unmanned aircraft. The UAS Traffic Management (UTM) project being conducted at the National Aeronautics and Space Administration (NASA) considers a layered approach to separation provision, ranging from segregation of operations through airspace volumes (geofences) to autonomous sense and avoid (SAA) technologies for higher risk, densely occupied airspace. Cooperative SAA systems, such as Automatic Dependent Surveillance-Broadcast (ADS-B) and/or vehicle-to-vehicle communication systems provide significant additional risk mitigation but they fail to adequately mitigate collision risks for non-cooperative (non-transponder equipped) airborne aircraft. The RAAVIN (Radar on Autonomous Aircraft to Verify ICAROUS Navigation) flight test being conducted by NASA and the Mid-Atlantic Aviation Partnership (MAAP) was designed to investigate the applicability and performance of a prototype, commercially available sUAS radar to detect and track non-cooperative airborne traffic, both manned and unmanned. The radar selected for this research was a Frequency Modulated Continuous Wave (FMCW) radar with 120 degree azimuth and 80 degree elevation field of view operating at 24.55GHz center frequency with a 200 MHz bandwidth. The radar transmits 2 watts of power thru a Metamaterial Electronically Scanning Array antenna in horizontal polarization. When the radar is transmitting, personnel must be at least 1 meter away from the active array to limit nonionizing radiation exposure. The radar physical dimensions are 18.7cm by 12.1cm by 4.1cm and it weighs less than 820 grams making it well suited for installation on small UASs. The onboard, SAA capability, known as ICAROUS, (Independent Configurable Architecture for Reliable Operations of Unmanned Systems), developed by NASA to support sUAS operations, will provide autonomous guidance using the traffic radar tracks from the onboard radar. The RAAVIN set of studies will be conducted in three phases. The first phase included outdoor, ground-based radar evaluations performed at the Virginia Tech’s Kentland Farm testing range in Blacksburg, VA. The test was designed to measure how well the radar could detect and track a small UAS flying in the radar’s field of view. The radar was used to monitor 5 test flights consisting of outbound, inbound and crossing routes at different ranges and altitudes. The UAS flown during the ground test was the Inspire 2, a quad copter weighing less than 4250 grams (10 pounds) at maximum payload. The radar was set up to scan and track targets over its full azimuthal field of view from 0 to 40 degrees in elevation. The radar was configured to eliminate tracks generated from any targets located beyond 2000 meters from the radar and moving at velocities under 1.45 meters per second. For subsequent phases of the study the radar will be integrated with a sUAS platform to evaluate its performance in flight for SAA applications ranging from sUAS to manned GA aircraft detections and tracking. Preliminary data analysis from the first outdoor ground tests showed the radar performed well at tracking the vehicle as it flew outbound and repeatedly maintained a track out to 1000 meters (maximum 1387 meters) until the vehicle slowed to a stop to reverse direction to fly inbound. As the Inspire flew inbound tracks from beyond 800 meters, a reacquisition time delay was consistently observed between when the Inspire exceeds a speed of 1.45 meters per second and when the radar indicated an inbound target was present and maintained its track. The time delay varied between 6 seconds to over 37 seconds for the inbound flights examined, and typically resulted in about a 200 meter closure distance before the Inspire track was maintained. The radar performed well at both acquiring and tracking the vehicle as it flew crossing routes out past 400 meters across the azimuthal field of view. The radar and ICAROUS software will be integrated and flown on a BFD-1400-SE8-E UAS during the next phase of the RAAVIN project. The main goal at the conclusion of this effort is to determine if this radar technology can reliably support minimum requirements for SAA applications of sUAS. In particular, the study will measure the range of vehicle detections, lateral and vertical angular errors, false and missed/late detections, and estimated distance at closest point of approach after an avoidance maneuver is executed. This last metric is directly impacted by sensor performance and indicates its suitability for the task.

Szatkowski, George N.↗

Mars Orbiter Sample Return Power Design

Mars has greatly intrigued scientists and the general public for many years because, of all the planets, its environment is most like Earth's. Many scientists believe that Mars once had running water, although surface water is gone today. The planet is very cold with a very thin atmosphere consisting mainly of CO2. Mariner 4, 6, and 7 explored the planet in flybys in the 1960s and by the orbiting Mariner 9 in 1971. NASA then mounted the ambitious Viking mission, which launched two orbiters and two landers to the planet in 1975. The landers found ambiguous evidence of life. Mars Pathfinder landed on the planet on July 4, 1997, delivering a mobile robot rover that demonstrated exploration of the local surface environment. Mars Global Surveyor is creating a highest-resolution map of the planet's surface. These prior and current missions to Mars have paved the way for a complex Mars Sample Return mission planned for 2003 and 2005. Returning surface samples from Mars will necessitate retrieval of material from Mars orbit. Sample mass and orbit are restricted to the launch capability of the Mars Ascent Vehicle. A small sample canister having a mass less than 4 kg and diameter of less than 16 cm will spend from three to seven years in a 600 km orbit waiting for retrieval by a second spacecraft consisting of an orbiter equipped with a sample canister retrieval system, and a Earth Entry Vehicle. To allow rapid detection of the on-orbit canister, rendezvous, and collection of the samples, the canister will have a tracking beacon powered by a surface mounted solar array. The canister must communicate using RF transmission with the recovery vehicle that will be coming in 2006 or 2009 to retrieve the canister. This paper considers the aspect and conclusion that went into the design of the power system that achieves the maximum power with the minimum risk. The power output for the spherical orbiting canister was modeled and plotted in various views of the orbit by the Satellite Orbit Analysis Program (SOAP).

Mardesich, N.↗

Real-time detection of moving objects from moving vehicles using dense stereo and optical flow

Dynamic scene perception is very important for autonomous vehicles operating around other moving vehicles and humans. Most work on real-time object tracking from moving platforms has used sparse features or assumed flat scene structures. We have recently extended a real-time, dense stereo system to include realtime, dense optical flow, enabling more comprehensive dynamic scene analysis. We describe algorithms to robustly estimate 6-DOF robot egomotion in the presence of moving objects using dense flow and dense stereo. We then use dense stereo and egomotion estimates to identify & other moving objects while the robot itself is moving. We present results showing accurate egomotion estimation and detection of moving people and vehicles under general 6-DOF motion of the robot and independently moving objects. The system runs at 18.3 Hz on a 1.4 GHz Pentium M laptop, computing 160x120 disparity maps and optical flow fields, egomotion, and moving object segmentation. We believe this is a significant step toward general unconstrained dynamic scene analysis for mobile robots, as well as for improved position estimation where GPS is unavailable.

egomotion↗