Search NASA⌕ Search

SEARCH · Search NASA

Results for “optical motion tracking”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2022

Characterization of Infrared Optical Motion Tracking System in NASA's Simulated Lunar Operations (SLOPE) Laboratory

This work characterizes the accuracy of a 16 camera OptiTrack motion tracking system installed in NASA Glenn Research Center's Simulated Lunar Operations (SLOPE) laboratory. The position of a rigid body mounted on a motorized linear stage is compared to its position reported by the motion tracking system as it travels through the facility's 777m$^3$ capture volume of interest. Experiments show that the mean error reported by the motion tracking system for the aggregate capture volume is in-line with independent measurements collected using the motion stage. Error within regions of the capture volume exceed the mean error reported by the motion tracking system, likely due to occlusion, and suggests that additional cameras should be used to increase measurement accuracy in these regions. Overall, results show that error values reported by the motion tracking system are representative of the measurement error in a collected data set and validates the system's use for characterizing the mobility and tractive performance of robots, rovers, and other vehicles for planetary exploration.

Motion capture↗
NASA NTRSDate not supplied

Towards Physics Guided Optical Flow for Tracking Atmospheric Motion

Observations of atmospheric 3D winds are critical for improving short-range and long-range forecasting. Such advancement in forecasting directly applies to research in a number of areas including convective processes, wildfire plumes and tornado prediction. Atmospheric Motion Vectors (AMVs) provide a passively sensed approach to quantifying horizontal motion and cloud heights, which are typically sourced from geostationary sensors due to the availability of high frequency observations. Recent work has shown that estimating AMVs by tracking individual pixels with dense optical flow is a promising new direction. In this work, we compare state-of-the-art convolutional neural networks for optical flow in a physics-guided deep learning framework for predicting AMVs. The approach is semi-supervised and uses physically informed wind vectors from high-resolution numerical simulations for supervised learning followed by fine-tuning though warping and reconstruction of full-disk geostationary images (GOES-16). In the vertical direction, we use labels from the CALIPSO low-earth orbit satellite to predict cloud height from 16-band geostationary images with a neural network. We present results for both tasks on held-out time periods and secondary datasets.

Geostationary↗
NASA NTRSDate not supplied

Towards Physics Guided Optical Flow for Tracking Atmospheric Motion

Atmospheric 3D winds in the horizontal and vertical directions are critical for improving short-range and long-range forecasting. Such advancement in forecasting directly applies to research in a number of areas including convective processes, wildfire plumes and tornado prediction. Atmospheric Motion Vectors (AMVs) provide a passively sensed approach to quantifying horizontal motion and cloud heights, which are typically sourced from geostationary sensors due to the availability of high frequency observations. Recent work has shown that estimating AMVs by tracking individual pixels with dense optical flow is a promising new direction. In this work, we use a state-of-the-art convolutional neural network for optical flow (FlowNetS) in a physics-guided deep learning framework for predicting AMVs in the horizontal direction. The approach is semi-supervised and uses physically informed wind vectors from high-resolution numerical simulations (DYAMOND) for supervised learning followed by fine-tuning though warping and reconstruction of full-disk geostationary images (GOES-16). In the vertical direction, we use labels from the CALIPSO low-earth orbit satellite to predict cloud height from 16-band geostationary images with a neural network. We present results for both tasks on held-out time periods and secondary datasets.

geostationary↗
NASA NTRSDate not supplied

Dense Feature Tracking of Atmospheric Winds with Deep Optical Flow

Atmospheric winds are a key physical phenomenon impacting natural hazards, energy transport, ocean currents, large-scale circulation, and ecosystem fluxes. Observing winds is a complex process and presents a large gap in NASA’s Earth Observation System. Atmospheric motion vectors (AMVs) aim to fill this gap by making numerical estimates of cloud movement between sequences of multi-spectral satellite images, tracking clouds and water vapor. Recent imaging hardware and software advancements have enabled the use of numerical optical flow techniques to produce accurate and dense vector fields outperforming traditional methods. This work presents WindFlow as the first machine learning based system for feature tracking atmospheric motion using optical flow. Due to the lack of large-scale satellite-based observations, we leverage high-resolution numerical simulations from NASA's GEOS-5 Nature Run to perform supervised learning and transfer to satellite images. We demonstrate that our approach using deep learning based optical flow scales to ultra-high-resolution images of size 2881x5760 with less than 1 m/s bias and 2.5 m/s average error. Four network and learning architectures are compared and it is found that recurrent all-pairs field transforms (RAFT) produces the lowest errors on all metrics for wind speed and direction. Results on held out numerical outputs shows RAFT's good performance in each of the spatial, temporal, and physical dimensions. A comparison between WindFlow and an operational AMV product against rawinsonde observations show that RAFT transfers across simulations and thermal infrared satellite observations. This work shows that machine learning based optical flow is an efficient approach to generating robust feature tracking for AMVs consistently over large regions.

Atmospheric winds↗
NASA NTRS1992

Vision-based recursive estimation of rotorcraft obstacle locations

The authors address vision-based passive ranging during nap-of-the-earth (NOE) rotorcraft flight. They consider the problem of estimating the relative location of identifiable features on nearby obstacles, assuming a sequence of noisy camera images and imperfect measurements of the camera's translation and rotation. An iterated extended Kalman filter is used to provide recursive range estimation. The correspondence problem is simplified by predicting and tracking each feature's image within the Kalman filter framework. Simulation results are presented which show convergent estimates and generally successful feature point tracking. Estimation performance degrades for features near the optical axis and for accelerating motions. Image tracking is also sensitive to angular rate.

Leblanc, D. J.↗
NASA NTRS2015

Spherical Coordinate Systems for Streamlining Suited Mobility Analysis

Introduction: When describing human motion, biomechanists generally report joint angles in terms of Euler angle rotation sequences. However, there are known limitations in using this method to describe complex motions such as the shoulder joint during a baseball pitch. Euler angle notation uses a series of three rotations about an axis where each rotation is dependent upon the preceding rotation. As such, the Euler angles need to be regarded as a set to get accurate angle information. Unfortunately, it is often difficult to visualize and understand these complex motion representations. It has been shown that using a spherical coordinate system allows Anthropometry and Biomechanics Facility (ABF) personnel to increase their ability to transmit important human mobility data to engineers, in a format that is readily understandable and directly translatable to their design efforts. Objectives: The goal of this project was to use innovative analysis and visualization techniques to aid in the examination and comprehension of complex motions. Methods: This project consisted of a series of small sub‐projects, meant to validate and verify a new method before it was implemented in the ABF's data analysis practices. A mechanical test rig was built and tracked in 3D using an optical motion capture system. Its position and orientation were reported in both Euler and spherical reference systems. In the second phase of the project, the ABF estimated the error inherent in a spherical coordinate system, and evaluated how this error would vary within the reference frame. This stage also involved expanding a kinematic model of the shoulder to include the rest of the joints of the body. The third stage of the project involved creating visualization methods to assist in interpreting motion in a spherical frame. These visualization methods will be incorporated in a tool to evaluate a database of suited mobility data, which is currently in development. Results: Initial results demonstrated that a spherical coordinate system is helpful in describing and visualizing the motion of a space suit. The system is particularly useful in describing the motion of the shoulder, where multiple degrees of freedom can lead to very complex motion paths.

Benson, Elizabeth↗
NASA NTRS2014

Spherical Coordinate Systems for Streamlining Suited Mobility Analysis

When describing human motion, biomechanists generally report joint angles in terms of Euler angle rotation sequences. However, there are known limitations in using this method to describe complex motions such as the shoulder joint during a baseball pitch. Euler angle notation uses a series of three rotations about an axis where each rotation is dependent upon the preceding rotation. As such, the Euler angles need to be regarded as a set to get accurate angle information. Unfortunately, it is often difficult to visualize and understand these complex motion representations. One of our key functions is to help design engineers understand how a human will perform with new designs and all too often traditional use of Euler rotations becomes as much of a hindrance as a help. It is believed that using a spherical coordinate system will allow ABF personnel to more quickly and easily transmit important mobility data to engineers, in a format that is readily understandable and directly translatable to their design efforts. Objectives: The goal of this project is to establish new analysis and visualization techniques to aid in the examination and comprehension of complex motions. Methods: This project consisted of a series of small sub‐projects, meant to validate and verify the method before it was implemented in the ABF's data analysis practices. The first stage was a proof of concept, where a mechanical test rig was built and instrumented with an inclinometer, so that its angle from horizontal was known. The test rig was tracked in 3D using an optical motion capture system, and its position and orientation were reported in both Euler and spherical reference systems. The rig was meant to simulate flexion/extension, transverse rotation and abduction/adduction of the human shoulder, but without the variability inherent in human motion. In the second phase of the project, the ABF estimated the error inherent in a spherical coordinate system, and evaluated how this error would vary within the reference frame. This stage also involved expanding a kinematic model of the shoulder, to include the torso, knees, ankle, elbows, wrists and neck. Part of this update included adding a representation of 'roll' about an axis, for upper arm and lower leg rotations. The third stage of the project involved creating visualization methods to assist in interpreting motion in a spherical frame. This visualization method will be incorporated in a tool to evaluate a database of suited mobility data, which is currently in development.

Benson, Elizabeth↗
NASA NTRS1996

Detection of obstacles on runway using Ego-Motion compensation and tracking of significant features

This report describes a method for obstacle detection on a runway for autonomous navigation and landing of an aircraft. Detection is done in the presence of extraneous features such as tiremarks. Suitable features are extracted from the image and warping using approximately known camera and plane parameters is performed in order to compensate ego-motion as far as possible. Residual disparity after warping is estimated using an optical flow algorithm. Features are tracked from frame to frame so as to obtain more reliable estimates of their motion. Corrections are made to motion parameters with the residual disparities using a robust method, and features having large residual disparities are signaled as obstacles. Sensitivity analysis of the procedure is also studied. Nelson's optical flow constraint is proposed to separate moving obstacles from stationary ones. A Bayesian framework is used at every stage so that the confidence in the estimates can be determined.

Kasturi, Rangachar↗
NASA NTRS1984

Spacecraft system study: A study to define the impact of laser communication systems on their host spacecraft

The mutual influence of a laser communication system and its host spacecraft and the degree to which the mutual influence limited acquisition, tracking and pointing processes were investigated. A laser klink between a low earth orbiting (LEO) satellite and a geosynchronous earth orbiting (GEO) satellite was used as a baseline. The laser link between satellites was a generic channel transferring 500 Mbps data from the LEO to GEO using the GaAlAs laser as the laser light source. Major aspects of pointing and tracking with a satelliteborne optical system were evaluated including: (1) orbital aspects such as spacecraft relative motions, point ahead, and Sun snd Moon optical noise; (2) burst errors introduced by the electronic and optical noise levels; (3) servo system design and configurations, and the noise sources such as, sensor noise, base motion disturbances, gimbal friction torque noise; (4) an evaluation of the tracking and beacon link and the type of sensors used; (5) the function of the acquisition procedure and an evaluation of the sensors employed; and (6) an estimate of the size, weight and power needed for the satellite system.

Source record↗
NASA NTRS2000

Ground-to-Ground Optical Communications Demonstration

A bidirectional horizontal-path optical link was demonstrated between Strawberry Peak (SP), Lake Arrowhead, California, and the JPL Table Mountain Facility (TMF), Wrightwood, California, during June and November of 1998. The 0.6-m telescope at TMF was used to broadcast a 4-beam 780-nm beacon to SP. The JPL-patented Optical Communications Demonstrator (OCD) at SP received the beacon, performed ne tracking to compensate for the atmosphere-induced beacon motion and retransmitted a 844-nm communications laser beam modulated at 40 to 500 Mb/s back to TMF. Characteristics of the horizontal-path atmospheric channel as well as performance of the optical communications link were evaluated. The normalized variance of the irradiance fluctuations or scintillation index delta2/I at either end was determined. At TMF where a single 844-nm beam was received by a 0.6-m aperture, the measured delta2/I covered a wide range from 0.07 to 1.08. A single 780-nm beam delta2/I measured at SP using a 0.09-m aperture yielded values ranging from 0.66 to 1.03, while a combination of four beams reduced the scintillation index due to incoherent averaging to 0.22 to 0.40. This reduction reduced the dynamic range of the fluctuations from 17 to 21 dB to 13 to 14 dB as compared with the OCD tracking sensor dynamic range of 10 dB. Predictions of these values also were made based on existing theories and are compared. Generally speaking, the theoretical bounds were reasonable. Discussions on the probability density function (PDF) of the intensity fluctuations are presented and compared with the measurements made. The lognormal PDF was found to agree for the weak scintillation regime as expected. The present measurements support evidence presented by earlier measurements made using the same horizontal path, which suggests that the aperture averaging effect is better than theoretically predicted.

Biswas, A.↗
NASA NTRS1982

An advanced tracker design for pointing and control of space vehicles using the charge injection device

The use of charge transfer devices (CTD) in pointing and control of space vehicles is examined, with emphasis on the use of charge injection devices (CID). The selection of CTD type and CID operation, including CID signal and noise analysis and signal improvement, are discussed. Star tracking operational advantages of the CTD are pointed out, and the tracking optical concept is discussed and graphically depicted. The position interpolation procedure and the effects of rate of stellar motion on position interpolation are considered, and error analysis is examined. Finally, the breadboard and test program are discussed in detail, coarse and fine acquisition, test for star, track pattern, test procedure and results. An overall accuracy performance of approximately 0.02 pixels or approximately 0.8 arcsec for the test equipment and tracker was obtained.

Jones, C.↗
NASA NTRS2015

Biomimetic Fly Eye Sensor for Real-Time Target Tracking

The project objective is to design, build, and demonstrate a biomimetic (inspired by biology) smart sensor based on the common house fly eye for real-time target tracking in three dimensions (3-D). The sensor makes use of revolutionary optical sensor design resulting in significantly improved motion detection capabilities when compared with conventional optical sensors. The design is motivated by the parallel nature of the flys vision system and its demonstrated hyperacuity or precision of visual localization beyond the conventional resolution limit. This means that the sensor is able to accurately detect very fast motion and small changes in motion. The analog architecture of the sensor allows for real-time solution at adjustable bandwidths depending on the application. The low cost, exceptionally lightweight, small form factor, low power requirements, and low computation requirements of the sensor make it ideally suited to many aeronautics applications that have limitations on weight, power, and processing time. The sensor is modular and can be easily adapted in scale and manufactured for a wide variety of sensing applications. Advanced target tracking algorithms will be developed to allow the sensor to track a target in 3-D. These algorithms will be implemented in the smart sensors hardware to enable real-time target tracking.

wing position measurement system↗
NASA NTRS1990

Passive navigation using image irradiance tracking

Rotorcraft operating at low altitudes require navigational schemes for detecting terrain and obstacles. Due to the nature of the missions to be accomplished and available power onboard, a passive navigation scheme is desirable in this situation. The development of a passive navigation scheme using optical image sequences and vehicle motion variables from an onboard inertial navigation scheme is described. This approach combines the geometric properties of perspective projection and a feedback irradiance tracking scheme at each pixel in the image to determine the range to various objects within the field-of-view. Derivation of the numerical algorithm and simulation results are given. Due to the feedback nature of the implementation, the computational scheme is robust. Other applications of the proposed approach include navigation for autonomous planetary rovers and telerobots.

Menon, P. K. A.↗
NASA NTRS1992

Flows around sunspots and pores

Observations are reported yielding high-resolution white-light data regarding the flow pattern of penumbral material and granules around sunspots and pores. The data are culled from optical observations near the limit of the telescope modulation transfer function, and correlation tracking is employed to track the motions of penumbral features and granules. Dark fibrils and bright grains in the sunspots' inner penumbra regions move toward the umbra, and the opposite occurs in the outer penumbra. Before pore formation and during the pores existence granular flows are found to converge on the features. The paper also details the evolution of an emerging flux region, and two types of photospheric dark alignments are described in the region of new flux emergence.

Wang, Haimin↗
NASA NTRS2012

Wavefront Compensation Segmented Mirror Sensing and Control

The primary mirror of very large submillimeter-wave telescopes will necessarily be segmented into many separate mirror panels. These panels must be continuously co-phased to keep the telescope wavefront error less than a small fraction of a wavelength, to ten microns RMS (root mean square) or less. This performance must be maintained continuously across the full aperture of the telescope, in all pointing conditions, and in a variable thermal environment. A wavefront compensation segmented mirror sensing and control system, consisting of optical edge sensors, Wavefront Compensation Estimator/Controller Soft ware, and segment position actuators is proposed. Optical edge sensors are placed two per each segment-to-segment edge to continuously measure changes in segment state. Segment position actuators (three per segment) are used to move the panels. A computer control system uses the edge sensor measurements to estimate the state of all of the segments and to predict the wavefront error; segment actuator commands are computed that minimize the wavefront error. Translational or rotational motions of one segment relative to the other cause lateral displacement of the light beam, which is measured by the imaging sensor. For high accuracy, the collimator uses a shaped mask, such as one or more slits, so that the light beam forms a pattern on the sensor that permits sensing accuracy of better than 0.1 micron in two axes: in the z or local surface normal direction, and in the y direction parallel to the mirror surface and perpendicular to the beam direction. Using a co-aligned pair of sensors, with the location of the detector and collimated light source interchanged, four degrees of freedom can be sensed: transverse x and y displacements, as well as two bending angles (pitch and yaw). In this approach, each optical edge sensor head has a collimator and an imager, placing one sensor head on each side of a segment gap, with two parallel light beams crossing the gap. Two sets of optical edge sensors are used per segment-to-segment edge, separated by a finite distance along the segment edge, for four optical heads, each with an imager and a collimator. By orienting the beam direction of one edge sensor pair to be +45 away from the segment edge direction, and the other sensor pair to be oriented -45 away from the segment edge direction, all six degrees of freedom of relative motion between the segments can be measured with some redundancy. The software resides in a computer that receives each of the optical edge sensor signals, as well as telescope pointing commands. It feeds back the edge sensor signals to keep the primary mirror figure within specification. It uses a feed-forward control to compensate for global effects such as decollimation of the primary and secondary mirrors due to gravity sag as the telescope pointing changes to track science objects. Three segment position actuators will be provided per segment to enable controlled motions in the piston, tip, and tilt degrees of freedom. These actuators are driven by the software, providing the optical changes needed to keep the telescope phased.

Redding, David C.↗
NASA NTRS2003

The Micro-Arcsecond Metrology Testbed

The Micro-Arcsecond Metrology (MAM) testbed is a ground-based system of optical and electronic equipment for testing components, systems, and engineering concepts for the Space Interferometer Mission (SIM) and similar future missions, in which optical interferometers will be operated in outer space. In addition, the MAM testbed is of interest in its own right as a highly precise metrological system. The designs of the SIM interferometer and the MAM testbed reflect a requirement to measure both the position of the starlight central fringe and the change in the internal optical path of the interferometer with sufficient spatial resolution to generate astrometric data with angular resolution at the microarcsecond level. The internal path is to be measured by use of a small metrological laser beam of 1,319-nm wavelength, whereas the position of the starlight fringe is to be estimated by use of a charge-coupled-device (CCD) image detector sampling a large concentric annular beam. For the SIM to succeed, the optical path length determined from the interferometer fringes must be tracked by the metrological subsystem to within tens of picometers, through all operational motions of an interferometer delay line and siderostats. The purpose of the experiments performed on the MAM testbed is to demonstrate this agreement in a large-scale simulation that includes a substantial portion of the system in the planned configuration for operation in outer space. A major challenge in this endeavor is to align the metrological beam with the starlight beam in order to maintain consistency between the metrological and starlight subsystems at the system level. The MAM testbed includes an optical interferometer with a white light source, all major optical components of a stellar interferometer, and heterodyne metrological sensors. The aforementioned subsystems are installed in a large vacuum chamber in order to suppress atmospheric and thermal disturbances. The MAM is divided into two distinct subsystems: the test article (TA), which is the interferometer proper, and the inverse interferometer pseudo-star (IIPS), which synthesizes the light coming from a distant target star by providing spatially coherent wavefronts out of two mirrors, separated by the MAM baseline, that feed directly into two siderostats that are parts of the TA. The two feed mirrors of the IIPS are articulated (in translation and tilt) in order to simulate stars located at different orientations in space, while still illuminating the TA siderostats. The spectrum of the simulated starlight of the IIPS corresponds to that of a blackbody at a temperature of about 3,100 K.

Goullioud, Renaud↗
NASA NTRS2000

Three-Dimensional Electron Optics Model Developed for Traveling-Wave Tubes

A three-dimensional traveling-wave tube (TWT) electron beam optics model including periodic permanent magnet (PPM) focusing has been developed at the NASA Glenn Research Center at Lewis Field. This accurate model allows a TWT designer to develop a focusing structure while reducing the expensive and time-consuming task of building the TWT and hot-testing it (with the electron beam). In addition, the model allows, for the first time, an investigation of the effect on TWT operation of the important azimuthally asymmetric features of the focusing stack. The TWT is a vacuum device that amplifies signals by transferring energy from an electron beam to a radiofrequency (RF) signal. A critically important component is the focusing structure, which keeps the electron beam from diverging and intercepting the RF slow wave circuit. Such an interception can result in excessive circuit heating and decreased efficiency, whereas excessive growth in the beam diameter can lead to backward wave oscillations and premature saturation, indicating a serious reduction in tube performance. The most commonly used focusing structure is the PPM stack, which consists of a sequence of cylindrical iron pole pieces and opposite-polarity magnets. Typically, two-dimensional electron optics codes are used in the design of magnetic focusing devices. In general, these codes track the beam from the gun downstream by solving equations of motion for the electron beam in static-electric and magnetic fields in an azimuthally symmetric structure. Because these two-dimensional codes cannot adequately simulate a number of important effects, the simulation code MAFIA (solution of Maxwell's equations by the Finite-Integration-Algorithm) was used at Glenn to develop a three-dimensional electron optics model. First, a PPM stack was modeled in three dimensions. Then, the fields obtained using the magnetostatic solver were loaded into a particle-in-cell solver where the fully three-dimensional behavior of the beam was simulated in the magnetic focusing field. For the first time, the effects of azimuthally asymmetric designs and critical azimuthally asymmetric characteristics of the focusing stack (such as shunts, C-magnets, or magnet misalignment) on electron beam behavior have been investigated. A cutaway portion of a simulated electron beam focused by a PPM stack is illustrated.

Kory, Carol L.↗
NASA NTRS1990

A quadrant-CCD star tracker

The characteristics of a quadrant-CCD designed for pointing and tracking are discussed with reference to its use in an adaptive optics program. The quadrant-CCD is used to correct stellar image motion proceeding from atmospheric turbulence by means of a system in which a sensor measures the image offset and sends data to a high-speed tip/tilt mirror. The design and control of the device are detailed, including four 100-micron-square pixels, the quadrant architecture, controller electronics, and data acquisition computer and interface. The transfer function is set forth in the x and y directions, and transfer curves are shown. A laboratory simulation of random image motion was conducted to evaluate the performance of the quadrant-CCD as an image motion sensor, and the experimental results are presented. The suitability of the quadrant-CCD for space-based pointing and tracking uses is demonstrated by this test and two earlier theoretical studies. Some future developments which improve performance capabilities are mentioned.

Clampin, M.↗