Search NASA⌕ Search

SEARCH · Search NASA

Results for “camera models”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Development of a sensor coordinated kinematic model for neural network controller training

A robotic benchmark problem useful for evaluating alternative neural network controllers is presented. Specifically, it derives two camera models and the kinematic equations of a multiple degree of freedom manipulator whose end effector is under observation. The mapping developed include forward and inverse translations from binocular images to 3-D target position and the inverse kinematics of mapping point positions into manipulator commands in joint space. Implementation is detailed for a three degree of freedom manipulator with one revolute joint at the base and two prismatic joints on the arms. The example is restricted to operate within a unit cube with arm links of 0.6 and 0.4 units respectively. The development is presented in the context of more complex simulations and a logical path for extension of the benchmark to higher degree of freedom manipulators is presented.

Jorgensen, Charles C.↗

Spin scan imaging at Jupiter

The general feasibility of spin scan imaging from spinning platforms in outer planet orbiters was investigated. The study was limited to consideration of a typical orbiter mission to Jupiter with an orbit designed to provide repetitive close approaches to the Galilean satellites. Discussed are: (1) data requirements for imaging experiments at Jupiter and its satellites; (2) spin scan camera and baseline camera selection; and (3) operational considerations bearing on imager performance. A physical camera model including relationships identifying the supporting requirements was developed and used to determine the characteristics of the baseline camera.

Sinclair, K. F.↗

Terrain Relative Navigation for Guided Descent on Titan

Titan’s dense atmosphere, low gravity, and high winds at high altitudes create descent times of >90 minutes with standard entry/descent/landing (EDL) architectures and result in large unguided landing ellipses, with 99% values of 110x110 km and 149x72 km in recent Titan lander proposals. Enabling precision landing on Titan could increase science return for the types of missions proposed to date and make additional types of landing sites accessible, opening up new possibilities for science investigations. Precision landing on Titan has unique challenges, because the hazy atmosphere makes it difficult to see the surface and because it requires guided descent with divert ranges that are one to two orders of magnitude larger than needed for other target bodies, i.e. up to on the order of 100 km. It is conceivable that such a divert capability could be provided economically by a parafoil or other steerable aerodynamic decelerator deployed several 10s of km above the surface. The long descent times lead to large inertial navigation errors, hence a need for terrain relative navigation (TRN). This would require a TRN capability that can operate at such altitudes, despite challenges of seeing the surface sufficiently clearly and of depending on map products that are two orders of magnitude lower in spatial resolution than those for Mars and airless bodies. We then develop algorithms for map matching and feature tracking with descent images and test these with synthetic images created from Cassini/Huygens data sets and our radiative transfer model. We also introduce new possibilities for TRN based on the potential to discriminate some specific types of terrain onboard in descent imagery, such as lake vs adjacent ground and dune vs interdune. We use sensor measurement noise models in simulations of state estimation with an extended Kalman filter that includes coordinates of a set of tracked features in the state vector. Case studies were done for two notional landing sites, one in a site with only dry ground and one in a Titan lake district. In both cases, the filter error model shows 3 position error at touchdown on the order of 2 km. More work is needed to validate these results with higher fidelity camera models and larger data sets, but this is very promising.

Matthies, Larry↗

Building a 2.5D Digital Elevation Model from 2D Imagery

When projecting imagery into a georeferenced coordinate frame, one needs to have some model of the geographical region that is being projected to. This model can sometimes be a simple geometrical curve, such as an ellipse or even a plane. However, to obtain accurate projections, one needs to have a more sophisticated model that encodes the undulations in the terrain including things like mountains, valleys, and even manmade structures. The product that is often used for this purpose is a Digital Elevation Model (DEM). The technology presented here generates a high-quality DEM from a collection of 2D images taken from multiple viewpoints, plus pose data for each of the images and a camera model for the sensor. The technology assumes that the images are all of the same region of the environment. The pose data for each image is used as an initial estimate of the geometric relationship between the images, but the pose data is often noisy and not of sufficient quality to build a high-quality DEM. Therefore, the source imagery is passed through a feature-tracking algorithm and multi-plane-homography algorithm, which refine the geometric transforms between images. The images and their refined poses are then passed to a stereo algorithm, which generates dense 3D data for each image in the sequence. The 3D data from each image is then placed into a consistent coordinate frame and passed to a routine that divides the coordinate frame into a number of cells. The 3D points that fall into each cell are collected, and basic statistics are applied to determine the elevation of that cell. The result of this step is a DEM that is in an arbitrary coordinate frame. This DEM is then filtered and smoothed in order to remove small artifacts. The final step in the algorithm is to take the initial DEM and rotate and translate it to be in the world coordinate frame [such as UTM (Universal Transverse Mercator), MGRS (Military Grid Reference System), or geodetic] such that it can be saved in a standard DEM format and used for projection.

Padgett, Curtis W.↗

Rover mast calibration, exact camera pointing, and camara handoff for visual target tracking

This paper presents three technical elements that we have developed to improve the accuracy of the visual target tracking for single-sol approach-and-instrument placement in future Mars rover missions. An accurate, straightforward method of rover mast calibration is achieved by using a total station, a camera calibration target, and four prism targets mounted on the rover. The method was applied to Rocky8 rover mast calibration and yielded a 1.1-pixel rms residual error. Camera pointing requires inverse kinematic solutions for mast pan and tilt angles such that the target image appears right at the center of the camera image. Two issues were raised. Mast camera frames are in general not parallel to the masthead base frame. Further, the optical axis of the camera model in general does not pass through the center of the image. Despite these issues, we managed to derive non-iterative closed-form exact solutions, which were verified with Matlab routines. Actual camera pointing experiments aver 50 random target image paints yielded less than 1.3-pixel rms pointing error. Finally, a purely geometric method for camera handoff using stereo views of the target has been developed. Experimental test runs show less than 2.5 pixels error on high-resolution Navcam for Pancam-to-Navcam handoff, and less than 4 pixels error on lower-resolution Hazcam for Navcam-to-Hazcam handoff.

camera handoff↗

Optical Geolocation for Small Unmanned Aerial Systems

This paper presents an airborne optical geolocation system using four optical targets to provide position and attitude estimation for a sUAS supporting the NASA Acoustic Research Mission (ARM), where the goal is to reduce nuisance airframe noise during approach and landing. A large precision positioned microphone array captures the airframe noise for multiple passes of a Gulfstream III aircraft. For health monitoring of the microphone array, the Acoustic Calibration Vehicle (ACV) sUAS completes daily flights with an onboard speaker emitting tones at frequencies optimized for determining microphone functionality. An accurate position estimate of the ACV relative to the array is needed for microphone health monitoring. To this end, an optical geolocation system using a downward facing camera mounted to the ACV was developed. The 3D positioning of the ACV is computed using the pinhole camera model. A novel optical geolocation algorithm first detects the targets, then a recursive algorithm tightens the localization of the targets. Finally, the position of the sUAS is computed using the image coordinates of the targets, the 3D world coordinates of the targets, and the camera matrix. A Real-Time Kinematic GPS system is used to compare the optical geolocation system.

Dolph, Chester V.↗

Analysis of Performance of Stereoscopic-Vision Software

A team of JPL researchers has analyzed stereoscopic vision software and produced a document describing its performance. This software is of the type used in maneuvering exploratory robotic vehicles on Martian terrain. The software in question utilizes correlations between portions of the images recorded by two electronic cameras to compute stereoscopic disparities, which, in conjunction with camera models, are used in computing distances to terrain points to be included in constructing a three-dimensional model of the terrain. The analysis included effects of correlation- window size, a pyramidal image down-sampling scheme, vertical misalignment, focus, maximum disparity, stereo baseline, and range ripples. Contributions of sub-pixel interpolation, vertical misalignment, and foreshortening to stereo correlation error were examined theoretically and experimentally. It was found that camera-calibration inaccuracy contributes to both down-range and cross-range error but stereo correlation error affects only the down-range error. Experimental data for quantifying the stereo disparity error were obtained by use of reflective metrological targets taped to corners of bricks placed at known positions relative to the cameras. For the particular 1,024-by-768-pixel cameras of the system analyzed, the standard deviation of the down-range disparity error was found to be 0.32 pixel.

Kim, Won↗

Development of an image converter of radical design

A long term investigation of thin film sensors, monolithic photo-field effect transistors, and epitaxially diffused phototransistors and photodiodes to meet requirements to produce acceptable all solid state, electronically scanned imaging system, led to the production of an advanced engineering model camera which employs a 200,000 element phototransistor array (organized in a matrix of 400 rows by 500 columns) to secure resolution comparable to commercial television. The full investigation is described for the period July 1962 through July 1972, and covers the following broad topics in detail: (1) sensor monoliths; (2) fabrication technology; (3) functional theory; (4) system methodology; and (5) deployment profile. A summary of the work and conclusions are given, along with extensive schematic diagrams of the final solid state imaging system product.

Irwin, E. L.↗

Mission environment simulation for Army rotorcraft development: Requirements and capabilities

The rich and varied detail visible in terrain flight must be presented by a wide field-of-view system with much detail and high resolution. The rotary-wing R&D simulator must have great versatility for easy change of cab configurations and the capability to accommodate a two or three man crew. Basic specifications for an adequate visual display were developed and are compared with current and forecasted techniques for image generation and presentation. Results of a study performed to determine the feasibility of meeting these requirements using the current technology of TV camera-model image generation and projected display are discussed and an assessment of the possibility that computer generated imagery can achieve the desired level of detail is presented.

Key, D. L.↗

Sensing and perception research for space telerobotics at JPL

PIFLEX is a pipelined-image processor that can perform elaborate computations whose exact nature is not fixed in the hardware, and that can handle multiple images. A wire-wrapped prototype PIFEX module has been produced and debugged, using a version of the convolver composed of three custom VLSI chips (plus the line buffers). A printed circuit layout is being designed for use with a single-chip convolver, leading to production of a PIFEX with about 120 modules. A high-level language for programming PIFEX has been designed, and a compiler will be written for it. The camera calibration software has been completed and tested. Two more terms in the camera model, for lens distortion, probably will be added later. The acquisition and tracking system has been designed and most of it has been coded in Pascal for the MicroVAX-II. The feature tracker, motion stereo module and stereo matcher have executed successfully. The model matcher is still under development, and coding has begun on the tracking initializer. The object tracker was running on a different computer from the VAX, and preliminary runs on real images have been performed there. Once all modules are working, optimization and integration will begin. Finally, when a sufficiently large PIFEX is available, appropriate parts of acquisition and tracking, including much of the feature tracker, will be programmed into PIFEX, thus increasing the speed and robustness of the system.

Gennery, Donald B.↗

The Orbital Maneuvering Vehicle Training Facility visual system concept

The purpose of the Orbital Maneuvering Vehicle (OMV) Training Facility (OTF) is to provide effective training for OMV pilots. A critical part of the training environment is the Visual System, which will simulate the video scenes produced by the OMV Closed-Circuit Television (CCTV) system. The simulation will include camera models, dynamic target models, moving appendages, and scene degradation due to the compression/decompression of video signal. Video system malfunctions will also be provided to ensure that the pilot is ready to meet all challenges the real-world might provide. One possible visual system configuration for the training facility that will meet existing requirements is described.

Williams, Keith↗

An improved method for precise automatic co-registration of moderate and high-resolution spacecraft imagery

Improvements to the automated co-registration and change detection software package, AFIDS (Automatic Fusion of Image Data System) has recently completed development for and validation by NGA/GIAT. The improvements involve the integration of the AFIDS ultra-fine gridding technique for horizontal displacement compensation with the recently evolved use of Rational Polynomial Functions/ Coefficients (RPFs/RPCs) for image raster pixel position to Latitude/Longitude indexing. Mapping and orthorectification (correction for elevation effects) of satellite imagery defies exact projective solutions because the data are not obtained from a single point (like a camera), but as a continuous process from the orbital path. Standard image processing techniques can apply approximate solutions, but advances in the state-of-the-art had to be made for precision change-detection and time-series applications where relief offsets become a controlling factor. The earlier AFIDS procedure required the availability of a camera model and knowledge of the satellite platform ephemeredes. The recent design advances connect the spacecraft sensor Rational Polynomial Function, a deductively developed model, with the AFIDS ultrafine grid, an inductively developed representation of the relationship raster pixel position to latitude /longitude. As a result, RPCs can be updated by AFIDS, a situation often necessary due to the accuracy limits of spacecraft navigation systems. An example of precision change detection will be presented from Quickbird.

co-registration↗

Facilitating Analysis of Multiple Partial Data Streams

Robotic Operations Automation: Mechanisms, Imaging, Navigation report Generation (ROAMING) is a set of computer programs that facilitates and accelerates both tactical and strategic analysis of time-sampled data especially the disparate and often incomplete streams of Mars Explorer Rover (MER) telemetry data described in the immediately preceding article. As used here, tactical refers to the activities over a relatively short time (one Martian day in the original MER application) and strategic refers to a longer time (the entire multi-year MER missions in the original application). Prior to installation, ROAMING must be configured with the types of data of interest, and parsers must be modified to understand the format of the input data (many example parsers are provided, including for general CSV files). Thereafter, new data from multiple disparate sources are automatically resampled into a single common annotated spreadsheet stored in a readable space-separated format, and these data can be processed or plotted at any time scale. Such processing or plotting makes it possible to study not only the details of a particular activity spanning only a few seconds, but also longer-term trends. ROAMING makes it possible to generate mission-wide plots of multiple engineering quantities [e.g., vehicle tilt as in Figure 1(a), motor current, numbers of images] that, heretofore could be found only in thousands of separate files. ROAMING also supports automatic annotation of both images and graphs. In the MER application, labels given to terrain features by rover scientists and engineers are automatically plotted in all received images based on their associated camera models (see Figure 2), times measured in seconds are mapped to Mars local time, and command names or arbitrary time-labeled events can be used to label engineering plots, as in Figure 1(b).

Maimone, Mark W.↗

Historic Partnership Captures Our Imagination

Victor Hasselblad AB, of Gothenburg, Sweden, has enjoyed a long-lived collaboration with NASA, especially Johnson Space Center. For over four decades, Hasselblad has supplied camera equipment to the NASA Space Program, and Hasselblad cameras still take on average between 1,500 and 2,000 photographs on each space shuttle mission. Collaboration with NASA has allowed a very small company to achieve worldwide recognition-Hassleblad's operations now include centers in Parsippany, New Jersey; and Redmond, Washington; as well as France and Denmark-and consumer camera models have featured improvements resulting from refinements for the space models.

Source record↗

Methods of Optical Navigation

Optical navigation is the use of onboard imaging to aid in the determination of the spacecraft trajectory and of the targets' ephemerides. Opnav techniques provide a direct measurement of the direction from a spacecraft to target bodies. Opnav data thus complement both radiometric tracking data (for instance, Doppler and range) and the groundbased astrometry which is used to determine the a priori ephemeris of the targets. We present the geometry and camera models which form the mathematical basis for optical navigation and some of the image processing techniques by which one can extract the optical observables--that is, the sample and line coordinates of images--from pictures.

spacecraft navigation↗

Horizon Detection for Mars Surface Operations

A new image processing method for automated horizon detection is presented in this paper. This method was developed for the Mars Exploration Rovers mission’s surface operations to aid in determining orbiter visibility periods for downlink data, and is now being considered for all Mars surface missions and for a variety of applications. Starting with images received from Mars rovers or landers, the horizon pixel location is found by (1) obtaining the gradient images using the Sobel operator, (2) calculating the preliminary horizon locations by optimizing the maximum difference between sky and ground regions in the gradient domain, and (3) applying a multi-variable thresholding method. The results are analyzed using a variety of images from the Mars rovers, as an example one dataset’s results were categorized as 94.2% Good, 4.11% Okay, and 1.65% Poor. The pixel location corresponding to the found horizon in an image is converted to azimuth and elevation values using the camera model. The elevation of the terrain surrounding the rover or lander directly affects the duration orbiters are visible for downlink data volume, and when the sun is visible for image quality or solar energy consumption. Having an automated process to detect the elevation of the terrain allows the operation team to better predict the outcome of the plan, reducing heath and safety risks and allowing new operational limits to be defined.

Oij, Stephanie Lynn↗

Distributed Target Tracking With Optimal Data Migration

The paper presents an Extended Kalman Filter based framework for airborne target tracking using dynamic information fusion from multi-modal sensors with geodiversity. First, the algorithm execution location is determined using an optimal data migration strategy, next the sensors information is dynamically fused at each estimation instance using validity flag for each sensor reading, finally the target estimation is updated based on the fused innovation vector. The approach is applied to synthetic data generated from the radar and camera models located on the ground for the simulated target flight in Reflection simulation environment.

Distributed sensing↗