Search NASA⌕ Search

SEARCH · Search NASA

Results for “targeted imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Precision Instrument Targeting via Image Registration for the Mars 2020 Rover

A key component of Mars exploration is the operation of robotic instruments on the surface, such as those on board the Mars Exploration Rovers, the Mars Science Laboratory (MSL), and the planned Mars 2020 Rover. As the instruments carried by these rovers have become more advanced, the area targeted by some instruments becomes smaller, revealing more fine-grained details about the geology and chemistry of rocks on the surface. However, thermal fluctuations, rover settling or slipping, and inherent inaccuracies in pointing mechanisms all lead to pointing error that is on the order of the target size (several millimeters) or larger. We show that given a target located on a previously acquired image, the rover can align this with a new image to visually locate the target and refine the current pointing. Due to round-trip communication constraints, this visual targeting must be done efficiently on board the rover using relatively limited computing hardware. We employ existing ORB features for landmark-based image registration, describe and theoretically justify a novel approach to filtering false landmark matches, and employ a random forest classifier to automatically reject failed alignments. We demonstrate the efficacy of our approach using over 3,800 images acquired by Remote Micro-Imager on board the “Curiosity” rover.

Doran, Gary↗

Automated Registration of Vector Data to Overhead Imagery

The availability of open source, remote sensing-derived vector data has increased exponentially in recent years. Unfortunately, these vector data are rarely made available with the corresponding source images from which objects were extracted. As such, these derived datasets are commonly used in combination with target images which differ from the source. Satellite viewing geometry can cause objects, extracted from a source image, to appear shifted when overlaid with a target image. Whether for purely cartographic purposes, reusability of preexisting training labels, or any spatial analysis where spatial correspondence between vector and image are required, the following paragraphs outline a method to address this challenge through the automated registration of vector data to overhead imagery, including existing literature regarding this challenge, followed by a case study of Sioux Falls, South Dakota.

McKee, Jacob↗

Mobile Aerial Tracking and Imaging System (MATrIS) for Aeronautical Research

A mobile, rapidly deployable ground-based system to track and image targets of aeronautical interest has been developed. Targets include reentering reusable launch vehicles as well as atmospheric and transatmospheric vehicles. The optics were designed to image targets in the visible and infrared wavelengths. To minimize acquisition cost and development time, the system uses commercially available hardware and software where possible. The conception and initial funding of this system originated with a study of ground-based imaging of global aerothermal characteristics of reusable launch vehicle configurations. During that study the National Aeronautics and Space Administration teamed with the Missile Defense Agency/Innovative Science and Technology Experimentation Facility to test techniques and analysis on two Space Shuttle flights.

Banks, Daniel W.↗

Mobile Aerial Tracking and Imaging System (MATRIS) for Aeronautical Research

A mobile, rapidly deployable ground-based system to track and image targets of aeronautical interest has been developed. Targets include reentering reusable launch vehicles (RLVs) as well as atmospheric and transatmospheric vehicles. The optics were designed to image targets in the visible and infrared wavelengths. To minimize acquisition cost and development time, the system uses commercially available hardware and software where possible. The conception and initial funding of this system originated with a study of ground-based imaging of global aerothermal characteristics of RLV configurations. During that study NASA teamed with the Missile Defense Agency/Innovative Science and Technology Experimentation Facility (MDA/ISTEF) to test techniques and analysis on two Space Shuttle flights.

Banks, Daniel W.↗

Assessment of High Resolution Commercial Satellite Geolocation Accuracy

Commercial companies such as Maxar, PlanetScope, and BlackSky have launched many satellites with revisit times ranging from two hours to one day and have built large archives of high resolution (1-3 m) Earth observing data. The high temporal resolution and global coverage of these satellites makes commercial satellite images ideal for scientists studying rapidly changing processes such as flooding and fires. A key step in assessing changes in these images is co-registration of various images to each other. High geolocation accuracy (at most 0.5 pixels of offset) allows for easy co-registration of images across different times and sensors. Here, we assess the latest PlanetScope imagery and evaluate it for geolocation accuracy. For our assessment, we compare the target image to a reference image with known geolocation accuracy (WorldView imagery) and determine the offset between these images by shifting them to maximize their Pearson Cross-Correlation (PCC) value. Offsets required to maximize the PCC give the geolocation accuracy of the target image relative to the reference image. Previously, our global assessment of Planet data revealed large variability in geolocation accuracy from one continent to another. The measured root mean squared errors (RMSEs) range from 5.4 m in North America to 14.9 m in Africa. We have updated this previous assessment to include both their newest SuperDove series as well as a more robust assessment of the temporal stability of PlanetScope's geolocation accuracy.

Alana G. Semple↗

Rover mast calibration, exact camera pointing, and camara handoff for visual target tracking

This paper presents three technical elements that we have developed to improve the accuracy of the visual target tracking for single-sol approach-and-instrument placement in future Mars rover missions. An accurate, straightforward method of rover mast calibration is achieved by using a total station, a camera calibration target, and four prism targets mounted on the rover. The method was applied to Rocky8 rover mast calibration and yielded a 1.1-pixel rms residual error. Camera pointing requires inverse kinematic solutions for mast pan and tilt angles such that the target image appears right at the center of the camera image. Two issues were raised. Mast camera frames are in general not parallel to the masthead base frame. Further, the optical axis of the camera model in general does not pass through the center of the image. Despite these issues, we managed to derive non-iterative closed-form exact solutions, which were verified with Matlab routines. Actual camera pointing experiments aver 50 random target image paints yielded less than 1.3-pixel rms pointing error. Finally, a purely geometric method for camera handoff using stereo views of the target has been developed. Experimental test runs show less than 2.5 pixels error on high-resolution Navcam for Pancam-to-Navcam handoff, and less than 4 pixels error on lower-resolution Hazcam for Navcam-to-Hazcam handoff.

camera handoff↗

Deep learning-based spatio-temporal fusion for high-fidelity ultra-high-speed X-ray radiography

Full-field ultra-high-speed (UHS) X-ray imaging experiments have been well established to characterize various processes and phenomena. However, the potential of UHS experiments through the joint acquisition of X-ray videos with distinct configurations has not been fully exploited. In this paper, we investigate the use of a deep learning-based spatio-temporal fusion (STF) framework to fuse two complementary sequences of X-ray images and reconstruct the target image sequence with high spatial resolution, high frame rate and high fidelity. We applied a transfer learning strategy to train the model and compared the peak signal-to-noise ratio (PSNR), average absolute difference (AAD) and structural similarity (SSIM) of the proposed framework on two independent X-ray data sets with those obtained from a baseline deep learning model, a Bayesian fusion framework and the bicubic interpolation method. The proposed framework outperformed the other methods with various configurations of the input frame separations and image noise levels. With three subsequent images from the low-resolution (LR) sequence of a four times lower spatial resolution and another two images from the high-resolution (HR) sequence of a 20 times lower frame rate, the proposed approach achieved average PSNRs of 37.57 dB and 35.15 dB, respectively. When coupled with the appropriate combination of high-speed cameras, the proposed approach will enhance the performance and therefore the scientific value of UHS X-ray imaging experiments.

deep learning↗

CHAMP - Camera, Handlens, and Microscope Probe

CHAMP (Camera, Handlens And Microscope Probe) is a novel field microscope capable of color imaging with continuously variable spatial resolution from infinity imaging down to diffraction-limited microscopy (3 micron/pixel). As an arm-mounted imager, CHAMP supports stereo-imaging with variable baselines, can continuously image targets at an increasing magnification during an arm approach, can provide precision range-finding estimates to targets, and can accommodate microscopic imaging of rough surfaces through a image filtering process called z-stacking. Currently designed with a filter wheel with 4 different filters, so that color and black and white images can be obtained over the entire Field-of-View, future designs will increase the number of filter positions to include 8 different filters. Finally, CHAMP incorporates controlled white and UV illumination so that images can be obtained regardless of sun position, and any potential fluorescent species can be identified so the most astrobiologically interesting samples can be identified.

Mungas, G. S.↗

CHAMP (Camera, Handlens, and Microscope Probe)

CHAMP (Camera, Handlens And Microscope Probe)is a novel field microscope capable of color imaging with continuously variable spatial resolution from infinity imaging down to diffraction-limited microscopy (3 micron/pixel). As a robotic arm-mounted imager, CHAMP supports stereo imaging with variable baselines, can continuously image targets at an increasing magnification during an arm approach, can provide precision rangefinding estimates to targets, and can accommodate microscopic imaging of rough surfaces through a image filtering process called z-stacking. CHAMP was originally developed through the Mars Instrument Development Program (MIDP) in support of robotic field investigations, but may also find application in new areas such as robotic in-orbit servicing and maintenance operations associated with spacecraft and human operations. We overview CHAMP'S instrument performance and basic design considerations below.

robotic field investigations↗

Image Discrimination Models Predict Object Detection in Natural Backgrounds

Object detection involves looking for one of a large set of object sub-images in a large set of background images. Image discrimination models only predict the probability that an observer will detect a difference between two images. In a recent study based on only six different images, we found that discrimination models can predict the relative detectability of objects in those images, suggesting that these simpler models may be useful in some object detection applications. Here we replicate this result using a new, larger set of images. Fifteen images of a vehicle in an other-wise natural setting were altered to remove the vehicle and mixed with the original image in a proportion chosen to make the target neither perfectly recognizable nor unrecognizable. The target was also rotated about a vertical axis through its center and mixed with the background. Sixteen observers rated these 30 target images and the 15 background-only images for the presence of a vehicle. The likelihoods of the observer responses were computed from a Thurstone scaling model with the assumption that the detectabilities are proportional to the predictions of an image discrimination model. Three image discrimination models were used: a cortex transform model, a single channel model with a contrast sensitivity function filter, and the Root-Mean-Square (RMS) difference of the digital target and background-only images. As in the previous study, the cortex transform model performed best; the RMS difference predictor was second best; and last, but still a reasonable predictor, was the single channel model. Image discrimination models can predict the relative detectabilities of objects in natural backgrounds.

Ahumada, Albert J., Jr.↗

Adaptive Bandwidth Compression For Moving Images

Data compressed in images with fast motion and expanded when motion slows. Proposed data-compression scheme adapts transmission rate for moving image to speed of motion of image. Laser rangefinder measures speed of target. Adaptive sampler determines required resolution of target image on basis of measured speed and provides decommutator at control station with more or fewer partial image fields per unit time. When monitor displays maximum number of fields simultaneously, resolution is highest.

Graham, Olin L.↗

Making A Circular-Harmonic Filter

Optical image-correlating system made rotationally invariant. Experiment shows circular-harmonic filter generated optically. Hologram made by phase-shifted-double-exposure procedure. Filter used in optical image-recognition system based on correlation between target (image to be recognized) and matched spatial filter. In addition to usual invariance under translation of target, circular harmonic filter invariant under rotation of target; peak intensity of illumination at origin of correlation plane does not vary when target rotated about optical axis.

Cheng, Yeou Yen↗

Autonomous Exploration for Gathering Increased Science

The Autonomous Exploration for Gathering Increased Science System (AEGIS) provides automated targeting for remote sensing instruments on the Mars Exploration Rover (MER) mission, which at the time of this reporting has had two rovers exploring the surface of Mars (see figure). Currently, targets for rover remote-sensing instruments must be selected manually based on imagery already on the ground with the operations team. AEGIS enables the rover flight software to analyze imagery onboard in order to autonomously select and sequence targeted remote-sensing observations in an opportunistic fashion. In particular, this technology will be used to automatically acquire sub-framed, high-resolution, targeted images taken with the MER panoramic cameras. This software provides: 1) Automatic detection of terrain features in rover camera images, 2) Feature extraction for detected terrain targets, 3) Prioritization of terrain targets based on a scientist target feature set, and 4) Automated re-targeting of rover remote-sensing instruments at the highest priority target.

Bornstein, Benjamin J.↗

The design of a line velocity interferometer for any reflector for inertial confinement experiments on the Z-machine

A line VISAR (Velocity Interferometer System for Any Reflector) has been designed and commissioned at the Sandia National Laboratory’s Z-machine. The instrument consists of an F/2 collection system, beam transport, and an interferometer table that contains two Mach–Zehnder type interferometers and an eight channel Gated Optical Imaging (GOI) system. The VISAR probe laser operates at the 532 nm wavelength, and the GOI bandpass is 540–600 nm. The output of each interferometer is passed to an optical streak camera with four selectable sweep speeds. The system is designed with three interchangeable optics modules to select a full field of view of 1 mm, 2 mm, or 4 mm. The optical beam transport system connects the target image plane to the interferometers and the gated optical imagers. The target is integrated into a sacrificial final optics assembly that is integral to the transport beamline.

Datte, P.↗

PET Imaging of the Neurotensin Targeting Peptide NOTA-NT-20.3 Using Cobalt-55, Copper-64 and Gallium-68

Introduction: Neurotensin receptor 1 (NTSR1) is an emerging target for imaging and therapy of many types of cancer. Nuclear imaging of NTSR1 allows for noninvasive assessment of the receptor levels of NTSR1 on the primary tumor, as well as potential metastases. This work focuses on a the neurotensin peptide analogue NT-20.3 conjugated to the chelator NOTA for radiolabeling for use in noninvasive positron emission tomography (PET). NOTA-NT-20.3 was radiolabeled with gallium-68, copper-64, and cobalt-55 to determine the effect that modification of the radiometal has on imaging and potential therapeutic properties of NOTA-NT-20.3. Methods: In vitro assays investigating cell uptake and subcellular localization of the radiolabeled peptides were performed using human colorectal adenocarcinoma HT29 cells. In vivo PET/CT imaging was used to determine the distribution and clearance of the peptide in mice bearing NTSR1 expressing HT29 tumors. Results: Cell uptake studies showed that the highest uptake was obtained with [ 55 Co] Co-NOTA-NT-20.3 (18.70 ± 1.30%ID/mg), followed by [ 64 Cu] Cu-NOTA-NT-20.3 (15.46 ± 0.91%ID/mg), and lastly [ 68 Ga] Ga-NOTA-NT-20.3 (10.94 ± 0.46%ID/mg) (p < 0.001). Subcellular distribution was similar across the three constructs, with the membranous fraction containing the highest amount of radioactivity. In vivo PET/CT imaging of the three constructs revealed similar distribution and tumor uptake at the 1 h imaging timepoint. Tumor uptake was receptor-specific and blockable by co-injection of non-radiolabeled NOTA-NT-20.3. SUV ratios of tumor to heart at the 24 h imaging timepoint show that [ 55 Co] Co-NOTA-NT-20.3 (20.28 ± 3.04) outperformed [ 64 Cu] Cu-NOTA-NT-20.3 (6.52 ± 1.97). In conclusion, our studies show that enhanced cell uptake and increasing tumor to blood ratios over time displayed the superiority of [ 55 Co] Co-NOTA-NT-20.3 over [ 68 Ga] Ga-NOTA-NT-20.3 and [ 64 Cu] Cu-NOTA-NT-20.3 for the targeting of NTSR1.

60 APPLIED LIFE SCIENCES↗