Search NASA⌕ Search

SEARCH · Search NASA

Results for “2D Image”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Constructing a Database from Multiple 2D Images for Camera Pose Estimation and Robot Localization

The LMDB (Landmark Database) Builder software identifies persistent image features (landmarks) in a scene viewed multiple times and precisely estimates the landmarks 3D world positions. The software receives as input multiple 2D images of approximately the same scene, along with an initial guess of the camera poses for each image, and a table of features matched pair-wise in each frame. LMDB Builder aggregates landmarks across an arbitrarily large collection of frames with matched features. Range data from stereo vision processing can also be passed to improve the initial guess of the 3D point estimates. The LMDB Builder aggregates feature lists across all frames, manages the process to promote selected features to landmarks, and iteratively calculates the 3D landmark positions using the current camera pose estimations (via an optimal ray projection method), and then improves the camera pose estimates using the 3D landmark positions. Finally, it extracts image patches for each landmark from auto-selected key frames and constructs the landmark database. The landmark database can then be used to estimate future camera poses (and therefore localize a robotic vehicle that may be carrying the cameras) by matching current imagery to landmark database image patches and using the known 3D landmark positions to estimate the current pose.

Wolf, Michael↗

NESC GN&C TDT Workshop on 2D Image Motion Optical Transfer Functions, Pointing Performance Analysis, and Requirements

This course was prepared by the author in support of the NASA GN&C Technical Discipline Team (TDT). The purpose of this two-day course is to inform practicing GN&C engineers, and other system and subsystem engineers, including payload engineers and mission analysts, of methodologies to analyze the pointing performance of spacecraft and to write unambiguous pointing requirements that are relevant to optical payload performance. It is hoped that the seminar will contribute to a best-practices manual and contribute to accepted and uniform means of requirements definition, validation, and verification. The course material is designed to address the needs of not only practicing GN&C engineers, but also system and subsystem engineers of other disciplines, payload engineers, mission analysts, and even astronomers who need to understand how they interface to a GN&C subsystem. Much revision is the direct result of active student participation during the presentations and from feedback obtained through course evaluation forms.

2D Image↗

NESC GN&C TDT Workshop on 2D Image Motion Optical Transfer Functions, Pointing Performance Analysis, and Requirements

What You Will Learn: The focus is on payload imaging performance due to pointing motion. Some historical background on pointing performance analysis is given. The Optical Transfer Function (OTF) and Modulation Transfer Function (MTF) are defined. The imaging performance due to pointing motion is measured by image motion optical transfer functions (IM OTF). IM OTFs are defined for displacement, smear, and jitter motions, which are all rigorously defined. Deterministic and Statistical IM OTFs are briefly derived and graphically illustrated and compared. The IM OTFs are parameterized by pointing error metrics(PEM), which are means and covariances of displacement, smear, and jitter. Emphasis is on procedures and algorithms to evaluate the image motion optical transfer functions and pointing error metrics. Three procedures are covered, which depend on whether the pointing error data is from time-domain simulation, frequency-domain analysis, or stochastic modeling. A method to evaluate the relative contribution of disturbance sources and to identify the most significant contributors is presented. The presentation includes pertinent discussion of flexible structures and control-structure interaction. No single book can adequately cover this subject, so a book is not required for the course. A list of selected articles, reports, documents, and books is provided for reference and further study. Mathis kept to the minimum necessary to convey principles; lengthy derivations are left to the reference material. Graphics are used to illustrate concepts. As with any such learning endeavor, the knowledge gained will be retained and strengthened through actual practice.c©2019–2021 Mark E. Pittelkau— 5

NASA Engineering and Safety Center (NESC)↗

Quantifying Therapeutic and Diagnostic Efficacy in 2D Microvascular Images

VESGEN is a newly automated, user-interactive program that maps and quantifies the effects of vascular therapeutics and regulators on microvascular form and function. VESGEN analyzes two-dimensional, black and white vascular images by measuring important vessel morphology parameters. This software guides the user through each required step of the analysis process via a concise graphical user interface (GUI). Primary applications of the VESGEN code are 2D vascular images acquired as clinical diagnostic images of the human retina and as experimental studies of the effects of vascular regulators and therapeutics on vessel remodeling.

Parsons-Wingerter, Patricia↗

Panchromatic spectrograph with supporting monochromatic imagers

The Arizona Imager/Spectrograph is a set of imaging spectrographs and 2D imagers for space flight. Nine nearly identical spectrographs record wavelengths from 114 to 1090 nm with a resolution of 0.5-1.3 nm. The spatial resolution along the slit is electronically selectable and can reach 192 elements. Twelve passband imagers cover wavelengths in the 160-900-nm range and have fields of view from 2 to 21 deg. The spectrographs and imagers rely on intensified CCD detectors to achieve substantial capability in an instrument of minimum mass and size. By use of innovative coupling techniques only two CCDs are required to record images from 12 imagers, and single CCDs record spectra from pairs of spectrographs. The fields of view of the spectrographs and imagers are coaligned, and all spectra and images can be exposed simultaneously. A scan platform can rotate the sensor head about two orthogonal axes. The Arizona imager/spectrograph is designed for investigations of the interaction between the Space Shuttle and its environment. It is scheduled for flight on a Shuttle subsatellite.

Broadfoot, A. L.↗

3D X-Ray Luggage-Screening System

A three-dimensional (3D) x-ray luggage- screening system has been proposed to reduce the fatigue experienced by human inspectors and increase their ability to detect weapons and other contraband. The system and variants thereof could supplant thousands of xray scanners now in use at hundreds of airports in the United States and other countries. The device would be applicable to any security checkpoint application where current two-dimensional scanners are in use. A conventional x-ray luggage scanner generates a single two-dimensional (2D) image that conveys no depth information. Therefore, a human inspector must scrutinize the image in an effort to understand ambiguous-appearing objects as they pass by at high speed on a conveyor belt. Such a high level of concentration can induce fatigue, causing the inspector to reduce concentration and vigilance. In addition, because of the lack of depth information, contraband objects could be made more difficult to detect by positioning them near other objects so as to create x-ray images that confuse inspectors. The proposed system would make it unnecessary for a human inspector to interpret 2D images, which show objects at different depths as superimposed. Instead, the system would take advantage of the natural human ability to infer 3D information from stereographic or stereoscopic images. The inspector would be able to perceive two objects at different depths, in a more nearly natural manner, as distinct 3D objects lying at different depths. Hence, the inspector could recognize objects with greater accuracy and less effort. The major components of the proposed system would be similar to those of x-ray luggage scanners now in use. As in a conventional x-ray scanner, there would be an x-ray source. Unlike in a conventional scanner, there would be two x-ray image sensors, denoted the left and right sensors, located at positions along the conveyor that are upstream and downstream, respectively (see figure). X-ray illumination may be provided by a single source or by two sources. The position of the conveyor would be detected to provide a means of matching the appropriate left- and right-eye images of an item under inspection. The appropriate right- and left-eye images of an item would be displayed simultaneously to the right and left eyes, respectively, of the human inspector, using commercially available stereo display screens. The human operator could adjust viewing parameters for maximum viewing comfort. The stereographic images thus generated would differ from true stereoscopic images by small distortions that are characteristic of radiographic images in general, but these distortions would not diminish the value of the images for identifying distinct objects at different depths.

Fernandez, Kenneth↗

Advanced Three-Dimensional Display System

A desktop-scale, computer-controlled display system, initially developed for NASA and now known as the VolumeViewer(TradeMark), generates three-dimensional (3D) images of 3D objects in a display volume. This system differs fundamentally from stereoscopic and holographic display systems: The images generated by this system are truly 3D in that they can be viewed from almost any angle, without the aid of special eyeglasses. It is possible to walk around the system while gazing at its display volume to see a displayed object from a changing perspective, and multiple observers standing at different positions around the display can view the object simultaneously from their individual perspectives, as though the displayed object were a real 3D object. At the time of writing this article, only partial information on the design and principle of operation of the system was available. It is known that the system includes a high-speed, silicon-backplane, ferroelectric-liquid-crystal spatial light modulator (SLM), multiple high-power lasers for projecting images in multiple colors, a rotating helix that serves as a moving screen for displaying voxels [volume cells or volume elements, in analogy to pixels (picture cells or picture elements) in two-dimensional (2D) images], and a host computer. The rotating helix and its motor drive are the only moving parts. Under control by the host computer, a stream of 2D image patterns is generated on the SLM and projected through optics onto the surface of the rotating helix. The system utilizes a parallel pixel/voxel-addressing scheme: All the pixels of the 2D pattern on the SLM are addressed simultaneously by laser beams. This parallel addressing scheme overcomes the difficulty of achieving both high resolution and a high frame rate in a raster scanning or serial addressing scheme. It has been reported that the structure of the system is simple and easy to build, that the optical design and alignment are not difficult, and that the system can be built by use of commercial off-the-shelf products. A prototype of the system displays an image of 1,024 by 768 by 170 (=133,693,440) voxels. In future designs, the resolution could be increased. The maximum number of voxels that can be generated depends upon the spatial resolution of SLM and the speed of rotation of the helix. For example, one could use an available SLM that has 1,024 by 1,024 pixels. Incidentally, this SLM is capable of operation at a switching speed of 300,000 frames per second. Implementation of full-color displays in future versions of the system would be straightforward: One could use three SLMs for red, green, and blue, respectively, and the colors of the voxels could be automatically controlled. An optically simpler alternative would be to use a single red/green/ blue light projector and synchronize the projection of each color with the generation of patterns for that color on a single SLM.

Geng, Jason↗

Overview of the Digitization Workflow Post Image Acquisition of Apollo Lunar and Antarctic Meteorite Samples Using Agisoft Photoscan for the NASA 3D Astromaterials Virtual Samples Collection

The 3D Virtual Astromaterials Samples (3DVAS) collection is a multi-year funded project to create a digital database of sixty Apollo Lunar and Antarctic Meteorite samples following non-destructive documentation conservation protocols. After initial image processing, the photos are evaluated and processed using unique structure-from-motion photogrammetric techniques in a high performance modelling software designed to create a 3D model from 2D images: Agisoft Photoscan Pro. Agisoft Photoscan Pro uses image processing algorithms and techniques originating in computer vision to resolve 3D models for accurate and detailed visualization of a subject. The software provides a stepwise process that is tailored per model based on spatial and specular reflectance properties, for example. The process includes: photo alignment, creation of a dense point cloud, mesh, and finally texture. Photo alignment is dependent on model properties. The 3DVAS process requires a special rotation platform with calibrated photogrammetric targets, specific distance rotation protocols, and a contrasting background for alignment and scale accuracy. As a result of the photographic process, alignment will complete with two mirrored hemispheres that, in a sense, represent the 2D images overlapping to create a 3D model. Each dense point cloud is analyzed with provided statistical measures in a gradual selection process to eliminate outliers. The point cloud is reduced to include only data valuable to the final model. When a precise dense point cloud is achieved, a mesh and texture are applied. Each model is scaled with scale bar accuracies within 100 microns. Each sample has its own intimate process for modelling; there is no standard for the parameters required in the final creation of a high resolution model. By processing multiple samples, a skill is gained in practice to allow a close definition of the original sample and will result in the most detailed version of the sample shell. This process completes one-fifth of the 3DVAS protocol for providing accurate digital documentation. Each model shell is merged with X-ray Computed Tomography data to create a full volumetric sample. All 3DVAS data will be served on NASA's Astromaterials Acquisition and Curation website with an early subset of data available in 2019 and the 3D Virtual Astromaterials Samples Collection launch in 2020.

Thomas, Andi B.↗

Factors influencing perceived angular velocity

Angular velocity perception is examined for rotations both in depth and in the image plane and the influence of several object properties on this motion parameter is explored. Two major object properties are considered, namely, texture density which determines the rate of edge transitions for rotations in depth, i.e., the number of texture elements that pass an object's boundary per unit of time, and object size which determines the tangential linear velocities and 2D image velocities of texture elements for a given angular velocity. Results of experiments show that edge-transition rate biased angular velocity estimates only when edges were highly salient. Element velocities had an impact on perceived angular velocity; this bias was associated with 2D image velocity rather than 3D tangential velocity. Despite these biases judgements were most strongly determined by the true angular velocity. Sensitivity to this higher order motion parameter appeared to be good for rotations both in depth (y-axis) and parallel to the line of sight (z-axis).

Kaiser, Mary K.↗

Monochromatic imaging instrumentation for applications in aeronomy of the earth and planets

Monochromatic imaging instrumentation has been developed that uses narrow-band (12 A FWHP) interference filters or plane reflection gratings for 2D imaging and imaging spectrograph applications. By changing the optics in front of the filter or grating, the field of view of the instruments can be varied from 180 deg to 6 deg. In the case of the 2D monochromatic imager, the 12 mm-diameter filtered image is formed at about f/1 on the input photocathode of an intensified CCD camera (380 x 488 pixels). The sensitivities of the systems are about 50-100 R s (S/N about 2). Examples of data taken with both of these instruments include detection and mapping of Jupiter's sodium magnetonebula and stable auroral red arcs in the terrestrial ionosphere.

Baumgardner, Jeffrey↗

3D Observation of GEMS by Electron Tomography

Amorphous silicates in chondritic porous interplanetary dust particles (CP-IDPs) coming from comets are dominated by glass with embedded metal and sulfides (GEMS). GEMS grains are submicron-sized rounded objects (typically 100-500) nm in diameter) with anaometer-sized (10-50 nm) Fe-Ni metal and sulfide grains embedded in an amorphous silicate matrix. Several formation processes for GEMS grains have been proposed so far, but these models are still being debated [2-5]. Bradley et al. proposed that GEMS grains are interstellar silicate dust that survived various metamorphism or alteration processes in the protoplanetary disk and that they are amorphiation products of crystalline silicates in the interstellar medium by sputter-deposition of cosmic ray irradiation, similar to space weathering [2,4]. This consideration is based on the observation of nano-sized crystals (approximately 10 nm) called relict grains in GEMS grains and their shapes are pseudomorphs to the host GEMS grains. On the other hand, Keller and Messenger proposed that most GEMS formed in the protoplanetary disk as condensates from high temperature gas [3,5]. This model is based on the fact that most GEMS grains have solar isotopic compositions and have extremely heterogeneous and non-solar elemental compositions. Keller and Messenger (2011) also reported that amorphous silicates in GEMS grains are surrounded by sulfide grains, which formed as sulfidization of metallic iron grains located on the GEMS surface. The previous studies were performed with 2D observation by using transmission electron microscopy (TEM) or scanning TEM (STEM). In order to understand the structure of GEMS grains described above more clearly, we observed 3D structure of GEMS grains by electron tomography using a TEM/STEM (JEM-2100F, JEOL) at Kyoto University. Electron tomography gives not only 3D structures but also gives higher spatial resolution (approximately a few nm) than that in conventional 2D image, which is restricted by sample thickness ) approx. or greater than 50 nm). Three cluster IDPs (L2036AA5 cluster4, L2009L8 cluster 13 and W726A2) were used for the observations. ID W726A2 was collected without silicon oil, which is ordinary used to collect IDPs, so this sample has no possibility of contaminations caused by silicon oil or solvent to rinse it [6]. The samples were embedded in epoxy risin and sliced into ultrathin sections (50-300 nm) using an ultramicotome. The sections were observed by BF-TEM and HAADF-STEM (high angle annular dark field-scanning TEM) modes. Images were obtained by rotating the sample tilt angle over a range of +/- 65 deg in 1 deg steps. The obtained images were reconstructed to slice images. Mineral phases in the slice images were estimated by comparing with a 2D elemental map obtained by an EDS (energy dispersive X-ray spectroscopy) system equipped in the TEM/STEM. Careful examination of the slice images confirmed that iron grains are embedded in the amorphous silicate matrix of the GEMS grains, but sulfide grains were mainly present on the surface of the amorphous silicate. These results are consistent with the model that GEMS grains formed as condensates [3,5], although more data are needed to conclude the origin of GEMS grains. The present study is the first successful example adapting the electron tomography to the IDPs. This type of analysis will be important for planetary material sciences in the future.

Matsuno, Junya↗

TPSAS-NF1676L-33668-DND

A three-color pyrometer has been developed based on plenoptic imaging technology. Three bandpass filters placed in front of the camera lens allows separate 2D images to be obtained at three different wavelengths. Images were obtained of different black- or grey-bodies including a calibration furnace, a radiation heater, a sooting butane flame and a luminous sulfur match flame. The images were processed to determine 2D temperature distributions. Calibration results in the furnace showed that the instrument could measure temperature with an accuracy and precision of 10 Kelvins between 1100 and 1350 K. Time-resolved 2D measurements of the radiation heater, flame and match are shown.

Paul M Danehy↗

Phase-Conjugate Receiver for Gaussian-State Quantum Illumination

An active optical sensor probes a region of free space that is engulfed in bright thermal noise to determine the presence (or absence) of a weakly reflecting target. The returned light (which is just thermal noise if no target is present, and thermal noise plus a weak reflection of the probe beam if a target is present) is measured and processed by a receiver and a decision is made on whether a target is present. It has been shown that generating an entangled pair of photons (which is a highly nonclassical state of light), using one photon as the probe beam and storing the other photon for comparison to the returned light, has superior performance to the traditional classical-light (coherent-state) target detection sensors. An entangled-photon transmitter and optimal receiver combination can yield up to a factor of 4 (i.e., 6 dB) gain in the error-probability exponent over a coherent state transmitter and optimal receiver combination, in a highly lossy and noisy scenario (when both sensors have the same number of transmitted photons). However, the receiver that achieves this advantage is not known. One structured receiver can close half of the 6-dB gap (i.e., a 3-dB improvement). It is based on phase-conjugating the returned light, then performing dual-balanced difference detection with the stored half of the entangled-photon pair. Active optical sensors are of tremendous value to NASA s missions. Although this work focuses on target detection, it can be extended to imaging (2D, 3D, hyperspectral, etc.) scenarios as well, where the image quality can be better than that offered by traditional active sensors. Although the current work is theoretical, NASA s future missions could benefit significantly from developing and demonstrating this capability. This is an optical receiver design whose components are, in principle, all implementable. However, the work is currently entirely theoretical. It is necessary to: 1. Demonstrate a bench-top proof of the theoretical principle, 2. Create an operational prototype off-the-bench, and 3. Build a practical sensor that can fly in a mission.

Erkmen, Baris I.↗

A Plenoptic Multi-Color Imaging Pyrometer

A three-color pyrometer has been developed based on plenoptic imaging technology. Three bandpass filters placed in front of a camera lens allow separate 2D images to be obtained on a single image sensor at three different and adjustable wavelengths selected by the user. Images were obtained of different black- or grey-bodies including a calibration furnace, a radiation heater, and a luminous sulfur match flame. The images obtained of the calibration furnace and radiation heater were processed to determine 2D temperature distributions. Calibration results in the furnace showed that the instrument can measure temperature with an accuracy and precision of 10 Kelvins between 1100 and 1350 K. Time-resolved 2D temperature measurements of the radiation heater are shown.

Danehy, Paul M.↗

Compact Midwave Imaging System: Results from an Airborne Demonstration

The Compact Midwave Imaging System (CMIS) is a wide field of view, multi-angle, multi-spectral push frame imager that relies on the forward motion of the satellite to create a two-dimensional (2D) image swath. An airborne demonstration of CMIS was successfully completed in January-February 2021 on the NASA Langley Research Center Gulfstream III. The primary objective of the four-flight campaign was to demonstrate the capability of this unique instrument to perform stereo observations of clouds and other particulates (e.g. smoke) in the atmosphere. It is shown that the midwave infrared (MWIR) spectral bands of CMIS provide a unique 24/7 capability with high resolution for accurate stereo sensing.The instrument relies on new focal plane array (FPA) technology, which provides excellent sensitivity at much warmer detector temperatures than traditional technologies. This capability enabled a compact, low-cost design that can provide atmospheric motion vectors and cloud heights to support requirements for atmospheric winds in the 2017-2027 Earth Science Decadal Survey. Applications include day/night observations of the planetary boundary layer, severe weather, and wildfires. A comparison with current space-based earth science instruments demonstrates that the SWIR/MWIR multi-spectral capability of CMIS is competitive with larger, more expensive instrumentation. Imagery obtained over a controlled burn and operating nuclear power plant demonstrated the sensitivity of the instrument to temperature variations. The system relies on a mature stereoscopic imaging technique applied to the same scene from two independent platforms to unambiguously retrieve atmospheric motion vectors (AMVs) with accurate height assignment.This capability has been successfully applied to geostationary and low-earth orbit satellites to achieve excellent accuracy. When applied to a ground-point validation case, the accuracy for the CMIS aircraft observations was 20 m and 0.3 m/s for cloud heights and motion vectors, respectively. This result was confirmed by a detailed error analysis with analytical and covariance models. The results for CMIS cases with under flights of Aeolus, CALIPSO and Aqua provided a good validation of expected accuracies. The paper also showed the feasibility of accommodating CMIS on CubeSats to enable multiple instruments to be flown in a leader-follower mode.

stereo winds↗

Imaging the 3.4-micron feature in Comet Levy (1990c)

The IRTF's ProtoCAM has been used to observe the organic emission feature peaking near 3.36 microns in Comet Levy. 2D images of the spatial distribution of the 3.4-micron organic emission exhibit brightness profiles statistically indistinguishable from that of the dust continuum, within 1225 of the cometary nucleus; this suggests a progenitor for the emission feature which is not a photodissociation fragment of some other species.

Klavetter, James J.↗