Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image processing.”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,477 records · Page 82

imageApps Package v 4.8

The imageApps package provides a number of image processing modules that are compatible with the Umbra/Camera package. Each module works with an connector and generally generates an output image. Modules include the following: imageBlobber: Rapid image segmentation into color blob regions. imageSegmenter: Another image segmentation module. imageAverage: A simple FIR image filter. imageMovingAverage: A simple IIR image filter. imageColorGrid: Used for tracking calibration color blobs. imageCrop: Simple cropping function. imageDifference: Used for detecting motion in image objects. imageSnake: Incorporates the (patent pending) polygon snake algorithm developed under the LDRD. camcal: A calibration module for performing visual targeting (originally developed under Automated Visual Direction LDRD)

Anderson, Robert↗

Coded-mask-based X-ray phase-contrast and dark-field imaging

Phase contrast and dark-field X-ray imaging enable imaging of objects that absorb or reflect very little X-ray light. Disclosed is a method and systems for performing coded-mask-based multi-contrast imaging (CMMI). The method includes providing radiation to a coded mask that has a known phase and absorption profile according to a pre-determined pattern. The radiation is then impingent upon a sample, and the radiation is detected to perform phase-reconstruction and image processing. The method and associated systems allow for the use of maximum-likelihood and machine learning methods for reconstruction images of the sample from the detected radiation.

Shi, Xianbo↗

The VISAR Process

The Video Image Stabilization And Registration (VISAR) process is an award winning video image processing software developed at NASA's Marshall Space Flight Center. VISAR has a wide variety of application areas where the refinement of digital video is needed. It is used to correct jitter, rotation, and zoom effects by registering and processing on individual image captures that are a part of normal video capturing. Its most prominent uses were the 1996 Olympic Bombing case and in identifying Saddam Hussein during the Iraq war. Based on first-hand knowledge, this paper describes the VISAR process, which consists of several steps designed to refine digital video using VISAR software. The process determines the differences between two video images so that one, or both, of the images can be changed in ways that make them match as well as possible. Corrections include changes in position (horizontal and vertical image shifts), changes in orientation (image rotation), and changes in magnification (image zoom). While much of the VISAR process is automated, in its current embodiment it requires the user to initially identify the area of interest and to reset a threshold parameter if the default gives unacceptable results. The basic process that is used is an old tried and true method that determines how well the two images match. This process is called cross-correlation. It gives a single number, the correlation coefficient, that is equal to 1.0 if the images are perfectly matched, is equal to 0.0 if the images have nothing in common, and is equal to -1.0 if one image is the negative of the other. This basic process is used by many image stabilization methods. With VISAR we use it in a manner that provides statistical information needed to best determine orientation and magnification.

Hathaway, David↗

Learning Model Structural Uncertainty with Gaussian Processes

The advent of commercially available quantum computers has marked the beginning of quantum computing as a reality. Both quantum gate and annealing computers have been released by major computer hardware companies. In this work, the D-Wave 2XTM quantum annealing computer housed at the NASA Advanced Systems computational facility is investigated to accelerate Machine Learning (ML) for image registration. NASA collects large amounts of images over the globe remotely using space-based monitoring. Images of a fixed areas of the land surface are taken over time. Due to the orbit of the sensors, the viewing angles deviate slightly, and it is necessary to align or register the images precisely to create image time series over the land surface. Unaligned images can lead to substantial analysis errors. These time-series are then used in modeling Earth Systems models such as hydrological, weather, and carbon monitoring models. In this work, we consider the Moderate Resolution Image Spectrometer (MODIS) data collected by the NASA's terra satellite. Artificial Neural Networks (ANNs) is a natural fit for ML modelling of images. Several successes have been reported using machine learning related to image processing. We investigate the use of ML to register MODIS images. ANNs are investigated in combination with a Restricted Boltzmann Machines (RBM) as an auto-encoder. We will present results showing the accuracy and efficiency of this approach.The D-Wave 2XTM quantum annealer samples the ground-state wave-function of a spin-Ising systems with quadratic interactions between qubits and a Chimera connectivity. The system sits in a ~15 mK thermal bath. One can think of the system as being placed in the ground state initially and subject to thermal excitations governed by Boltzmann statistics. If this is assumed true, one can use the statistics from the D-Wave 2XTM to train RBMs. Generating statistics for training Boltzmann machines is an NP-hard problem and constitutes the largest compute cost. We investigate the use of the D-Wave 2XTM to accelerate the training of the RBMs in our ANNs and report on the results.

Kouatchou, Jules↗

Direct observations of damage during unconfined brittle failure of Carrara marble

Abstract To observe and quantify the production of microfracturing from initial yield to failure, we deformed Carrara marble samples in uniaxial compression at 20, 105, and 180°C and continuously observed a region of about 1 mm 2 on an exposed face with a long‐working distance microscope. Using image processing and microscale strain‐mapping techniques, we measured local strains over a length scale of tens of micrometers. By treating the images with various filters, we identified linear damage features, as well as the magnitude of localized strain and the mode of deformation, i.e., shear versus normal deformation. In general, shear deformation is more prevalent after initial yielding, while tensile deformation dominates closer to peak stress. Independent measurements of both stress and microcrack density at different stages of each experiment provide a unique opportunity to explicitly compare the data with damage models. The model of Ashby and Sammis (1990) significantly underestimated the damage that the rock could sustain before peak stress, perhaps owing to the influence of weak grain boundaries on the damage production. In these samples, microcracks tended to form near boundaries before yield stress. During strain hardening, the damage parameters increased rapidly as longer microcracks grew along the boundaries and finally transected grains as loading neared peak stress. The microcrack density can be empirically related to the reduction of Young's modulus; stiffness ratios decay exponentially with increasing microcrack density for T ≤ 105°C.

Tal, Yuval↗

Impact of Wettability on Pore-Scale Characteristics of Residual Nonaqueous Phase Liquids

The objective of this paper was to investigate the impact of wettability of porous media on pore-scale characteristics of residual nonaqueous phase liquids (NAPLs). Synchrotron X-ray microtomography was used to obtain high-resolution three-dimensional images of fractionally wet sand systems with mean grain size of 250 {micro}m. Pore-scale characteristics of NAPL blobs such as volume, lengths, interfacial areas, and sphericity index were computed using three-dimensional image processing algorithms. Four systems comprised of 100, 50, 25, and 0% NAPL-wet mass fractions containing the residual NAPL were imaged and analyzed. Findings indicate that spatial variation in wettability of porous media surfaces has a significant impact on pore-scale characteristics of residual NAPL blobs in saturated porous media systems. As the porous media comprises more water-wet surfaces, residual NAPL blobs increase in size and length due to the entrapment at large pore bodies. NAPL-water interfacial areas tend to increase as the NAPL-wet surface fractions increase in the systems. Overall residual NAPL saturations are less in fractionally wet systems and increase as the systems become more NAPL-wet or water-wet.

54 ENVIRONMENTAL SCIENCES↗

Comparison of the spatial statistics of random and defined-sequence photoresist films

The resolution-line edge roughness-sensitivity tradeoff has motivated the exploration of potential improvements using defined sequence polymers and polymer-bound photoacid generators and quenchers. We characterize the internal structures of positive tone photoresist polymer films formed from defined sequence polymers and compare them with random copolymers of the same composition. We model their imaging to connect initially to developable film structures. We use a polymer packing algorithm to simulate films of diverse compositions and locations of photoacid generators and quenchers, using the composition of an ESCAP photoresist. We use a simple extreme ultraviolet exposure-deprotection algorithm to model developable image formation within them. In all cases, the spatial distribution of chemical moieties in the film for defined sequence polymers is nearly indistinguishable from random copolymers. We evaluate several exposure-deprotection scenarios and find that a defined sequence copolymer has a distinctive developable image under certain circumstances. The use of defined sequence polymers within a photoresist layer does not automatically result in improved imaging; however, they do have some characteristics different from random polymers of the same composition. Further study of these characteristics may provide a route to improved control over the nanoscale imaging process.

36 MATERIALS SCIENCE↗

Evaluation of LANDSAT-2 (ERTS) images applied to geologic structures and mineral resources of South America

The author has identified the following significant results. Work with the Image 100 clearly demonstrates that radiance values of LANDSAT data can be used for correlation of geologic formations across international boundaries. The Totora Formation of the Corocoro Group of Tertiary age was traced from known outcrops near Tiahuanaco, Bolivia, along the south side of Lake Titicaca westward into Peru where the same rocks are considered to be Cretaceous in age. This inconsistency suggests: (1) that a review of this formation is needed by joint geological surveys of both countries to determine similarities, differences, and the true age; (2) that recognition of the extension of the copper-bearing Totora Formation of Bolivia into Peru may provide Peru with a new target for exploration. Equal radiance maps made by use of the Image 100 system show as many as eight different units within salar deposits (salt flats) of the Bolivian Altiplano. Standard film processed images show them as nearly uniform areas of white because of lack of dynamic range in film products. The Image 100 system, therefore, appears to be of great assistance in subdividing the salt flats on the basis of moisture distribution, surface roughness, and distribution of windblown materials. Field work is needed to determine these relationships to mineral composition and distribution. Images representing seasonal changes should also improve the accuracy of such maps. Radiance values of alteration zones related to the occurrence of porphyry copper ores were measured at the San Juan del Abra deposit of northern Chile using the Image 100 system. The extent to which these same values may be used to detect similar alteration zones in other areas has not yet been tested.

Carter, W. D.↗

Saturn's E ring revisited

Images of the E ring of Saturn obtained by the image processing of photographs of the 1966 edge-on presentation of the planet's ring plane are presented. Two methods of image enhancement were used: scanning with an image quantizer operated in the derivative mode to enhance contrast and computerized subtraction of a circularly symmetric image of the overexposed Saturn disk. Further photographic and CCD observation confirming the existence of the ring extending to twice the diameter of the A ring, which was not detected by the Pioneer 11 imaging photopolarimeter, is indicated.

Feibelman, W. A.↗

Experimental Optoelectronic Associative Memory

Optoelectronic associative memory responds to input image by displaying one of M remembered images. Which image to display determined by optoelectronic analog computation of resemblance between input image and each remembered image. Does not rely on precomputation and storage of outer-product synapse matrix. Size of memory needed to store and process images reduced.

Chao, Tien-Hsin↗

Astronomical data analysis software and systems I; Proceedings of the 1st Annual Conference, Tucson, AZ, Nov. 6-8, 1991

Consideration is given to a definition of a distribution format for X-ray data, the Einstein on-line system, the NASA/IPAC extragalactic database, COBE astronomical databases, Cosmic Background Explorer astronomical databases, the ADAM software environment, the Groningen Image Processing System, search for a common data model for astronomical data analysis systems, deconvolution for real and synthetic apertures, pitfalls in image reconstruction, a direct method for spectral and image restoration, and a discription of a Poisson imagery super resolution algorithm. Also discussed are multivariate statistics on HI and IRAS images, a faint object classification using neural networks, a matched filter for improving SNR of radio maps, automated aperture photometry of CCD images, interactive graphics interpreter, the ROSAT extreme ultra-violet sky survey, a quantitative study of optimal extraction, an automated analysis of spectra, applications of synthetic photometry, an algorithm for extra-solar planet system detection and data reduction facilities for the William Herschel telescope.

Worrall, Diana M.↗

Fine-resolution imaging of solar features using Phase-Diverse Speckle

Phase-diverse speckle (PDS) is a novel imaging technique intended to overcome the degrading effects of atmospheric turbulence on fine-resolution imaging. As its name suggests, PDS is a blend of phase-diversity and speckle-imaging concepts. PDS reconstructions on solar data were validated by simulation, by demonstrating internal consistency of PDS estimates, and by comparing PDS reconstructions with those produced from well accepted speckle-imaging processing. Several sources of error in data collected with the Swedish Vacuum Solar Telescope (SVST) were simulated: CCD noise, quantization error, image misalignment, and defocus error, as well as atmospheric turbulence model error. The simulations demonstrate that fine-resolution information can be reliably recovered out to at least 70% of the diffraction limit without significant introduction of image artifacts. Additional confidence in the SVST restoration is obtained by comparing its spatial power spectrum with previously-published power spectra derived from both space-based images and earth-based images corrected with traditional speckle-imaging techniques; the shape of the spectrum is found to match well the previous measurements. In addition, the imagery is found to be consistent with, but slightly sharper than, imagery reconstructed with accepted speckle-imaging techniques.

Paxman, Richard G.↗

Orion Optical Navigation Progress Toward Exploration: Mission 1

Optical navigation of human spacecraft was proposed on Gemini and implemented successfully on Apollo as a means of autonomously operating the vehicle in the event of lost communication with controllers on Earth. It shares a history with the "method of lunar distances" that was used in the 18th century and gained some notoriety after its use by Captain James Cook during his 1768 Pacific voyage of the HMS Endeavor. The Orion emergency return system utilizing optical navigation has matured in design over the last several years, and is currently undergoing the final implementation and test phase in preparation for Exploration Mission 1 (EM-1) in 2019. The software development is being worked as a Government Furnished Equipment (GFE) project delivered as an application within the Core Flight Software of the Orion camera controller module. The mathematical formulation behind the initial ellipse fit in the image processing is detailed in Christian. The non-linear least squares refinement then follows the technique of Mortari as an estimation process of the planetary limb using the sigmoid function. The Orion optical navigation system uses a body fixed camera, a decision that was driven by mass and mechanism constraints. The general concept of operations involves a 2-hour pass once every 24 hours, with passes specifically placed before all maneuvers to supply accurate navigation information to guidance and targeting. The pass lengths are limited by thermal constraints on the vehicle since the OpNav attitude generally deviates from the thermally stable tail-to-sun attitude maintained during the rest of the orbit coast phase. Calibration is scheduled prior to every pass due to the unknown nature of thermal effects on the lens distortion and the mounting platform deformations between the camera and star trackers. The calibration technique is described in detail by Christian, et al. and simultaneously estimates the Brown-Conrady coefficients and the Star Tracker/Camera interlock angles. Accurate attitude information is provided by the star trackers during each pass. Figure 1 shows the various phases of lunar return navigation when the vehicle is in autonomous operation with lost ground communication. The midcourse maneuvers are placed to control the entry interface conditions to the desired corridor for safe landing. The general form of optical navigation on Orion is where still images of the Moon or Earth are processed to find the apparent angular diameter and centroid in the camera focal plane. This raw data is transformed into range and bearing angle measurements using planetary data and precise star tracker inertial attitude. The measurements are then sent to the main flight computer's Kalman filter to update the onboard state vector. The images are, of course, collected over an arc to converge the state and estimate velocity. The same basic technique was used by Apollo to satisfy loss-of-comm, but Apollo used manual crew sightings with a vehicle-integral sextant instead of autonomously processing optical imagery. The software development is past its Critical Design Review, and is progressing through test and certification for human rating. In support of this, a hardware-in-the-loop test rig was developed in the Johnson Space Center Electro-Optics Lab to exercise the OpNav system prior to integrated testing on the Orion vehicle. Figure 2 shows the rig, which the test team has dubbed OCILOT (Orion Camera In the Loop Optical Testbed). Analysis performed to date shows a delivery that satisfies an allowable entry corridor as shown in Figure 3.

Holt, Greg N.↗

Automated reduction of instantaneous flow field images

An automated data reduction system for the analysis of interference fringe patterns obtained using the particle image velocimetry technique is described. This system is based on digital image processing techniques that have provided the flexibility and speed needed to obtain more complete automation of the data reduction process. As approached here, this process includes scanning/searching for data on the photographic record, recognition of fringe patterns of sufficient quality, and, finally, analysis of these fringes to determine a local measure of the velocity magnitude and direction. The fringe analysis as well as the fringe image recognition are based on full frame autocorrelation techniques using parallel processing capabilities.

Reynolds, G. A.↗

Horizon Detection for Mars Surface Operations

A new image processing method for automated horizon detection is presented in this paper. This method was developed for the Mars Exploration Rovers mission’s surface operations to aid in determining orbiter visibility periods for downlink data, and is now being considered for all Mars surface missions and for a variety of applications. Starting with images received from Mars rovers or landers, the horizon pixel location is found by (1) obtaining the gradient images using the Sobel operator, (2) calculating the preliminary horizon locations by optimizing the maximum difference between sky and ground regions in the gradient domain, and (3) applying a multi-variable thresholding method. The results are analyzed using a variety of images from the Mars rovers, as an example one dataset’s results were categorized as 94.2% Good, 4.11% Okay, and 1.65% Poor. The pixel location corresponding to the found horizon in an image is converted to azimuth and elevation values using the camera model. The elevation of the terrain surrounding the rover or lander directly affects the duration orbiters are visible for downlink data volume, and when the sun is visible for image quality or solar energy consumption. Having an automated process to detect the elevation of the terrain allows the operation team to better predict the outcome of the plan, reducing heath and safety risks and allowing new operational limits to be defined.

Oij, Stephanie Lynn↗

FPGA-accelerated SpeckleNN with SNL for real-time X-ray single-particle imaging

We present the implementation of a specialized version of our previously published unified embedding model, SpeckleNN, for real-time speckle pattern classification in X-ray Single-Particle Imaging (SPI), using the SLAC Neural Network Library (SNL) on an FPGA platform. This hardware realization transitions SpeckleNN from a prototypic model into a practical edge solution, optimized for running inference near the detector in high-throughput X-ray free-electron laser (XFEL) facilities, such as those found at the Linac Coherent Light Source (LCLS). To address the resource constraints inherent in FPGAs, we developed a more specialized version of SpeckleNN. The original model, which was designed for broader classification across multiple biological samples, comprised ~5.6 million parameters. The new implementation, while reducing the parameter count to 64.6K (a 98.8% reduction), focuses on maintaining the model's essential functionality for real-time operation, achieving an accuracy of 90%. Furthermore, we compressed the latent space from 128 to 50 dimensions. This implementation was demonstrated on the KCU1500 FPGA board, utilizing 71% of available DSPs, 75% of LUTs, and 48% of FFs, with an average power consumption of 9.4W according to the Vivado post-implementation report. The FPGA performed inference on a single image with a latency of 45.015 microseconds at a 200 MHz clock rate. In comparison, running the same inference on an NVIDIA A100 GPU resulted in an average power consumption of ~73W and an image processing latency of around 400 microseconds. Our FPGA-accelerated version of SpeckleNN demonstrated significant improvements, achieving an 8.9 × speedup and a 7.8 × reduction in power consumption compared to the GPU implementation. Key advancements include model specialization and dynamic weight loading through SNL, which eliminates the need for time-consuming FPGA design re-synthesis, allowing fast and continuous deployment of models (re)trained online. These innovations enable real-time adaptive classification and efficient vetoing of speckle patterns, making SpeckleNN more suited for deployment in XFEL facilities. This implementation has the potential to significantly accelerate SPI experiments and enhance adaptability to evolving experimental conditions.

47 OTHER INSTRUMENTATION↗

Automated Scoring of Morphological Changes in Images of Pentaerythritol Tetranitrate

Recent advances in characterization techniques that generate large datasets of material microstructure images require robust, automated image-processing. We applied an unsupervised anomaly detection method called feature anomaly detection system (FADS) to automatically detect and quantify microstructure changes in images of the explosive pentaerythritol tetranitrate (PETN) aged at various temperatures. We demonstrated the FADS approach on two-dimensional images extracted from computed tomography scans, but the same technique can be readily applied to other imaging modalities. FADS calculates anomaly scores on the basis of differences in filter activations of nominal and test data in pretrained convolutional neural networks. The FADS scores successfully differentiated between pristine PETN and PETN aged at a temperature where material coarsening occurred. Morphological metric analysis of segmented images verified observed trends in FADS scores as a function of aging temperature and aging time, specifically by calculating volume fractions, specific boundary lengths, two-point correlation functions, and local thicknesses. Here, the FADS technique has two important advantages compared to traditional morphological analysis: First, it uses grayscale images as input, rather than images that are segmented to separate the appropriate phases; and second, FADS scores capture any type of changes among image sets, rather than requiring prior knowledge or selection of a relevant set of metrics.

Accelerated aging↗

High-Resolution 3D Acoustic Borehole Integrity Monitoring (Research Performance Progress Report Q2 2021)

Real-time, in-situ, high spatial resolution (sub-cm) imaging of the near-borehole environment would revolutionize wellbore diagnostics and integrity assessment by direct observation of defects. It is becoming increasingly apparent, that better understanding of the near-wellbore environment is required to meet the safety and operational needs in challenging environments such as those present in subsurface energy extraction (geothermal) and storage (CO2 sequestration) applications. Therefore, it is important to have a more robust ability to image the near-borehole and reliably detect defects. It was proposed to further develop and improve our advanced 3D imaging system to evaluate casing defects (e.g. corrosion) and cement quality in either open- or cased-borehole with the ultimate goal to develop a commercially deployable technology. The system consists of a unique acoustic source (LANL) and advanced inversion techniques for image processing (LANL, ORNL). This system will provide comprehensive borehole integrity monitoring with improved resolution over existing techniques. As an application of this imaging system, we will characterize the effectiveness of next-generation wellbore completion technology (NETL, SNL), and will demonstrate that, unlike current technology, the proposed approach can successfully characterize foamed cements.

15 GEOTHERMAL ENERGY↗