Search NASA⌕ Search

SEARCH · Search NASA

Results for “Advanced Image Processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

The exploration metaphor

NASA's experience in planetary exploration has demonstrated that the desktop workstation is inadequate for many visualization situations. The primary mission displays for the unmanned Surveyor missions to the moon during the mid-1960's, for example, were environmental images assembled on the inside surfaces of spherical shells. Future exploration missions will greatly benefit from advances in digital computer and display technology, but there remain unmet user interface needs. Alternative user interfaces and metaphors are needed for planetary exploration and other interactions with complex spatial environments. These interfaces and metaphors would enable the user to directly explore environments and naturally manipulate objects in those environments. Personal simulators, virtual workstations, and telepresence user interfaces are systems capable of providing this integration of user space and task space. The Exploration Metaphor is a useful concept for guiding the design of user interfaces for virtual environments and telepresence. To apply the Exploration Metaphor is to assert that computing is like exploration, and to support objects, operations, and contexts comparable to those encountered in the exploration of natural environments. The Exploration Metaphor, under development for user interfaces in support of NASA's planetary exploration missions and goals, will also benefit other applications where complex spatial information must be visualized. Visualization methods and systems for planetary exploration are becoming increasingly integrated and interactive as computing technology improves. These advances will benefit from virtual environment and telepresence interface technology. A key development has been the processing of multiple images and other sensor data to create detailed digital models of the planets and moons. Data from images of the Earth, Mars, and Miranda, for example, have been converted into 3D models, and dynamic virtual fly-overs have been computed as demonstrations. Similar processing of lower altitude photography and the use of computer aided design tools promise to produce very detailed models in the future.

Mcgreevy, Michael W.↗

Machine learning approaches for intentional materials engineering

In this article, the development of nanoporous metals and metallic composites through dealloying processes presents significant opportunities in materials engineering. However, designing multicomponent precursor alloys and establishing corresponding processing methods that yield predictable compositions and nanostructures remain a complex challenge. This article explores how machine learning (ML)-augmented computational and experimental methodologies can tackle these challenges by predicting precursor alloy compositions, final nanoporous structures, and mechanical properties, while integrating ML-enabled autonomous experimentation for material design and quantification. We highlight recent advancements in applying ML to nanostructured materials design via dealloying and discuss how techniques from other nanomaterial designs can be adapted for improved control over morphological and compositional outcomes in nanoporous and nanocomposite materials. Furthermore, we explore the role of ML in autonomous synchrotron x-ray experimentation, enabling real-time feedback between modeling and experimental setups. ML-driven approaches to microstructure characterization and mechanical property prediction are also examined, with a focus on modeling and advanced imaging techniques such as three-dimensional nanotomography. Finally, this article outlines future directions for ML-enhanced materials science, emphasizing the exploration of high-dimensional parameter spaces and the incorporation of materials kinetics into processing and property evaluation, ultimately advancing the design of nanoporous structures and materials science.

36 MATERIALS SCIENCE↗

Equipping an FPGA-Based Mars Rover With an LN-200 IMU

The Mars Exploration Rovers (MER) currently navigating the surface of Mars are outfitted with an advanced stereovision correlation algorithm which allows them to "see" three-dimensionally and autonomously avoid obstac'les in their path. A bottleneck of this system is that it is computationally intense and requires 3 minutes of processing for every correlated image and path choice. Taking advantage of the optimization and reprogrammability of FPGAs, the Mobility Avionics lab has reduced this process to under a second. The lab is demonstrating the advancement with a prototype rover, complete with an LN-200 inertial measurement unit (IMU), which is a flight spare from MER. The LN-200 is a space-grade, six degrees-of-freedom IMU using three fiber-optic gyroscopes and three silicon accelerometers and no moving parts. It has particular power-sequencing needs and communicates with a specialized serial protocol (SDLC over RS-422), requiring specific hardware and software for proper functionality and interfacing with an FPGA. The process of incorporating the LN-200 into the system is described herein.

Zola, Nicholas J.↗

A PC-based multispectral scanner data evaluation workstation: Application to Daedalus scanners

In late 1989, a personal computer (PC)-based data evaluation workstation was developed to support post flight processing of Multispectral Atmospheric Mapping Sensor (MAMS) data. The MAMS Quick View System (QVS) is an image analysis and display system designed to provide the capability to evaluate Daedalus scanner data immediately after an aircraft flight. Even in its original form, the QVS offered the portability of a personal computer with the advanced analysis and display features of a mainframe image analysis system. It was recognized, however, that the original QVS had its limitations, both in speed and processing of MAMS data. Recent efforts are presented that focus on overcoming earlier limitations and adapting the system to a new data tape structure. In doing so, the enhanced Quick View System (QVS2) will accommodate data from any of the four spectrometers used with the Daedalus scanner on the NASA ER2 platform. The QVS2 is designed around the AST 486/33 MHz CPU personal computer and comes with 10 EISA expansion slots, keyboard, and 4.0 mbytes of memory. Specialized PC-McIDAS software provides the main image analysis and display capability for the system. Image analysis and display of the digital scanner data is accomplished with PC-McIDAS software.

Jedlovec, Gary J.↗

Video Mosaicking for Inspection of Gas Pipelines

A vision system that includes a specially designed video camera and an image-data-processing computer is under development as a prototype of robotic systems for visual inspection of the interior surfaces of pipes and especially of gas pipelines. The system is capable of providing both forward views and mosaicked radial views that can be displayed in real time or after inspection. To avoid the complexities associated with moving parts and to provide simultaneous forward and radial views, the video camera is equipped with a wide-angle (>165 ) fish-eye lens aimed along the axis of a pipe to be inspected. Nine white-light-emitting diodes (LEDs) placed just outside the field of view of the lens (see Figure 1) provide ample diffuse illumination for a high-contrast image of the interior pipe wall. The video camera contains a 2/3-in. (1.7-cm) charge-coupled-device (CCD) photodetector array and functions according to the National Television Standards Committee (NTSC) standard. The video output of the camera is sent to an off-the-shelf video capture board (frame grabber) by use of a peripheral component interconnect (PCI) interface in the computer, which is of the 400-MHz, Pentium II (or equivalent) class. Prior video-mosaicking techniques are applicable to narrow-field-of-view (low-distortion) images of evenly illuminated, relatively flat surfaces viewed along approximately perpendicular lines by cameras that do not rotate and that move approximately parallel to the viewed surfaces. One such technique for real-time creation of mosaic images of the ocean floor involves the use of visual correspondences based on area correlation, during both the acquisition of separate images of adjacent areas and the consolidation (equivalently, integration) of the separate images into a mosaic image, in order to insure that there are no gaps in the mosaic image. The data-processing technique used for mosaicking in the present system also involves area correlation, but with several notable differences: Because the wide-angle lens introduces considerable distortion, the image data must be processed to effectively unwarp the images (see Figure 2). The computer executes special software that includes an unwarping algorithm that takes explicit account of the cylindrical pipe geometry. To reduce the processing time needed for unwarping, parameters of the geometric mapping between the circular view of a fisheye lens and pipe wall are determined in advance from calibration images and compiled into an electronic lookup table. The software incorporates the assumption that the optical axis of the camera is parallel (rather than perpendicular) to the direction of motion of the camera. The software also compensates for the decrease in illumination with distance from the ring of LEDs.

Magruder, Darby↗

Permeability Prediction Using Vision Transformers

Accurate permeability predictions remain pivotal for understanding fluid flow in porous media, influencing crucial operations across petroleum engineering, hydrogeology, and related fields. Traditional approaches, while robust, often grapple with the inherent heterogeneity of reservoir rocks. With the advent of deep learning, convolutional neural networks (CNNs) have emerged as potent tools in image-based permeability estimation, capitalizing on micro-CT scans and digital rock imagery. This paper introduces a novel paradigm, employing vision transformers (ViTs)—a recent advancement in computer vision—for this crucial task. ViTs, which segment images into fixed-sized patches and process them through transformer architectures, present a promising alternative to CNNs. We present a methodology for implementing ViTs for permeability prediction, its results on diverse rock samples, and a comparison against conventional CNNs. The prediction results suggest that, with adequate training data, ViTs can match or surpass the predictive accuracy of CNNs, especially in rocks exhibiting significant heterogeneity. This study underscores the potential of ViTs as an innovative tool in permeability prediction, paving the way for further research and integration into mainstream reservoir characterization workflows.

58 GEOSCIENCES↗

Performance of the Aspect Camera Assembly for the Advanced X-Ray Astrophysics Facility: Imaging

The Aspect Camera Assembly (ACA) is a "state-of-the-art" star tracker that provides real-time attitude information to the Advanced X-Ray Astrophysics Facility - Imaging (AXAF-I), and provides imaging data for "post-facto" ground processing. The ACA consists of a telescope with a CCD focal plane, associated focal plane read-out electronics, and an on-board processor that processes the focal plane data to produce star image location reports. On-board star image locations are resolved to 0.8 arcsec, and post-facto algorithms yield 0.2 arcsec star location accuracies (at end of life). The protoflight ACA has been built, along with a high accuracy vacuum test facility. Image position determination has been verified to < 0.2 arcsec accuracies. This paper is a follow-on paper to one presented by the author at the AeroSense '95 conference. This paper presents the "as built" configuration, the tested performance, and the test facility's design and demonstrated accuracy. The ACA has been delivered in anticipation of a August, 1998 shuttle launch.

Michaels, Dan↗

On the Use of Mahalanobis Distance in Particle Image Velocimetry Post-Processing

Particle Image Velocimetry (PIV) is a method of flow measurement that has become increasingly popular as an experimental tool. New technology has made high-speed and higher-dimension (stereoscopic, tomographic, etc) methods available to an ever-growing population of researchers. These advanced methods can provide significantly more data than traditional low-speed planar PIV, but these larger data sets also require more resources to process and store. A major time sink in the post-processing of large PIV data sets is the identification and rejection of “bad” or ”spurious” vectors that survive an initial processing step in commercial software, which attempts to identify spurious vectors on an image-by-image basis and not with respect to repeated trials. The Mahalanobis distance, an almost 100-year-old statistical function, was determined to be well suited for this task for its computational efficiency and higher-dimensional nature. This work includes a summary of the Mahalanobis distance and validation of its usefulness as a tool for outlier rejection in the post-processing of PIV data.

Experimental Methods↗

International Symposium on Remote Sensing of Environment, 15th, University of Michigan, Ann Arbor, MI, May 11-15, 1981, Proceedings. Volumes 1, 2 & 3

Developments related to advanced sensors and sensor systems are being examined, taking into account advanced aerospace remote sensing systems for global resource applications, spaceborne radar observation of the earth surface, a concept for an advanced earth resources satellite system, technologies for the multispectral mapping of earth resources, and the use of Landsat images and morphologic analogs in space exploration. Other topics discussed are related to modeling for terrain analysis, digital processing and analysis of remotely sensed data, microwave remote sensing, new discoveries from planetary remote sensing, and data base utilization. Advances in the area of luminescence are also considered along with future plans and prospects concerning the remote sensing of the earth from space.

Source record↗

Distribution and Spectroscopy of Green Fluorescent Protein and Acyl-CoA: Cholesterol Acytransferase in Sf21 Insect Cells

Acyl-CoA: cholesterol acyltransferase (ACAT) is thought to significantly participate in the pathway of cholesterol esterification that underlies the pathology of artherosclerosis. This enzyme is a membrane protein known to be preferentially bound within the endoplasmic reticulum of mammalian cells, from which location it esterifies cholesterol derived from low density lipoprotein. Cultures of insect cells were separately infected with baculovirus containing the gene for green fluroescent protein (GFP) and with baculovirus containing tandem genes for GFP and ACAT. These infected cultures expressed GFP and the fusion protein GCAT, respectively, with maximum expression occurring on the fourth day after infection. Extraction of GFP- and of GCAT-expressing cells with urea and detergent resulted in recovery of fluorescent protein in aqueous solution. Fluorescence spectra at neutral pH were identical for both GFP and GCAT extracts in aqueous solution, indicating unperturbed tertiary structure for the GFP moiety within GCAT. In a cholesterol esterification assay, GCAT demonstrated ACAT activity, but with less efficiency compared to native ACAT. It was hypothesized that the membrane protein ACAT would lead to differences in localization of GCAT compared to GFP within the respective expressing insect cells. The GFP marker directly and also within the fusion protein GCAT was accordingly used as the intracellular probe that was fluorescently analyzed by the new biophotonics technique of hyperspectral imaging. In that technique, fluorescence imaging was obtained from two dimensional arrays of cells, and regions of interest from within those images were then retrospectively analyzed for the emission spectra that comprises the image. Results of hyperspectral imaging of insect cells on day 4 postinfection showed that GCAT was preferentially localized to the cytoplasm of these cells compared to GFP. Furthermore, the emission spectra obtained for the localized GCAT displayed a peak blue shift from 518nm obtained in neutral aqueous solution to 505nm obtained in localized regions within the cells. This blue shift indicates change in the fluorescence coupling of the GFP moiety of GCAT. It is hypothesized that change in tertiary environment of GCAT, coincident with intracellular deposition of GCAT, follows from intracellular trafficking of GCAT leading to membrane interactions with the ACAT moiety, and/or self-assembly of GCAT, that alters the chromophore environment of the GFP moiety of GCAT. These findings introduce a new technique of biophotonic imaging to studies of intracellular protein trafficking and interactions. This technique of hyperspectral imaging could contribute to advancing the emergent field of proteomics. Because of the noninvasive nature of this technique, kinetic processes associated with intracellular protein trafficking, and interactions of proteins within cellular domains, can be considered for investigation within a single cell as well as a cell population.

Richmond, R. C.↗

Recent advances in geologic mapping by radar

Quantitative techniques are available which allow the analysis of SAR images for the derivation of geological surface and process data. In conjunction with calibrated radar sensors operating at several incidence angles, wavelengths, and polarizations, the compilation of multiparameter radar signatures of lithological and geomorphic units can accordingly proceed for geological mapping in unknown areas. While radar image tone can be used in arid zones to derive surface micromorphology, heavily vegetated tropical regions require the analysis of radar image texture by means of Fourier techniques which decompose the image into bandpasses that represent different scales of texture.

Farr, T. G.↗

Advances in the photon avalanche luminescence of inorganic lanthanide-doped nanomaterials

Photon avalanche (PA)—where the absorption of a single photon initiates a ‘chain reaction’ of additional absorption and energy transfer events within a material—is a highly nonlinear optical process that results in upconverted light emission with an exceptionally steep dependence on the illumination intensity. Over 40 years following the first demonstration of photon avalanche emission in lanthanide-doped bulk crystals, PA emission has been achieved in nanometer-scale colloidal particles. The scaling of PA to nanomaterials has resulted in significant and rapid advances, such as luminescence imaging beyond the diffraction limit of light, optical thermometry and force sensing with (sub)micron spatial resolution, and all-optical data storage and processing. In this review, we discuss the fundamental principles underpinning PA and survey the studies leading to the development of nanoscale PA. Finally, we offer a perspective on how this knowledge can be used for the development of next-generation PA nanomaterials optimized for a broad range of applications, including mid-IR imaging, luminescence thermometry, (bio)sensing, optical data processing and nanophotonics.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Introducing SpaceNet 9 - Cross-Modal Satellite Imagery Registration for Natural Disaster Responses

Computer vision algorithms are increasingly leveraged to accelerate geospatial analysis for disaster response and recovery. As the diversity of remote sensing imagery grows with optical, SAR, and other modalities, a perquisite for analytics is cross-modal image registration. There is a high potential to harness computer vision for this pre-processing requirement toward enabling downstream analytics such as heterogeneous change detection, automated feature extraction, and data fusion. Advancement in these areas has the potential to simplify data wrangling tasks and further accelerate disaster response timelines. The SpaceNet 9 challenge (launching in mid-2024) focuses on addressing the cross-modal image registration problem and demonstrating the utility of such modules on earthquake impacted scenarios. This paper describes the motivation for the SpaceNet 9 and provides a first overview of the dataset, the baseline algorithm, and implications for seeking cross-modal image registration in Earth observation. Code is available at https://github.com/SpaceNetChallenge/SpaceNet9.

Hansch, Ronny↗

M-DAS: System for multispectral data analysis

M-DAS is a ground data processing system designed for analysis of multispectral data. M-DAS operates on multispectral data from LANDSAT, S-192, M2S and other sources in CCT form. Interactive training by operator-investigators using a variable cursor on a color display was used to derive optimum processing coefficients and data on cluster separability. An advanced multivariate normal-maximum likelihood processing algorithm was used to produce output in various formats: color-coded film images, geometrically corrected map overlays, moving displays of scene sections, coverage tabulations and categorized CCTs. The analysis procedure for M-DAS involves three phases: (1) screening and training, (2) analysis of training data to compute performance predictions and processing coefficients, and (3) processing of multichannel input data into categorized results. Typical M-DAS applications involve iteration between each of these phases. A series of photographs of the M-DAS display are used to illustrate M-DAS operation.

Johnson, R. H.↗

Research and Technology 1980

Topics are divided into three major areas: Earth resources, advanced development, and technology transfer. Topics include: aerial color infrared photography, fiber optics, lightning research, soil mechanics, corrosion prevention, image processing, and communication systems development.

Source record↗

An optical processor for object recognition and tracking

The design and development of a miniaturized optical processor that performs real time image correlation are described. The optical correlator utilizes the Vander Lugt matched spatial filter technique. The correlation output, a focused beam of light, is imaged onto a CMOS photodetector array. In addition to performing target recognition, the device also tracks the target. The hardware, composed of optical and electro-optical components, occupies only 590 cu cm of volume. A complete correlator system would also include an input imaging lens. This optical processing system is compact, rugged, requires only 3.5 watts of operating power, and weighs less than 3 kg. It represents a major achievement in miniaturizing optical processors. When considered as a special-purpose processing unit, it is an attractive alternative to conventional digital image recognition processing. It is conceivable that the combined technology of both optical and ditital processing could result in a very advanced robot vision system.

Sloan, J.↗

Infrared systems and components II; Proceedings of the Meeting, Los Angeles, CA, Jan. 14, 15, 1988

The present conference on the development status of IR electrooptics technologies discusses topics concerning such systems' materials and architectures, their modeling and data processing requirements, and advancements in IR automatic target recognition. Attention is given to active multispectral three-dimensional vision sensor image evaluation, a VHSIC processor-based real-time image tracker, the use of Al-alloy castings as diamond machining substrates for optical surfaces, a two-dimensional recognition range model, calculations of the optical blurring in IR systems, synthetic IR scene generation, and automatic target recognition evaluation.

Liaw, H. M.↗

Study of Fluid Experiment System (FES)/CAST/Holographic Ground System (HGS)

The use of holographic and schlieren optical techniques for studying the concentration gradients in solidification processes has been used by several investigators over the years. The HGS facility at MSFC has been primary resource in researching this capability. Consequently, scientific personnel have been able to utilize these techniques in both ground based research and in space experiments. An important event in the scientific utilization of the HGS facilities was the TGS Crystal Growth and the casting and solidification technology (CAST) experiments that were flown on the International Microgravity Laboratory (IML) mission in March of this year. The preparation and processing of these space observations are the primary experiments reported in this work. This project provides some ground-based studies to optimize on the holographic techniques used to acquire information about the crystal growth processes flown on IML. Since the ground-based studies will be compared with the space-based experimental results, it is necessary to conduct sufficient ground based studies to best determine how the experiment worked in space. The current capabilities in computer based systems for image processing and numerical computation have certainly assisted in those efforts. As anticipated, this study has certainly shown that these advanced computing capabilities are helpful in the data analysis of such experiments.

Workman, Gary L.↗