Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
NASA NTRS2013

Polarization Imaging Apparatus with Auto-Calibration

A polarization imaging apparatus measures the Stokes image of a sample. The apparatus consists of an optical lens set, a first variable phase retarder (VPR) with its optical axis aligned 22.5 deg, a second variable phase retarder with its optical axis aligned 45 deg, a linear polarizer, a imaging sensor for sensing the intensity images of the sample, a controller and a computer. Two variable phase retarders were controlled independently by a computer through a controller unit which generates a sequential of voltages to control the phase retardations of the first and second variable phase retarders. A auto-calibration procedure was incorporated into the polarization imaging apparatus to correct the misalignment of first and second VPRs, as well as the half-wave voltage of the VPRs. A set of four intensity images, I(sub 0), I(sub 1), I(sub 2) and I(sub 3) of the sample were captured by imaging sensor when the phase retardations of VPRs were set at (0,0), (pi,0), (pi,pi) and (pi/2,pi), respectively. Then four Stokes components of a Stokes image, S(sub 0), S(sub 1), S(sub 2) and S(sub 3) were calculated using the four intensity images.

Zou, Yingyin Kevin↗
NASA NTRS2018

Super Resolution of Remote Sensing Images Using Edge-Directed Radial Basis Functions

Edge-Directed Radial Basis Functions (EDRBF) are used to compute super resolution(SR) image from a given set of low resolution (LR) images differing in subpixel shifts. The algorithm is tested on remote sensing images and compared for accuracy with other well-known algorithms such as Iterative Back Projection (IBP), Maximum Likelihood (ML) algorithm, interpolation of scattered points using Nearest Neighbor (NN) and Inversed Distance Weighted (IDW) interpolation, and Radial Basis Functin(RBF) . The accuracy of SR depends on various factors besides the algorithm (i) number of subpixel shifted LR images (ii) accuracy with which the LR shifts are estimated by registration algorithms (iii) and the targeted spatial resolution of SR. In our studies, the accuracy of EDRBF is compared with other algorithms keeping these factors constant. The algorithm has two steps: i) registration of low resolution images and (ii) estimating the pixels in High Resolution (HR) grid using EDRBF. Experiments are conducted by simulating LR images from a input HR image with different sub-pixel shifts. The reconstructed SR image is compared with input HR image to measure the accuracy of the algorithm using sum of squared errors (SSE). The algorithm has outperformed all of the algorithms mentioned above. The algorithm is robust and is not overly sensitive to the registration inaccuracies.

Mareboyana, Manohar M.↗
DOE OSTI2024

Uncertainty-refined image segmentation under domain shift

Digital image segmentation is provided. The method comprises training a neural network for image segmentation with a labeled training dataset from a first domain, wherein a subset of nodes in the neural net are dropped out during training. The neural network receives image data from a second, different domain. A vector of N values that sum to 1 is calculated for each image element, wherein each value represents an image segmentation class. A label is assigned to each image element according to the class with the highest value in the vector. Multiple inferences are performed with active dropout layers for each image element, and an uncertainty value is generated for each image element. Uncertainty is resolved according to expected characteristics. The label of any image element with an uncertainty above a threshold is replaced with a new label corresponding to a segmentation class based on domain knowledge.

Martinez, Carianne↗
DOE OSTI2025

Single-Objective Airy Light-Sheet Imaging

Despite its massive potential, standard light-sheet imaging (LSI) faces key challenges, such as the incompatibility with common sample mounting techniques and low-resolution imaging. Single-objective LSI attempts to address these issues but often suffers from limited fields-of-view and throughput rates, or requires multiple optics that increase costs, alignment complexity, and losses. To overcome these challenges of standard single-objective LSI, we introduce single-objective Airy light-sheet imaging (SoALSI). SoALSI leverages the extraordinary self-acceleration properties of the Airy beam, achieving 5× higher imaging rates and enhanced imaging efficiency than standard single-objective LSI. Here, we demonstrate SoALSI’s versatility through rigorous contrast and resolution characterizations and by high-resolution imaging of diverse biological specimens, including malaria parasite-infected red blood cells and plant root tissue. SoALSI seamlessly integrates with any standard inverted microscope frame, enabling broader accessibility for the bioimaging community to explore biological processes in a wide range of specimens with enhanced resolution and imaging contrast.

airy beam↗
DOE OSTI2026

High-speed quantitative X-ray multi-contrast imaging with deep learning based modulated pattern analysis

The advent of X-ray multi-contrast imaging methods, providing absorption, phase, and dark-field images, holds tremendous promise for complementary and non-destructive visualization of inner structures within materials and bio-samples. However, the low efficiency in measuring and analyzing X-ray modulated patterns has hindered their application in high-resolution in situ imaging. In this work, the Enhanced Scanning Pattern-based Imaging Neural Network (ESPINNet) is introduced as a powerful tool for achieving high-speed, high-resolution quantitative imaging. ESPINNet is faster than correlation-based speckle tracking methods such as XSVT and UMPA, and provides a balanced performance in terms of resolution and speed for data collection by using fewer scanning images. In comparison with our previously developed neural network, ESPINNet introduces the capability to generate dark-field images, further enhancing its versatility. By leveraging scanning patterns, ESPINNet significantly improves resolution and measurement precision. Furthermore, its adaptability to various modulation patterns, including those produced by sandpaper, coded masks, or gratings, ensures broad applicability. These features enable real-time 2D and 3D multi-contrast imaging, positioning ESPINNet as a transformative solution for applications in materials science and biomedical research, particularly for high-speed and in situ measurements.

X-ray at-wavelength metrology↗
DOE OSTI2024

Zone plate-based extreme ultraviolet mask microscope with through-pellicle imaging capability

Mirror-based and zone plate-based imaging systems are being used in actinic extreme ultraviolet (EUV) reticle review tools. With regard to zone plates, a short working distance is advantageous in terms of the required spectral bandwidth, manufacturability, and potential throughput and imaging performance. Zone plates therefore typically have a short working distance. The industry has adopted the use of an EUV pellicle to protect the photomask. Imaging photomask through-pellicle requires a working distance larger than 2.5 mm. A zone-plate-based EUV mask microscope with a 3-mm working distance has been commissioned at beamline 11.3.2 of the Advanced Light Source. Through-pellicle imaging at an exposure time of 2 s is demonstrated. The instrument achieves an image contrast of 95% on large features on a photomask with a tantalum-based absorber. Imaging down to 45-nm half pitch (mask scale) is demonstrated. A NILS of 2.55 is achieved on 60-nm half-pitch (mask scale) lines and spaces. These results demonstrate that zone-plate-based imaging systems can meet the requirements of an actinic EUV mask review tool in terms of imaging performance and throughput in an instrument compatible with EUV pellicles.

Extreme ultraviolet↗
NASA NTRS1997

STRIPE: Remote Driving Using Limited Image Data

Driving a vehicle, either directly or remotely, is an inherently visual task. When heavy fog limits visibility, we reduce our car's speed to a slow crawl, even along very familiar roads. In teleoperation systems, an operator's view is limited to images provided by one or more cameras mounted on the remote vehicle. Traditional methods of vehicle teleoperation require that a real time stream of images is transmitted from the vehicle camera to the operator control station, and the operator steers the vehicle accordingly. For this type of teleoperation, the transmission link between the vehicle and operator workstation must be very high bandwidth (because of the high volume of images required) and very low latency (because delayed images can cause operators to steer incorrectly). In many situations, such a high-bandwidth, low-latency communication link is unavailable or even technically impossible to provide. Supervised TeleRobotics using Incremental Polyhedral Earth geometry, or STRIPE, is a teleoperation system for a robot vehicle that allows a human operator to accurately control the remote vehicle across very low bandwidth communication links, and communication links with large delays. In STRIPE, a single image from a camera mounted on the vehicle is transmitted to the operator workstation. The operator uses a mouse to pick a series of 'waypoints' in the image that define a path that the vehicle should follow. These 2D waypoints are then transmitted back to the vehicle, where they are used to compute the appropriate steering commands while the next image is being transmitted. STRIPE requires no advance knowledge of the terrain to be traversed, and can be used by novice operators with only minimal training. STRIPE is a unique combination of computer and human control. The computer must determine the 3D world path designated by the 2D waypoints and then accurately control the vehicle over rugged terrain. The human issues involve accurate path selection, and the prevention of disorientation, a common problem across all types of teleoperation systems. STRIPE is the only semi-autonomous teleoperation system that can accurately follow paths designated in monocular images on varying terrain. The thesis describes the STRIPE algorithm for tracking points using the incremental geometry model, insight into the design and redesign of the interface, an analysis of the effects of potential errors, details of the user studies, and hints on how to improve both the algorithm and interface for future designs.

REMOTE CONTROL↗
NASA NTRS1995

Trainable Cataloging for Digital Image Libraries with Applications to Volcano Detection

Users of digital image libraries are often not interested in image data per se but in derived products such as catalogs of objects of interest. Converting an image database into a usable catalog is typically carried out manually at present. For many larger image databases the purely manual approach is completely impractical. In this paper we describe the development of a trainable cataloging system: the user indicates the location of the objects of interest for a number of training images and the system learns to detect and catalog these objects in the rest of the database. In particular we describe the application of this system to the cataloging of small volcanoes in radar images of Venus. The volcano problem is of interest because of the scale (30,000 images, order of 1 million detectable volcanoes), technical difficulty (the variability of the volcanoes in appearance) and the scientific importance of the problem. The problem of uncertain or subjective ground truth is of fundamental importance in cataloging problems of this nature and is discussed in some detail. Experimental results are presented which quantify and compare the detection performance of the system relative to human detection performance. The paper concludes by discussing the limitations of the proposed system and the lessons learned of general relevance to the development of digital image libraries.

digital image libraries, trainable cataloging↗
NASA NTRSDate not supplied

Enabling Space Biological Knowledge Discovery Through Image and Video Data Sharing

Increased biomedical risks and challenges associated with deep space missions and experiments (cis-Lunar, Mars transit/surface) require new knowledge discovery and development of novel ecosystems. Supporting distant and long-duration missions and experiments requires biological data (from yeast, microbes, fruit flies, C. elegans, plants, crops, rodents, humans) be findable, accessible, interoperable, reusable (FAIR), and maximally open-access. As data-intensive, bioinformatic, meta-analytical, and computer-assisted approaches continue to be a centerpiece of modern research, the NASA Biological and Physical Sciences division is expanding its Open Science capabilities beyond NASA GeneLab. The NASA Ames Life Sciences Data Archive (ALSDA) is a repository which is responsible for collecting and access to space biological imagery and video, alongside tabular and environmental data. In this presentation, we will discuss strategies dealing with archiving, curating, and accessibility of images from very distinct imaging modalities (e.g., micro-computed tomography, magnetic resonance imaging, photographic images of plants, fluorescence microscopy, behavioral videos, etc.). There are two main challenges: 1. Open-source data storage and 2. Metadata related to the imagery-video. Both have been solved by leveraging two existing open-source systems. For data storage, ALSDA is utilizing components through the Open Microscopy Environment (OME), which can read most imaging proprietary formats and display on a web interface complex multidimensional images (Z stack, multi-channel, temporal, spectral). Most technical metadata from imaging modalities are captured seamlessly. For metadata capturing experimental details, ALSDA (like GeneLab) uses the ISA-Tab specification which relies on the ISA data model to order and classify metadata. The ISA data model uses a tree structure with three files to capture the metadata: The top layer is the Investigations file, the second layer is the Study file(s), and the last layer is the Assay file(s). We believe such an approach may be useful for other types of image research data from other investigators in the AGU community.

imaging↗
NASA NTRSDate not supplied

From the Solar Limb and Out: Results from the Wide-Field EUV Image Campaigns with GOES/SUVI

Traditional approaches to tracking solar outflows for space weather forecasting rely primarily on coronagraph images, which generally observe the solar corona above a minimum height of about 2.5 solar radii. EUV images have been widely used to characterize features on the solar disk, but the limited fields of view of most current EUV imagers have prevented their use for tracking outflows through the inner and middle coronae. A series of off-point campaigns with the GOES 16-18 Solar Ultraviolet Imager (SUVI) between 2018 and 2022 from three Flight Models have provided an opportunity to assess the value of extended EUV images for space weather forecasting applications. These new results demonstrate that wide field-of-view EUV images are useful for characterizing the early onset of eruptive events and tracking smaller outflow into the solar wind. They also reveal the origins of shocks that are known to accelerate particles and drive solar energetic particle (SEP) events. Because CMEs generally experience the bulk of their acceleration below the height of white light coronagraphic observations, these images provide information about the origins of these events that has not been available traditionally. Together with coronagraphic measurements, EUV images provide the continuous views needed to connect CMEs back to their source regions. Here, we present these new SUVI observations and discuss their potential use in space weather operations.

SUVI↗
NASA NTRSDate not supplied

Electroluminescence Imaging: A Quantitative Characterization Technique to Measure Dust Occlusion of Solar Cells

Electroluminescence (EL) imaging is a qualitative characterization technique that is typically used to identify cracks, corrosion, and other defects in solar cells. It consists of imaging a cell under forward bias, where the solar cell emits photons due to radiative electron-hole pair recombination. Over the past few years, our team has expanded this into a quantitative technique with the help of image processing. We have primarily used this method to investigate lunar dust occlusion of solar cells and arrays. Lunar dust accumulation on solar cells is a major concern because it directly limits light accessible to the cell, decreasing power output. Many teams are working to develop dust mitigation technology to protect these arrays on the surface of the Moon, but thoroughly characterizing their efficacy is important to ensure their success prior to launch. Here, we present EL as a quantitative characterization technique to observe dust coverage on solar cells that, when coupled with IV performance measurements, can offer unique insights into how dust coverage impacts power output. Quantitative electroluminescence imaging works by running EL images through an image processing script that first grayscales the image then plots a histogram of the brightness of each pixel. On its own, it does not offer much insight into a solar cell’s performance. However, when comparing images to a baseline pristine, undamaged, or uncoated solar cell, it can quickly provide information about the impacts of surface contaminants or damage to the cell. Here, we present a case study where quantitative EL is used to measure the efficacy of dust mitigation technology for flexible solar arrays and discuss the lessons learned about dust mitigation, testing with lunar simulant, and this characterization technique.

photovoltaics↗
DOE OSTI2025

End–to–End Metasurface Design for Temperature Imaging via Broadband Planck‐Radiation Regression

A theoretical framework is presented for temperature imaging from long-wavelength infrared (LWIR) thermal radiation (e.g., 8–12 µm) through the end-to-end design of a metasurface-optics frontend and a computational-reconstruction backend. A new nonlinear reconstruction algorithm, “Planck regression”, is introduced to reconstruct the temperature map from a gray scale sensor image, even in the presence of severe chromatic aberration, by exploiting black body and optical physics particular to thermal imaging. This algorithm is combined with an end-to-end approach that optimizes manufacturable, single-layer metasurfaces to yield the most accurate reconstruction. The designs demonstrate high-quality, noise-robust reconstructions of arbitrary temperature maps (including completely random images) in simulations of an ultra-compact thermal-imaging device. Here, it is also shown that Planck regression is much more generalizable to arbitrary images than a straightforward neural-network reconstruction, which requires a large training set of domain-specific images.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Multimodal Defect Imaging of Pure Tungsten Components Fabricated via Electron Beam Powder Bed Fusion

The utilization of additive manufacturing (AM) techniques for refractory materials in high-temperature environments has significantly expanded because of the ability to fabricate geometrically complex components. Electron beam powder bed fusion (EB-PBF), which provides lower residual stress, a cleaner vacuum environment, and better efficiency for high melting point, is one of the best-suited AM methods to produce advanced refractory components. However, the property variation attributed to the heterogeneous microstructure and process-induced defects has hindered the widespread adoption of EB-PBF-produced material like tungsten. While numerous in-situ monitoring and defect detection methods have been demonstrated for EB-PBF, a workflow that compares and evaluates process-induced abnormalities from different imaging perspectives is still limited. This study examines a feature-embedded tungsten component manufactured via the EB-PBF process to demonstrate the defect detection capabilities of a multimodal defect imaging workflow. The predefined and process-induced defects are evaluated by harnessing various imaging techniques, including in-situ electron imaging, layerwise near-infrared (NIR) imaging, post-build high-energy x-ray computed tomography (CT), and conventional destructive metallography. The results highlight the strengths and limitations of distinctive defect imaging techniques concerning specific defect types, sizes, and conditions. It was found that electron imaging can provide more abnormal detection capabilities while maintaining a higher measuring accuracy, against the conventional metallography in this case study, compared with NIR and CT imaging techniques.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Toward more-robust, AI-enabled subsurface seismic imaging for geotechnical applications

Non-invasive seismic imaging has the potential to cost-effectively evaluate large volumes of subsurface material to inform geotechnical site investigation. However, seismic imaging using full waveform inversion (FWI) requires significant computational time and is dependent on an initial starting model. As a result, FWI has not yet been widely adopted into geotechnical practice. Previous efforts, on relatively simple two-layered models, indicate that data-driven artificial intelligence (AI) models may be as effective as FWI at predicting 2D images of shear wave velocity (V s ). Furthermore, the AI model predictions can be made almost instantaneously after data acquisition and do not require an initial starting model. We examine the generality of these findings by developing a new AI model for subsurface seismic imaging, whereby we make several notable contributions. First, we architect a multimodal AI model that combines time- and frequency-domain representations of the seismic wavefield to predict a 50 m by 20 m subsurface image of V s . Second, we developed a new diverse dataset of 100,000 images with their corresponding seismic wavefields to train the AI model. Third, we propose four physics-informed data augmentations for data-driven seismic imaging. Fourth, we develop two prediction consistency tests to evaluate the model’s performance when the true subsurface is unknown. Our final model, which has been made publicly available, is capable of predicting a subsurface V s image from a single seismic wavefield with an average, mean absolute percent error (MAPE) of 24 %. The predictive model is applied to a field dataset and shown to be consistent with local geology and shear-wave refraction measurements from the same location.

Artificial intelligence↗
DOE OSTI2025

Advanced multi-modal mass spectrometry imaging reveals functional differences of placental villous compartments at microscale resolution

The placenta is a complex and heterogeneous organ that links the mother and fetus, playing a crucial role in nourishing and protecting the fetus throughout pregnancy. Integrative spatial multi-omics approaches can provide a systems-level understanding of molecular changes underlying the mechanisms leading to the histological variations of the placenta during healthy pregnancy and pregnancy complications. Herein, we advance our metabolome-informed proteome imaging (MIPI) workflow to include lipidomic imaging, while also expanding the molecular coverage of metabolomic imaging by incorporating on-tissue chemical derivatization (OTCD). The improved MIPI workflow advances biomedical investigations by leveraging state-of-the-art molecular imaging technologies. Lipidome imaging identifies molecular differences between two morphologically distinct compartments of a placental villous functional unit, syncytiotrophoblast (STB) and villous core. Next, our advanced metabolome imaging maps villous functional units with enriched metabolomic activities related to steroid and lipid metabolism, outlining distinct molecular distributions across morphologically different villous compartments. Complementary proteome imaging on these villous functional units reveals a plethora of fatty acid- and steroid-related enzymes uniquely distributed in STB and villous core compartments. Integration across our advanced MIPI imaging modalities enables the reconstruction of active biological pathways of molecular synthesis and maternal-fetal signaling across morphologically distinct placental villous compartments with micrometer-scale resolution.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Radiation image reconstruction and uncertainty quantification using a Gaussian process prior

We propose a complete framework for Bayesian image reconstruction and uncertainty quantification based on a Gaussian process prior (GPP) to overcome limitations of maximum likelihood expectation maximization (ML-EM) image reconstruction algorithm. The prior distribution is constructed with a zero-mean Gaussian process (GP) with a choice of a covariance function, and a link function is used to map the Gaussian process to an image. Unlike many other maximum a posteriori approaches, our method offers highly interpretable hyperparamters that are selected automatically with the empirical Bayes method. Furthermore, the GP covariance function can be modified to incorporate a priori structural priors, enabling multi-modality imaging or contextual data fusion. Lastly, we illustrate that our approach lends itself to Bayesian uncertainty quantification techniques, such as the preconditioned Crank–Nicolson method and the Laplace approximation. The proposed framework is general and can be employed in most radiation image reconstruction problems, and we demonstrate it with simulated free-moving single detector radiation source imaging scenarios. We compare the reconstruction results from GPP and ML-EM, and show that the proposed method can significantly improve the image quality over ML-EM, all the while providing greater understanding of the source distribution via the uncertainty quantification capability. Furthermore, significant improvement of the image quality by incorporating a structural prior is illustrated.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2024

Identifying Outliers in AI-based Image Compression

Image compression using artificial intelligence (AI) is becoming increasingly prevalent across various fields, including scientific research. Scientific instruments can generate hundreds of images per second, and effectively compressing these images with high compression ratios is crucial for facilitating scientific discoveries. However, automatically detecting outlier cases, where compression may not have succeeded or where interesting scientific phenomena are present, poses a significant challenge. To address this, we have developed a methodology based on unsupervised machine learning techniques for detecting outlier compressed images. This methodology utilizes metrics such as peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), structural texture similarity index measure (STSIM), and deep image and structural texture similarity index (DISTS). We have evaluated our methodology on several unlabeled datasets, including microscopy and x-ray images, and have successfully identified multiple outlier images using our proposed approach. Furthermore, our approach has enabled us to identify image semantics that are valuable for post-experiment analysis by scientists.

Data Analysis↗
DOE OSTI2025

Exploring Capability of Multimodal Foundation Model for Image-based Fault Detection of Photovoltaic Modules

Multimodal Foundation Model (MFM), like ChatGPT and Gemini, have emerged as powerful tools for their exceptional natural language processing capabilities and their emerging potential in image analysis. This paper investigates the application of MFMs for photovoltaic (PV) fault detection through image analysis, focusing on ChatGPT 4.0 and Gemini 1.5 Pro. Three types of PV images and the corresponding common PV faults are detected: bird droppings using visible images, cell cracks via electroluminescence (EL) images, and hotspots using infrared (IR) images. Among the two models, Gemini 1.5 Pro demonstrated superior performance, achieving near-perfect results with an average F1 score of 0.97, consistently outperforming ChatGPT 4.0 in accuracy and reliability. Unlike traditional machine learning (ML) models, MFMs can operate in a zero shot manner that does not require additional training by the user, and the input images are not limited by size, angle, scope, or PV technology. The strong adaptability and user-friendliness make MFM a promising tool for analyzing PV images and advancing health monitoring for PV modules.

Li, Baojie↗