Search NASA⌕ Search

SEARCH · Search NASA

Results for “computational imaging”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16

Multitemporal and Multiscaled Fractal Analysis of Landsat Satellite Data Using the Image Characterization and Modeling System (ICAMS)

The Image Characterization And Modeling System (ICAMS) is a public domain software package that is designed to provide scientists with innovative spatial analytical tools to visualize, measure, and characterize landscape patterns so that environmental conditions or processes can be assessed and monitored more effectively. In this study ICAMS has been used to evaluate how changes in fractal dimension, as a landscape characterization index, and resolution, are related to differences in Landsat images collected at different dates for the same area. Landsat Thematic Mapper (TM) data obtained in May and August 1993 over a portion of the Great Basin Desert in eastern Nevada were used for analysis. These data represent contrasting periods of peak "green-up" and "dry-down" for the study area. The TM data sets were converted into Normalized Difference Vegetation Index (NDVI) images to expedite analysis of differences in fractal dimension between the two dates. These NDVI images were also resampled to resolutions of 60, 120, 240, 480, and 960 meters from the original 30 meter pixel size, to permit an assessment of how fractal dimension varies with spatial resolution. Tests of fractal dimension for two dates at various pixel resolutions show that the D values in the August image become increasingly more complex as pixel size increases to 480 meters. The D values in the May image show an even more complex relationship to pixel size than that expressed in the August image. Fractal dimension for a difference image computed for the May and August dates increase with pixel size up to a resolution of 120 meters, and then decline with increasing pixel size. This means that the greatest complexity in the difference images occur around a resolution of 120 meters, which is analogous to the operational domain of changes in vegetation and snow cover that constitute differences between the two dates.

Quattrochi, Dale A.↗

Jipole: A Differentiable ipole-based Code for Radiative Transfer in Curved Spacetimes

Recent imaging of supermassive black holes by the Event Horizon Telescope has relied on exhaustive parameter-space searches, matching observations to large, precomputed libraries of theoretical models. As observational data become increasingly precise, the limitations of this computationally expensive approach grow more acute, creating a pressing need for more efficient methods. In this work, we present Jipole, an automatically differentiable (AD), ipole-based code for radiative transfer in curved spacetimes, designed to compute image gradients with respect to underlying model parameters. These gradients quantify how parameter changes—such as the black hole’s spin or the observer’s inclination—affect the image, enabling more efficient parameter estimation and reducing the number of required images. We validate Jipole against ipole in two analytical tests and then compare pixelwise intensity derivatives from AD with those from finite-difference methods. We then demonstrate the utility of these gradients by performing parameter recovery for an analytical model in three increasingly complex cases for the injected image: ideal, blurred, and blurred with added noise. In most cases, high-accuracy fits are obtained in only a few optimization steps, failing only in cases with extremely low signal-to-noise ratios. These results highlight the potential of AD-based methods to accelerate robust, high-fidelity model-data comparisons in current and future black hole imaging efforts.

79 ASTRONOMY AND ASTROPHYSICS↗

Through the Windshield Driver Recognition

Biometric recognition of vehicle occupants in unconstrained environments is rife with a host of challenges. In particular, the complications arising from imaging through vehicle windshields provide a significant hurdle. Distance to target, glare, poor lighting, head pose of occupants, and speed of vehicle are some of the challenges. We explore the construction of a multi-unit computational camera system to mitigate these challenges in order to obtain accurate and consistent face recognition results. This paper documents the hardware components and software design of the computational imaging system. Also, we document the use of RCNN for face detection and GAN for machine learning-inspired High Dynamic Range Imaging, artifact removal, and image fusion.

Cornett, David↗

Quantitative approaches for multiscale structural analysis with atomic resolution electron microscopy

Atomic-resolution imaging with scanning transmission electron microscopy is a powerful tool for characterizing the nanoscale structure of materials, in particular features such as defects, local strains, and symmetry-breaking distortions. In addition to advanced instrumentation, the effectiveness of the technique depends on computational image analysis to extract meaningful features from complex datasets recorded in experiments, which can be complicated by the presence of noise and artifacts, small or overlapping features, and the need to scale analysis over large representative areas. Here, we present image analysis approaches which synergize real and reciprocal space information to efficiently and reliably obtain meaningful structural information with picometer scale precision across hundreds of nanometers of material from atomic-resolution electron microscope images. Damping superstructure peaks in reciprocal space allows symmetry-breaking structural distortions to be disentangled from other sources of inhomogeneity and measured with high precision. Real-space fitting of the wavelike signals resulting from Fourier filtering enables absolute quantification of lattice parameter variations and strain, as well as the uncertainty associated with these measurements. Implementations of these algorithms are made available as an open source python package.

36 MATERIALS SCIENCE↗

Ultrasparse View X-ray Computed Tomography for 4D Imaging

X-ray computed tomography (CT) is a noninvasive, nondestructive approach to imaging materials, material systems, and engineered components in two and three dimensions. Acquisition of three-dimensional (3D) images requires the collection of hundreds or thousands of through-thickness X-ray radiographic images from different angles. Such 3D data acquisition strategies commonly involve suboptimal temporal sampling for in situ and operando studies (4D imaging). Herein, we introduce a sparse-view imaging approach, Tomo-NeRF, which is capable of reconstructing high-fidelity 3D images from <10 twodimensional radiographic images. Experimental 2D and 3D X-ray images were used to test the reconstruction capability in two-view, four-view, and six-view scenarios. Tomo-NeRF is capable of reconstructing 3D images with a structural similarity of 0.9971–0.9975 and a voxel-wise accuracy of 81.83–89.59% from 2D experimentally obtained images. Furthermore, the reconstruction accuracy for the experimentally obtained images is less than the synthetic structures. Experimentally obtained images demonstrate a similarity of 0.9973–0.9984 and a voxelwise accuracy of 84.31–95.77%.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A compressed sensing X-ray camera with a multilayer architecture

Recent advances in compressed sensing theory and algorithms offer new possibilities for high-speed X-ray camera design. In many CMOS cameras, each pixel has an independent on-board circuit that includes an amplifier, noise rejection, signal shaper, an analog-to-digital converter (ADC), and optional in-pixel storage. When X-ray images are sparse, i.e., when one of the following cases is true: (a.) The number of pixels with true X-ray hits is much smaller than the total number of pixels; (b.) The X-ray information is redundant; or (c.) Some prior knowledge about the X-ray images exists, sparse sampling may be allowed. In this work, we first illustrate the feasibility of random on-board pixel sampling (ROPS) using an existing set of X-ray images, followed by a discussion about signal to noise as a function of pixel size. Next, we describe a possible circuit architecture to achieve random pixel access and in-pixel storage. The combination of a multilayer architecture, sparse on-chip sampling, and computational image techniques, is expected to facilitate the development and applications of high-speed X-ray camera technology.

47 OTHER INSTRUMENTATION↗

Random On-Board Pixel Sampling (ROPS) X-Ray Camera

Recent advances in compressed sensing theory and algorithms offer new possibilities for high-speed X-ray camera design. In many CMOS cameras, each pixel has an independent on-board circuit that includes an amplifier, noise rejection, signal shaper, an analog-to-digital converter (ADC), and optional in-pixel storage. When X-ray images are sparse, i.e., when one of the following cases is true: (a.) The number of pixels with true X-ray hits is much smaller than the total number of pixels; (b.) The X-ray information is redundant; or (c.) Some prior knowledge about the X-ray images exists, sparse sampling may be allowed. Here we first illustrate the feasibility of random on-board pixel sampling (ROPS) using an existing set of X-ray images, followed by a discussion about signal to noise as a function of pixel size. Next, we describe a possible circuit architecture to achieve random pixel access and in-pixel storage. The combination of a multilayer architecture, sparse on-chip sampling, and computational image techniques, is expected to facilitate the development and applications of high-speed X-ray camera technology.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Superresolution Diffuse Optical Imaging by Localization of Fluorescence

The multiple scattering of light presents major challenges in realizing useful in vivo imaging at tissue depths of more than about one millimeter, where many answers to health questions lie. Visible through near-infrared photons can be readily and safely detected through centimeters of tissue; however, limited information is available for image formation. One strategy for obtaining images is to model the photon transport and a simple incoherent model is the diffusion equation approximation to the Boltzmann transport equation. Such an approach provides a prediction of the mean intensity of heavily scattered light and hence provides a forward model for optimization-based computational imaging. While diffuse optical imaging methods have received substantial attention, they remain restricted in terms of resolution because of the loss of high-spatial-frequency information that is associated with the multiple scattering of photons. Consequently, only relatively large inhomogeneities, such as tumors or organs in small animals, can be effectively resolved. We introduce a superresolution imaging approach based on point localization in a diffusion framework that enables over two orders of magnitude improvement in the spatial resolution of diffuse optical imaging. The method is demonstrated experimentally by localizing a fluorescent inhomogeneity in a highly scattering slab and characterizing the localization uncertainty. The approach allows imaging through centimeters of tissue with a resolution of tens of microns, thereby enabling cells or cell clusters to be resolved. More generally, this high-resolution imaging approach could be applied with any physical transport or wave model and hence to a broad class of physical problems. Finally, paired with a suitable optical contrast mechanism, as can be realized with targeted fluorescent molecules or genetically modified animals, superresolution diffuse imaging should open alternative dimensions for in vivo applications.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Effects on Training Using Illumination in Virtual Environments

Camera based tasks are commonly performed during orbital operations, and orbital lighting conditions, such as high contrast shadowing and glare, are a factor in performance. Computer based training using virtual environments is a common tool used to make and keep CTW members proficient. If computer based training included some of these harsh lighting conditions, would the crew increase their proficiency? The project goal was to determine whether computer based training increases proficiency if one trains for a camera based task using computer generated virtual environments with enhanced lighting conditions such as shadows and glare rather than color shaded computer images normally used in simulators. Previous experiments were conducted using a two degree of freedom docking system. Test subjects had to align a boresight camera using a hand controller with one axis of rotation and one axis of rotation. Two sets of subjects were trained on two computer simulations using computer generated virtual environments, one with lighting, and one without. Results revealed that when subjects were constrained by time and accuracy, those who trained with simulated lighting conditions performed significantly better than those who did not. To reinforce these results for speed and accuracy, the task complexity was increased.

Maida, James C.↗

Validation of an image simulation technique for two computed radiography systems: An application to neonatal imaging

Purpose: The purpose of this study is to develop a computer model to simulate the image acquisition for two computed radiography (CR) imaging systems used for neonatal chest imaging: (1) The Agfa ADC Compact, a flying spot reader with powder phosphor image plates (MD 40.0); and (2) the Agfa DX-S, a line-scanning CR reader with needle crystal phosphor image plates (HD 5.0). The model was then applied to compare the image quality of the two CR imaging systems. Methods: Monte Carlo techniques were used to simulate the transport of primary and scattered x rays in digital x-ray systems. The output of the Monte Carlo program was an image representing the energy absorbed in the detector material. This image was then modified using physical characteristics of the CR imaging systems to account for the signal intensity variations due to the heel effect along the anode-cathode axis, the spatial resolution characteristics of the imaging system, and the various sources of image noise. The simulation was performed for typical acquisition parameters of neonatal chest x-ray examinations. To evaluate the computer model, the authors compared the threshold-contrast detectability in simulated and experimentally acquired images of a contrast-detail phantom. Threshold-contrast curves were computed using a commercially available scoring program. Results: The threshold-contrast curves of the simulated and experimentally acquired images show good agreement; for the two CR systems, 93% of the threshold diameters calculated from the simulated images fell within the confidence intervals of the threshold diameter calculated from the experimentally assessed images. Moreover, the superiority of needle based CR plates for neonatal imaging was confirmed. Conclusions: The good agreement between simulated and experimental acquired results indicates that the computer model is accurate.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Arteriovenous Fistula of a Colic Branch of the Superior Mesenteric Artery: Endovascular Therapy

Arteriovenous fistulae (AVF) of the superior mesenteric artery and its branches are exceedingly rare. We report an unusual case of a patient who was found to be symptomatic from such an AVF, with diarrhea and terminal ileal thickening. We describe the findings from magnetic resonance imaging, computed tomography and catheter angiography and discuss the endovascular management.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

THE POWER OF IMAGING: CONSTRAINING THE PLASMA PROPERTIES OF GRMHD SIMULATIONS USING EHT OBSERVATIONS OF Sgr A*

Recent advances in general relativistic magnetohydrodynamic simulations have expanded and improved our understanding of the dynamics of black-hole accretion disks. However, current simulations do not capture the thermodynamics of electrons in the low density accreting plasma. This poses a significant challenge in predicting accretion flow images and spectra from first principles. Because of this, simplified emission models have often been used, with widely different configurations (e.g., disk- versus jet-dominated emission), and were able to account for the observed spectral properties of accreting black holes. Exploring the large parameter space introduced by such models, however, requires significant computational power that exceeds conventional computational facilities. In this paper, we use GRay, a fast graphics processing unit (GPU) based ray-tracing algorithm, on the GPU cluster El Gato, to compute images and spectra for a set of six general relativistic magnetohydrodynamic simulations with different magnetic field configurations and black-hole spins. We also employ two different parametric models for the plasma thermodynamics in each of the simulations. We show that, if only the spectral properties of Sgr A* are used, all 12 models tested here can fit the spectra equally well. However, when combined with the measurement of the image size of the emission using the Event Horizon Telescope, current observations rule out all models with strong funnel emission, because the funnels are typically very extended. Our study shows that images of accretion flows with horizon-scale resolution offer a powerful tool in understanding accretion flows around black holes and their thermodynamic properties.

79 ASTRONOMY AND ASTROPHYSICS↗

Optimal Transport Based Control of Granular Imaging System in Space

"Orbiting Rainbows” is a paradigm for creating a space-based observatory (telescope) from confined and aligned granular media. The overall objective is to construct a very large and lightweight aperture in space using a cloud of micron-sized particles held in position and aligned by the application of external electromagnetic fields, thus alleviating the extreme expense of deploying and stabilizing large monolithic telescopes by reducing the mass of the primary aperture. Adaptive optics techniques for wavefront stabilization and computational imaging techniques are then used to remove the optical noise from the scattering reflections of the granular medium, and finally producing clean images within the diffraction limit. In this paper, we address one of the key challenges of this new paradigm, namely controlling the position and orientation of the granules or particles so that the cloud of particles achieves the desired shape of an ultra-lightweight telescope and points into the right orientation. A further complication arises due to the fact that the particles do not have any onboard actuators. A number of external electric-field-based actuators are used to control all the particles simultaneously. Moreover, the number of actuators are orders-of-magnitude smaller than the number of particles, making this system largely under-actuated. Since the cloud of particles in any plausible configuration can be modeled as a probability distribution over the workspace, we formulate this control challenge as an optimal transport problem and then show that our optimal transport based control law drives the cloud of particles from any initial distribution to the desired position distribution (optical surface) and angular distribution (polarization state). Simulation results demonstrate the effectiveness of our approach.

Bandyopadhyay, Saptarshi↗

Structured illumination for surface-resolved grazing-incidence X-ray scattering

Grazing-incidence (GI) scattering techniques are widely used to characterize thin films, offering high surface sensitivity and insight into morphology and structure. However, these approaches typically provide statistical averaged information due to elongated footprint or limited spatial resolution due to beam size. Here we introduce a method that combines structured illumination with GI X-ray scattering and leverages our computational imaging approach to resolve local structural details. We demonstrate that our method captures local features of an organic semiconductor thin film without the need for sample rotation as in tomography. The method expands GI techniques from statistical averaging to high-resolution imaging, thereby providing the capability for detailed analysis of local material properties, such as domain shape, orientation and polymorphism, which are critical for advancing material design towards more efficient and tailored materials.

97 MATHEMATICS AND COMPUTING↗

Two datasets are better than one: method of double moments for 3D reconstruction in cryo-EM

Cryo-electron microscopy is a powerful imaging technique for reconstructing three-dimensional molecular structures from noisy tomographic projection images of randomly oriented particles. We introduce a new data fusion framework, termed the method of double moments, which reconstructs molecular structures from two instances of the second-order moment of projection images obtained under distinct orientation distributions: one uniform, the other non-uniform and unknown. We prove that these moments generically uniquely determine the underlying structure, up to a global rotation and reflection, and we develop a convex-relaxation-based algorithm that achieves accurate recovery using only second-order statistics. Our results demonstrate the advantage of collecting and modeling multiple datasets under different experimental conditions, illustrating that leveraging dataset diversity can substantially enhance reconstruction quality in computational imaging tasks.

Kam’s method↗

Three dimensions, two microscopes, one code: Automatic differentiation for x-ray nanotomography beyond the depth of focus limit

Conventional tomographic reconstruction algorithms assume that one has obtained pure projection images, involving no within-specimen diffraction effects nor multiple scattering. Advances in x-ray nanotomography are leading toward the violation of these assumptions, by combining the high penetration power of x-rays, which enables thick specimens to be imaged, with improved spatial resolution that decreases the depth of focus of the imaging system. We describe a reconstruction method where multiple scattering and diffraction effects in thick samples are modeled by multislice propagation and the 3D object function is retrieved through iterative optimization. We show that the same proposed method works for both full-field microscopy and for coherent scanning techniques like ptychography. Our implementation uses the optimization toolbox and the automatic differentiation capability of the open-source deep learning package TensorFlow, demonstrating a straightforward way to solve optimization problems in computational imaging with flexibility and portability.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

A neutron tomography study to visualize fluoride salt (FLiNaK) intrusion in nuclear-grade graphite

Manufactured graphite is a preferred material for in-core components of molten salt reactors and fluoride salt-cooled high-temperature reactors, which are in permanent contact with liquid salts. However, owing to the porous nature of nuclear graphite, under certain conditions, molten salts may intrude graphite's pores and affect graphite's properties and functionality. Therefore, a better understanding of molten salt intrusion (distribution across sample cross section and penetration depth) is needed to assess its effects. Here, in this work, we have demonstrated the use of neutron imaging (computed tomography) in the evaluation of salt penetration and distribution of a wide range of graphite grades with diverse microstructures that have been subjected to FLiNaK (LiF–NaF–KF) intrusion at 750 °C and 5 bar pressure for 12 h. Because of the great neutron attenuation contrast from scattering and adsorption between Li (from FLiNaK) and the graphite matrix, we have obtained direct visualization of FLiNaK salt distribution in the salt-impregnated graphites for the first time. Three-dimensional reconstructed images and cross-sectional concentration profiles demonstrate that salt penetration and density distribution are greatly dependent on the microstructural properties of the graphite grade.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Science Federation Emulation Testbed: Demonstration of VFSIE Functionalities

The Virtual Federated Science Instrument Environment (VFSIE) is a digital twin of a federated infrastructure of multiple sites with science instruments and computing systems that are geographically dispersed. It emulates the federation using containers and virtual hosts (vhosts) connected over local and wide-area networks for the main purpose of supporting the development and testing of science workflows and software stacks, which will subsequently transition to the physical infrastructure. In this demo, we present VFSIE of a four sites scenario and illustrate the following use cases: (i) execution of federation stack components that expose resources to enable a science user to execute workflows, (ii) execution of remote control commands of beam-line instruments to collect measurements and position the sensor, and (iii) remote execution and access of Jupyter Notebook for tomographic image computations

Al Najjar, Anees↗