Search NASA⌕ Search

SEARCH · Search NASA

Results for “Imaging & optical processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Optical versus radiographic imaging and tomography: introduction to the ROADS feature issue

Optical imaging is an ancient branch of imaging dating back to thousands of years. Radiographic imaging and tomography (RadIT), including the first use of X-rays by Wilhelm Röntgen, and then, $γ$ -rays, energetic charged particles, neutrons, etc. are about 130 years young. The synergies between optical and radiographic imaging can be cast in the framework of these building blocks: Physics, Sources, Detectors, Methods, and Data Science, as described in Appl. Opt. 61, RDS1 (2022). Optical imaging has expanded to include three-dimensional (3D) tomography (including holography), due in to part the invention of optical (including infrared) lasers. RadIT are intrinsically 3D because of the penetrating power of ionizing radiation. Both optical imaging and tomography (OIT) and RadIT are evolving into even higher dimensional regimes, such as time-resolved tomography (4D) and temporarily and spectroscopically resolved tomography (4D + ). Further advances in OIT and RadIT will continue to be driven by desires for higher information yield, higher resolutions, and higher probability models with reduced uncertainties. Synergies in quantum physics, laser-driven sources, low-cost detectors, data-driven methods, automated processing of data, and artificially intelligent data acquisition protocols will be beneficial to both branches of imaging in many applications. These topics, along with an overview of the Radiography, Applied Optics, and Data Science virtual feature issue, are discussed here.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Review of High‐Speed Digital Image Correlation: Advancements and Good Practices

This paper reviews the current state of the art in high‐speed (HS) and ultrahigh‐speed (UHS) digital image correlation (DIC) techniques, emphasizing their critical role in experimental research across various scientific domains. HS and UHS DIC have evolved significantly, driven by advancements in camera systems, image processing algorithms and experimental methodologies. These developments have opened new avenues for capturing and analysing dynamic events with unprecedented temporal and spatial detail, but not without introducing challenges such as optical distortions, motion blur and lighting issues that can affect measurement quality. This review advocates for standardized reporting practices in HS/UHS DIC methodologies to improve reproducibility and reliability across studies, drawing on guidelines from the International Digital Image Correlation Society (iDICs). Through a comprehensive analysis of over 150 articles, this review identifies key advancements in imaging technology and their application in six research domains: material characterization, test development, fracture mechanics, model validation, ballistic and explosive phenomena assessment and measurement uncertainties. Distinctions between two‐dimensional (2D) and stereo‐DIC applications are explored, offering insights into their practical implementation and trade‐offs. Good practices for HS/UHS DIC applications are proposed along with suggestions for future directions for this evolving field, highlighting the indispensable role of technological innovation in expanding the capabilities of optical metrology.

experimental mechanics↗
DOE OSTI2020

Smart Adhesive Joint with High-Definition Fiber-Optic Sensing for Automotive Applications

Structural health monitoring of fiber-reinforced composite-based joints for automotive applications during their manufacturing and on-demand assessment for its durability in working environments is critically needed. High-definition fiber-optic sensing is an effective method to measure internal strain/stress development using minimally invasive continuous sensors. The sensing fiber diameters are in the same order of magnitude when compared to reinforcement (glass, basalt, or carbon fibers) used in polymer composites. They also offer a unique ability to monitor the evolution of residual stresses after repeated thermal exposure with varying temperatures for automotive components/joints during painting using an electrophoretic painting process. In this paper, a high-definition fiber-optic sensor utilizing Rayleigh scattering is embedded within an adhesive joint between a carbon fiber-reinforced thermoset composite panel and an aluminum panel to measure spatially resolved strain development, residual strain, and thermal expansion properties during the electrophoretic paint process-simulated conditions. The strain measured by the continuous fiber-optic sensor was compared with an alternate technique using thermal digital image correlation. The fiber-optic sensor was able to identify the spatial variation of residual strains for a discontinuous carbon fiber-reinforced composite with varying local fiber orientations and resin content.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2021

Integrated transmission electron microscope

An integrated transmission electron microscope comprising multiple electron sources for tuned beams of ultrafast, scanning probe, and parallel illumination in varied beam energies can be alternated within sub-microseconds onto a sample with dynamic ‘transient state’ processes to acquire atomic-scale structural/chemical data with site specificity. The various electron sources and condenser optics enable high-resolution imaging, high-temporal resolution imaging, and chemical imaging, using fast-switching magnets to direct the different electron beams onto a single maneuverable objective pole piece where the sample resides. Such multimodal in situ characterization tools housed in a single microscope have the potential to revolutionize materials science.

Jungjohann, Katherine L.↗
DOE OSTI2024

A globally sampled high-resolution hand-labeled validation dataset for evaluating surface water extent maps

Effective monitoring of global water resources is increasingly critical due to climate change and population growth. Advancements in remote sensing technology, specifically in spatial, spectral, and temporal resolutions, are revolutionizing water resource monitoring, leading to more frequent and high-quality surface water extent maps using various techniques such as traditional image processing and machine learning algorithms. However, satellite imagery datasets contain trade-offs that result in inconsistencies in performance, such as disparities in measurement principles between optical (e.g., Sentinel-2) and radar (e.g., Sentinel-1) sensors and differences in spatial and spectral resolutions among optical sensors. Therefore, developing accurate and robust surface water mapping solutions requires independent validations from multiple datasets to identify potential biases within the imagery and algorithms. However, high-quality validation datasets are expensive to build, and few contain information on water resources. For this purpose, we introduce a globally sampled, high-spatial-resolution dataset labeled using 3 m PlanetScope imagery. Our surface water extent dataset comprises 100 images, each with a size of 1024×1024 pixels, which were sampled using a stratified random sampling strategy covering all 14 biomes. We highlighted urban and rural regions, lakes, and rivers, including braided rivers and coastal regions. We evaluated two surface water extent mapping methods using our dataset – Dynamic World, based on Sentinel-2, and the NASA IMPACT model, based on Sentinel-1. Dynamic World achieved a mean intersection over union (IoU) of 72.16 % and F1 score of 79.70 %, while the NASA IMPACT model had a mean IoU of 57.61 % and F1 score of 65.79 %. Performance varied substantially across biomes, highlighting the importance of evaluating models on diverse landscapes to assess their generalizability and robustness. Our dataset can be used to analyze satellite products and methods, providing insights into their advantages and drawbacks. Our dataset offers a unique tool for analyzing satellite products, aiding the development of more accurate and robust surface water monitoring solutions. The dataset can be accessed via https://doi.org/10.25739/03nt-4f29.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Detecting keyhole porosity and monitoring process signatures in additive manufacturing: an in situ pyrometry and ex situ X-ray radiography correlation

Creation of pores and defects during laser powder bed fusion (LPBF) can lead to poor mechanical properties and thus must be minimized. Post-build inspection is required to ensure the printed parts contain acceptably low defect concentrations. These inspections are time consuming and costly, especially for large or complex parts. As a potential solution, in situ process monitoring can be used to detect the creation of defects, characterize local material behavior and predict expected component properties. However, the precise relationship between pore creation and in situ process monitoring still needs to be understood. In this work, high-speed infrared diode-based pyrometry and high-speed optical imaging signals were used to monitor LPBF printing of 446 stainless steel 316 L single tracks with varying laser power and velocity. Results indicate an increase in pyrometer signal and melt pool dimensions with increasing laser power and decreasing velocity in agreement with previous work. In addition, careful analysis of pyrometer signal reveals a distinct signature of the conduction-to-keyhole mode transition which was confirmed by metallography. Critically, pore defect initiation as characterized by ex situ X-ray radiography was correlated with in situ thermal monitoring signals to derive the probability of defect creation. Our results show that, in principle, a probabilistic prediction of pore formation can be achieved based on in situ high-speed pyrometry monitoring of the LPBF melt pool.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Laser beam pointing stabilization using analog position-sensitive diodes

Laser wire scanners have been used for ion beam profile and emittance measurements at the Spallation Neutron Source linear accelerator. Due to propagation distances exceeding 100 m, reliable measurements require laser beam stabilization, previously accomplished with a feedback control loop using a digital camera as a position sensor [Hardin et al., Opt. Express 19, 2874 (2011)]. Here, this paper presents an upgraded pointing stabilization system utilizing analog position-sensitive diodes (PSDs) as the position detector, optimized with an optical diffuser. The new system significantly surpasses the previous system by offering an order-of-magnitude improvement in radiation tolerance and a bandwidth limited only by the burst repetition rate of the laser beam. Operating with a 60-Hz burst mode laser, the new system effectively suppresses laser beam drifts up to 30 Hz, compared to the previous system’s 4 Hz limit. In addition, the amplitude of spectral components below 0.1 Hz was reduced by a factor of more than 100, which is over seven times greater than was achieved by the previous system.

Data acquisition↗
DOE OSTI2020

Raytracing the long trace profiler

The optical design of the Long Trace Profiler optical system is explored with a commercial raytrace program, Zemax OpticStudio™ (ZOS)1, with the intent of finding and correcting sources of systematic error. ZOS provides both geometric raytracing tools and physical optics Gaussian beam propagation and diffraction image calculation tools, and two design modes, sequential component (SC) and non-sequential component (NSC) that are optimized for different aspects of the design process. The original LTP-II system employs a singlet lens with a 1250 mm focal length. It is optimized to provide minimum distortion over a surface slope angle range of ±5 mrad. Using the ZOS tools, we are able to simulate ghost rays that produce distortion in the beam spot image and can minimize the distortion by deliberate misalignment of the beamsplitter (BS) components. Unfortunately, the reference beam is compromised because of the component tilts. The most recent LTP500 system design simplifies the optical system and makes the reference beam usable again, even with misalignment of the polarizing beamsplitter (PBS). Two lenses are designed for the LTP500 - a cemented doublet that has been fabricated, and a singlet with one aspheric surface. Both have focal distances of 500 mm with an expanded angular measurement range of ±10 mrad. The aspheric singlet provides superior performance. ZOS allows the import of wavefront measurement data produced by commercial interferometer software. We apply the wavefront error measurement from the cemented doublet to the model to show that the 19nm RMS wavefront error needs to be improved by at least a factor of ten in order to reduce the systematic error to a level that will allow the LTP to approach its design limit of a few tens of nanoradians.

Takacs, Peter Z.↗
DOE OSTI2022

Optics-Free Chip-Scale Intraoperative Imaging Using NIR-Excited Upconverting Nanoparticles

Here we present an optics-free CMOS image sensor that incorporates a novel time-gated dual-photodiode pixel design to allow filter- and lens-less image acquisition of near-infrared-excited (NIR-excited) upconverting nanoparticles. Recent biomedical advances have highlighted the benefits of NIR excitation, but NIR interaction with silicon has remained a challenge, even with high-performance optical blocking filters. Using a secondary diode and a dual-photodiode design, this sensor is able to remove the 100s of mV of NIR background on pixels and bring it down to single-digit mV level, nearing its noise floor of 2.2 mV rms, not achievable with any optical filter. Non-linear effects of background cancellation using the diode pair has been mitigated using an initial one-time pixel-level curve fitting and calibration in a post-processing setting. This imager comprises a highly linear 11 fF metal-oxide-metal (MOM) capacitor and includes integrated angle-selective gratings to reject oblique light and enhance sharpness. Each pixel also includes two distinct correlated double sampling schemes, to remove low frequency flicker noise and systematic offset in the datapath. We demonstrate the performance of this imager using pulsed NIR-excited upconverting nanoparticles on standard United-States-Air-Force (USAF) resolution targets and achieve an SNR of 15 dB, while keeping NIR background below 6 mV. This 36-by-80-pixel array measures only 2.3 mm by 4.8 mm and can be thinned down to 25 µm, allowing it to become surgically compatible with intraoperative instruments and equipment, while remaining optics-free.

42 ENGINEERING↗
DOE OSTI2023

System and method to fuse multiple sources of optical data to generate a high-resolution, frequent and cloud-/gap-free surface reflectance product

Aspects of the subject disclosure may include, for example, performing, by a processing system, image fusion using two or more groups of images to generate predicted images, wherein each group of the two or more groups has one of a different resolution, a different frequency temporal pattern or a combination thereof than another of the two or more groups. Gap filling can be performed by the processing system to correct images of the two or more groups. Additional embodiments are disclosed.

Guan, Kaiyu↗
DOE OSTI2022

Learning the Temporal Effect in Infrared Thermal Videos With Long Short-Term Memory for Quality Prediction in Resistance Spot Welding

With the advances of sensing technology, in-situ infrared thermal videos can be collected from Resistance Spot Welding (RSW) processes. Each video records the formulation process of a weld nugget. The nugget evolution creates a “temporal effect” across the frames, which can be leveraged for real-time, nondestructive evaluation (NDE) of the weld quality. Currently, quality prediction with imaging data mainly focuses on optical feature extraction with Convolutional Neural Network (CNN) but does not make the most of such temporal effect. In this study, pixels corresponding to critical locations on the weld nugget surface are extracted from a video to form multivariate time series (MTS). Multivariate Adaptive Regression Splines (MARS) is used in MTS processing to remove noisy signals related to uninformative frames. A Stacked Long Short-Term Memory (LSTM) model is developed to learn from the processed MTS and then predicts weld nugget size and thickness in real-time NDE. Results from a case study on RSW of Boron steel demonstrates the improvement in prediction accuracy and computational time with the proposed method, as compared to CNN-based weld quality prediction.

Guo, Shenghan↗
DOE OSTI2023

Adaptive methods of generating complex light arrays

Structured light arrays of various shapes have been a cornerstone in optical science, driven by the complexities of precise and adaptable generation. This study introduces an approach using a spatial light modulator (SLM) as a generator for these arrays. By projecting a holographic mask onto the SLM, it functions simultaneously as an optical convolution device, focusing mechanism, and structured light beam mask. Our approach offers unmatched versatility, allowing for the experimental fabrication of traditional beam arrays like azimuthal Laguerre–Gaussian (LG), Bessel–Gaussian (BG), and Hermite–Gauss (HG) in the far-field. Notably, it has enabled a method of generating Ince–Gauss (IG) and LG radial mode beam arrays using a convolution solution. Our system provides exceptional control over array periodicity and intensity distribution, bypassing the Talbot self-imaging phenomenon seen in traditional setups. We provide an in-depth theoretical discussion, supported by empirical evidence, of our far-field results. This method has vast potential for applications in optical communication, data processing, and multi-particle manipulation. It paves the way for rapid generation of structured light with high spatial frequencies and complex shapes, promising transformative advances in these domains.

Optics↗
DOE OSTI2024

Path-Integrated Stereo X-Ray Digital Image Correlation: Resolving the Violation of Conservation of Intensity

In this study, x-ray imaging addresses many challenges with visible light imaging in extreme environments, where optical diagnostics such as digital image correlation (DIC) and particle image velocimetry (PIV) suffer biases from index of refraction changes and/or cannot penetrate visibly occluded objects. However, conservation of intensity—the fundamental principle of optical image correlation algorithms—may be violated if ancillary components in the X-ray path besides the surface or fluid of interest move during the test. The test series treated in this work sought to characterize the safe use of fiber-epoxy composites in aerospace and aviation industries during fire accident scenarios. Stereo X-ray DIC was employed to measure test unit deformation in an extreme thermal environment involving a visibly occluded test unit, incident surface heating to temperatures above 600°C, and flames and soot from combusting epoxy decomposition gasses. The objective of the current work is to evaluate two solutions to resolve the violation of conservation of intensity that resulted from both the test unit and the thermal chamber deforming during the test. The first solution recovered conservation of intensity by pre-processing the path-integrated X-ray images to isolate the DIC pattern of the test unit from the thermal chamber components. These images were then correlated with standard, optical DIC software. The second solution, called Path-Integrated Digital Image Correlation (PI-DIC), modified the fundamental matching criterion of DIC to account for multiple, independently-moving components contributing to the final image intensity. The PI-DIC algorithm was extended from a 2D framework to a stereo framework and implemented in a custom DIC software. Both solutions accurately measured the cylindrical shape of the undeformed test unit, recovering radii values of R = 76.20±0.12 mm compared to the theoretical radius of R theor = 76.20 mm. During the test, the test unit bulged asymmetrically as decomposition gasses pressurized the interior and eventually burned in a localized jet. Both solutions measured the heterogeneous radius of this bulge, which reached a maximum of approximately R = 91 mm, with a discrepancy of 2–3% between the two solutions. Two solutions that resolve the violation of conservation of intensity for path-integrated X-ray images were developed. Both were successfully employed in a stereo X-ray DIC configuration to measure deformation of an aluminum-skinned, fiber-epoxy composite test unit in a fire accident scenario.

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Real-time X-ray phase-contrast imaging using SPINNet—a speckle-based phase-contrast imaging neural network

X-ray phase-contrast imaging has become indispensable for visualizing samples with low absorption contrast. In this regard, speckle-based techniques have shown significant advantages in spatial resolution, phase sensitivity, and implementation flexibility compared with traditional methods. However, the computational cost associated with data inversion has hindered their wider adoption. By exploiting the power of deep learning, we developed a speckle-based phase-contrast imaging neural network (SPINNet) that significantly improves the imaging quality and boosts the phase retrieval speed by at least 2 orders of magnitude compared to existing methods. To achieve this performance, we combined SPINNet with a coded-mask-based technique, an enhanced version of the speckle-based method. Using this scheme, we demonstrate the simultaneous reconstruction of absorption and phase images on the order of 100 ms, where a traditional correlation-based analysis would take several minutes even with a cluster. In addition to significant improvement in speed, our experimental results show that the imaging and phase retrieval quality of SPINNet outperform existing single-shot speckle-based methods. Furthermore, we successfully demonstrate SPINNet application in x-ray optics metrology and 3D x-ray phase-contrast tomography. Our result shows that SPINNet could enable many applications requiring high-resolution and fast data acquisition and processing, such as in situ and in operando 2D and 3D phase-contrast imaging and real-time at-wavelength metrology and wavefront sensing.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Disentangling Rotational Dynamics and Ordering Transitions in a System of Self-Organizing Protein Nanorods via Rotationally Invariant Latent Representations

The dynamics of complex ordering systems with active rotational degrees of freedom exemplified by protein self-assembly is explored using a machine learning workflow that combines deep learning-based semantic segmentation and rotationally invariant variational autoencoder-based analysis of orientation and shape evolution. The latter allows for disentanglement of the particle orientation from other degrees of freedom and compensates for lateral shifts. The disentangled representations in the latent space encode the rich spectrum of local transitions that can now be visualized and explored via continuous variables. The time dependence of ensemble averages allows insight into the time dynamics of the system and, in particular, illustrates the presence of the potential ordering transition. Finally, analysis of the latent variables along the single-particle trajectory allows tracing these parameters on a single-particle level. The proposed approach is expected to be universally applicable for the description of the imaging data in optical, scanning probe, and electron microscopy seeking to understand the dynamics of complex systems where rotations are a significant part of the process.

representation learning↗
DOE OSTI2026

Projector Selection for SOFAST Testing

In Concentrating Solar Power (CSP) there is a need for mirrors that are optically accurate, as they are used to focus light onto a receiver at high concentration. To test the accuracy of the mirrors’ optical slopes, we employ a technique called deflectometry. Deflectometry measures mirror slope directly. A projector displays an image onto a screen or wall, and a mirror is positioned to reflect the image to a camera. The camera sees the mirror’s reflection of the screen and sends imaging information to software which analyzes the reflected images from the mirror to determine the local slopes and curvature of the mirror. For this, projectors that can provide a crisp and clear image are imperative. Choosing the right projector(s) can be a long and tedious process; this paper will cover the process we used to select projectors for the SOFAST systems in the Sandia Concentrating Solar Optics Laboratory (CSOL).

14 SOLAR ENERGY↗
DOE OSTI2022

High-throughput, in situ imaging of multi-layer powder-blown directed energy deposition with angled nozzle

Laser metal additive manufacturing (AM) has become an increasingly popular technology due to its flexibility in geometry and materials. As one of the commercialized additive processes, powder-blown directed energy deposition (DED) has been used in multiple industries such as aerospace, automotive, medical device, etc. However, a lack of fundamental understanding remains for this process, and many opportunities for alloy development and implementation can be identified. A high-throughput, in situ DED system capable of multi-layer builds that can address these issues is presented here. In this work, implications of layer heights and energy density are investigated through an extensive process parameter sweep, showcasing the power of a high-throughput setup while also discussing multi-layer interactions.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Deep-learning based artificial intelligence tool for melt pools and defect segmentation

Accelerating fabrication of additively manufactured components with precise microstructures is important for quality and qualification of built parts, as well as for a fundamental understanding of process improvement. Accomplishing this requires fast and robust characterization of melt pool geometries and structural defects in images. This paper proposes a pragmatic approach based on implementation of deep learning models and self-consistent workflow that enable systematic segmentation of defects and melt pools in optical images. Deep learning is based on an image-to-image translation–conditional generative adversarial neural network architecture. An artificial intelligence (AI) tool based on this deep learning model enables fast and incrementally more accurate predictions of the prevalent geometric features, including melt pool boundaries and printing-induced structural defects. We present statistical analysis of geometric features that is enabled by the AI tool, showing strong spatial correlation of defects and the melt pool boundaries. The correlations of widths and heights of melt pools with dataset processing parameters show the highest sensitivity to thermal influences resulting from laser passes in adjacent and subsequent layer passes. The presented models and tools are demonstrated on the aluminum alloy and datasets produced with different sets of processing parameters. However, they have universal quality and could easily be adapted to different material compositions. The method can be easily generalized to microstructural characterizations other than optical microscopy.

additive manufacturing↗