Search NASA⌕ Search

SEARCH · Search NASA

Results for “analog image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

17 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Nonlinear analog processing with anisotropic nonlinear films

Digital signal processing is the cornerstone of several modern-day technologies, yet in multiple applications it faces critical bottlenecks related to memory and speed constraints. Thanks to recent advances in metasurface design and fabrication, light-based analog computing has emerged as a viable option to partially replace or augment digital approaches. Several light-based analog computing functionalities have been demonstrated using patterned flat optical elements, with great opportunities for integration in compact nanophotonic systems. So far, however, the available operations have been restricted to the linear regime, limiting the impact of this technology to a compactification of Fourier optics systems. In this paper, we introduce nonlinear operations to the field of metasurface-based analog optical processing, demonstrating that nonlinear optical phenomena, combined with nonlocality in flat optics, can be leveraged to synthesize kernels beyond linear Fourier optics, paving the way to a broad range of new opportunities. As a practical demonstration, we report the experimental synthesis of a class of nonlinear operations that can be used to realize broadband, polarization-selective analog-domain edge detection.

analog image processing↗
DOE OSTI2024

Zero-Power Analog Optical Processing

The motivation behind this research is the growing challenge of handling the massive amounts of data generated by modern imaging systems. Conventional digital image processing techniques are struggling to keep pace with the demands of high-resolution and high-speed imaging systems for remote sensing due to their high-power consumption and data storage requirements. We present a novel approach based on analog photonics to address this challenge. The proposed system utilizes a silicon-photonics-based image encoder positioned after image formation and initial optical-to-electrical conversion. The photonic encoder compresses image data using a passive disordered photonic structure to perform kernel-type random projections of the raw data. The compressed data is then processed by a back-end neural network, which reconstructs the original image with high fidelity (structural similarity exceeding 90%). Our proposed approach has the potential to compress images with ~ 1000X lower power consumption compared to digital approaches with data rates exceeding 1 terapixel/second.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Frequency-domain computing using nonlinear acoustic-wave device on lithium niobate

Abstract Multiply-accumulation are crucial computing operations in signal processing, numerical simulations, and machine learning. In recent years, optical analog approaches have demonstrated higher computing performance and better power efficiency than their digital counterparts. However, analog computing chips usually need large areas and complex structures for parallel computing, as a single device element only executes one computing operation at a single time. Here, we demonstrate frequency-domain computing using the nonlinear acoustic-wave devices on lithium niobate, featuring a normalized external second-harmonic generation conversion efficiency of ~ 5.7 × 10-4 W-1. The second-order sum-frequency nonlinear process of lithium niobate enables multiplication of inputs encoded in the frequency domain. Compared to the analog schemes, our device features a notably simpler design, and nanofabrication requires only one lift-off. Using a single acoustic-wave device within an area of 0.03 mm2, we can simultaneously conduct over 130,000 multiply-accumulation operations. Our acoustic-wave device shows applications in real and complex vector convolutions and image processing. This demonstration sets the stage for experimental realizations into frequency-domain integrated nonlinear acoustic computing systems, potentially shaping future developments in acoustic neural networks and quantum computing.

chai, mingzhao (ORCID:0009000466226341)↗
DOE OSTI2024

A Cryogenic readout integrated circuit with analog pile-up and in-Pixel ADC for high frame rate Skipper CCD-in-CMOS Sensors

The Skipper CCD-in-CMOS Parallel Read-Out Circuit V2 (SPROCKET2) is designed to enable high frame rate readout of Skipper CCD-in-CMOS image sensors. The SPROCKET2 pixel is fabricated in a 65 nm CMOS process and occupies a 60$\mu$m $\times$ 60$\mu$m footprint. SPROCKET2 is intended to be heterogeneously integrated with a pixelated Skipper CCD-in-CMOS sensor, such that one readout pixel is connected to a multiplexed array of 16 active image sensor pixels, to match their spatial geometry. Our design benefits from the Skipper CCD-in-CMOS sensor's non-destructive readout capability to achieve exceptionally low noise through multi-sampling and averaging while optimizing for total power consumption. The pixel readout utilizes correlated double sampling to minimize 1/f noise and includes "pile-up" of ten successive samples in the analog domain before digitizing at a rate of 66.7 ksps. Measurement results of in-pixel serial SAR ADC show DNL and INL of ~0. 44 LSB and 0.58 LBS respectively. A large area array of 20,000 SPROCKET2 ADC pixels (multiplexed 1:16 to 320,000 sensor pixels) is currently under test. By reading out data over a 10 Gbps optical link, this pixel design enables a frame rate of $\sim$ 4 kfps for large sensing areas with minimal sensing deadtime. In the highest gain mode, the pixelated ADC has an input-referred resolution of 10$\mu$V with a simulated power consumption of 50$\mu$W. The pixel operates with constant current draw to minimize power-rail crosstalk.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

An in situ imaging investigation of the effect of gas flow rates on directed energy deposition

Gas flow rates in Directed Energy Deposition (DED) Additive Manufacturing (AM) can significantly affect the quality of built parts by altering melt pool geometry. Using a DED process replicator and in situ synchrotron radiography, together with analogous experiments in an industrial DED machine, we investigate the impact of carrier gas and shield gas flow rates on build quality. The results reveal that there is a critical shield gas flow rate above which melt pools are flattened, tracks widen, and thus layer thickness decreases. The reduction in layer thickness is most prominent in conditions with low carrier gas flow rate, as the highly turbulent shield gas flow may divert slow moving powder particles away from the melt pool, decreasing capture efficiency. Very high flow rates increase internal porosity, as fast-moving particles impacting the melt pool surface can entrain chamber gas behind them. High gas flow rates also cool the melt pool, creating shallower melt pools with increased thermal gradients near the solidification front, increasing pore entrapment in the solidified track.

Additive manufacturing↗
DOE OSTI2025

Femtojoule optical nonlinearity for deep learning with incoherent illumination

Optical neural networks (ONNs) are a promising computational alternative for deep learning due to their inherent massive parallelism for linear operations. However, the development of energy-efficient and highly parallel optical nonlinearities, a critical component in ONNs, remains an outstanding challenge. Here, we introduce a nonlinear optical microdevice array (NOMA) compatible with incoherent illumination by integrating the liquid crystal cell with silicon photodiodes at the single-pixel level. We fabricate NOMA with more than half a million pixels, each functioning as an optical analog of the rectified linear unit at ultralow switching energy down to 100 femtojoules per pixel. With NOMA, we demonstrate an optical multilayer neural network. Our work holds promise for large-scale and low-power deep ONNs, computer vision, and real-time optical image processing.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Low Power, Radiation Resilient Synchronous Edge Processing for Remote Monitoring

Next-generation space remote sensing systems may be equipped with imaging arrays that sense data at a rate that outstrips the processing capability of any computing hardware that can operate within a satellite’s power budget. This project developed novel convolutional and recurrent neural networks to detect and estimate point-like events amid clutter, and investigated their efficient and accurate implementation on analog in-memory computing systems that are 10-1000× more energy-efficient than digital processors. This project leveraged two memory devices at different levels of technological maturity: a large-scale analog computing prototype using commercial SONOS charge-trap memory, and electrochemical memory (ECRAM) with intrinsic radiation hardness. We experimentally demonstrated end-to-end analog processing of our neural networks on SONOS and characterized the radiation response of both SONOS and ECRAM. We advanced the state-of-the-art in ECRAM precision and reliability, and developed co-design methods to enable accurate long-term operation of SONOS analog accelerators in space radiation environments.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2026

Evaluation of an event-driven 3FI ASIC for spectroscopic X-ray detection with synchrotron radiation

The novel design and evaluation on the NSLS-II beamline of the 3FI application-specific integrated circuit (ASIC) bump-bonded to a simple, planar, 2D segmented silicon sensor are presented. The ASIC was developed for full-field fluorescence spectral X-ray imaging (3FI). It is a small-scale prototype that features a square array of 32 × 32 pixels, and the size of the pixels is 100 µm × 100 µm. The ASIC was implemented in a 65 nm CMOS integrated circuit fabrication process. Each pixel incorporates a charge-sensitive amplifier, a shaping filter, a discriminator, a peak detector and a sample-and-hold circuit, allowing detection of events and storage of signal amplitudes. The system operates in a frameless event-driven readout mode, outputting analog values for threshold-triggered events, allowing high-speed multi-element X-ray fluorescence data acquisition. The 3FI ASIC achieves per-channel spectrometric performance at a power consumption of only 200 µW per pixel, with nearly all dissipation confined to the analog front-end. An energy resolution is measured at the level of 308 eV full width at half-maximum (FWHM) at 8.04 keV (Cu Kα), and 138 eV FWHM at 3.69 keV (Ca Kα). This per-pixel capability makes the prototype suitable for in situ trace element microanalysis in biological and environmental studies. Moreover, the frameless architecture of the detector is designed to address limitations of conventional X-ray fluorescence microscopy, which typically requires mechanical scanning, by enabling continuous high-throughput data acquisition in future full-field implementations.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Imaging nanoscale carrier, thermal, and structural dynamics with time-resolved and ultrafast electron energy-loss spectroscopy

Time-resolved and ultrafast electron energy-loss spectroscopy (EELS) is an emerging technique for measuring photoexcited carriers, lattice dynamics, and near-fields across femtosecond to microsecond timescales. When performed in either a specialized scanning transmission electron microscope or ultrafast electron microscope (UEM), time-resolved and ultrafast EELS can directly image charge carriers, lattice vibrations, and heat dissipation following photoexcitation or applied bias. Yet, recent advances in theoretical calculations and electron optics are often required to realize the full potential of ultrafast EEL spectrum imaging. Here, in this review, we present a comprehensive overview of the recent progress in the theory and instrumentation of time-resolved and ultrafast EELS. We begin with an introduction to the technique, followed by a physical description of the loss function. We outline approaches for calculating and interpreting ground-state and transient EEL spectra spanning low-loss plasmons to core-level excitations analogous to x-ray absorption. We then survey the current state of time-resolved and ultrafast EELS techniques beyond photon-induced near-field electron microscopy, highlighting abilities to image carrier and thermal dynamics. Finally, we examine future directions enabled by emerging technologies, including electron beam monochromation, in situ and operando cells, laser-free UEM, and high-speed direct electron detectors. These advances position time-resolved and ultrafast EELS as a critical tool for uncovering nanoscale dynamic processes in quantum materials and solar energy conversion devices.

Computational methods↗
DOE OSTI2025

Mixed Element Microparticle Characterization by Electron Probe Microanalysis

Abstract Microparticle compositional characterization for nuclear forensics has traditionally been achieved by “gold-standard” destructive analytical techniques such as large geometry-secondary ion mass spectrometry and fission track-thermal ionization mass spectrometry, but long processing times and total sample consumption eliminate the option of subsequent analysis by other methods. Electron probe microanalysis has long been widely employed for rapid, nondestructive, micrometer-scale compositional measurements and imaging in fields such as material science and geology and may therefore need to be reevaluated as an alternative tool for microparticle analysis for the nuclear forensics community. This study presents the use of electron probe microanalysis for imaging and quantitative characterization of homogeneous microparticles utilizing a calibration curve based on high-precision quadrupole-inductively coupled plasma-mass spectrometry analyses. Samples of opportunity synthesized at Savannah River National Laboratory, nickel-doped cerium oxide microparticles, were selected as analogs for plutonium-doped uranium oxide microparticles. Positive detection and accurate quantification of variable amounts of nickel dopant down to trace levels (10s of parts per million) suggest applicability of this technique to other mixed element systems (e.g., actinides). Quantitative single-particle characterization via electron probe microanalyzer may thus provide a high fidelity, nondestructive complement to techniques currently in use.

Riche, Alexis T. (ORCID:0009000121978126)↗
DOE OSTI2024

Density of molten oxides measured in an aero-acoustic levitator

Knowing the thermophysical properties of high-temperature melts can aid the design of melt processes and validate atomic structural models, such as those used in studying glass formation. Property measurements on such melts are challenging, however, due to container-related contamination and heterogeneous nucleation. Containerless processing techniques that employ levitation can be used to avoid these obstacles. In that context, we demonstrate here the application of silhouette imaging to measure the density of molten oxides in an aero-acoustic levitation instrument (AAL). The AAL combines gas jet levitation with actively controlled acoustic positioning to enable full optical access to samples ca. 2–4 mm in diameter, which are laser beam heated and melted. The cross sections of molten drops are imaged using a monochromatic light source and narrowband-filtered camera. Melt volume is calculated from the cross sections and used to find density at several temperatures ranging 1530–1920 K, including up to 350 K of supercooling. We report densities for CaAl 2 O 4 , Ca 12 Al 14 O 33 , CaSiO 3 , their Fe 2 O 3 -bearing analogs, and 83TiO 2 -17RE 2 O 3 (RE = La or Nd). These provide important benchmarks of the capabilities, measurement uncertainties, and future outlook for this technique.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Initial in-orbit operation of the soft X-ray spectrometer Resolve onboard the X-ray imaging and spectroscopy mission satellite

The X-Ray Imaging and Spectroscopy Mission satellite was launched on September 6, 2023 (UT). Its Resolve instrument is a high-resolution X-ray spectrometer enabled by a microcalorimeter array thermally anchored to a 50-mK heat sink. Many sensitive, critical sub-systems comprise Resolve, including a multistage cryogenic cooling system, thin-film aperture filters, low-noise electronics, on-board signal processing, and several sources of X-rays for calibration. We summarize the initial on-orbit power-on and checkout of Resolve that commenced immediately after launch. Soon after launch, the cryocoolers were activated, and their operation was successfully established. On October 9, 2023, the first cycle of the adiabatic demagnetization refrigerator was carried out, bringing the sensors to their steady-state operational temperatures. Following this, the energy resolution at 5.9 keV was successfully measured. The energy scale of the system is highly sensitive to the thermal environment surrounding both the sensors and their analog electronics. Gain correction was performed using reference X-ray lines from onboard calibration sources. To optimize cooler frequency settings, noise spectra were collected across a range of frequencies, and the most suitable frequency pair was selected based on the in-orbit environment. During the final phase of the checkout, an attempt was made to open the gate valve, which is designed to protect the Dewar’s interior from external pressure during ground operations and launch. Unfortunately, this attempt was unsuccessful. As a result, the checkout process was temporarily paused, and a stable operational strategy was subsequently developed to enable Resolve to function effectively with the gate valve remaining closed.

X-ray micro-calorimeter↗
DOE OSTI2025

Absolute timing calibration of the Resolve microcalorimeter spectrometer on the X-ray Imaging and Spectroscopy Mission

The Resolve microcalorimeter spectrometer on the X-ray Imaging and Spectroscopy Mission (XRISM) is designed to have a good timing capability with the mission-level requirement of 1 ms as the absolute time tagging accuracy to suffice the needs for observatory science. In the ground calibration campaign, the absolute and relative timing offsets were measured using pulsed X-rays from the modulated X-ray sources. These offsets were used to determine calibration parameters, the Resolve timing coefficients, which are used in the offline correction of event times. In the orbit, reevaluation of the timing coefficients was carried out using the Crab pulsar, which was observed in two periods, one in the performance verification phase and the other in the guest observation phase. We report the absolute timing calibration of XRISM/Resolve using the ground and in-orbit data. Although the requirement is likely satisfied with the ground parameters, the timing coefficients have been refined using the in-orbit calibration to improve the timing accuracy. In addition, for the first time, we present the interpretation of the absolute timing offset originating from the analog and digital processing of X-ray events unique to a microcalorimeter spectrometer and present a complete view of the timing error of the Resolve instrument.

Astronomy and AstroPhysics↗
DOE OSTI2025

Massively parallel and universal approximation of nonlinear functions using diffractive processors

Nonlinear computation is essential for a wide range of information processing tasks, yet implementing nonlinear functions using optical systems remains a challenge due to the weak and power-intensive nature of optical nonlinearities. Overcoming this limitation without relying on nonlinear optical materials could unlock unprecedented opportunities for ultrafast and parallel optical computing systems. Here, we demonstrate that large-scale nonlinear computation can be performed using linear optics through optimized diffractive processors composed of passive phase-only surfaces. In this framework, the input variables of nonlinear functions are encoded into the phase of an optical wavefront—e.g., via a spatial light modulator (SLM)—and transformed by an optimized diffractive structure with spatially varying point-spread functions to yield output intensities that approximate a large set of unique nonlinear functions–all in parallel. We provide proof establishing that this architecture serves as a universal function approximator for an arbitrary set of bandlimited nonlinear functions, also covering wavelength-multiplexed nonlinear functions as well as multi-variate and complex-valued functions that are all-optically cascadable. Our analysis also indicates the successful approximation of typical nonlinear activation functions commonly used in neural networks, including the sigmoid, tanh, ReLU (rectified linear unit), and softplus. We numerically demonstrate the parallel computation of one million distinct nonlinear functions, accurately executed at wavelength-scale spatial density at the output of a diffractive optical processor. Furthermore, we experimentally validated this framework using in situ optical learning and approximated 35 unique nonlinear functions in a single shot using a compact setup consisting of an SLM and an image sensor. These results establish diffractive optical processors as a scalable platform for massively parallel universal nonlinear function approximation, paving the way for new capabilities in analog optical computing based on linear materials.

Rahman, Md Sadman Sakib [University of California,↗
DOE OSTI2024

Nonlinear encoding in diffractive information processing using linear optical materials

Nonlinear encoding of optical information can be achieved using various forms of data representation. Here, we analyze the performances of different nonlinear information encoding strategies that can be employed in diffractive optical processors based on linear materials and shed light on their utility and performance gaps compared to the state-of-the-art digital deep neural networks. For a comprehensive evaluation, we used different datasets to compare the statistical inference performance of simpler-to-implement nonlinear encoding strategies that involve, e.g., phase encoding, against data repetition-based nonlinear encoding strategies. We show that data repetition within a diffractive volume (e.g., through an optical cavity or cascaded introduction of the input data) causes the loss of the universal linear transformation capability of a diffractive optical processor. Therefore, data repetition-based diffractive blocks cannot provide optical analogs to fully connected or convolutional layers commonly employed in digital neural networks. However, they can still be effectively trained for specific inference tasks and achieve enhanced accuracy, benefiting from the nonlinear encoding of the input information. Our results also reveal that phase encoding of input information without data repetition provides a simpler nonlinear encoding strategy with comparable statistical inference accuracy to data repetition-based diffractive processors. Our analyses and conclusions would be of broad interest to explore the push-pull relationship between linear material-based diffractive optical systems and nonlinear encoding strategies in visual information processors.

42 ENGINEERING↗
DOE OSTI2025

Laser beam pointing stabilization using analog position-sensitive diodes

Laser wire scanners have been used for ion beam profile and emittance measurements at the Spallation Neutron Source linear accelerator. Due to propagation distances exceeding 100 m, reliable measurements require laser beam stabilization, previously accomplished with a feedback control loop using a digital camera as a position sensor [Hardin et al., Opt. Express 19, 2874 (2011)]. Here, this paper presents an upgraded pointing stabilization system utilizing analog position-sensitive diodes (PSDs) as the position detector, optimized with an optical diffuser. The new system significantly surpasses the previous system by offering an order-of-magnitude improvement in radiation tolerance and a bandwidth limited only by the burst repetition rate of the laser beam. Operating with a 60-Hz burst mode laser, the new system effectively suppresses laser beam drifts up to 30 Hz, compared to the previous system’s 4 Hz limit. In addition, the amplitude of spectral components below 0.1 Hz was reduced by a factor of more than 100, which is over seven times greater than was achieved by the previous system.

Data acquisition↗
DOE OSTI2025

Molecular-Level Insights into the NMR Relaxivity of Gadobutrol Using Quantum and Classical Molecular Simulations

MRI is an indispensable diagnostic tool in modern medicine; however, understanding the molecular-level processes governing NMR relaxation of water in the presence of MRI contrast agents remains a challenge, hindering the molecular-guided development of more effective contrast agents. By using quantum-based polarizable force fields, the first-of-its-kind molecular dynamics (MD) simulations of Gadobutrol are reported where the 1 H NMR longitudinal relaxivity r 1 of the aqueous phase is determined without any adjustable parameters. The MD simulations of r 1 dispersion (i.e., frequency dependence) show good agreement with measurements at frequencies of interest in clinical MRI. Importantly, the simulations reveal key insights into the molecular level processes leading to r 1 dispersion by decomposing the NMR dipole–dipole autocorrelation function G(t) into a discrete set of molecular modes, analogous to the eigenmodes of a quantum harmonic oscillator. The molecular modes reveal important aspects of the underlying mechanisms governing r 1 , such as its multiexponential nature and the importance of the second eigenmodal decay. By simply analyzing the MD trajectories on a parameter-free approach, the Gadobutrol simulations show that the outer-shell water contributes ∼50% of the total relaxivity r 1 compared to the inner-shell water, in contrast to simulations of (nonchelated) gadolinium-aqua where the outer shell contributes only ∼15% of r 1 . The deviation between simulations and measurements of r 1 below clinical MRI frequencies is used to determine the low-frequency electron-spin relaxation time for Gadobutrol, in good agreement with independent studies.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗