Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,423 records · Page 79
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Assessing an aqueous flow cell designed for in situ crystal growth under X-ray nanotomography and effects of radiolysis products

Nucleation and growth of minerals has broad implications in the geological, environmental and materials sciences. Recent developments in fast X-ray nanotomography have enabled imaging of crystal growth in solutions in situ with a resolution of tens of nanometres, far surpassing optical microscopy. Here, a low-cost, custom-designed aqueous flow cell dedicated to the study of heterogeneous nucleation and growth of minerals in aqueous environments is shown. To gauge the effects of radiation damage from the imaging process on growth reactions, radiation-induced morphological changes of barite crystals (hundreds of nanometres to ∼1 µm) that were pre-deposited on the wall of the flow cell were investigated. Under flowing solution, minor to major crystal dissolution was observed when the tomography scan frequency was increased from every 30 min to every 5 min (with a 1 min scan duration). The production of reactive radicals from X-ray induced water radiolysis and decrease of pH close to the surface of barite are likely responsible for the observed dissolution. The flow cell shown here can possibly be adopted to study a wide range of other chemical reactions in solutions beyond crystal nucleation and growth where the combination of fast flow and fast scan can be used to mitigate the radiation effects.

36 MATERIALS SCIENCE↗
DOE OSTI2024

VitroJet: new features and case studies

Single-particle cryo-electron microscopy has become a widely adopted method in structural biology due to many recent technological advances in microscopes, detectors and image processing. Before being able to inspect a biological sample in an electron microscope, it needs to be deposited in a thin layer on a grid and rapidly frozen. The VitroJet was designed with this aim, as well as avoiding the delicate manual handling and transfer steps that occur during the conventional grid-preparation process. Since its creation, numerous technical developments have resulted in a device that is now widely utilized in multiple laboratories worldwide. It features plasma treatment, low-volume sample deposition through pin printing, optical ice-thickness measurement and cryofixation of pre-clipped Autogrids through jet vitrification. This paper presents recent technical improvements to the VitroJet and the benefits that it brings to the cryo-EM workflow. A wide variety of applications are shown: membrane proteins, nucleosomes, fatty-acid synthase, Tobacco mosaic virus, lipid nanoparticles, tick-borne encephalitis viruses and bacteriophages. These case studies illustrate the advancement of the VitroJet into an instrument that enables accurate control and reproducibility, demonstrating its suitability for time-efficient cryo-EM structure determination.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2019

A Two-Tier Convolutional Neural Network for Combined Detection and Segmentation in Biological Imagery

Deep learning techniques have been useful for modern microscopy imaging techniques to further study and analyze biological structures and organs. Convolutional neural networks (CNN) have improved 2D object detection, localization, and segmentation. For imagery containing biological structures with depth, it is especially desirable to perform these tasks in 3D. Traditionally, performing these tasks simultaneously in 3D has proven to be computationally expensive. Currently available methodologies thus largely work to segment 3D objects from 2D images (without context from captured 3D volumes). In this work, we present a novel approach to perform fast and accurate localization, detection, and segmentation of volumes containing cells. Specifically, in our method, we modify and tune two state-of-the-art CNNs, namely 2D YOLOv2 and 3D U-Net, and combine them with a new fusion and image processing algorithms. Annotated volumes in this space are limited, and we have created synthetic data that mimics actual structures for training and testing our proposed approach. Promising results on this test data demonstrate the value of the technique and offers a methodology for 3D cell analysis in real microscopy imagery.

Ziabari, Amir↗
DOE OSTI2025

Random Walks With Tweedie: A Unified View of Score-Based Diffusion Models [In the Spotlight]

We present a concise derivation for several influential score-based diffusion models that relies on only a few textbook results. Diffusion models have recently emerged as powerful tools for generating realistic, synthetic signals—particularly natural images—and often play a role in state-of-the-art algorithms for inverse problems in image processing. While these algorithms are often surprisingly simple, the theory behind them is not, and multiple complex theoretical justifications exist in the literature. Here, in this study, we provide a simple and largely self-contained theoretical justification for score-based diffusion models that is targeted towards the signal processing community. This approach leads to generic algorithmic templates for training and generating samples with diffusion models. We show that several influential diffusion models correspond to particular choices within these templates and demonstrate that alternative, more straightforward algorithmic choices can provide comparable results. This approach has the added benefit of enabling conditional sampling without any likelihood approximation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Robust and Simple ADMM Penalty Parameter Selection

We present a new method for online selection of the penalty parameter for the alternating direction method of multipliers (ADMM) algorithm. ADMM is a widely used method for solving a range of optimization problems, including those that arise in signal and image processing. In its standard form, ADMM includes a scalar hyperparameter, known as the penalty parameter, which usually has to be tuned to achieve satisfactory empirical convergence. In this work, we develop a framework for analyzing the ADMM algorithm applied to a quadratic problem as an affine fixed point iteration. Using this framework, we develop a new method for automatically tuning the penalty parameter by detecting when it has become too large or small. We analyze this and several other methods with respect to their theoretical properties, i.e., robustness to problem transformations, and empirical performance on several optimization problems. Our proposed algorithm is based on a theoretical framework with clear, explicit assumptions and approximations, is theoretically covariant/invariant to problem transformations, is simple to implement, and exhibits competitive empirical performance.

42 ENGINEERING↗
DOE OSTI2026

An Adaptive Multiparameter Penalty Selection Method for Multiconstraint and Multiblock ADMM

This work presents a new method for online selection of multiple penalty parameters for the alternating direction method of multipliers (ADMM) algorithm applied to optimization problems with multiple constraints or functions with block matrix components. ADMM is widely used for solving constrained optimization problems in a variety of fields, including signal and image processing. Implementations of ADMM often utilize a single hyperparameter, referred to as the penalty parameter, which needs to be tuned to control the rate of convergence. However, in problems with multiple constraints, ADMM may demonstrate slow convergence regardless of penalty parameter selection due to scale differences between constraints. Accounting for scale differences between constraints to improve convergence in these cases requires introducing a penalty parameter for each constraint. The proposed method is able to adaptively account for differences in scale between constraints, providing robustness with respect to problem transformations and initial selection of penalty parameters. It is also simple to understand and implement. Our numerical experiments demonstrate that the proposed method performs favorably compared to a variety of existing penalty parameter selection methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Event-to-Video Conversion for Overhead Object Detection

Collecting overhead imagery using an event camera is desirable due to the energy efficiency of the image sensor compared to standard cameras. However, event cameras complicate downstream image processing, especially for complex tasks such as object detection. In this paper, we investigate the viability of event streams for overhead object detection. We demonstrate that across a number of standard modeling approaches, there is a significant gap in performance between dense event representations and corresponding RGB frames. We establish that this gap is, in part, due to a lack of overlap between the event representations and the pre-training data that the object detectors were initially trained on through a number of experiments. Then, apply an off-the-shelf event-to-video conversion tool that converts event streams into gray-scale video to close this gap. We demonstrate that this approach results in a large performance increase, outperforming even event-specific object detection techniques on our overhead target task. These results suggest that better aligning event representations with existing large pre-trained models may result in greater short-term performance gains compared to end-to-end event-specific architectural improvements.

machine learning (ML), computer vision, Neuromorph↗
DOE OSTI2021

Quantitative order-parameter measurement in lattice-mismatched AlInP using precession electron diffraction

Precession electron diffraction (PED) was used to measure the long-range order parameter in lattice-mismatched AlInP epitaxial films under investigation for solid-state-lighting applications. Both double- and single-variant films grown at 620, 650, and 680°C were analyzed in TEM cross-section. PED patterns were acquired in selected-area-diffraction mode through external microscope control using serial acquisition, which allows inline image processing. The integrated peak intensities from experimental patterns were fit using dynamical simulations of diffraction from the ordered domain structures. Included in the structure-factor calculations were mean atomic displacements of the anions (P) due to ordering, which were found by valence-force-field calculations to have a nearly linear dependence on order parameter. A maximum order parameter of S = 0.36 was measured for a double-variant specimen grown at 650°C.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2023

OPEN leaf : an open‐source cloud‐based phenotyping system for tracking dynamic changes at leaf‐specific resolution in Arabidopsis

SUMMARY The first draft of the Arabidopsis genome was released more than 20 years ago and despite intensive molecular research, more than 30% of Arabidopsis genes remained uncharacterized or without an assigned function. This is in part due to gene redundancy within gene families or the essential nature of genes, where their deletion results in lethality (i.e., thedark genome). High‐throughput plant phenotyping (HTPP) offers an automated and unbiased approach to characterize subtle or transient phenotypes resulting from gene redundancy or inducible gene silencing; however, access to commercial HTPP platforms remains limited. Here we describe the design and implementation ofOPEN leaf, an open‐source phenotyping system with cloud connectivity and remote bilateral communication to facilitate data collection, sharing and processing.OPEN leaf, coupled with our SMART imaging processing pipeline was able to consistently document and quantify dynamic changes at the whole rosette level and leaf‐specific resolution when plants experienced changes in nutrient availability. Our data also demonstrate that VIS sensors remain underutilized and can be used in high‐throughput screens to identify and characterize previously unidentified phenotypes in a leaf‐specific time‐dependent manner. Moreover, the modular and open‐source design ofOPEN leafallows seamless integration of additional sensors based on users and experimental needs.

Plant Sciences↗
DOE OSTI2024

Terahertz time-domain spectroscopy imaging of pancreatic ductal adenocarcinoma tissues

Pancreatic ductal adenocarcinoma (PDAC) ranks among the malignancies with the highest fatality and morbidity rates. This is predominantly attributable to an absence of understanding the intricate and diverse microenvironment of the tumor. We use terahertz time-domain spectroscopy (THz-TDS) imaging in transmission geometry to probe ex-vivo the heterogenous microenvironment of the genetically modified murine PDAC tissue that closely resembles the PDAC heterogeneity in human malignancy. We introduced a maximum a-posteriori probability estimation algorithm to objectively the tumor’s heterogenous microenvironment using the average values of refractive index and absorption coefficient within the useable terahertz bandwidth as imaging markers. Furthermore, direct comparison of stained histopathologic images and the refractive index and the absorption coefficient high-resolution, two dimensional maps of the same PDAC samples confirms the high potential of the THz-TDS method for tumor tissue characterization.

absorption↗
DOE OSTI2025

Femtojoule optical nonlinearity for deep learning with incoherent illumination

Optical neural networks (ONNs) are a promising computational alternative for deep learning due to their inherent massive parallelism for linear operations. However, the development of energy-efficient and highly parallel optical nonlinearities, a critical component in ONNs, remains an outstanding challenge. Here, we introduce a nonlinear optical microdevice array (NOMA) compatible with incoherent illumination by integrating the liquid crystal cell with silicon photodiodes at the single-pixel level. We fabricate NOMA with more than half a million pixels, each functioning as an optical analog of the rectified linear unit at ultralow switching energy down to 100 femtojoules per pixel. With NOMA, we demonstrate an optical multilayer neural network. Our work holds promise for large-scale and low-power deep ONNs, computer vision, and real-time optical image processing.

36 MATERIALS SCIENCE↗
DOE OSTI2018

Imaging in Diagnostic Nuclear Medicine

Single-photon emission computed tomography (SPECT) and positron emission tomography (PET) are modern methods for visualization in diagnostic nuclear medicine. SPECT is known as a workhorse in cardiology, and PET is the gold standard in oncology. The development of nuclear medicine is provided by cooperation of physicists, mathematicians, biologists, medical doctors, and radio-chemists. In spite of extensive clinical applications, several problems may lead to false diagnoses. In particular, the correction of attenuation of gamma radiation in human organs must be taken into account. For interpretation and evaluation of such an effect on the clinical results, we perform physico-mathematical simulation of the SPECT diagnostics in cardiology in the absence and presence of the correction of attenuation. A brief review of the state-of-the art is presented. The simulation employs the first Russian anthropomorphic mathematical phantom that describes the distribution of radio-pharmacological agent ({sup 99m }Tc-methoxyisobutylisonitrile) in chest organs of a typical male patient. A model for calculation of raw images is developed with allowance for attenuation of radiation in biological tissues and the effect of collimator and detector. The results of the proposed models and calculated images are compared with clinical images obtained at the Meshalkin Institute of Circulation Pathology (Novosibirsk) and Myasnikov Institute of Clinical Cardiology (Moscow). Statistical algorithms are developed for the solution of the inverse problem of image reconstruction based on the entropy principle. The clinical and physico-mathematical approaches are compared in the evaluation of the effect of correction on the quality of reconstructed images of the left ventricle of myocardium.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2023

Noise-Resilient and Reduced Depth Approximate Adders for NISQ Quantum Computing

The "Noisy intermediate-scale quantum" NISQ machine era primarily focuses on mitigating noise, controlling errors, and executing high-fidelity operations, hence requiring shallow circuit depth and noise robustness. Approximate computing is a novel computing paradigm that produces imprecise results by relaxing the need for fully precise output for error-tolerant applications including multimedia, data mining, and image processing. We investigate how approximate computing can improve the noise resilience of quantum adder circuits in NISQ quantum computing. We propose five designs of approximate quantum adders to reduce depth while making them noise-resilient, in which three designs are with carryout, while two are without carryout. We have used novel design approaches that include approximating the Sum only from the inputs (pass-through designs) and having zero depth, as they need no quantum gates. The second design style uses a single CNOT gate to approximate the SUM with a constant depth of O(1). We performed our experimentation on IBM Qiskit on noise models including thermal, depolarizing, amplitude damping, phase damping, and bitflip: (i) Compared to exact quantum ripple carry adder without carryout the proposed approximate adders without carryout have improved fidelity ranging from 8.34% to 219.22%, and (ii) Compared to exact quantum ripple carry adder with carryout the proposed approximate adders with carryout have improved fidelity ranging from 8.23% to 371%. Further, the proposed approximate quantum adders are evaluated in terms of various error metrics.

Gaur, Bhaskar↗
DOE OSTI2021

Multi-Energy Differential Evolution Reconstruction (MEnDER 1D) for Proton Deflectometry

This code is designed to reconstruct magnetic field deflections, and thus the path-integrated magnetic field, from sets of proton images at two distinct proton probe energies. A differential evolution (DE) algorithm is used to iteratively update a population of solution candidates of the magnetic deflections of the protons for reconstructing the input images, selecting improved candidates as they are discovered. This algorithm was written using MATLAB (R2019a) and makes use of the Image Processing and Parallel Processing Toolboxes.

Levesque, Joseph↗
DOE OSTI2019

DefectSegNet

DefectSegNet for semantic segmentation of defects in Steels The first and most important step of automating defect analysis is perceptual defect identification. In terms of digital image processing, semantic segmentation best emulates human recognition of defect features – it identifies the crystallographic defects and where they are located in a TEM micrograph. We solved this problem by developing DefectSegNet, a novel hybrid CNN algorithm for robust and automated semantic segmentation of three crystallographic defects, including line dislocations, precipitates and voids, that are commonly observed in structural metals and alloys.

Sainju, Rajat↗
DOE OSTI2024

FLIT: A Generic Fortran Library based on Interfaces and Templates

This Fortran code consists of multiple modules with a focus on simplifying array operations, image processing, and numerical computation especially for computational geophysics applications. We intend to use this code to demonstrate the application and usefulness of Fortran interface and templates for generic programming, especially for computational geophysics and seismology applications. The code has several notable features. Firstly, it is based on a modularized structure, where each module contains multiple functions but with a focus of functionality. Secondly, it heavily uses interfaces and templates for improving the genericness and convenience of the resulting code, where a same function interface can enclose a group of functions that perform the same functionality but with inputs/output variables of different data types. Thirdly, it includes a variety of generic functions with an emphasis on array operations, such as rotation, flipping, cropping, padding, fast Fourier transform, Gaussian blurring, interpolation, and so on. We name this package FLIP – a generic Fortran Library based on Interfaces and Templates.

Gao, Kai↗
DOE OSTI2021

The effect of transient needle lift on the internal flow and near-nozzle spray characteristics for modern GDI systems investigated by high-speed X-ray imaging

The development of the injector nozzle is a dynamic area in regard of several technical aspects. At first, the internal flow influences the near-field spray characteristics via various phenomena such as cavitation and turbulence. However, these phenomena are not fully understood due to their extremely fast, complex and multiscale nature. Furthermore, it governs the spray targeting inside the combustion chamber. High-speed X-ray imaging of GDI injector nozzles is performed in this study. The experimental results presented are related to the internal flow and primary breakup of discharged liquid jets. The injectors used are equipped with nozzles made of aluminum which have been specially developed for these investigations to enhance optical accessibility. The visualization of the needle motion, in-nozzle flow and the primary breakup region provides several exciting observations. First, the needle lift tracking exhibits short overshooting right before the steady-state of the injection phase. Additionally, this event leads to a short-term, however, significant change in the associated performance of the breakup. This phenomenon is found to be a consequence of the transient behavior of the in-nozzle flow. It is shown that under some circumstances hydraulic flip may occur during this overshooting period. The primary jet breakup region is visualized and evaluated by means of image processing. Thus, the transient behavior of liquid jet expansion is quantified in the vicinity of the nozzle. It is observed that the liquid jet direction deviates from the hole axis already at the nozzle outlet, which is caused by internal flow characteristics.

42 ENGINEERING↗