Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image Processeing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

VitroJet: new features and case studies

Single-particle cryo-electron microscopy has become a widely adopted method in structural biology due to many recent technological advances in microscopes, detectors and image processing. Before being able to inspect a biological sample in an electron microscope, it needs to be deposited in a thin layer on a grid and rapidly frozen. The VitroJet was designed with this aim, as well as avoiding the delicate manual handling and transfer steps that occur during the conventional grid-preparation process. Since its creation, numerous technical developments have resulted in a device that is now widely utilized in multiple laboratories worldwide. It features plasma treatment, low-volume sample deposition through pin printing, optical ice-thickness measurement and cryofixation of pre-clipped Autogrids through jet vitrification. This paper presents recent technical improvements to the VitroJet and the benefits that it brings to the cryo-EM workflow. A wide variety of applications are shown: membrane proteins, nucleosomes, fatty-acid synthase, Tobacco mosaic virus, lipid nanoparticles, tick-borne encephalitis viruses and bacteriophages. These case studies illustrate the advancement of the VitroJet into an instrument that enables accurate control and reproducibility, demonstrating its suitability for time-efficient cryo-EM structure determination.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Random Walks With Tweedie: A Unified View of Score-Based Diffusion Models [In the Spotlight]

We present a concise derivation for several influential score-based diffusion models that relies on only a few textbook results. Diffusion models have recently emerged as powerful tools for generating realistic, synthetic signals—particularly natural images—and often play a role in state-of-the-art algorithms for inverse problems in image processing. While these algorithms are often surprisingly simple, the theory behind them is not, and multiple complex theoretical justifications exist in the literature. Here, in this study, we provide a simple and largely self-contained theoretical justification for score-based diffusion models that is targeted towards the signal processing community. This approach leads to generic algorithmic templates for training and generating samples with diffusion models. We show that several influential diffusion models correspond to particular choices within these templates and demonstrate that alternative, more straightforward algorithmic choices can provide comparable results. This approach has the added benefit of enabling conditional sampling without any likelihood approximation.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Robust and Simple ADMM Penalty Parameter Selection

We present a new method for online selection of the penalty parameter for the alternating direction method of multipliers (ADMM) algorithm. ADMM is a widely used method for solving a range of optimization problems, including those that arise in signal and image processing. In its standard form, ADMM includes a scalar hyperparameter, known as the penalty parameter, which usually has to be tuned to achieve satisfactory empirical convergence. In this work, we develop a framework for analyzing the ADMM algorithm applied to a quadratic problem as an affine fixed point iteration. Using this framework, we develop a new method for automatically tuning the penalty parameter by detecting when it has become too large or small. We analyze this and several other methods with respect to their theoretical properties, i.e., robustness to problem transformations, and empirical performance on several optimization problems. Our proposed algorithm is based on a theoretical framework with clear, explicit assumptions and approximations, is theoretically covariant/invariant to problem transformations, is simple to implement, and exhibits competitive empirical performance.

42 ENGINEERING↗
DOE OSTI2026

An Adaptive Multiparameter Penalty Selection Method for Multiconstraint and Multiblock ADMM

This work presents a new method for online selection of multiple penalty parameters for the alternating direction method of multipliers (ADMM) algorithm applied to optimization problems with multiple constraints or functions with block matrix components. ADMM is widely used for solving constrained optimization problems in a variety of fields, including signal and image processing. Implementations of ADMM often utilize a single hyperparameter, referred to as the penalty parameter, which needs to be tuned to control the rate of convergence. However, in problems with multiple constraints, ADMM may demonstrate slow convergence regardless of penalty parameter selection due to scale differences between constraints. Accounting for scale differences between constraints to improve convergence in these cases requires introducing a penalty parameter for each constraint. The proposed method is able to adaptively account for differences in scale between constraints, providing robustness with respect to problem transformations and initial selection of penalty parameters. It is also simple to understand and implement. Our numerical experiments demonstrate that the proposed method performs favorably compared to a variety of existing penalty parameter selection methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Event-to-Video Conversion for Overhead Object Detection

Collecting overhead imagery using an event camera is desirable due to the energy efficiency of the image sensor compared to standard cameras. However, event cameras complicate downstream image processing, especially for complex tasks such as object detection. In this paper, we investigate the viability of event streams for overhead object detection. We demonstrate that across a number of standard modeling approaches, there is a significant gap in performance between dense event representations and corresponding RGB frames. We establish that this gap is, in part, due to a lack of overlap between the event representations and the pre-training data that the object detectors were initially trained on through a number of experiments. Then, apply an off-the-shelf event-to-video conversion tool that converts event streams into gray-scale video to close this gap. We demonstrate that this approach results in a large performance increase, outperforming even event-specific object detection techniques on our overhead target task. These results suggest that better aligning event representations with existing large pre-trained models may result in greater short-term performance gains compared to end-to-end event-specific architectural improvements.

machine learning (ML), computer vision, Neuromorph↗
DOE OSTI2021

Quantitative order-parameter measurement in lattice-mismatched AlInP using precession electron diffraction

Precession electron diffraction (PED) was used to measure the long-range order parameter in lattice-mismatched AlInP epitaxial films under investigation for solid-state-lighting applications. Both double- and single-variant films grown at 620, 650, and 680°C were analyzed in TEM cross-section. PED patterns were acquired in selected-area-diffraction mode through external microscope control using serial acquisition, which allows inline image processing. The integrated peak intensities from experimental patterns were fit using dynamical simulations of diffraction from the ordered domain structures. Included in the structure-factor calculations were mean atomic displacements of the anions (P) due to ordering, which were found by valence-force-field calculations to have a nearly linear dependence on order parameter. A maximum order parameter of S = 0.36 was measured for a double-variant specimen grown at 650°C.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2023

OPEN leaf : an open‐source cloud‐based phenotyping system for tracking dynamic changes at leaf‐specific resolution in Arabidopsis

SUMMARY The first draft of the Arabidopsis genome was released more than 20 years ago and despite intensive molecular research, more than 30% of Arabidopsis genes remained uncharacterized or without an assigned function. This is in part due to gene redundancy within gene families or the essential nature of genes, where their deletion results in lethality (i.e., thedark genome). High‐throughput plant phenotyping (HTPP) offers an automated and unbiased approach to characterize subtle or transient phenotypes resulting from gene redundancy or inducible gene silencing; however, access to commercial HTPP platforms remains limited. Here we describe the design and implementation ofOPEN leaf, an open‐source phenotyping system with cloud connectivity and remote bilateral communication to facilitate data collection, sharing and processing.OPEN leaf, coupled with our SMART imaging processing pipeline was able to consistently document and quantify dynamic changes at the whole rosette level and leaf‐specific resolution when plants experienced changes in nutrient availability. Our data also demonstrate that VIS sensors remain underutilized and can be used in high‐throughput screens to identify and characterize previously unidentified phenotypes in a leaf‐specific time‐dependent manner. Moreover, the modular and open‐source design ofOPEN leafallows seamless integration of additional sensors based on users and experimental needs.

Plant Sciences↗
DOE OSTI2024

Terahertz time-domain spectroscopy imaging of pancreatic ductal adenocarcinoma tissues

Pancreatic ductal adenocarcinoma (PDAC) ranks among the malignancies with the highest fatality and morbidity rates. This is predominantly attributable to an absence of understanding the intricate and diverse microenvironment of the tumor. We use terahertz time-domain spectroscopy (THz-TDS) imaging in transmission geometry to probe ex-vivo the heterogenous microenvironment of the genetically modified murine PDAC tissue that closely resembles the PDAC heterogeneity in human malignancy. We introduced a maximum a-posteriori probability estimation algorithm to objectively the tumor’s heterogenous microenvironment using the average values of refractive index and absorption coefficient within the useable terahertz bandwidth as imaging markers. Furthermore, direct comparison of stained histopathologic images and the refractive index and the absorption coefficient high-resolution, two dimensional maps of the same PDAC samples confirms the high potential of the THz-TDS method for tumor tissue characterization.

absorption↗
DOE OSTI2025

Femtojoule optical nonlinearity for deep learning with incoherent illumination

Optical neural networks (ONNs) are a promising computational alternative for deep learning due to their inherent massive parallelism for linear operations. However, the development of energy-efficient and highly parallel optical nonlinearities, a critical component in ONNs, remains an outstanding challenge. Here, we introduce a nonlinear optical microdevice array (NOMA) compatible with incoherent illumination by integrating the liquid crystal cell with silicon photodiodes at the single-pixel level. We fabricate NOMA with more than half a million pixels, each functioning as an optical analog of the rectified linear unit at ultralow switching energy down to 100 femtojoules per pixel. With NOMA, we demonstrate an optical multilayer neural network. Our work holds promise for large-scale and low-power deep ONNs, computer vision, and real-time optical image processing.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Noise-Resilient and Reduced Depth Approximate Adders for NISQ Quantum Computing

The "Noisy intermediate-scale quantum" NISQ machine era primarily focuses on mitigating noise, controlling errors, and executing high-fidelity operations, hence requiring shallow circuit depth and noise robustness. Approximate computing is a novel computing paradigm that produces imprecise results by relaxing the need for fully precise output for error-tolerant applications including multimedia, data mining, and image processing. We investigate how approximate computing can improve the noise resilience of quantum adder circuits in NISQ quantum computing. We propose five designs of approximate quantum adders to reduce depth while making them noise-resilient, in which three designs are with carryout, while two are without carryout. We have used novel design approaches that include approximating the Sum only from the inputs (pass-through designs) and having zero depth, as they need no quantum gates. The second design style uses a single CNOT gate to approximate the SUM with a constant depth of O(1). We performed our experimentation on IBM Qiskit on noise models including thermal, depolarizing, amplitude damping, phase damping, and bitflip: (i) Compared to exact quantum ripple carry adder without carryout the proposed approximate adders without carryout have improved fidelity ranging from 8.34% to 219.22%, and (ii) Compared to exact quantum ripple carry adder with carryout the proposed approximate adders with carryout have improved fidelity ranging from 8.23% to 371%. Further, the proposed approximate quantum adders are evaluated in terms of various error metrics.

Gaur, Bhaskar↗
DOE OSTI2021

Multi-Energy Differential Evolution Reconstruction (MEnDER 1D) for Proton Deflectometry

This code is designed to reconstruct magnetic field deflections, and thus the path-integrated magnetic field, from sets of proton images at two distinct proton probe energies. A differential evolution (DE) algorithm is used to iteratively update a population of solution candidates of the magnetic deflections of the protons for reconstructing the input images, selecting improved candidates as they are discovered. This algorithm was written using MATLAB (R2019a) and makes use of the Image Processing and Parallel Processing Toolboxes.

Levesque, Joseph↗
DOE OSTI2024

FLIT: A Generic Fortran Library based on Interfaces and Templates

This Fortran code consists of multiple modules with a focus on simplifying array operations, image processing, and numerical computation especially for computational geophysics applications. We intend to use this code to demonstrate the application and usefulness of Fortran interface and templates for generic programming, especially for computational geophysics and seismology applications. The code has several notable features. Firstly, it is based on a modularized structure, where each module contains multiple functions but with a focus of functionality. Secondly, it heavily uses interfaces and templates for improving the genericness and convenience of the resulting code, where a same function interface can enclose a group of functions that perform the same functionality but with inputs/output variables of different data types. Thirdly, it includes a variety of generic functions with an emphasis on array operations, such as rotation, flipping, cropping, padding, fast Fourier transform, Gaussian blurring, interpolation, and so on. We name this package FLIP – a generic Fortran Library based on Interfaces and Templates.

Gao, Kai↗
DOE OSTI2021

The effect of transient needle lift on the internal flow and near-nozzle spray characteristics for modern GDI systems investigated by high-speed X-ray imaging

The development of the injector nozzle is a dynamic area in regard of several technical aspects. At first, the internal flow influences the near-field spray characteristics via various phenomena such as cavitation and turbulence. However, these phenomena are not fully understood due to their extremely fast, complex and multiscale nature. Furthermore, it governs the spray targeting inside the combustion chamber. High-speed X-ray imaging of GDI injector nozzles is performed in this study. The experimental results presented are related to the internal flow and primary breakup of discharged liquid jets. The injectors used are equipped with nozzles made of aluminum which have been specially developed for these investigations to enhance optical accessibility. The visualization of the needle motion, in-nozzle flow and the primary breakup region provides several exciting observations. First, the needle lift tracking exhibits short overshooting right before the steady-state of the injection phase. Additionally, this event leads to a short-term, however, significant change in the associated performance of the breakup. This phenomenon is found to be a consequence of the transient behavior of the in-nozzle flow. It is shown that under some circumstances hydraulic flip may occur during this overshooting period. The primary jet breakup region is visualized and evaluated by means of image processing. Thus, the transient behavior of liquid jet expansion is quantified in the vicinity of the nozzle. It is observed that the liquid jet direction deviates from the hole axis already at the nozzle outlet, which is caused by internal flow characteristics.

42 ENGINEERING↗
DOE OSTI2022

LiDAR-based aboveground biomass changes data of tropical montane forest in Borneo

Anthropogenic activities are increasingly impacting the carbon storage of tropical montane forests. We employed airborne LiDAR data to estimate the aboveground biomass (AGB) changes at high resolution in a human-modified tropical montane forest in northern Borneo. The data package consists of LiDAR-based AGB changes at 1m resolution in GeoTIFF format, a table of field and estimated AGB changes at plot level and a shape file of the plots’ coordinates. The raster data (GeoTIFF) at 1 m resolution covers two study sites (site 1: 2.67 km x 8 km; site 2: 2 km x 8 km). The GeoTIFF and shape files can be read using any GIS or image processing software. The dataset can be utilized to deepen our understanding of the carbon storage of tropical montane forests, establish reference values for Southeast Asian tropical montane forests, guide forest resource managers on rehabilitation strategies and further research on the impacts of anthropogenic land use activities.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Data from: "Moisture rivals temperature in limiting photosynthesis by trees establishing beyond their cold-edge range limit under ambient and warmed conditions"

This archive contains data files that were used to draw conclusions in “Moisture rivals temperature in limiting photosynthesis by trees establishing beyond their cold-edge range limit under ambient and warmed conditions”, by Moyes et al., 2015. All field research was completed in common garden plots set up as part of the Alpine Treeline Warming Experiment (ATWE) on Niwot Ridge, Colorado, USA.There are two main data file formats in this archive: comma-separated values (.csv), and Microsoft Excel (.xls and .xlsx). .xlsx files can be read using Microsoft Excel and Google Sheets, and .csv files can be read using any simple text editor program, such as TextEdit (Mac) and Notepad (Windows). This .pdf data user’s guide can be read using Adobe Acrobat Reader, or any other compatible software. Seedling photographs and their corresponding leaf area-processed images are available in .jpg/.JPG image format, and can be opened using Preview (Mac) and Photos (Windows). To provide additional spatial context, two types of geospatial files are also published in this data package: ESRI shapefiles (.shp) and .kml files. Shapefiles are compatible with any GIS software able to read the file type (such as QGIS or ESRI’s ArcGIS suite), and .kml files can be opened with Google Earth or Google Maps. Figures 3 and 4 in the publication contain data from Moyes et al. 2013. This publication is cited in the References section in this archive, and data files can be accessed via the Alpine Treeline Warming Experiment project portal on ESS-DIVE. ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Climate change is altering plant species distributions globally, and warming is expected to promote uphill shifts in mountain trees. However, at many cold-edge range limits, such as alpine treelines in the western United States, tree establishment may be colimited by low temperature and low moisture, making recruitment patterns with warming difficult to predict.- We measured response functions linking carbon (C) assimilation and temperature- and moisture-related microclimatic factors for limber pine (Pinus flexilis) seedlings growing in a heating × watering experiment within and above the alpine treeline. We then extrapolated these response functions using observed microclimate conditions to estimate the net effects of warming and associated soil drying on C assimilation across an entire growing season.- Moisture and temperature limitations were each estimated to reduce potential growing season C gain from a theoretical upper limit by 15–30% (c. 50% combined). Warming above current treeline conditions provided relatively little benefit to modeled net assimilation, whereas assimilation was sensitive to either wetter or drier conditions.- Summer precipitation may be at least as important as temperature in constraining C gain by establishing subalpine trees at and above current alpine treelines as seasonally dry subalpine and alpine ecosystems continue to warm.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Resonant Frequency Derived from the Rayleigh-Wave Dispersion Image: The High-Impedance Boundary Problem

In this work, we present a simple and automated approach to estimate primary site-response resonance, layer thickness, and shear-wave velocity directly from a dispersion image for a layer over half-space problem. We demonstrate this for high-impedance boundary conditions that lie in the upper tens of meters. Our approach eliminates the need for time-consuming dispersion curve picking and 1D shear-wave velocity inversion for large data volumes that can capture velocity structure in profile. We highlight important relationships between dispersion characteristics and resonance parameters through synthetic modeling and field data acquired over Atlantic Coastal Plain sediments. In this environment, shallow soil conditions are critical to accurately estimate earthquake site response. We suggest that this image processing approach can be applied to a range of high-impedance conditions, at a range of scales, or can provide model constraints for more complex velocity structures.

58 GEOSCIENCES↗
DOE OSTI2020

AI Denoising to Accelerate Detector Simulation

Detector simulation is critical to experimental HEP; however this simulation (commonly done through toolkits such as Geant4) is computationally intensive. Performance can be improved somewhat through technical optimization, but more is needed. Using machine learning (ML) to accelerate simulation is a promising field, however efforts to use generative adversarial networks (GANs) or optimized autoencoders have faced issues. Using convolutional neural networks (CNNs) for denoising has been successful in non-HEP applications such as image processing. This poster investigates the efficacy of using CNNs to denoise Geant4 simulations. This could increase the accuracy of simulations performed under settings designed to increase computational efficiency.

Franklin, Lena↗
DOE OSTI2020

CENC PSN VOID FY20 Report

Maritime trade accounts for approximately 80 percent of international commerce. The high volume of vessels traversing domestic and international ports makes port areas prime targets for terrorism as well as illegal trafficking of drugs and arms (conventional or nuclear). Port security is therefore a worldwide concern affecting global economies, freedom of movement, and national security. However, extensive port monitoring is inherently complex and time consuming — making it truly viable only via an automated framework that can detect potential illicit activity and alert authorities in a timely manner. The development of image processing algorithms for this purpose requires access to large, labeled datasets that cover the breadth of targets of interest as well as the environments that they are observed within. Curated and labeled datasets of this nature are of enormous value to Sandia's Defense Nuclear Nonproliferation and National Security Program portfolios, as well as to Sandia's machine learning/automatic target recognition (ML/ATR) algorithm development and R&D communities. The goal of this project is to create a commercial satellite imagery dataset of labeled maritime vessels in port areas to support the development of ML/ATR algorithms for port security nonproliferation purposes. This dataset — Port Security Nonproliferation Vessel Overhead Imagery Dataset (PSN VOID) — has the potential to support a variety of other ancillary missions, such as maritime domain awareness, domestic and international security, drug interdiction, and weapons trafficking.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗