Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image sensors”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

A Machine Learning Approach to the Detection of Ghosting Artifacts in Dark Energy Survey Images

Unwanted artifacts that often plague astronomical images arise from a number of sources that include imperfect optics, faulty image sensors, cosmic ray hits, and even airplanes and satellites. One major source that is dicult to avoid is known as ghosting, and is caused by the scattering and internal reflections of light o of the telescope’s mechanical and optical components. Detecting ghosting artifacts eciently in the large cosmological surveys that will acquire petabytes of data can be a daunting task. In this paper, we use data from the Dark Energy Survey to develop, train, and validate a machine learning model to detect ghosts based on convolutional neural networks. The model architecture and training procedure is discussed in detail, and the performance on the training and validation set presented. Testing is performed on data and results are compared with those from a ray-tracing algorithm. A proof-of-principle is demonstrated that shows promise for Stage IV surveys and beyond.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2025

Estimation of cutting tool wear using an elastomeric tactile sensor

Machining performance of cutting tools and part quality are affected by the geometric condition of the cutting edge, which is influenced by thermomechanical loads experienced during the process. Tool condition monitoring (TCM) systems provide insight for timely replacement of cutting tools. However, existing TCM systems are expensive and require specialized equipment or sensors, hindering widespread adoption. A novel TCM system is developed herein using an elastomeric tactile sensor. Sensor images of the cutting edge are used to quantify wear using two distinct algorithms. In the first algorithm, the unworn and worn edges are identified based on Canny edge detect. In the second, the unworn edge is identified using edge detection while the region of wear is identified using a relative intensity method. In both cases, the maximum wear width is calculated based on an experimentally determined pixel to-physical distance scale. The TCM system is first used to estimate flank wear on a solid carbide helical end mill before evaluating its robustness by employing it to estimate insert wear of an indexable helical end mill. Measurements are also performed manually using an optical microscope and a high-resolution focus variation microscope for verification. The novel technique estimates flank wear in the solid carbide tool with a high accuracy of 98%. Larger discrepancies are observed for the inserts, however, with overlapping uncertainties. In conclusion, the technique shows promise in adaptability, automation, and closed loop control of machine tools.

Machining↗
DOE OSTI2020

Plant science decadal vision 2020–2030: Reimagining the potential of plants for a healthy and sustainable future

Abstract Plants, and the biological systems around them, are key to the future health of the planet and its inhabitants. The Plant Science Decadal Vision 2020–2030 frames our ability to perform vital and far‐reaching research in plant systems sciences, essential to how we value participants and apply emerging technologies. We outline a comprehensive vision for addressing some of our most pressing global problems through discovery, practical applications, and education. The Decadal Vision was developed by the participants at the Plant Summit 2019, a community event organized by the Plant Science Research Network. The Decadal Vision describes a holistic vision for the next decade of plant science that blends recommendations for research, people, and technology. Going beyond discoveries and applications, we, the plant science community, must implement bold, innovative changes to research cultures and training paradigms in this era of automation, virtualization, and the looming shadow of climate change. Our vision and hopes for the next decade are encapsulated in the phrase reimagining the potential of plants for a healthy and sustainable future. The Decadal Vision recognizes the vital intersection of human and scientific elements and demands an integrated implementation of strategies for research (Goals 1–4), people (Goals 5 and 6), and technology (Goals 7 and 8). This report is intended to help inspire and guide the research community, scientific societies, federal funding agencies, private philanthropies, corporations, educators, entrepreneurs, and early career researchers over the next 10 years. The research encompass experimental and computational approaches to understanding and predicting ecosystem behavior; novel production systems for food, feed, and fiber with greater crop diversity, efficiency, productivity, and resilience that improve ecosystem health; approaches to realize the potential for advances in nutrition, discovery and engineering of plant‐based medicines, and "green infrastructure." Launching the Transparent Plant will use experimental and computational approaches to break down the phytobiome into a "parts store" that supports tinkering and supports query, prediction, and rapid‐response problem solving. Equity, diversity, and inclusion are indispensable cornerstones of realizing our vision. We make recommendations around funding and systems that support customized professional development. Plant systems are frequently taken for granted therefore we make recommendations to improve plant awareness and community science programs to increase understanding of scientific research. We prioritize emerging technologies, focusing on non‐invasive imaging, sensors, and plug‐and‐play portable lab technologies, coupled with enabling computational advances. Plant systems science will benefit from data management and future advances in automation, machine learning, natural language processing, and artificial intelligence‐assisted data integration, pattern identification, and decision making. Implementation of this vision will transform plant systems science and ripple outwards through society and across the globe. Beyond deepening our biological understanding, we envision entirely new applications. We further anticipate a wave of diversification of plant systems practitioners while stimulating community engagement, underpinning increasing entrepreneurship. This surge of engagement and knowledge will help satisfy and stoke people's natural curiosity about the future, and their desire to prepare for it, as they seek fuller information about food, health, climate and ecological systems.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2025

Semiconductor-compatible topological digital alloys

Recently, GeSn alloys have attracted much interest for direct-gap infrared photonics and as potential topological materials which are compatible with the semiconductor industry. However, for photonics, the high-Sn content required leads to low detectivity, associated with poor material quality, and the (>35 %) Sn required for topological properties have been out of reach experimentally. Here, we demonstrate that by patterning the Sn distribution within Ge, the electronic properties have a far greater tunability than is possible with the random alloy. For the GeSn δ-digital alloy (DA) formed by confining Sn atoms in atomic layer(s) along the [111] direction of Ge, we show that ∼ 10 % Sn can lead to a triple-point semimetal. These findings are understood in terms of Sn ordering causing spatial separation of Sn and Ge band edges, leading to band inversion. This mechanism can also lead to a weak topological insulator, Weyl semimetal, and enables tunable direct bandgaps down to 2 meV, covering the entire infrared range. This DA induced topological properties are also identified in compound semiconductors, such as InAs 1-x Sb x , showing the general applicability of the DA design for realizing topological properties on conventional semiconductor platforms. Furthermore, our findings not only point to a new class of currently unexplored topological systems accessible by epitaxy, but also establish the promise of low-Sn GeSn DAs for application as infrared laser diodes and photodetectors in Si photonic integrated circuits and infrared image sensors.

3D topological semimetal↗
DOE OSTI2025

Gate-Tunable Short-Wave Infrared Polycrystalline GeSn Phototransistors on Noncrystalline Substrates

GeSn is a group-IV alloy with immense potential to advance microelectronics technology due to its intrinsic compatibility with existing Si CMOS processes. With a sufficiently high Sn composition, GeSn is classified as a direct bandgap semiconductor. Polycrystalline GeSn holds several additional advantages, including its significantly lower synthesis cost compared to its epitaxial counterpart, as well as the versatility to grow these films on a variety of substrates. Here, in this work, we present a polycrystalline thin-film GeSn phototransistor on a fused silica substrate with a Sn composition of ~10%, showing a photoresponse in the short-wave infrared wavelength range, critical for emerging sensing applications. This device shows a gate-tunable response, with responsivities approaching up to 1.7 mA/W with only a 30 nm-thick GeSn layer. Furthermore, phototransistors offer additional adaptability through gating, which allows for the reduction of dark current. This not only enhances the signal-to-noise ratio but also offers more flexible integration with various image sensor readout implementations using different substrates. The specific detectivity of this phototransistor is within an order of magnitude of those of previously reported GeSn photodetectors grown by molecular beam epitaxy and chemical vapor deposition, even though the absorber is 3 to 20× thinner while the electrode spacing for photocarrier transport is approximately 15× longer than the carrier diffusion length in this work, showing great potential benefits of extending similar device structures to epitaxial GeSn layers. As these GeSn phototransistors utilize a noncrystalline substrate, our work establishes a fundamentally more versatile path toward monolithically integrated GeSn-based photodetectors for next-generation multimodal sensors.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Changes to the Appearance of Optical Lightning Flashes Observed From Space According to Thunderstorm Organization and Structure

Optical lightning observations from space reveal a wide range of flash structure. Lightning imagers such as the Geostationary Lightning Mapper and Lightning Imaging Sensor measure flash appearance by recording transient changes in cloud top illumination. The spatial and temporal optical energy distributions reported by these instruments depend on the physical structure of the flash and the distribution of hydrometeors within the thundercloud that scatter and absorb the optical emissions. This study reported herein explores how flash appearance changes according to the scale and organization of the parent thunderstorms with a focus on mesoscale convective systems. Clouds near the storm edge are frequently illuminated by large optical flashes that remain stationary between groups. These flashes appear large because their emissions can reflect off the exposed surfaces of nearby clouds to reach the satellite. Large stationary flashes also occur in small isolated thunderstorms. Optical flashes that propagate horizontally, meanwhile, are most frequently observed in electrified stratiform regions where extensive layered charge structures promote lateral development. Highly radiant “superbolts” occur in two scenarios: embedded within raining stratiform regions or in nonraining boundary/anvil clouds where optical emissions can take a relatively clear path to the satellite.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

A Global LIS/OTD Climatology of Lightning Flash Extent Density

Previous lightning climatologies derived from Lightning Imaging Sensor (LIS) and Optical Transient Detector (OTD) total lightning measurements have quantified lightning frequency as a Flash Rate Density (FRD). This approach assumes that lightning flashes can be represented as points and quantifies the frequency of lightning centered in each grid cell. However, lightning has a finite extent that can reach hundreds of kilometers. A new climatology based on Flash Extent Density (FED) is constructed for LIS (including ISS-LIS) and OTD that accounts for the horizontal dimension of lightning. The FED climatology documents the frequency that an observer can expect lightning to be visible overhead—regardless of where the flash began or ended. This new FED climatology confirms and elaborates on the previous global LIS/OTD FRD and Americas-only Geostationary Lightning Mapper (GLM) findings. The FED climatology maintains Lake Maracaibo as the global lightning hotspot with an average of 389 flashes/day but designates Karabre in the Democratic Republic of the Congo as the global thunderstorm duty (percent of the total viewtime where lightning is observed) hotspot at 7.29%. Meanwhile, Kuala Lumpur is the national capital city with the most lightning, and its airport (KUL) is the top major airport affected by lightning (in terms of duty). The FED seasonal cycle and month-to-month changes in the “center of lightning” for the three continental chimney regions are also discussed.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Landsat 8 monitoring of multi-depth suspended sediment concentrations in Lake Erie’s Maumee River using machine learning

Satellite remote sensing has been widely used to map suspended sediment concentration (SSC) in waterbodies. However, due to the complexity of sediment-water interactions, it has been difficult to derive linear and non-linear regression equations to reliably predict SSC, especially when trying to estimate depth of integrated sediment. Herein, this study uses Landsat 8 OLI (Operational Land Imager) sensor to map SSC within the Maumee River in Ohio, USA, at multiple depth intervals (15, 61, 91, and 182 cm). Simple linear least squares regression (LLSR), and three common machine learning models: random forest (RF), support vector regression (SVR), and model averaged neural network (MANN) were used to estimate SSC at the depth intervals. All machine learning models significantly outperformed LLSR while RF performed the best. In both RF and MANN, R2 (coefficient of determination) increases with depth with a maximum R2 of 0.89 and 0.83, respectively, at a depth of 0–182 cm. The results show that machine learning models can implement nonlinear relationships that produce better predictions than traditional linear regression methods in estimating depth integrated SSC, especially when samples are limited.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Software for High-Resolution Flood Mapping With Sentinel-1 and Sentinel-2 via Misalignment-Robust Cross-Sensor Learning and Generative Despeckling

SF-26-078 This software provides a high-level workflow for satellite-based flood and surface-water mapping using Sentinel-1 SAR and Sentinel-2 multispectral imagery. It supports preparation of remote-sensing data, training and evaluation of deep-learning models, and generation of high-resolution water extent predictions, including methods to improve robustness to SAR speckle noise and cross-sensor image misalignment.

Feinstein, Jeremy [Argonne National Laboratory (AN↗
DOE OSTI2025

Massively parallel and universal approximation of nonlinear functions using diffractive processors

Nonlinear computation is essential for a wide range of information processing tasks, yet implementing nonlinear functions using optical systems remains a challenge due to the weak and power-intensive nature of optical nonlinearities. Overcoming this limitation without relying on nonlinear optical materials could unlock unprecedented opportunities for ultrafast and parallel optical computing systems. Here, we demonstrate that large-scale nonlinear computation can be performed using linear optics through optimized diffractive processors composed of passive phase-only surfaces. In this framework, the input variables of nonlinear functions are encoded into the phase of an optical wavefront—e.g., via a spatial light modulator (SLM)—and transformed by an optimized diffractive structure with spatially varying point-spread functions to yield output intensities that approximate a large set of unique nonlinear functions–all in parallel. We provide proof establishing that this architecture serves as a universal function approximator for an arbitrary set of bandlimited nonlinear functions, also covering wavelength-multiplexed nonlinear functions as well as multi-variate and complex-valued functions that are all-optically cascadable. Our analysis also indicates the successful approximation of typical nonlinear activation functions commonly used in neural networks, including the sigmoid, tanh, ReLU (rectified linear unit), and softplus. We numerically demonstrate the parallel computation of one million distinct nonlinear functions, accurately executed at wavelength-scale spatial density at the output of a diffractive optical processor. Furthermore, we experimentally validated this framework using in situ optical learning and approximated 35 unique nonlinear functions in a single shot using a compact setup consisting of an SLM and an image sensor. These results establish diffractive optical processors as a scalable platform for massively parallel universal nonlinear function approximation, paving the way for new capabilities in analog optical computing based on linear materials.

Rahman, Md Sadman Sakib [University of California,↗
DOE OSTI2025

Content-aware foveated camera for multi-target tracking

Modern image sensors deliver substantial space-time bandwidth, yet indiscriminate acquisition often overwhelms memory, computation, and downstream perception. We present a content-aware, multi-foveated camera that dynamically reallocates sensing and magnification to multiple regions of interest (ROIs). A phase-only spatial light modulator (SLM) serves as a solid-state, inertia-free beam-steering and lens element, enabling per-frame field-of-view (FOV) reconfiguration and content-aware target tracking. By interleaving frames across foveae, our system preserves a wide-FOV situational context while refreshing each ROI at high rates, thereby reducing data volume without degrading task performance. We constructed a prototype employing a single-SLM, single-sensor architecture and demonstrated its application in real-time multi-object tracking with dynamic ROI maintenance across multiple viewpoints. The approach offers a general pathway to integrate detection, tracking, and segmentation algorithms in the acquisition loop, shifting workload from post hoc processing to intelligent capture.

Zang, Zihan [Univ. of California, Los Angeles, CA ↗
DOE OSTI2024

Field-resolved space–time characterization of few-cycle structured light pulses

Accompanied by the rapid development of ultrafast laser platforms in recent decades, the spatiotemporal manipulation of ultrashort laser pulses has attracted much attention due to the potential for cutting-edge applications of structured light, including optical tweezers, optical communications, super-resolution imaging, time-resolved spectroscopy in molecules and quantum materials, and strong-field physics. Today, techniques capable of characterizing the full spatial, temporal, and polarization state properties of structured light are strongly desired. Here, we demonstrate a technique, termed 3D TIPTOE, for characterizing structured mid-infrared waveforms, which uses only a two-dimensional silicon-based image sensor as both the detector and the nonlinear medium. By combining the advantages of the sub-cycle time resolution afforded by nonlinear excitation and the spatial resolution inherent to the two-dimensional sensor, the 3D TIPTOE technique allows full characterization of structured electric fields, significantly reducing the complexity of detection compared to other techniques. The validity of the technique is established by measuring both few-cycle Bessel–Gaussian pulses and radially polarized femtosecond vector beams.

Liu, Yangyang (ORCID:0000000335205332)↗
DOE OSTI2024

Imaging Enhanced Simulation Validation for Directed Energy Deposition Additive Manufacturing (Final CRADA Report – NFE-22-09107)

Directed Energy Deposition (DED) is a welding-based metal Additive Manufacturing (AM) process that relies on the programmed rastering of an electric arc or laser induced weld pool to construct a component in a layerwise fashion. The induced complex thermal field and uneven thermal contraction depends on the printed geometry and scan pattern, and as such, accumulated residual stresses and distortions are complex and difficult to predict. Several prior works have resulted in tools to combat this issue; ANSYS has developed a thermoplastic simulation package targeting DED AM, and ORNL has developed an in-situ imaging sensor package ‘Stereo Correlated Optical and Pyrometric System’ (SCOPS) that can spatially monitor temperature and full field strain. In this CRADA, these tools are compared in order to validate the results and complimentarily address the weaknesses in each other.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Di-CNN: Domain-Knowledge-Informed Convolutional Neural Network for Manufacturing Quality Prediction

In manufacturing, convolutional neural networks (CNNs) are widely used on image sensor data for data-driven process monitoring and quality prediction. However, as purely data-driven models, CNNs do not integrate physical measures or practical considerations into the model structure or training procedure. Consequently, CNNs’ prediction accuracy can be limited, and model outputs may be hard to interpret practically. This study aims to leverage manufacturing domain knowledge to improve the accuracy and interpretability of CNNs in quality prediction. A novel CNN model, named Di-CNN, was developed that learns from both design-stage information (such as working condition and operational mode) and real-time sensor data, and adaptively weighs these data sources during model training. It exploits domain knowledge to guide model training, thus improving prediction accuracy and model interpretability. A case study on resistance spot welding, a popular lightweight metal-joining process for automotive manufacturing, compared the performance of (1) a Di-CNN with adaptive weights (the proposed model), (2) a Di-CNN without adaptive weights, and (3) a conventional CNN. The quality prediction results were measured with the mean squared error (MSE) over sixfold cross-validation. Model (1) achieved a mean MSE of 6.8866 and a median MSE of 6.1916, Model (2) achieved 13.6171 and 13.1343, and Model (3) achieved 27.2935 and 25.6117, demonstrating the superior performance of the proposed model.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Integrated telescope for imaging applications

Integrated telescopes are described that are stable and compact, and include optics pieces that are susceptible to stray light. One example telescope includes an optics piece formed of a transparent optical material and two surfaces with each surface including a reflector surface and a baffle. The baffles may be formed in a groove in one of the surfaces of the optics piece. The baffle may have an index of refraction that is approximately the same as an index of refraction of the optics piece. The baffle may include a blackened epoxy, a carbon black material, or a powdered black spinel. The integrated telescope may include a short-wave infrared image sensor fixed in position relative to the optics piece.

Bauman, Brian↗
DOE OSTI2024

Time resolved X-ray diffraction using the FIDDLE diagnostic at NIF: Preliminary assessment of diffraction precision

The Flexible Imaging Diffraction Diagnostic for Laser Experiments (FIDDLE) is a new diagnostic at the National Ignition Facility (NIF) designed to observe in situ solid-solid phase changes at high pressures using time resolved X-ray diffraction. FIDDLE currently incorporates five Icarus Ultrafast X-ray Imager sensors that take 2 ns snapshots and can be tuned to collect X-rays for tens of ns. The platform utilizes the laser power at NIF for both the laser drive and the generation of 10 keV X-rays for ~10 ns using a Ge backlighter foil. We aim to use FIDDLE to observe diffraction at different times during compression to probe the kinetics of phase changes. Pb undergoes two solid-solid phase transitions during ramp compression: from FCC to HCP and HCP to BCC. Results will be reported on some of the first shots using the FIDDLE diagnostic at NIF on ramp compressed Pb to a peak pressure of ~110 GPa and a single undriven CeO2 calibration shot. A discussion of the uncertainties in the observed diffraction is included.

Vennari, C. E.↗
DOE OSTI2026

Alpha-Imaging Detector System Development for Large Area Monitoring

Effective management and disposal of legacy nuclear waste are essential for ensuring safe work environments and minimizing environmental impacts. Monitoring airborne actinide contamination is particularly critical due to the high internal dose potential of alpha-emitting radionuclides. Traditional continuous air monitoring systems (CAMs) used in the industry are limited in the volume of air they can sample, potentially leading to inaccurate radiation detection over large areas. For example, in 2018, elevated levels of airborne Plutonium-239 were detected beyond the controlled areas of the Hanford Plutonium Finishing Plant, highlighting the potential risks to both plant workers and nearby residents. To address these challenges, high-efficiency particulate absorbing (HEPA) air purifiers can enhance air flow by up to 1.5 orders of magnitude, thereby increasing monitoring efficiency and providing a cost-effective solution for large-area surveillance. To quantify the activities of alpha-emitting radionuclides on HEPA filters, the Savannah River National Laboratory is developing an advanced alpha-imaging detection system. This system includes scintillating materials combined with a digital scientific camera. A significant concern in operating such a large-area airborne monitoring system is the handling of HEPA filters, which may be contaminated with radioactive particles. To mitigate these hazards, it is crucial to ensure that any contamination is securely fixed onto the filters. Efforts have been made to optimize the sensitivity of scintillator-epoxy composites and apply them to HEPA filters. These materials were characterized using fluoroscence spectroscopy. These techniques confirmed the purity of the raw materials, the dispersion of scintillators in the epoxy matrix, and the stability of their optical and structural properties post-modification. The optimal scintillator-epoxy composite was selected for use on alpha-spiked HEPA filters to evaluate the efficiency of the sprayer. HEPA filters, embedded with alpha particles collected by an air purifier deployed in an airborne radiation area, have been tested to assess detection efficiency. Future work will focus on employing multiple imaging sensors simultaneously to enhance sensitivity across different regions of the HEPA filter.

Pham, Phuong [Savannah River National Laboratory (↗
DOE OSTI2022

Microbial sensor system for monitoring and imaging of an environment

A microbial sensor, microbial sensing system, and method that can be used to determine the chemical environment of unsaturated soils, rhizosphere, and/or plants are disclosed. The microbial sensing system can be used for monitoring the health of plants including nutrients, salinity, contaminants, chemicals (pesticides, herbicides) and diseases. A microbial sensing system can include one or more indicator electrodes and a reference electrode. The microbial sensing system can include a signal acquisition and/or communication module to allow the real-time collection of data from field deployments and laboratory investigations.

Burge, Scott R.↗