Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image Sensor”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

ResSR: A Computationally Efficient Residual Approach to Super-Resolving Multispectral Images

Multispectral imaging (MSI) plays a critical role in material classification, environmental monitoring, and remote sensing. However, MSI sensors typically have wavelength-dependent resolution, which limits downstream analysis. MSI super-resolution (MSI-SR) methods address this limitation by reconstructing all bands at a common high spatial resolution. Existing methods can achieve high reconstruction quality but often rely on spatially-coupled optimization or large learning-based models, leading to significant computational cost and limiting their use in large-scale or time-critical settings. In this paper, we introduce ResSR, a computationally efficient, model-based MSI-SR method that achieves high-quality reconstruction without supervised training or spatially-coupled optimization. Notably, ResSR decouples spectral and spatial processing into two sequential steps. ResSR first computes a spectrally-informed high-resolution estimate of the MSI using singular value decomposition together with a spatially-decoupled approximate forward model. It then applies a residual correction step to restore low-frequency spatial consistency while preserving high-frequency detail recovered by the spectral reconstruction. ResSR achieves comparable or improved reconstruction quality relative to existing MSI-SR methods while being

Sullivan, Haley [ORNL] (ORCID:0000000274069217)↗

WHYMSIE-SGP Field Campaign Report

Through a partnership between the U.S. National Aeronautics and Space Administration (NASA) and the National Oceanic and Atmospheric Administration (NOAA), this field campaign demonstrated first-of-its-kind hyperspectral microwave airborne measurements (Conical Scanning Millimeter-wave Imaging Radiometer [CoSMIR-H]). It was complemented by other passive (infrared, visible) and active (lidar) sensors onboard the NASA ER-2 aircraft. Serving as a future NASA planetary boundary-layer (PBL) mission prototype, the Westcoast and Heartland Hyperspectral Microwave Intensive Experiment (WH 2 yMSIE, formerly WHyMSIE) aimed to capture a wide variety of thermodynamic, moisture, and PBL regimes across a variety of surface types. The intensive operating period of the campaign spanned from October 22, 2024, through November 15, 2024, and included a large network of collaborators.

54 ENVIRONMENTAL SCIENCES↗

Using Fiducial Markers for Pose Estimation of an OSWEC in a Wave Tank: Preprint

In this study, we consider a novel method of sensing the motion of a wave energy converter during testing in a wave flume under the influence of incoming waves. The wave energy converter considered in our research is an oscillating surge wave energy converter, which is a hinged paddle that responds to incoming waves. Motion sensing is normally done with inertial sensors, which can hinder the motion due to suspended cables that carry power and transmit signals. Our proposed method is contactless and can be implemented economically. A camera is used to record different marker patterns affixed to the moving paddle and the motion deduced by pose estimation algorithms. Fiducial markers are commonly used for robot localization and in augmented reality. There are many types of fiducial markers, including ArUco-type markers which are accurate, fast and robust. The system consists of markers attached to the paddle element and recorded using a machine vision camera. A pose estimation algorithm is then applied to the detected markers to estimate the tilt of the paddle. In this work, we examine the challenges of image acquisition and calibration for underwater targets, compare the motion obtained by this new system with a calibrated tilt sensor and identify areas where the new system may be superior.

computer vision↗

A modular chemigenetic calcium indicator for multiplexed in vivo functional imaging

Abstract Genetically encoded fluorescent calcium indicators allow cellular-resolution recording of physiology. However, bright, genetically targetable indicators that can be multiplexed with existing tools in vivo are needed for simultaneous imaging of multiple signals. Here we describe WHaloCaMP, a modular chemigenetic calcium indicator built from bright dye-ligands and protein sensor domains. Fluorescence change in WHaloCaMP results from reversible quenching of the bound dye via a strategically placed tryptophan. WHaloCaMP is compatible with rhodamine dye-ligands that fluoresce from green to near-infrared, including several that efficiently label the brain in animals. When bound to a near-infrared dye-ligand, WHaloCaMP shows a 7× increase in fluorescence intensity and a 2.1-ns increase in fluorescence lifetime upon calcium binding. We use WHaloCaMP1a to image Ca 2+ responses in vivo in flies and mice, to perform three-color multiplexed functional imaging of hundreds of neurons and astrocytes in zebrafish larvae and to quantify Ca 2+ concentration using fluorescence lifetime imaging microscopy (FLIM).

Biochemistry & Molecular Biology↗

Persistent global greening over the last four decades using novel long-term vegetation index data with enhanced temporal consistency

Advanced Very High-Resolution Radiometer (AVHRR) satellite observations have provided the longest global daily records from 1980s, but the remaining temporal inconsistency in vegetation index datasets has hindered reliable assessment of vegetation greenness trends. To tackle this, we generated novel global long-term Normalized Difference Vegetation Index (NDVI) and Near-Infrared Reflectance of vegetation (NIRv) datasets derived from AVHRR and Moderate Resolution Imaging Spectroradiometer (MODIS). We addressed residual temporal inconsistency through three-step post processing including cross-sensor calibration among AVHRR sensors, orbital drifting correction for AVHRR sensors, and machine learning-based harmonization between AVHRR and MODIS. After applying each processing step, we confirmed the enhanced temporal consistency in terms of detrended anomaly, trend and interannual variability of NDVI and NIRv at calibration sites. Our refined NDVI and NIRv datasets showed a persistent global greening trend over the last four decades (NDVI: 0.0008 yr -1 ; NIRv: 0.0003 yr -1 ), contrasting with those without the three processing steps that showed rapid greening trends before 2000 (NDVI: 0.0017 yr -1 ; NIRv: 0.0008 yr -1 ) and weakened greening trends after 2000 (NDVI: 0.0004 yr -1 ; NIRv: 0.0001 yr -1 ). These findings highlight the importance of minimizing temporal inconsistency in long-term vegetation index datasets, which can support more reliable trend analysis in global vegetation response to climate changes.

54 ENVIRONMENTAL SCIENCES↗

Electronic structure orientation as a map of in-plane antiferroelectricity in β'-In 2 Se 3

Antiferroelectric (AFE) materials are excellent candidates for sensors, capacitors, and data storage due to their electrical switchability and high-energy storage capacity. However, imaging the nanoscale landscape of AFE domains is notoriously inaccessible, which has hindered development and intentional tuning of AFE materials. Here, we demonstrate that polarization-dependent photoemission electron microscopy can resolve the arrangement and orientation of in-plane AFE domains on the nanoscale, despite the absence of a net lattice polarization. Through direct determination of electronic transition orientations and analysis of domain boundary constraints, we establish that antiferroelectricity in β'-In 2 Se 3 is a robust property from the scale of tens of nanometers to tens of micrometers. Ultimately, the method for imaging AFE domain organization presented here opens the door to investigations of the influence of domain formation and orientation on charge transport and dynamics.

36 MATERIALS SCIENCE↗

Tesla Model 3 Autopilot On-road Data

This dataset encompasses about 60 individual drives of a 2020 Tesla Model 3 with Autopilot in its relevant operational domain covering more than 1,000 miles. The majority of the data was collected during highway and suburban driving. Information collected includes vehicle CAN data as well as Lidar and camera data from a vehicle mounted sensor array. Vehicle CAN data and information on traffic surrounding the Ego-vehicle derived from the sensor array are postprocessed and merged to provide one combined CVS data file per drive. ![tesla m3 image](tesla-m3.png)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Fourier-based three-dimensional multistage transformer for aberration correction in multicellular specimens

High-resolution tissue imaging is often compromised by sample-induced optical aberrations that degrade resolution and contrast. Although wavefront sensor-based adaptive optics (AO) can measure these aberrations, such hardware solutions are typically complex, expensive to implement and slow when serially mapping spatially varying aberrations across large fields of view. Here we introduce AOViFT (adaptive optical vision Fourier transformer)—a machine learning-based aberration sensing framework built around a three-dimensional multistage vision transformer that operates on Fourier domain embeddings. AOViFT infers aberrations and restores diffraction-limited performance in puncta-labeled specimens with substantially reduced computational cost, training time and memory footprint compared to conventional architectures or real-space networks. We validated AOViFT on live gene-edited zebrafish embryos, demonstrating its ability to correct spatially varying aberrations using either a deformable mirror or postacquisition deconvolution. By eliminating the need for the guide star and wavefront sensing hardware and simplifying the experimental workflow, AOViFT lowers technical barriers for high-resolution volumetric microscopy across diverse biological samples.

Alshaabi, Thayer [Howard Hughes Medical Institute,↗

Multi-amplifier Sensing Charge-coupled Devices for Next Generation Spectroscopy

We present characterization results and performance of a prototype Multiple-Amplifier Sensing (MAS) silicon charge-coupled device (CCD) sensor with 16 channels potentially suitable for faint object astronomical spectroscopy and low-signal, photon-limited imaging. The MAS CCD is designed to reach sub-electron readout noise by repeatedly measuring charge through a line of amplifiers during the serial transfer shifts. Using synchronized readout electronics based on the Dark Energy Spectroscopic Instrument CCD controller, we report a read noise of 1.03 e$^{−}$ rms pix$^{−1}$ at a speed of 26 μs pix$^{−1}$ with a single-sample readout scheme where charge in a pixel is measured only once for each output stage. At these operating parameters, we find the amplifier-to-amplifier charge transfer efficiency (ACTE) to be >0.9995 at low counts for all amplifiers but one for which the ACTE is 0.997. This charge transfer efficiency falls above 50,000 electrons for the read-noise optimized voltage configuration we chose for the serial clocks and gates. The amplifier linearity across a broad dynamic range from ∼300 to 35,000 e$^{−}$ was also measured to be ±2.5%. We describe key operating parameters to optimize on these characteristics and describe the specific applications for which the MAS CCD may be a suitable detector candidate.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Cadillac CT6 Super Cruise On-road Data

This dataset encompasses about 60 individual drives of a 2019 Cadillac CT6 with Super Cruise in its relevant operational domain covering more than 1,000 miles. Adhering to the limited operational design domain of the investigated version of the Supercruise system, the majority of the data was collected during highway driving. Information collected includes vehicle CAN data as well as Lidar and camera data from a vehicle mounted sensor array. Vehicle CAN data and information on traffic surrounding the Ego-vehicle derived from the sensor array are postprocessed and merged to provide one combined CVS data file per drive. ![cadillac-ct6 image](ct6.png)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

28nm front end ASIC and 12” LGADs for 3D integration

The 3DIntSenS Collaboration—a joint effort between SLAC, Fermilab, and LLNL—is developing enabling technologies for next-generation radiation imaging detectors that combine ultra-fine spatial resolution (≈10 μm) with precision timing (<20 ps), while maintaining low power <1 W/cm2 and high data throughput. The approach leverages 3D integration between advanced CMOS readout ASICs and finely pixelated LGAD sensors to achieve the performance and scalability required for large-area, high-rate applications. High-granularity, precision-timing detectors are essential for scientific advances in HEP, NP, BES, and FES, but widespread adoption is limited by the cost and complexity of 3D integration. To close this gap, the collaboration is developing LGAD sensors compatible with 12-inch commercial CMOS processes, enabling cost-effective integration with high-performance ASICs under development. We present the design and results from a 28 nm CMOS ASIC prototype, including a low-jitter front end, and in-pixel TDC demonstrating sub-10 ps timing resolution. We also report on the co-design and characterization of reticle-scale LGAD sensors with 50 μm and 100 μm pixels and introduce the next 10k-pixel ASIC designed for full 3D integration. These advances represent a critical step toward scalable, high-resolution radiation imaging systems for future scientific instrumentation.

England, Troy [Fermilab] (ORCID:0000000154405255)↗

Improved Gas Plume Identification Using Nearest Neighbor Methods for Background Estimation

Longwave infrared (LWIR) hyperspectral imaging (HSI) can be used for many tasks in remote sensing, including detecting and identifying effluent gases by LWIR sensors on airborne platforms. Identification is used after detection to increase confidence in weakly detected plumes, reduce false positives from detection, and distinguish between similar and confounding material signatures. Background estimation is an important step used to reveal the unique spectral characteristics of the detected gas, allowing the identification model to determine what the gas is specifically. The importance of proper background estimation increases when dealing with weak signals, large libraries of gases of interest, and uncommon or heterogeneous backgrounds. In this article, we propose two methods for background estimation: a novel k-nearest segments (KNS) algorithm and the standard k-nearest neighbors (KNN) algorithm. We test our methods and three existing background estimation methods for comparison against global background estimation to determine which performs best at estimating the true background radiance under a plume and for increasing identification confidence using a neural network classification model. We compare the different methods using 640 simulated weak plumes in an urban environment. For identification, our KNS algorithm improves median neural network identification confidence by 53.2%. For background radiance estimation, the KNN algorithm provides a median of 49 times less RMSE than global background estimation. Furthermore, KNN is the easiest method to tune for different plumes, making it an excellent “out of the box” background estimator.

47 OTHER INSTRUMENTATION↗

Sim2Real Autonomous Robotic Exploration [Poster]

Autonomous robots offer promising solutions for exploration in environments that are inaccessible or hazardous to humans. Despite this, physical training of such robots is often constrained by safety risks, high cost or limited accessibility. This project presents an end-to-end simulation to reality pipeline leveraging Nvidia Isaac Sim and Boston Dynamics' Spot to enable autonomous navigation in indoor environments. A reinforcement learning policy is first trained using Nvidia Isaac Lab to establish Spot's locomotion pattern. Virtual LiDAR sensors are then integrated to perform SLAM-based navigation using simulated odometry. Finally, the simulated navigation scheme is transferred to a physical Spot robot to inspect and record images of a real-world room by repeating the learnt trajectory. The proposed framework highlights the potential of scalable training in simulation and reliable deployment in physical environments. Future directions include dynamic trajectory generation in unseen and challenging environments and integration of environmental sensing like temperature, radiation or humidity via sensor and material simulation.

97 - MATHEMATICS AND COMPUTING↗

First Direct-Detection Results on Sub-GeV Dark Matter Using the SENSEI Detector at SNOLAB

Here, we present the first results from a dark matter search using six Skipper-CCDs in the SENSEI detector operating at SNOLAB. We employ a bias-mitigation technique of hiding approximately 46% of our total data and aggressively mask images to remove backgrounds. Given a total exposure after masking of 100.72 gram-days from well-performing sensors, we observe 55 two-electron events, 4 three-electron events, and no events containing 4–10 electrons. The two-electron events are consistent with pileup from one-electron events. Among the 4 three-electron events, 2 appear in pixels that are likely impacted by detector defects, although not strongly enough to trigger our “hot-pixel” mask. We use these data to set world-leading constraints on sub-GeV dark matter interacting with electrons and nuclei.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Two-Stage Wildlife Event Classification for Edge Deployment

Camera-based wildlife monitoring is often overwhelmed by non-target triggers and slowed by manual review or cloud-dependent inference, which can prevent timely intervention for high stakes human–wildlife conflicts. Our key contribution is a deployable, fully offline edge vision sensor that achieves near-real-time, highly accurate wildlife event classification by combining detector-based empty-image suppression with a lightweight classifier trained with a staged transfer-learning curriculum. Specifically, Stage 1 uses a pretrained You Only Look Once (YOLO)-family detector for permissive animal localization and empty-trigger suppression, and Stage 2 uses a lightweight EfficientNet-based binary classifier to confirm puma on detector crops and gate downstream actions. Our design is robust to low-quality nighttime monochrome imagery (motion blur, low contrast, illumination artifacts, and partial-body captures) and operates using commercially available components in connectivity-limited settings. In field deployments running since May 2025, end-to-end latency from camera trigger to action command is approximately 4 s. Ablation studies using a dataset of labeled wildlife images (pumas, not pumas) show that the two-stage approach substantially reduces false alarms in identifying pumas relative to a full-image classifier while maintaining high recall. On the held-out test set (N = 1434 events), the proposed two-stage cascade achieves precision 0.983, recall 0.975, F1 0.979, accuracy 0.986, and balanced accuracy 0.983, with only 8 false positives and 12 false negatives. The system can be easily adapted for other species, as demonstrated by rapid retraining of the second stage to classify ringtails. Downstream responses (e.g., notifications and optional audio/light outputs) provide flexible actuation capabilities that can be configured to support intervention.

58 GEOSCIENCES↗

Raw Lidar and Camera Data Synchronized with Precipitation and Present Weather Data

As part of the sensor characterization task of the SMART 2.0 project, this dataset includes raw data from three spinning lidars ([Ouster OS2-128](https://ouster.com/products/scanning-lidar/os2-sensor/), [Velodyne Puck (VLP-16)](https://velodynelidar.com/products/puck/), and [Velodyne Ultra Puck (VLP-32)](https://velodynelidar.com/products/ultra-puck/)), one camera ([Mako G-319](https://www.alliedvision.com/en/camera-selector/detail/mako/g-319/)), and one present weather sensor ([Vaisala FD-70](https://www.vaisala.com/en/products/weather-environmental-sensors/forward-scatter-fd70)). All data were synchronized, with the log start time indicated in the file name (HHMMSS). The data can be filtered by date, log time (HHMMSS), sensor, frame ID, and weather classification. These data were gathered statically at the Argonne Testbed for Multiscale Observational Science (ATMOS). Two target stop signs were placed in view of the sensors to contribute a target for comparing sensor data under different conditions. The weather data for each day are stored in netCDF “.nc” files. The lidar data contain the X, Y, Z, intensity, reflectivity, and ring from Ouster OS2-128 rev6, Velodyne VLP-16, and Velodyne VLP-32 lidars. ![raw lidar image](LiDAR_pointcloud_ATMOS.png)

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

AEPF: Attention-Enabled Point Fusion for 3D Object Detection

Current state-of-the-art (SOTA) LiDAR-only detectors perform well for 3D object detection tasks, but point cloud data are typically sparse and lacks semantic information. Detailed semantic information obtained from camera images can be added with existing LiDAR-based detectors to create a robust 3D detection pipeline. With two different data types, a major challenge in developing multi-modal sensor fusion networks is to achieve effective data fusion while managing computational resources. With separate 2D and 3D feature extraction backbones, feature fusion can become more challenging as these modes generate different gradients, leading to gradient conflicts and suboptimal convergence during network optimization. To this end, we propose a 3D object detection method, Attention-Enabled Point Fusion (AEPF). AEPF uses images and voxelized point cloud data as inputs and estimates the 3D bounding boxes of object locations as outputs. An attention mechanism is introduced to an existing feature fusion strategy to improve 3D detection accuracy and two variants are proposed. These two variants, AEPF-Small and AEPF-Large, address different needs. AEPF-Small, with a lightweight attention module and fewer parameters, offers fast inference. AEPF-Large, with a more complex attention module and increased parameters, provides higher accuracy than baseline models. Experimental results on the KITTI validation set show that AEPF-Small maintains SOTA 3D detection accuracy while inferencing at higher speeds. AEPF-Large achieves mean average precision scores of 91.13, 79.06, and 76.15 for the car class’s easy, medium, and hard targets, respectively, in the KITTI validation set. Results from ablation experiments are also presented to support the choice of model architecture.

Chemistry↗

Hydrogen Detection Strategies to Support H2@SCALE - The NREL Sensor Laboratory

Hydrogen represents a major pathway to decarbonize and stabilize the national and international energy industry and select manufacturing markets. To facilitate the development of hydrogen markets, the US Department of Energy initiated H2@Scale to bring together stakeholders to advance affordable hydrogen production, transport, storage, and utilization to increase revenue opportunities in multiple energy sectors. One major impediment to hydrogen implementation is cost. To expedite the use of hydrogen in energy and other markets, the United States announced in 2021 the Hydrogen Shot, which seeks to reduce the cost of clean hydrogen by 80% to $1 per 1 kilogram in 1 decade ("1 1 1"). As the cost of hydrogen drops, new applications will emerge that will require unique configurations of existing equipment and infrastructure, and eventually lead to advances in the generation and utilization of hydrogen. As the hydrogen economy expands, sensors and detection methods will need to adapt to changing infrastructure demands to address the primary targets of health & safety, emissions monitoring, and process control. The NREL Sensor Laboratory is playing a pivotal role in advancing the use of hydrogen sensors and detection methodologies in each of these categories to support DOE's mission for safe and efficient utilization in emerging markets. Health & safety monitors are required to ensure that operators and facilities can react to unintended hydrogen releases, either as GH2, LH2, or as a constituent of blends (e.g., natural gas or ammonia). Current detection methodologies focus on safety applications to detect near its lower flammable limit (4 vol %), and typically include point sensors in applications such as fixed or mobile detectors (e.g., personal gas monitors). Methodologies amenable for area detection include acoustic, emerging optical imaging methods, and flame detectors. Comparable detection strategies can be utilized for emissions monitoring and quantization, however few methods can simultaneously cover both low (emissions) and high (health & safety) levels. Deployment of emission level detectors will be required to 1) reduce product loss through small but potentially significant leaks from an environmental or cost perspective, 2) reduce downtime of high demand systems by early identification of eminent system failures (leaks through pump or compressor seals indicative of impending failure), and 3) address potential emission monitoring requirements that may be set by regulating bodies. The first two points should be adopted by industry to reduce the cost-of-goods-sold. The third main category for hydrogen detection relates to process control and may be advantageous for many existing applications. Two main applications are emerging. For example, the purity requirements for hydrogen that is dispensed from refueling systems for hydrogen fuel cell electric vehicles (FCEV) is rigorously regulated by the Standard SAE J2719, which prescribes maximum allowable levels of multiple impurities in the hydrogen fuel and must be verified by a regulatory body. Hydrogen contaminant detectors (HCD) integrated to the fueling station can assure this compliance. HCDs must be able operate in 100% H2 backgrounds and be able to distinguish between multiple contaminants at low ppm to low ppb levels. Secondly, as a strategy to decarbonize the natural gas grid, there are proposals to blend hydrogen with natural gas. This blending will affect transport applications (pipeline infrastructure), stationary combustion systems (turbines), and consumer and commercial appliances. In the short-term, hydrogen levels up to 20% are proposed. Variations in the hydrogen level can have dramatic impact on the combustion process and on the potential response of safety sensors. These mixtures may be regulated so that the concentration at a delivery point must be monitored with high precision. However, routine maintenance may introduce background gases such as ambient air (with water) or maintenance gases (introduced with welding processes or adhesive outgassing.) Therefore, the detection methodology must be robust enough to recover or respond to various contaminants. Several reviews can be found in literature addressing sensing and detection technologies, including their limitations and applications. However, for most applications, limitations can be alleviated by combining various detection techniques either through system integration or implementation of machine learning methods (artificial intelligence). In this presentation, we will discuss several applications, highlight their current approach for hydrogen detection, and suggest detection strategies to supplement their limitations.

ENERGY STORAGE,HYDROGEN↗