Search NASA⌕ Search

SEARCH · Search NASA

Results for “Pixels”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Mixed gain detector configurations for time-resolved X-ray solution scattering

X-ray detection at X-ray free-electron lasers is challenging in part due to the XFEL's extremely short and intense X-ray pulses. Experimental measurements are further complicated by the large fluctuations inherent to the self-amplified spontaneous emission process producing the X-rays. At the Linac Coherent Light Source the ePix10ka2M detector offers multiple gain modes, and auto-ranging between these, to increase the dynamic range while retaining low noise. For diffuse scattering techniques, such as time-resolved X-ray solution scattering, where the shape of the scattering pattern largely does not change between exposures, a fixed mix of different gain modes offers many of the same advantages as auto-ranging. We find that configuring individual ASICs in separate gain modes does not impact the intensity linearity of the gain response and has a limited effect on the effective dynamic range in regions with different gain mode settings while avoiding the complexities of auto-ranging. Small (<5%) non-linear gain contributions arise when pixels on the same ASIC are configured in different gain modes. We present a configuration scheme that is designed to select the optimal mixed gain configuration to minimize effects of saturation in the high-/medium-gain region, while maximizing the number of pixels with higher gain to improve the signal-to-noise ratio.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Gaia: segmented germanium detector for high-energy X-ray fluorescence and spectroscopic imaging

We present Gaia, a monolithic array of 96 high-purity germanium pixel detectors integrated with a custom low-noise application-specific integrated circuit (ASIC) and a field-programmable gate array (FPGA)-based data acquisition system. The sensor operates at ∼100 K using a commercial closed-cycle cryocooler, with the in-vacuum electronics thermally isolated from the cold finger to ensure thermal stability. The system demonstrates an average energy resolution of 711 eV at 122 keV, measured using a 57 Co source, and 253 eV at 5.89 keV, measured with 55 Fe across all channels. The readout architecture incorporates a high-performance FPGA paired with a dual-core ARM processor, forming a complete embedded Linux-based computing platform. Communication between the processor and FPGA is handled via memory-mapped I/O, and data are streamed over high-speed gigabit Ethernet. A full-scale 384-pixel Gaia detector, based on this 96-element module, is currently under fabrication.

36 MATERIALS SCIENCE↗

Real-time data processing for serial crystallography experiments

We report the use of streaming data interfaces to perform fully online data processing for serial crystallography experiments, without storing intermediate data on disk. The system produces Bragg reflection intensity measurements suitable for scaling and merging, with a latency of less than 1 s per frame. Our system uses the CrystFEL software in combination with the ASAP::O data framework. In a series of user experiments at PETRA III, frames from a 16 megapixel Dectris EIGER2 X detector were searched for peaks, indexed and integrated at the maximum full-frame readout speed of 133 frames per second. The computational resources required depend on various factors, most significantly the fraction of non-blank frames ('hits'). The average single-thread processing time per frame was 242 ms for blank frames and 455 ms for hits, meaning that a single 96-core computing node was sufficient to keep up with the data, with ample headroom for unexpected throughput reductions. Further significant improvements are expected, for example by binning pixel intensities together to reduce the pixel count. We discuss the implications of real-time data processing on the `data deluge' problem from recent and future photon-science experiments, in particular on calibration requirements, computing access patterns and the need for the preservation of raw data.

47 OTHER INSTRUMENTATION↗

Toward an AI-Powered Software Pipeline for Real-Time Tracking and Analysis of Wildfire and Smoke

Real-time tracking of wildfires and smoke is crucial for effective response, minimizing damage, protecting lives, and efficiently managing resources during fire emergencies. We develop a web-based AI-powered pipeline that detects wildfires in aerial video and estimates deployment-relevant behavior metrics, including cumulative burned area, burned-area growth rate, fire spread direction, and smoke dispersion. The system combines a YOLO-based detector with YCbCr-based fire segmentation, HSV-based smoke segmentation, Farneback optical flow, and centroid-based spatiotemporal tracking. Using ground sampling distance (GSD), pixel-level fire masks are converted to physical burned-area measurements by correlating fire pixel counts with camera altitude and tilt angle. We benchmark YOLO variants and non-YOLO baselines (GoogLeNet, CNN, DBN, Autoencoder, U-Net, and AlexNet) on the IEEE FLAME dataset and a newly created aerial frame dataset, Wildfire-DB. Cross-dataset evaluation uses a strict threshold-transfer protocol: decision thresholds are selected on FLAME validation and transferred unchanged to Wildfire-DB to quantify generalization under domain shift. YOLOv6 achieves the strongest cross-dataset frame-level fire detection on Wildfire-DB (ROC-AUC 0.8200, PR-AUC 0.8044, and transferred-threshold F1 0.7596). For tracking-oriented deployment requiring oriented localization, YOLO11-OBB provides the most reliable cross-dataset behavior among OBB-capable models while remaining computationally feasible. To analyze the feasibility of UAV deployment, we further measure inference efficiency using synchronized GPU and CPU power logs on a fixed workload of 1569 frames. YOLO-family models process the video in 5.73–12.47 seconds with net energy of 1247.28–1775.39 J, substantially lower latency and energy than heavier classification and reconstruction baselines. Overall, model optimality depends on operational objectives: YOLOv6 is best for cross-dataset detection robustness, whereas YOL...

Color segmentation↗

Passive Inter-Photon Imaging

Digital camera pixels measure image intensities by converting incident light energy into an analog electrical current, and then digitizing it into a fixed-width binary representation. This direct measurement method, while conceptually simple, suffers from limited dynamic range and poor performance under extreme illumination --- electronic noise dominates under low illumination, and pixel full-well capacity results in saturation under bright illumination. We propose a novel intensity cue based on measuring inter-photon timing, defined as the time delay between detection of successive photons. Based on the statistics of inter-photon times measured by a time-resolved single-photon sensor, we develop theory and algorithms for a scene brightness estimator which works over extreme dynamic range; we experimentally demonstrate imaging scenes with a dynamic range of over ten million to one. The proposed techniques, aided by the emergence of single-photon sensors such as single-photon avalanche diodes (SPADs) with picosecond timing resolution, will have implications for a wide range of imaging applications: robotics, consumer photography, astronomy, microscopy and biomedical imaging.

97 MATHEMATICS AND COMPUTING↗

Neuro-Spark: A Submicrosecond Spiking Neural Networks Architecture for In-Sensor Filtering

Neuro-Spark, which is a new neuromorphic architecture with a field-programmable gate array (FPGA) implementation for ultrafast spiking neural network (SNN) inference at the edge, facilitates smart-pixel in-sensor filtering for high-energy physics experiments at the Large Hadron Collider (LHC). Utilizing the evolutionary optimization for neuromorphic systems (EONS) training method, we generate compact SNN models with 91% signal efficiency, akin to convolutional neural networks but with half the parameters. However, deploying near the detector poses a challenge because the SNN must handle a sustained input data rate exceeding 1013 GB/s. To overcome this, we propose a novel hardware architecture that uses high-level synthesis to construct a tuned architecture for the EONS-trained SNN. In addition to the analysis and validation with an AMD Xilinx Artix-A7 FPGA, our solution consumes only ç24% of FPGA LUT and flipflops. We also introduce an innovative quantization method that reduces FPGA resource utilization by ç15% without compromising accuracy. Our FPGA implementation achieves computing latency of ç10 ns for smart-pixel application inference on an edge FPGA.

Miniskar, Narasinga Rao↗

Tensorized Feature Spaces for Feature Explosion

In this paper 1 1 This manuscript has been authored by UT-Battelle, LLC under Contract No. DE-AC05-000R22725 with the U.S. Department of Energy. The United States Government retains and the publisher, by accepting the article for publication, acknowledges that the United States Government retains a nonexclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this manuscript, or allow others to do so, for United States Government purposes. The Department of Energy will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan (http://energy.gov/downloads/doe-public-access-plan) This research used resources of the Oak Ridge Leadership Computing Facility, which is a DOE Office of Science User Facility supported under Contract DE-AC05-000R22725., we present a novel framework that uses tensor factorization to generate richer feature spaces for pixel classification in hyperspectral images. In particular, we assess the performance of different tensor rank decomposition methods as compared to the traditional kernel-based approaches for the hyperspectral image classification problem. We propose Orion, which takes as input a hyperspectral image tensor and a rank and outputs an enhanced feature space from the factor matrices of the decomposed tensor. Our method is a feature explosion technique that inherently maps low dimensional input space in $\mathbb{R}^{K}$ to high dimensional space in $\mathbb{R}^{R}$ , where $R\gg K$ , say in the order of 1000x, like a kernel. We show how the proposed method exploits the multi-linear structure of hyperspectral three dimensional tensor. We demonstrate the effectiveness of our method with experiments on three publicly available hyperspectral datasets with labeled pixels and compare their classification performance against traditional linear and non-linear supervised learning methods such as SVM with Linear, Polynomial, RBF kernels, and the Multi-Layer Perceptron model. Finally, we explore the relationship between the rank of the tensor decomposition and the classification accuracy using several hyperspectral datasets with ground truth.

Pasricha, Ravdeep Singh↗

SpaceNet 9—Cross-Sensor Alignment of Optical and SAR Imagery

Precise registration of high-resolution synthetic aperture radar (SAR) and optical imagery is necessary for realizing the full potential and benefits of multimodal image analysis. However, two significant challenges presently exist. First, there is a lack of annotated datasets and benchmarks available for high-resolution SAR–optical image registration. Second, an assessment of efficient and reliable image registration methods that can precisely align these modalities is lacking. Here, we present a holistic description of the SpaceNet 9 Challenge and its results. We present a description of the dataset and baseline algorithm along with the results of the challenge, including a description of the winning algorithms. We release the SpaceNet 9 dataset along with open-sourcing the winning algorithms and baseline. The objective of SpaceNet 9 was to compute a dense displacement map that indicates the shift needed to align pixels in an optical image to the pixels in a SAR image. The challenge launched in April 2025 and was active for approximately two months. The top five solutions reduced image alignment error from approximately 34 m to under 13 m for public and private test data, with the best results obtaining a registration error of only 8.5 and 6.7 m on the public testing and private testing dataset, respectively. Usage of pretrained image matching models, robust outlier rejection with RANSAC, and estimating local displacement were common among the top solutions. The results of this challenge provide insight into high-resolution SAR–optical image registration and offer opportunities for future benchmarking in this domain. The baseline algorithm, winning solutions, and datasets are available at https://spacenet.ai/sn9-challenge/.

benchmark datasets↗

ETROC2 as the Final Version for CMS MTD Endcap Timing Layer (ETL) Upgrade

The ETROC2 is the first full-size full-functionality prototype design fully compatible with the final chip specifications for CMS ETL. The ETROC2 chips have been extensively tested and the results have been presented at IEEE NSS MIC RTSD 2024. We will present here new results including the bump bonding yield improvement study, the time walk correction (TWC) generality study with single pixel TWC applied to all pixels, the final SEU testing results using both heavy ion and proton beam, more beam test studies including different sensors and irradiated sensors, and readiness for the ETROC2 production for CMS ETL upgrade.

Liu, Tie Hui [Fermilab] (ORCID:0009000765225605)↗

Characterization of MKIDs for CMB Observation at 220 GHz With the South Pole Telescope

We present an updated design of the 220 GHz microwave kinetic inductance detector (MKID) pixel for SPT-3G+, the next-generation camera for the South Pole Telescope. We show results of the dark testing of a 63-pixel array with mean inductor quality factor $Q_{i} = 4.8 \times 10^{5}$, aluminum inductor transition temperature $T_{c} = 1.19$K, and kinetic inductance fraction $\alpha _{k} = 0.32$. We optically characterize both the microstrip-coupled and CPW-coupled resonators, and find both have a spectral response close to prediction with an optical efficiency of $\eta \sim 70\%$. However, we find slightly lower optical response on the lower edge of the band than predicted, with neighboring dark detectors showing more response in this region, though at level consistent with less than 5% frequency shift relative to the optical detectors. The detectors show polarized response consistent with expectations, with a cross-polar response of $\sim 10\%$for both detector orientations.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

A High-Speed, High-Resolution Transition Edge Sensor Spectrometer for Soft X-Rays at the Advanced Photon Source

This project explores the design and development of a transition edge sensor (TES) spectrometer for resonant soft X-ray scattering (RSXS) measurements developed in collaboration between Argonne National Laboratory (ANL) and the National Institute of Standards and Technology (NIST). Soft X-ray scattering is a powerful technique for studying the electronic and magnetic properties of materials on a microscopic level. However, the lack of high-performance soft X-ray spectrometers has limited the potential of this technique. TES spectrometers have the potential to overcome these limitations due to their high energy resolution, high efficiency, and broad energy range. This project aims to optimize the design of a TES spectrometer for RSXS measurements and more generally soft X-ray spectroscopy at the Advanced Photon Source (APS) 29-ID, leading to improved understanding of advanced materials. We will present a detailed description of the instrument design and implementation. The spectrometer consists of a large array of approximately 250 high-speed and high-resolution pixels. The pixels have saturation energies of approximately 1 keV, sub-ms pulse duration and energy resolution of approximately 1 eV. The array is read out using microwave multiplexing chips with MHz bandwidth per channel, enabling efficient data throughput. To facilitate measurement of samples in situ under ultra-high vacuum conditions at the beamline, the spectrometer is integrated with an approximately 1 m long snout.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

A Combined Computer Vision and Deep Learning Approach for Rapid Drone-Based Optical Characterization of Parabolic Troughs

Optical accuracy is a primary driver of parabolic trough concentrating solar power (CSP) plant performance, but can be damaged by wind loads, gravity, error during installation, and regular plant operation. Collecting and analyzing optical measurements over an entire operating parabolic trough plant is difficult, given the large scale of typical installations. Distant Observer, a software tool developed at the National Renewable Energy Laboratory, uses images of the absorber tube reflected in the collector mirror to measure both surface slope in the parabolic mirror and offset of the absorber tube from the ideal focal point. This technology has been adapted for fast data collection using low-cost commercial drones, but until recently still required substantial human labor to process large amounts of data. A new method leveraging advanced deep learning and computer vision tools can drastically reduce the time required to process images. This new method addresses the primary analysis bottleneck, identifying featureless, reflective mirror corner points to a high degree of accuracy. Recent work has shown promising results using computer vision methods. The combined deep learning and computer vision approach presented here proved highly effective and has the potential to further automate data collection and analysis, making the tool more robust. The method presented in this paper automatically identified 74.3% of mirror corners within 2 pixels of their manually marked counterparts and 91.9% within 3 pixels. This level of accuracy is sufficient for practical Distant Observer analysis within a target uncertainty. A commercial drone collected video of over 100 parabolic trough modules at an operating CSP plant to demonstrate the deep learning and computer vision method's usefulness in processing large amounts of data. These troughs were successfully analyzed using Distant Observer, paired with the new deep learning and computer vision algorithm, and can provide plant operators and trough designers with valuable insight about plant performance, operating strategies, and plant-wide optical error trends.

computer vision↗

Energy gain scale calibration of the XRISM Resolve microcalorimeter spectrometer: ground calibration results and on-orbit comparison

The Resolve instrument aboard the X-ray Imaging and Spectroscopy Mission (XRISM) is a 36-pixel microcalorimeter spectrometer that provides nondispersive spectroscopy with ∼ 5 eV spectral resolution in the soft X-ray waveband. Resolve has a requirement to provide an absolute energy-scale calibration of ± 2 eV from 0.3 to 12 keV. We describe our ground calibration strategy and results of a subset of the ground calibration campaigns, including a discussion of improvements in the energy scale ground calibration compared with Hitomi’s. These improvements include calibration of the low-energy band below 4 keV with the instrument in the flight dewar and the dewar aperture door open, which was not performed for Hitomi, and thorough measurements over an extended high-energy waveband to 22 keV. We also developed an improved technique for gain calibration of “mid-res” secondary events, which have suppressed gain due to proximity to a preceding X-ray event (18 to 70 ms) on the same pixel. We provide a discussion of the on-orbit energy scale monitoring campaigns and an assessment of the Resolve energy scale uncertainties, a key parameter for astrophysics analysis. Energy-scale calibration approaches for future space-based instruments, including the X-ray Integral Field Unit on Athena and microcalorimeter spectrometers proposed or under discussion for future X-ray observatory concepts, have heritage in the calibration of XRISM. We briefly comment on lessons learned from Resolve calibration that are relevant for these future instruments.

Aluminum↗

Line emission mapper microcalorimeter spectrometer

The line emission mapper (LEM) is a probe-class mission concept that is designed to detect x-ray emission lines from hot ionized gas (T > 10 6 K) that will enable us to test galaxy evolution theories. It will permit us to study the effects of stellar and black-hole feedback and flows of baryonic matter into and out of galaxies. The key to being able to study the hot gases that are otherwise invisible to current imaging x-ray spectrometers is that the energy resolution is sufficient to use cosmological redshift to separate extragalactic source lines from foreground Milky Way emission. LEM incorporates a large-format microcalorimeter array instrument called the LEM microcalorimeter spectrometer (LMS) with a light-weight x-ray optic with 10” half power diameter angular resolution. The LMS microcalorimeter array has pixels with 15" pixel pitch over a 33' field of view (FOV) optimized for the 0.3 to 2 keV energy band. The central 7' region of the array has an energy resolution of 1.3 eV at 1 keV and the rest of the FOV has 2.5 eV energy resolution at 1 keV. The array will be read out with state-of-the-art time-division multiplexing. We present an overview of the LMS instrument, including details of the entire detection chain, the focal plane assembly, as well as the cooling system and overall mechanical and thermal design. For each of the key technologies, we discuss the current technology readiness level and the plan to advance them to be ready for flight. We also describe the current system design and our estimate for the mass, power, and data rate of the instrument. The design details presented concentrate primarily on the unique aspects of the LMS design compared with prior missions and confirm that the type of microcalorimeter instrument needed for LEM is not only feasible but also technically mature.

47 OTHER INSTRUMENTATION↗

NACHOS, a CubeSat-based high-resolution UV-Visible hyperspectral imager for remote sensing of trace gases: system overview and science objectives

Here, the Nano-satellite Atmospheric Chemistry Hyperspectral Observation System (NACHOS) is a high-throughput (f/2.9), high spectral resolution (~1.3 nm optical resolution, 0.6 nm sampling) Offner-design hyperspectral imager operating in the 300-500 nm spectral region. The 1.5U instrument payload (1U optical system, 0.5U electronics module) is hosted by a 1.5U LANL-designed CubeSat bus to comprise a 3U complete satellite. Spectroscopically similar to NASA’s Ozone Monitoring Instrument (OMI), which provides wide-field global mapping of ozone and other gases at coarse spatial resolution, NACHOS fills the complementary niche of targeted measurements at much higher spatial resolution. With 350 across-track spatial pixels and a 15-degree across-track field of view, NACHOS will provide spectral imaging at roughly 0.4 km per pixel from 500 km altitude. NACHOS incorporates highly streamlined gas-retrieval algorithms for rapid onboard processing, alleviating the need to routinely downlink massive hyperspectral data cubes. We will discuss the instrument design, challenges in achieving mechanical robustness to launch vibration in such a compact instrument, the onboard calibration system, and gas-retrieval data downlink strategy. We will also discuss potential science missions, including monitoring of NO 2 as an easily detected proxy for anthropogenic fossil-fuel greenhouse gases, monitoring lowlevel SO 2 degassing at pre-eruptive volcanoes, H 2 CO from wildfires, and characterization of aerosols. The long-term vision is for a many-satellite constellation that could provide both high spatial resolution and frequent revisits for selected targets of interest. As an initial technology demonstration of this vision, the NACHOS project is currently slated to launch two CubeSats in early 2022.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Observation of a single protein by ultrafast X-ray diffraction

* runs/ - The raw data from the pnCCD * histograms.h5 - Histogram of the values recorded by each pixel throughout the data acquisition. Used for pedestal and gain correction. * mask.h5 - Detector bad pixels mask. * 1SS8.pdb - PDB model of the assembled GroEL 14-mer, from the 1SS8 PDB entry. * 1SS8_H2O.pdb - Hydrated version of the assembled GroEL 14-mer, derived from the 1SS8 PDB entry. The various hydrated models are created by removing water from this initial model. * rotations.h5 - Quaternions of the rotations used for template matching

European XFEL↗

Panel-Segmentation [SWR-21-18]

Panel-Segmentation contains the scripts for automated metadata extraction of solar PV installations, using satellite imagery coupled with computer vision techniques. In this package, the user can perform the following actions: *Automatically generate a satellite image using a set of lat-long coordinates, and a Google Maps API key. Users would need to set up a Google Cloud account and get a Maps Static API key. Please refer to Setting Up Google Maps Static API Key section for this process. *Perform image segmentation on the satellite image, to locate the solar array(s) in the image on a pixel-by-pixel basis, using an image segmentation model (panel_detection_model.pth). Get classification of the installation (rooftop, ground mounted fixed-tilt or tracking, carport, etc). *Perform azimuth estimation on each solar array cluster in the masked image. *Detect solar panels and get its latitude, longitude, and address within a geographic bounding box through the SOL-Searcher Pipeline. *Detect and calculate hurricane damage on solar installations given pre-hurricane and post-hurricane satellite imagery through the Hurricane Detection Pipeline. *Detect and calculate hail damage on solar installations given satellite imagery through the Hail Detection pipeline. *Convert NOAA MESH (Maximum Estimated Size of Hail) grib2 files into kml or geojson files. *Estimate tilt and azimuth of a solar array by processing USGS LiDAR data for the array’s location.

Edun, Ayobami↗

coloring v.1.0

SAND2024-02435O The software coloring allows applications written in the C++ language to generate publication-quality 2D plots. Its functionality is similar to Microsoft Excel's chart functionality or the Python language's matplotlib package. The value of coloring is that it is written purely in C++ and thus can be compiled on systems where Python is not available and linked into high performance computing software. For drawing shapes onto an image, coloring uses the mathematical definition of quadratic Bezier splines and uses Newton's method to search for the closest point on a spline to a given query point. This is then used to do accurate sub-pixel sampling to get clean, non-pixelated images. For working with the actual plot data, coloring has basic statistical methods such as finding maxima and minima as well as axis scaling such as logarithms. Sandia National Laboratories is a multimission laboratory managed and operated by National Technology & Engineering Solutions of Sandia, LLC, a wholly owned subsidiary of Honeywell International Inc., for the U.S. Department of Energy’s National Nuclear Security Administration under contract DE-NA0003525.

Ibanez, Daniel↗