Search NASA⌕ Search

SEARCH · Search NASA

Results for “Pixels”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 235 records · Page 13
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Unmanned aircraft system (UAS) detection and assessment via temporal intensity aliasing

A method and system for temporal frequency analysis for identification of unmanned aircraft systems. The method includes obtaining a sequence of video image frames and providing a pixel from an output frame of the video; generating a fluctuating pixel value vector; examining the fluctuating pixel value vector over a period of time; obtaining the frequency information present in the pixel fluctuations; summing the frequency coefficients for the vectorized pixel values from the fluctuating pixel value vector; obtaining an image representing a two dimensional space based on the summed center frequency coefficients; generating a series of still frames equal to a summation of the center frequency coefficients for pixel variations; and combining the temporal information into spatial locations in a matrix to provide a single image containing the spatial and temporal information present in the sequence of video image frame.

Woo, Bryana Lynn↗
DOE OSTI2023

Electronic device and method for compressing video data

A computer-implemented method for compressing video data comprises receiving a sequence of video data values, each video data value being a digital value from a successive one of a plurality of pixels that form a video sensor, the sequence of video data values resulting from successive frames of video captured by the video sensor; extracting the video data values for each pixel in turn to create a plurality of pixel data streams, each pixel data stream including the video data value for each frame of captured video for the pixel; and applying data compression to each pixel data stream to create compressed data for each pixel data stream.

Tohlen, Michael Aaron↗
DOE OSTI2026

Toward memory-efficient melt pool monitoring: a classification framework using event-based imaging and sparse sensing technique

Vision sensors like CMOS and CCD cameras are often used for in-process monitoring of melt pools in laser-based additive and welding processes, but they require transferring large amounts of data and computational processing resources. Event-based neuromorphic imagery, on the other hand, detects only the change in pixel intensity, thus potentially reducing the data amount and latency. With an event imager, this study develops a framework for melt pool condition classification, including image construction, time scale selection, optimal pixel selection, and sparse classification, to achieve a highly memory-efficient scheme. These are based on sparse sensing techniques with singular value decomposition (SVD) and QR pivoting, the two fundamental matrix transformations for linear dimensionality reduction. The framework is then validated by classifying a controlled experiment by exciting various mode shapes of liquid gallium pools of varying depths (3, 6, and 8 mm). At 200 pixels, the classifier can reach overall accuracy of 75%, while at 2000 pixels (0.013% of the total possible pixels), the accuracy is nearly 90% (89.86%). At the same number of pixels, random selection can only achieve 46% and 67%, respectively. The memory savings of the sparsely sampled event data compared to a conventional imager is about 500 times. In addition to performance, implementation and limitations of the framework are also discussed.

42 ENGINEERING↗
DOE OSTI2023

The brighter-fatter effect in the JWST MIRI Si:As IBC detectors: I. Observations, impact on science, and modeling

Context.The Mid-Infrared Instrument (MIRI) on board theJames WebbSpace Telescope (JWST) uses three Si:As impurity band conduction (IBC) detector arrays. The output voltage level of each MIRI detector pixel is digitally recorded by sampling up the ramp. For uniform or low-contrast illumination, the pixel ramps become nonlinear in a predictable way, but in areas of high contrast, the nonlinearity curve becomes much more complex. The origin of the effect is poorly understood and currently not calibrated out of the data. Aims.We provide observational evidence of the brighter-fatter effect (BFE) in MIRI conventional and high-contrast coronagraphic imaging, low-resolution spectroscopy, and medium-resolution spectroscopy data, and we investigate the physical mechanism that gives rise to the effect on the MIRI detector pixel raw voltage integration ramps. Methods.We used public data from the JWST/MIRI commissioning and Cycle 1 phase. We also developed a numerical electrostatic model of the MIRI detectors using a modified version of the publicPoisson_CCDcode. Results.We find that the physical mechanism behind the BFE manifesting in MIRI data is fundamentally different to that of charge-coupled devices and photodiode arrays such as the Hawaii-XRG near-infrared detectors used by the NIRISS, NIRCam, and NIRSpec instruments on board JWST. Observationally, the BFE makes the JWST MIRI data yield 10–25% larger point sources and spectral line profiles as a function of the relative level of de-biasing of neighboring detector pixels. This broadening impacts the MIRI absolute flux calibration, time-series observations of faint companions, and point spread function modeling and subtraction. We also find that the intra-pixel 2D profile of the shrinking Si:As IBC detector depletion region directly impacts the accuracy of the pixel ramp nonlinearity calibration model.

Astronomy & Astrophysics↗
DOE OSTI2025

Super-Resolution Ptychography with Small Segmented Detectors

To overcome the spatial resolution limit set by aperture-limited diffraction in traditional scanning transmission electron microscopy, microscopists have developed ptychography enabled by iterative phase retrieval algorithms and high-dynamic-range pixel array detectors. Current detector designs are limited by the data rate off chip, so a high-pixel-count detector has a proportionally lower frame rate than the few-segment detectors used for differential phase contrast (DPC) imaging. This slower acquisition speed leads to heightened vulnerability to scan noise, drift, and potential sample damage. This creates opportunities for repurposing fast segmented detectors for ptychography by trading a reduction in reciprocal space pixels for an increase in real space pixels. Here, we explore a strategy of oversampling in real space and instead apply detector pixel upsampling during the reconstruction process. Further, we demonstrate the viability of achieving super-resolution ptychography on thin objects using only 2 × 2 detector pixels, surpassing the resolution of integrated DPC (iDPC) imaging. With optimization using simulated datasets and experiments on MoTe 2 /WSe 2 bilayer moiré superlattices, we achieved super-resolution ptychography reconstructions under rapid acquisition conditions (37.5 pA, 1 μs dwell time), yielding over 50% improvements in contrast and information limit compared to annular dark field and iDPC imaging on the same detectors.

2D materials↗
DOE OSTI2025

Pxl

The code consists of several scripts. The image is fetched from a predefined URL, downloaded, and is displayed in the virtual environment at a predefined location. The image is also dynamically scaled to fit in the virtual environment depending on its size. The image is sent to have each pixel's value written to a CSV file. While the CSV is being written, a dictionary is populated with values that map each pixel to a temperature reading. The image's height, width, position and references to its corners are sent to make a button that is the same size as the image and placed right behind the image in the virtual scene. The button defines behavior that should be triggered when the user pushes the image. Unity provides visual cues that alert the user when they are about to touch something in the virtual environment. The code holds references to the cues for the left and right hands. The button queries the cue tracker and receives the position of the active cue in the form of a 3D vector. The 3D vector is compared to the bottom left corner of the image to transform the world space coordinates of the cue to the pixel space of the image. The specific pixel is approximated relative to how far left and up the user touched from the bottom left corner of the image. The approximated pixel value, which is represented as a coordinate in 2D space, is used to retrieve the temperature value associated with the approximated pixel. A window of text is then updated to display the temperature reading.

. Otis, KrystianeS [Idaho National Laboratory (INL↗
DOE OSTI2026

Evaluation of an event-driven 3FI ASIC for spectroscopic X-ray detection with synchrotron radiation

The novel design and evaluation on the NSLS-II beamline of the 3FI application-specific integrated circuit (ASIC) bump-bonded to a simple, planar, 2D segmented silicon sensor are presented. The ASIC was developed for full-field fluorescence spectral X-ray imaging (3FI). It is a small-scale prototype that features a square array of 32 × 32 pixels, and the size of the pixels is 100 µm × 100 µm. The ASIC was implemented in a 65 nm CMOS integrated circuit fabrication process. Each pixel incorporates a charge-sensitive amplifier, a shaping filter, a discriminator, a peak detector and a sample-and-hold circuit, allowing detection of events and storage of signal amplitudes. The system operates in a frameless event-driven readout mode, outputting analog values for threshold-triggered events, allowing high-speed multi-element X-ray fluorescence data acquisition. The 3FI ASIC achieves per-channel spectrometric performance at a power consumption of only 200 µW per pixel, with nearly all dissipation confined to the analog front-end. An energy resolution is measured at the level of 308 eV full width at half-maximum (FWHM) at 8.04 keV (Cu Kα), and 138 eV FWHM at 3.69 keV (Ca Kα). This per-pixel capability makes the prototype suitable for in situ trace element microanalysis in biological and environmental studies. Moreover, the frameless architecture of the detector is designed to address limitations of conventional X-ray fluorescence microscopy, which typically requires mechanical scanning, by enabling continuous high-throughput data acquisition in future full-field implementations.

47 OTHER INSTRUMENTATION↗
DOE OSTI2024

Signatures of Thermal and Electrical Crosstalk in a Microwave Multiplexed Hard X-ray Transition Edge Sensor Array

We investigate the crosstalk between Transition-Edge Sensor (TES) pixels in a 24-pixel hard X-ray spectrometer array fabricated at the Advanced Photon Source, Argonne National Laboratory. Analysis shows thermal cross talk, possibly associated with insufficient thermalization, and rare but larger in magnitude electrical crosstalk between specific perpetrator-victim pixel combinations, potentially due to defects in the bias wiring or microwave multiplexing circuit. We use a method based on group-triggering and averaging to isolate the crosstalk response despite only having access to X-ray photon illumination uniform across the entire array. This allows us to identify thermal and electrical crosstalk between pixel pairs in repeated measurements to the level of 1 part in 1000 or better. In the array under study, the magnitude of observed crosstalk is small but comparable to the resolving power of this pixel design (E/Delta E similar to\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$E/\Delta {}E \sim$$\end{document} 1000 at 20 keV) and so potentially responsible for a degradation in energy resolution of the array at high incident photon rates. Having proven the methods to identify and quantify crosstalk in our setup, we can now consider mitigations.

Triamkitsawat, Panthita↗
DOE OSTI2024

Advanced Energy Scale Correction Techniques for the X-ray Transition Edge Sensors of the Athena mission

The X-ray Integral Field Unit (X-IFU) onboard the future European X-ray telescope Athena will be the first space instrument carrying an array of more than a thousand transition edge sensors. One of the key challenges of the X-IFU is the measurement of narrow X-ray atomic lines to determine velocity shifts at an unprecedented level of accuracy. For this reason, the energy scale of the instrument needs to be known with extreme accuracy, of 0.4 eV (1σ) up to 7 keV. The energy scale will be measured on the ground through a dedicated calibration campaign using fiducial X-ray sources. Though calibrated, the energy scale is extremely sensitive to the environmental conditions around the TES array, and drifts in the readout chain electronics. Uncorrected, the energy scale can naturally drift up to hundreds of eVs. Changes of the TES gain will be monitored via onboard X-ray calibration sources, and the energy scale will be corrected either per pixel, or within a small groups of pixels. Although simulations show that a 0.4 eV level can be achieved, the very high accuracy required by the X-IFU calls for experimental validation. A dedicated measurement campaign has been performed by NASA Goddard Space Flight Center to characterize the energy scale of a prototype kilo-pixel array of X-IFU-representative TESs. The analysis of the data demonstrated the ability to correct for various drifts using two fiducial lines to track the temporal gain variation. In this paper, we propose to extend this study on the same data set by investigating multi-parameter correction techniques based on both the pulse-height of the fiducial line and the prepulse baseline level, using the knowledge of the TES energy scale at reference temperature/magnetic field set points acquired on the ground. Investigations on the co-adding of pixels to perform a joint correction over pools of pixels is also explored.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2021

Subfield crop yields and temporal stability in thousands of US Midwest fields

Understanding subfield crop yields and temporal stability is critical to better manage crops. Several algorithms have proposed to study within-field temporal variability but they were mostly limited to few fields. In this study, a large dataset composed of 5520 yield maps from 768 fields provided by farmers was used to investigate the influence of subfield yield distribution skewness on temporal variability. The data are used to test two intuitive algorithms for mapping stability: one based on standard deviation and the second based on pixel ranking and percentiles. The analysis of yield monitor data indicates that yield distribution is asymmetric, and it tends to be negatively skewed (p < 0.05) for all of the four crops analyzed, meaning that low yielding areas are lower in frequency but cover a larger range of low values. The mean yield difference between the pixels classified as high-and-stable and the pixels classified as low-and-stable was 1.04 Mg ha –1 for maize, 0.39 Mg ha –1 for cotton, 0.34 Mg ha –1 for soybean, and 0.59 Mg ha —1 for wheat. The yield of the unstable zones was similar to the pixels classified as low-and-stable by the standard deviation algorithm, whereas the two-way outlier algorithm did not exhibit this bias. Furthermore, the increase in the number years of yield maps available induced a modest but significant increase in the certainty of stability classifications, and the proportion of unstable pixels increased with the precipitation heterogeneity between the years comprising the yield maps.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Automated co-adding and energy calibration of large array microcalorimeter data with zero sample knowledge

State-of-the-art microcalorimeter spectrometers now contain large detector arrays with hundreds of individual pixels. Each individual pixel outputs a unique and non-linear response with respect to deposited energy. This work describes a pattern-recognition algorithm to combine these responses into a single energy-calibrated histogram, referred to as co-adding pixels. Photo-peaks from different pixels are matched together based upon how well the match aligns the centroids and heights of neighboring peaks. This usually results in around 100 co-adding calibration points from 30 to 300 keV for a several day acquisition of plutonium items with masses between 0.5 and 10 grams. An additional algorithm energy-calibrates this co-added spectrum using the fluoresced K x-ray emissions from a tantalum absorber and inherent x-ray escape peaks from the tin absorbers. Both algorithms operate without knowledge of the source and are fully automated. This work presents results from the acquisitions of high and low burnup plutonium, 10% enriched uranium, a 153 Gd calibration source, and a 57 Co+ 166m Ho calibration source. In all measurements, resolution defined as the full-width at half-maximum (FWHM) of photo-peaks is preserved between the individual pixel and co-added spectra at around 65 eV for incident photon energies between 60 and 208 keV. The energy calibration algorithm is approximate and yields a calibration curve off by an average of around 200 eV for incident photon energies between 60 and 208 keV.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Analysis of the EMCCD point-source response using x-rays

Electron Multiplying Charge Coupled Devices, EMCCD are used as x-ray detectors. The NSLS-II Soft Inelastic x-ray Scattering (SIX) beam line has two EMCCDs for x-ray detection in the spectrometer arm. The spectrometer with high resolving power disperses x-rays vertically. The x-ray vertical position on the sensor plane is related to its energy. This allows for very accurate x-ray energy measurements through x-ray coordinates. X-rays interact with silicon and create a number of electron-hole pairs proportional to the x-ray energy. Electrons drift and diffuse toward pixel gates and are collected there. The diffused electrons form a charge cloud distributed over several neighboring pixels. This charge sharing enables coordinate measurements with accuracy better than the pixel pitch. The charge distribution shape has to be taken into account to achieve ultimate accuracy in coordinate measurements. In this paper, we present a method of the charge distribution shape analysis and demonstrate its applications. The drift and diffusion of electrons ftom the point of generation to pixel gates results in the bell-shaped electron cloud usually approximated by Gaussian shape. The number of electrons collected under a pixel is proportional to the shape function integral. These electron packets get transferred to the sense node of the output amplifier. The transfer process could introduce distortions to the original charge distribution. For example, during transfers, electrons in the packet could be exposed to traps if they are present in the sensor. The trapping and later the release processes distort the apparent shape of the charge distribution. Therefore, deviations of the charge distribution shape ftom the originally symmetrical form can indicate the presence of trap centers in the sensor and can be used for sensor diagnostics.

47 OTHER INSTRUMENTATION↗
DOE OSTI2020

Brighter-fatter Effect in Near-infrared Detectors—III. Fourier-domain Treatment of Flat Field Correlations and Application to WFIRST

Weak gravitational lensing has emerged as a leading probe of the growth of cosmic structure. However, the shear signal is very small and accurate measurement depends critically on our ability to understand how non-ideal instrumental effects affect astronomical images. The Wide-Field Infrared Survey Telescope (WFIRST) will fly a focal plane containing 18 Teledyne H4RG-10 near-infrared detector arrays, which present different instrument calibration challenges from previous weak lensing observations. Previous work [Paper I: Hirata & Choi, PASP, 132, 014501 (2020); and Paper II: Choi & Hirata, PASP, 132, 014502 (2020)] has shown that correlation functions of flat field images, including cross-correlations between different time slices that are enabled by the non-destructive read capability of the infrared detectors, are effective tools for disentangling linear and nonlinear inter-pixel capacitance (IPC) and the brighter-fatter effect (BFE). Here we present a Fourier-domain treatment of the flat field correlations, which allows us to expand the previous formalism to all orders in IPC, BFE, and classical nonlinearity. We show that biases in simulated flat field analyses in Paper I are greatly reduced through the use of this formalism. We then apply this updated formalism to flat field data from three WFIRST flight candidate detectors, and explore the robustness to variations in the analysis. We find that the BFE is present in all three detectors, and that its contribution to the flat field correlations dominates over the nonlinear IPC, in accordance with the results from Paper II on a development detector. The magnitude of the BFE is such that the effective area of a pixel is increased by (3.54 ± 0.03) × 10 -7 for every electron deposited in a neighboring pixel (sensor chip assembly [SCA] 20829, statistical error, not IPC-deconvolved). We compare IPC maps from flat field autocorrelation measurements to those obtained from the single pixel reset method and find a median difference of 0.113% for SCA 20829. After further diagnosis of this difference, we ascribe it largely to an additional source of cross-talk, the vertical trailing pixel effect, and recommend further work to develop a model for this effect. These results represent a significant step toward calibration of the non-ideal effects in WFIRST detectors.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2022

Optics-Free Chip-Scale Intraoperative Imaging Using NIR-Excited Upconverting Nanoparticles

Here we present an optics-free CMOS image sensor that incorporates a novel time-gated dual-photodiode pixel design to allow filter- and lens-less image acquisition of near-infrared-excited (NIR-excited) upconverting nanoparticles. Recent biomedical advances have highlighted the benefits of NIR excitation, but NIR interaction with silicon has remained a challenge, even with high-performance optical blocking filters. Using a secondary diode and a dual-photodiode design, this sensor is able to remove the 100s of mV of NIR background on pixels and bring it down to single-digit mV level, nearing its noise floor of 2.2 mV rms, not achievable with any optical filter. Non-linear effects of background cancellation using the diode pair has been mitigated using an initial one-time pixel-level curve fitting and calibration in a post-processing setting. This imager comprises a highly linear 11 fF metal-oxide-metal (MOM) capacitor and includes integrated angle-selective gratings to reject oblique light and enhance sharpness. Each pixel also includes two distinct correlated double sampling schemes, to remove low frequency flicker noise and systematic offset in the datapath. We demonstrate the performance of this imager using pulsed NIR-excited upconverting nanoparticles on standard United-States-Air-Force (USAF) resolution targets and achieve an SNR of 15 dB, while keeping NIR background below 6 mV. This 36-by-80-pixel array measures only 2.3 mm by 4.8 mm and can be thinned down to 25 µm, allowing it to become surgically compatible with intraoperative instruments and equipment, while remaining optics-free.

42 ENGINEERING↗
DOE OSTI2026

CHESS 2025: Orthorectified airborne RGB imagery from NEON AOP surveys

This dataset provides Level 1 (L1) and Level 3 (L3) orthorectified Red-Green-Blue (RGB) imagery collected for the 2025 Colorado Headwaters Ecological Spectroscopy Study (CHESS). This high-resolution imagery is a photographic record of red, green, and blue visible light from sunlight reflected off of the Earth’s surface. The data comprise full-color images of the ground surface and are primarily intended to provide context to imaging spectroscopy and light detection and ranging (LiDAR) data. The data were acquired over three study domains in the Upper Gunnison river basin: the upper East River watershed (CRBU); Almont Triangle and Taylor Canyon (ALMO); and Upper Taylor River watershed (UPTA) between 2025-06-13 and 2025-07-15. RGB images were acquired using the PhaseOne IXM-RS150F high-resolution digital camera onboard the National Ecological Observatory Network (NEON) Airborne Observation Platform (AOP). The package data include both an L1 product comprising one camera frame per file and an L3 mosaic aligned to the Universal Transverse Mercator (UTM) Zone 13N grid and the World Geodetic System (WGS) 84 projection. Both products are provided in geotif (.tif) format at 0.1 m ground resolution. The bulk of the imagery was collected during the main CHESS field campaign from June 13 to July 15, 2025. Additional images of a portion of the Upper Taylor (UPTA) domain were collected on September 18, 2025, to fill gaps in imagery identified after the main campaign was complete. RGB camera imagery is not radiometrically calibrated, and therefore pixel values should not be exploited for scientific analysis. Pixel values have undergone a manual adjustment to enhance feature identification. The imagery is rigorously geolocated which does allow for reliable geometric information to be retrieved. To generate the orthorectified imagery, the NEON AOP camera captured visible spectrum in red, green, and blue bands. The raw images were then processed using NEON’s camera orthorectification workflow. A boresight calibration flight was made to build a complete camera, distortion, and alignment model. Color balance/white balance and exposure correction were applied to the raw RGB images. The corrected images were orthorectified by ray-tracing image pixels to a lidar-derived digital surface model (DSM) mesh using the refined camera model, outputting orthorectified raster pixels on a regular grid. Flightline-level data were mosaicked by selecting per-pixel contributions from overlapping orthorectified images using line-of-sight (LOS) zenith angle minimization to reduce edge distortions. CHESS Project Description: The Colorado Headwaters Ecological Spectroscopy Study (CHESS) comprised a multi-week airborne remote sensing and field observation campaign in the Upper Gunnison Basin, Colorado, conducted in June and July of 2025. Airborne remote sensing was conducted by the National Ecological Observatory Network Airborne Observation Platform (NEON AOP), concurrent with a field campaign run by the Rocky Mountain Biological Laboratory (RMBL), the Lawrence Berkeley National Laboratory (LBNL) and SLAC National Accelerator Laboratory Watershed Function Science Focus Area (SFA), and NASA-JPL (Jet Propulsion Laboratory) Earth Surface Mineral Dust Source Investigation (EMIT) program. Between June 10 and July 18, 2025, the NEON AOP flight team collected high-resolution aerial imaging spectroscopy and Light Detection and Ranging (LiDAR) data over three domains: the Upper East River (CRBU), Almont Triangle (ALMO), and the Upper Taylor Basin (UPTA). In coordination with the flights, a field campaign acquired ground-truth observations, including observations of vegetation composition, foliar traits, forest demography, and subsurface properties in 18 core sampling areas within the domains. Additional surface water observations were taken at over 380 point locations. All CHESS campaign datasets can be found within the CHESS ESS-DIVE data portal: https://data.ess-dive.lbl.gov/portals/chess. Funding Acknowledgement: Field and remote-sensing data acquisition was performed under a grant from the National Aeronautics and Space Administration (80NSSC24K1005). This work was also supported by the Watershed Function Science Focus Area at Lawrence Berkeley National Laboratory funded by the US Department of Energy, Office of Science, Biological and Environmental Research under Contract No. DE-AC02-05CH11231.

2018 NEON and 2025 CHESS Campaigns↗
DOE OSTI2021

Production-Ready CsPbBr3 Module Fabrication

The purpose of this SBIR was to work on evaluation, development, and testing of CsPbBr3 semiconductors for use in commercial gamma-ray detection. The overarching goal was to demonstrate the capability to fabricate functional detectors through resources available to H3D, Inc in pursuit of an alternative to CdZnTe for room-temperature semiconductor detectors. Throughout the project, CdZnTe crystals from Redlen were used as a control group to demonstrate whether the fabrication processes could produce reasonable results. The CdZnTe crystals were diced into roughly 6 mm x 6 mm x 4.5 mm pieces and electrodes were evaporated onto planar faces. In one case, pixels were patterned through a laser ablation method; in the other, a rudimentary pixel shadow-mask was fabricated, and the pixels were generated in the evaporation process. A 16 mm x 16 mm x 14 mm CsPbBr3 crystal was diced into four smaller crystals. These CsPbBr3 had electrodes applied in a similar way to the CdZnTe samples with a rudimentary mask used for pixels on the cathode. Tested CdZnTe pieces were found to generally function with reasonable, low-energy performance. CsPbBr3 crystals were found to be non-functional under forward bias with a large dark-current. A separate attempt, using reverse bias in a non-H3D, Inc test system, observed a dark current similar to previous observations, and some active pixels but no waveforms were observed.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2025

Even Higher-Level Synthesis: An Exploration of AI Hardware Accelerators using HLS4ML

With the rise of artificial intelligence, the popularization of deep learning, and a constantly evolving industry, the demand for flexible and efficient tools has never been greater. As algorithms grow more complex, their runtime and energy consumption increase exponentially. Customized hardware accelerators, long used for specific mathematical operations, remain essential for managing modern applications' computational and power demands. Hardware accelerators can speed up complex computations by orders of magnitude, but their manual design and verification processes are often challenging and time-consuming. High-Level Synthesis (HLS) provides a solution by transforming high-level algorithm descriptions, typically written in C++ or SystemC, into synthesizable RTL suitable for hardware implementation. This approach reduces development time for RTL engineers while offering flexibility beyond what traditional handwritten RTL can provide. We extended this capability to the machine-learning domain with the open-source framework hls4ml, which allows neural networks trained in Python frameworks like Tensorflow or PyTorch to be synthesized into efficient hardware representations for the traditional FPGA and ASIC flows. This breakthrough addresses the growing need for reduced design turnaround and easy verification of ML hardware accelerators with low latency and power efficiency constraints. During this tutorial, we will demonstrate how Python complements HLS by simplifying the ML design process, bridging the gap between software and hardware development. Attendees will explore how we translate neural networks modeled in Python into fixed-point C++ models suitable for HLS workflows. We will dive into strategies like Value-Range Analysis and Quantization-Aware Training, which optimize these designs for deployment and evaluate their accuracy, power consumption, and energy efficiency. To exemplify these concepts, experts from Fermilab will share their experiences applying this technology to high-energy physics experiments, where real-time, low-latency processing is critical. Over the years, Fermilab engineers have demonstrated how deep neural networks, optimized for hardware using hls4ml, can meet the stringent requirements of trigger systems at the CERN Large Hadron Collider. These systems rely on rapid decision-making to process immense data volumes while retaining only the most relevant events for further analysis. The application of hls4ml has also been extended to innovative technologies like smart pixel arrays. These smart pixels integrate ML inference capabilities directly into sensor devices, enabling localized data processing at the pixel level. This approach drastically reduces the need to transmit raw data to external processing units, significantly decreasing power consumption and latency. By embedding neural networks within the pixel architecture, the smart pixels can identify and prioritize relevant data in real time, providing a highly efficient solution for edge computing in scenarios such as particle detectors and imaging systems. Fermilab's work highlights the potential of hardware-accelerated ML in scenarios where both speed and power efficiency are mission-critical. Through this tutorial, attendees will gain valuable insights into the challenges and solutions of deploying ML in hardware. Understanding how HLS and hls4ml streamline the development of neural network-based hardware accelerators is fundamental for the industry's future. Participants will learn how these technologies are shaping the future of AI and scientific computing.

Di Guglielmo, Giuseppe [Fermilab]↗
DOE OSTI2020

Detector Characterization for Quantitative Spectral Radiography of Uranium Powder Samples

Pacific Northwest National Laboratory (PNNL) is developing a prototype spectral x-ray radiography (SpecX) non-destructive assay system for noninvasive material mass quantification of uranium-bearing powders. The SpecX system uses a custom material estimation algorithm, which requires a high-fidelity pixel-by-pixel detector response model for accurate quantification. We performed a detailed characterization and built a model of a High-Energy X-ray Imaging Technology (HEXITEC) CdTe pixelated spectral detector. Here we present the detector characterization which led to that model, including a determination of the pixel-wise energy calibration, the detection efficiency, the detector uniformity, the detector stability, and a comparison of methods to remove charge-shared events.

spectral X-ray radiography, pixelated detector, ca↗