Kraken Camera Development and Fielding Overview
Explore the source record for details and available documents.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
SEARCH · Search NASA
Results for “digital framing sensors”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Complex Parsing for In-Network Acceleration of High-Energy Physics Experiments
This paper describes a novel application and evaluation of programmable networking in High-Energy Physics (HEP): a complete parser for the custom packet format used by Fermilab’s DUNE experiment. Notably, this parser is implemented on a Tofino programmable network switch and evaluated on the FABRIC testbed by using network traffic generated by the ICEBERG DUNE prototype. The parsed network traffic consists of Jumbo Ethernet frames that contain digitizations of sensor readings from ICEBERG’s detector.This work is an early investigation into providing in-network processing support for HEP experiments. The paper describes DUNE’s custom packet format, the challenges encountered when implementing a parser for that format, and an exploration of the techniques that are needed to overcome those challenges. We identify performance bottlenecks and discuss directions for future research.
Sagstad, Bjoern [IIT, Chicago] (ORCID:000900033610↗
Spatiotemporal Automatic Calibration of Infrastructure Lidar, Radar, and Camera with a Global Navigation Satellite System
Robust and accurate perception is important for modern intelligent transportation systems (ITS), which use sensors of various modalities for data fusion to create a digital twin of an intersection. Sensor calibration is an important process that creates a unified coordinate frame for the sensor output data so that it can be used for data fusion. Classical approaches for sensor calibration are time-consuming, require an overlapping field of view for feature matching, and are not feasible for ITS application as they cause disruptions in the flow of traffic. In this paper, we present a spatiotemporal automatic calibration approach to calibrate multiple infrastructure lidar, radar, and cameras installed at a traffic intersection. The approach uses global navigation satellite system (GNSS) positioning information shared by connected vehicles, and when the vehicle is detected by the sensor, we match the sensor detections with the GNSS coordinates. The proposed algorithm is evaluated with a real-world dataset utilizing detections from two radars, cameras, and lidars with a test vehicle instrumented with a post-processing kinematic (PPK)-corrected GNSS driving past the sensors installed at a four-way traffic intersection. The experimental results show that the proposed automatic calibration approach can achieve the transformation with a root mean squared error of less than 0.5 for radar and lidar and less than 2 for camera detections. The ability to rapidly calibrate sensors not only benefits initial installations, but can also be used for system health monitoring, while utilizing available connected vehicle data to test the real-time sensor fidelity and operational status.
ADVANCED PROPULSION SYSTEMS,ENERGY CONSERVATION, C↗
Spatiotemporal Automatic Calibration of Infrastructure Lidar, Radar, and Camera with a Global Navigation Satellite System: Preprint
Robust and accurate perception is important for modern intelligent transportation systems (ITS), which use sensors of various modalities for data fusion to create a digital twin of an intersection. Sensor calibration is an important process that creates a unified coordinate frame for the sensor output data so that it can be used for data fusion. Classical approaches for sensor calibration are time-consuming, require an overlapping field of view for feature matching, and are not feasible for ITS application as they cause disruptions in the flow of traffic. In this paper, we present a spatiotemporal automatic calibration approach to calibrate multiple infrastructure lidar, radar, and cameras installed at a traffic intersection. The approach uses global navigation satellite system (GNSS) positioning information shared by connected vehicles, and when the vehicle is detected by the sensor, we match the sensor detections with the GNSS coordinates. The proposed algorithm is evaluated with a real-world dataset utilizing detections from two radars, cameras, and lidars with a test vehicle instrumented with a post-processing kinematic (PPK)-corrected GNSS driving past the sensors installed at a four-way traffic intersection. The experimental results show that the proposed automatic calibration approach can achieve the transformation with a root mean squared error of less than 0.5 for radar and lidar and less than 2 for camera detections. The ability to rapidly calibrate sensors not only benefits initial installations, but can also be used for system health monitoring, while utilizing available connected vehicle data to test the real-time sensor fidelity and operational status.
ADVANCED PROPULSION SYSTEMS↗
Electronic device and method for compressing video data
A computer-implemented method for compressing video data comprises receiving a sequence of video data values, each video data value being a digital value from a successive one of a plurality of pixels that form a video sensor, the sequence of video data values resulting from successive frames of video captured by the video sensor; extracting the video data values for each pixel in turn to create a plurality of pixel data streams, each pixel data stream including the video data value for each frame of captured video for the pixel; and applying data compression to each pixel data stream to create compressed data for each pixel data stream.
Tohlen, Michael Aaron↗
Electronic device and method for compressing video data
A computer-implemented method for compressing video data comprises receiving a sequence of video data values, each video data value being a digital value from a successive one of a plurality of pixels that form a video sensor, the sequence of video data values resulting from successive frames of video captured by the video sensor; extracting the video data values for each pixel in turn to create a plurality of pixel data streams, each pixel data stream including the video data value for each frame of captured video for the pixel; and applying data compression to each pixel data stream to create compressed data for each pixel data stream.
Tohlen, Michael Aaron↗
Characterization of high-flux cadmium zinc telluride detectors coupled to MM-PAD readout ASICs for high-flux X-ray applications
High-flux cadmium zinc telluride (HF-CZT) is a promising material for next-generation X-ray imaging due to its high stopping power, wide bandgap, and improved resistance to radiation-induced polarization [1]. We bonded 2 mm thick HF-CZT sensors with Cornell's Mixed-Mode Pixel Array ASICs, which combine analog charge integration and in-pixel digital counting to achieve single X-ray sensitivity, large full well capacity, and frame rates up to 10 kHz [2,3]. Detector characterization showed stable electron collection above 150 V bias, while hole collection remained limited by trapping even at 700 V. Temporal studies revealed non-negligible afterglow, with an unexpected increase in afterglow at higher biases, which was reduced by infrared illumination, suggesting that injected carriers reduce trapping near contact interfaces. Polarization measurements confirmed improved stability compared to conventional CZT, though polarization effects persisted, particularly with hole collection, with up to 5% signal loss and spatial distortion at high doses.
36 MATERIALS SCIENCE↗
A Cryogenic readout integrated circuit with analog pile-up and in-Pixel ADC for high frame rate Skipper CCD-in-CMOS Sensors
The Skipper CCD-in-CMOS Parallel Read-Out Circuit V2 (SPROCKET2) is designed to enable high frame rate readout of Skipper CCD-in-CMOS image sensors. The SPROCKET2 pixel is fabricated in a 65 nm CMOS process and occupies a 60$\mu$m $\times$ 60$\mu$m footprint. SPROCKET2 is intended to be heterogeneously integrated with a pixelated Skipper CCD-in-CMOS sensor, such that one readout pixel is connected to a multiplexed array of 16 active image sensor pixels, to match their spatial geometry. Our design benefits from the Skipper CCD-in-CMOS sensor's non-destructive readout capability to achieve exceptionally low noise through multi-sampling and averaging while optimizing for total power consumption. The pixel readout utilizes correlated double sampling to minimize 1/f noise and includes "pile-up" of ten successive samples in the analog domain before digitizing at a rate of 66.7 ksps. Measurement results of in-pixel serial SAR ADC show DNL and INL of ~0. 44 LSB and 0.58 LBS respectively. A large area array of 20,000 SPROCKET2 ADC pixels (multiplexed 1:16 to 320,000 sensor pixels) is currently under test. By reading out data over a 10 Gbps optical link, this pixel design enables a frame rate of $\sim$ 4 kfps for large sensing areas with minimal sensing deadtime. In the highest gain mode, the pixelated ADC has an input-referred resolution of 10$\mu$V with a simulated power consumption of 50$\mu$W. The pixel operates with constant current draw to minimize power-rail crosstalk.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
The ETROC2 as the Final Version for CMS Endcap Timing Layer (ETL) Upgrade
The ETROC (Endcap Timing Readout Chip) is being developed for the LGAD-based CMS Endcap Timing Layer (ETL) at HL-LHC. The ETL on each side of the interaction region will be instrumented with a two-disk system of MIP-sensitive LGAD (Low Gain Avalanche Diodes) silicon devices, read out by ETROCs for precision timing measurement with down to ~30 ps timing resolution per track. The ETROC is designed to handle a 16 x 16 pixel cell matrix, with each pixel being 1.3 mm x 1.3 mm to match the LGAD sensor pixel size. The front-end design for preamplifier and discriminator has been specifically optimized for the reduced LGAD signals, with enough flexibilities to meet the ETL specific needs for time resolution, power budget and radiation profile. The ETROC chip is implemented in a commercial 65nm CMOS process. Each channel consists of a preamplifier, a discriminator, a TDC used for TOA (Time Of Arrival) and TOT (Time Over Threshold) measurements, and a memory for data storage and readout. An in-pixel auto threshold calibration is included, along with a self-testing pattern generator. The TOT is used for time-walk correction of the TOA measurement. The detailed hit information (TOA and TOT) from each cell will be read out from a local circular buffer after each Level-1 Accept (about 1 MHz). In addition, a charge injection circuit is implemented to allow for testing and calibration. For more detailed monitoring of the signal pulses, waveform sampling circuits are included for one pixel. The clock distribution is based on a 16x16 H-tree design with a shielding structure to alleviate potential interference. The global peripheral circuits include a PLL, a phase shifter, an I2C slave controller, a fast control block, a global readout, and a data driver along with an efuse and temperature sensor. The ETROC builds event data frames for each L1A selected event and is also capable of providing L1 trigger information for user-defined delayed hits. The main design challenge is how to extract precision timing information from the small LGAD signals in the presence of high irradiation fluence, while keeping the power consumption and digital activity low. The ETL design goal for the time resolution of 50 ps per hit is required to achieve a 35 ps arrival time measurement for a MIP particle, which has its track registered in two ETL disk layers. The LGAD contribution is known to be about 30 ps, this means that the jitter from the ETROC has to be kept below 40 ps. The ETROC2 is the first full size full functionality prototype design fully compatible with the final chip specifications for CMS ETL and now becomes the final version. The ETROC2 chips have been extensively tested. We will present here new testing results including the bump bonding yield improvement study, the time walk correction (TWC) generality study with one pixel TWC applying to all pixels, the final SEU testing using both heavy ion and proton beam, more beam test studies including different sensors, and readiness for the ETROC2 production for CMS ETL upgrade.
Liu, Tiehui [Fermilab] (ORCID:0009000765225605)↗
New Orthophoto Generation Strategies from UAV and Ground Remote Sensing Platforms for High-Throughput Phenotyping
Remote sensing platforms have become an effective data acquisition tool for digital agriculture. Imaging sensors onboard unmanned aerial vehicles (UAVs) and tractors are providing unprecedented high-geometric-resolution data for several crop phenotyping activities (e.g., canopy cover estimation, plant localization, and flowering date identification). Among potential products, orthophotos play an important role in agricultural management. Traditional orthophoto generation strategies suffer from several artifacts (e.g., double mapping, excessive pixilation, and seamline distortions). The above problems are more pronounced when dealing with mid- to late-season imagery, which is often used for establishing flowering date (e.g., tassel and panicle detection for maize and sorghum crops, respectively). In response to these challenges, this paper introduces new strategies for generating orthophotos that are conducive to the straightforward detection of tassels and panicles. The orthophoto generation strategies are valid for both frame and push-broom imaging systems. The target function of these strategies is striking a balance between the improved visual appearance of tassels/panicles and their geolocation accuracy. The new strategies are based on generating a smooth digital surface model (DSM) that maintains the geolocation quality along the plant rows while reducing double mapping and pixilation artifacts. Moreover, seamline control strategies are applied to avoid having seamline distortions at locations where the tassels and panicles are expected. The quality of generated orthophotos is evaluated through visual inspection as well as quantitative assessment of the degree of similarity between the generated orthophotos and original images. Several experimental results from both UAV and ground platforms show that the proposed strategies do improve the visual quality of derived orthophotos while maintaining the geolocation accuracy at tassel/panicle locations.
54 ENVIRONMENTAL SCIENCES↗
Nanosecond Gated CMOS Camera (NSGCC) ICD (Rev. 2.1)
The Ultra-Fast X-ray Imager (UXI) program is an ongoing effort at Sandia National Laboratories to create high speed, multi-frame, time-gated Read Out Integrated Circuits (ROICs), and a corresponding suite of photodetectors to image a wide variety of High Energy Density (HED) physics experiments on both Sandia’s Z-Machine and LLNL’s National Ignition Facility (NIF). Several cameras have been designed over the length of the program; one of the most recent is the Icarus, which is an improvement on past imagers (Furi and Hippogriff). A second sensor that can be connected is the Daedalus sensor. The Icarus is a 1024 × 512-pixel array with either 25 μm or 8 µm spatial resolution containing four frames of storage per pixel and has improved timing generation and distribution components while achieved 2 ns time gating. The Daedalus sensor is also a 1024 x 512-pixel array with 25 µm special resolution containing three frames of storage per pixel and has an increased set of features for a wider variety of applications from interlacing of rows in each frame to configurability of all shutters. See Section 14 for details regarding the Icarus implementation of the firmware and Section 15 for details regarding the Daedalus implementation. Due to the unique test environments UXI sensors are targeted for, full custom hardware was required to physically mount an Icarus or Daedalus sensor, manage its various functions, and read out pixel data for transfer to a host computer. Beyond experimental functionality, the hardware also needed to accommodate sensor characterization requirements. Lawrence Livermore National Laboratory’s ‘Version 4.0 Board’ was the result of these efforts. It mounts all the components required to fully utilize the Icarus and Daedalus sensors including analog to digital converters to convert pixel data and various system voltages to digital form for readout and analysis, DAC channels for remote configuration of critical bias voltages, static random-access memories to buffer pixel data, RS422 and Gigabit Ethernet communications for remote access, and an FPGA to tie these components together. This document describes the FPGA electrical interfaces in detail to allow the reader a greater understanding of the device, and to facilitate implementation of custom software to control and manage it. The Version 4.0 Board is a continuation of the Nano-second Gated CMOS hardware design that retains much of the functionality of the Version 1.0 Board while adding features including a DAC instead of digital potentiometers, as well as sensors for pressure and radiation. The Version 4.0 board is intended for applications requiring tight form-factor enclosures. It is composed of two stacking boards; one holds the FPGA and regulators to power the various components of the board while the other contains the mating connector to the sensor, image-readoff ADCs, the DAC, and other components.
42 ENGINEERING↗
Automated construction of clear-sky dictionary from all-sky imager data
All-sky imagers (ASIs) have significant promise as scalable sensors for short-term solar irradiance forecasting. Many of the current computational techniques that use ASIs for this purpose rely on collections of clear-sky images indexed by time of day, solar angle, or both, called clear-sky dictionaries (CSDs). These CSDs act as baselines against which images can be compared to locate and classify clouds within the image frame. CSDs are often compiled by hand, where individuals visually inspect collections of images one at a time to find clear-sky images. This process is not scalable, and it is prone to error. This paper proposes an automated, nonparametric alternative that uses the principles of digital image processing to find clear-sky images within a set of images taken over several days. We use ground-truth measurements of the clearness index to assess the performance of our method, and we show that the images it selects accurately correspond to clear-sky images. We also compare our proposal, which is nonparametric, with a state-of-the-art parametric method. The numerical results indicate that the performance of the method proposed here is superior.
14 SOLAR ENERGY↗
The SparkPix-S ASIC for the sparsified readout of 1 MHz frame-rate X-ray cameras at LCLS-II: pixel design and simulation results
Exploiting the “sparse” nature of the information in XPCS (X-ray Photon Correlation Spectroscopy) and XSVS (Speckle Visibility Spectroscopy) experiments, we present the SparkPix-S, a 3-sides buttable Application Specific Integrated Circuit (ASIC) based on a sparsified readout strategy for large-format hybrid detectors. The SparkPix-S architecture, based on the successful ePix family, will be composed as follows: a front-end 2-D matrix of 384×352 square pixels with 50 µm pitch is arranged to match the dimensions of a PIN Si-sensor matrix; charge readout, signal shaping and amplitude discrimination is performed at pixel-level, by means of a low-power (<18 µW) analog processor, which, in case of an event, negotiates access to an analog bus placed every other column; on the chip periphery (balcony), the information on each bus is digitized by an array of successive approximation analog-to-digital converters (SAR-ADCs) running at 10 Msps; on the digital back-end the global logic will generate the output data stream using low-voltage differential signalling (LVDS). A first prototype of the SparkPix-S, with a reduced matrix size of 96×96 pixels, is currently under production on a 130 nm CMOS technology. Simulated performance results show an equivalent noise charge <60 el. r.m.s. at 1 MHz repetition rate, with a maximum input energy of 60 keV and capability to discriminate charge signals with equivalent energy as low as 900 eV.
46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
High speed ultraviolet digital image correlation (UV-DIC) for dynamic strains at extreme temperatures
Digital Image Correlation (DIC) is a camera-based method of measuring full-field displacements and strains from the surface of a deforming object. It can be applied at any length scale (determined by the lenses) and any time scale (determined by the camera), and because it is non-contacting, it can also be used at temperatures much higher than can be withstood by bonded strain gauges. At extreme temperatures, materials emit light in the form of blackbody radiation, which can saturate the camera sensor. It has previously been shown that the emitted light can be effectively screened by using ultraviolet (UV) cameras, lenses, and filters; however, commercially available UV cameras are relatively slow, which limits the speed of combined UV-DIC measurements. In this study, a UV intensifier was paired with a high-speed camera, and its ability to perform UV-DIC at high temperature and high speed was investigated. The system was compared over three different experiments: (A) a quasi-static thermal expansion test at high temperature, (B) a vibration test at room temperature, and (C) the same vibration test repeated at high temperature. The system successfully performed DIC up to at least 1600 °C at frame rates of 5000 fps, which is more than 100 times faster than other examples of UV-DIC in the literature. In all cases, measurements made using the UV intensifier were much noisier than those made without the intensifier, but the intensifier enabled measurements at temperatures well above those which an unfiltered high-speed camera otherwise saturates.
47 OTHER INSTRUMENTATION↗
Characterization of Orography-Influenced Riming and Secondary Ice Production and Their Effects on Precipitation Rates Using Radar Polarimetry and Doppler Spectra (CORSIPP-SAIL)
The Characterization of Orography-Influenced Riming and Secondary Ice Production and Their Effects on Precipitation Rates Using Radar Polarimetry and Doppler Spectra (CORSIPP) project was conducted to help improve the understanding of precipitation formation in orographically influenced terrain. Special focus is put on the two processes of riming and secondary ice production and their external drivers. Two instruments, a polarimetric W-band simultaneous transmission simultaneous reception (STSR) Doppler cloud radar manufactured by Radiometer Physics GmbH (RPG, instrument type RPG-FMCW-94-DP), from now on named LIMRAD94, and the video in situ snowfall sensor (VISSS), were deployed at the U. S. Department of Energy Atmospheric Radiation Measurement (ARM) user facility’s Surface Atmosphere Integrated Field Laboratory (SAIL) site in Gothic, Colorado between November 2022 and June 2023 during the second SAIL winter. Note that the exact dates of data availability differ between the instruments. Both instruments arrived at Gothic on November 2, 2022, 09:20 local time. VISSS, described by Maahn et al., is equipped with two camera systems with telecentric lenses. The two cameras are at a 90° angle to each other. This configuration allows for size-independent measurements by capturing images of hydrometeors from two sides at a high frame rate of 250 Hz. With a minimum detection size of 200 μm, VISSS provides valuable insights into particle size, number, shape, complexity, and fall velocity. The VISSS was deployed on the grassland next to the ARM facility with the amazing help of the ARM employees on site. The setup started on November 2, 2022, and was finished on November 5, 2022, without major problems. VISSS measurements were started on November 6, 2022. LIMRAD94 was installed on a scaffolding platform near Orehouse (Gothic) on November 9, 2022, with the great help of RMBL staff. LIMRAD94 was mounted on a cold temperature scanner prototype. After a short test of the setup on November 9, 2022, the digital control of the scanner elevation stopped working for (at that time) unknown reasons. All attempts to resolve the problem failed. This malfunction made it impossible to operate LIMRAD94 in scanning mode. The scanner was then manually moved to zenith pointing mode and between November 10 and November 15, 2022, vertical observations for polarimetric calibration were performed. On November 15, 2022, after the polarimetric calibration was applied, the scanner was manually moved to 40° elevation with azimuthal view towards the Ka-band ARM Zenith Radar (KAZR) and measurements were continued at constant elevation. Investigation of the scanner malfunction on February 6, 2023, by Benn Schmatz revealed a disengagement between the cogwheel of the elevation motor and the cogwheel moving the scanner in elevation. This mechanical issue was temporarily solved by re-engaging the cogwheels. This made the scanner operational again for about four weeks, until mechanical force disengaged the cogwheels again on March 15, 2023. This repeated scanner failure remained undetected for about three weeks until April 8, 2023; during this time the scanner was stuck at 72° elevation. However, the radar software continued to produce data files falsely indicating that the scanner was still operational. After the scanner failure was noticed, scanning was stopped again, and we returned to constant elevation measurements. On May 15, 2023, the cogwheels of the elevation motor were secured with additional screws sent by the manufacturer. At some point in May, the cogwheels of the azimuth motor were also disengaged by mechanical force, which still allowed for range height indicator (RHI) but no plan position indicator (PPI) scans in the last weeks of the campaign. The azimuth motor was repaired in Germany after the end of the campaign. Throughout the campaign, RMBL and ARM staff kept the radar and the VISSS free of snow.
54 ENVIRONMENTAL SCIENCES↗