Search NASA⌕ Search

SEARCH · Search NASA

Results for “Image Sensor”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Geophysical Signatures of Crack Network Coalescence in Rocks at Multiple Length Scales

The main goal of the research project was to identify the geophysical signatures of fracture growth in natural rocks by utilizing novel geophysical techniques. The research objectives were to (a) investigate the potential for geophysical methods to determine when cracks initiate, the types and locations of propagated cracks, and the coalescence of networks of cracks in natural rocks at multiple scales, (b) determine how damage at the microscale evolved into damage at the macroscale and then link the microscopic and macroscopic observations, (c) quantify crack coalescence in rocks under realistic stress conditions using coupled mechanical-geophysical-optical visualization, and (d) identify the precursors in geophysical signals to crack coalescence. The following research thrusts were explored to achieve the research objectives: (1) uniaxial compression testing of rock specimens with and without a set of pre‐existing flaws and (2) triaxial compression testing of natural rock specimens. These thrusts allowed for exploring fracturing in rocks under realistic in situ environments and at multiple scales. This project provided educational opportunities for nine graduate and undergraduate students and resulted in 27 peer-reviewed publications. This first research thrust focused on investigating the micromechanics of fractures in rocks through uniaxial compression testing combined with advanced geophysical and imaging techniques, specifically acoustic emission (AE) monitoring, ultrasonic imaging, and 2-dimensional Digital Image Correlation (2D-DIC). By examining damage processes under time-independent and time-dependent loading conditions, insights into damage localization, crack initiation, and fracturing mechanisms were gained. It was observed that the AE signals and the strain-based measurements directly reflect the state of damage in the rock specimen and could be used to identify the cracking levels, such as the crack initiation (CI) and crack damage (CD), and the mode of deformation. A novel calibration apparatus was developed to enhance the accuracy of AE sensors, allowing for the estimation of key parameters such as magnitude, source dimension, stress drop, and radiated seismic energy associated with the fractures. The findings highlighted significant variations in the temporal evolution of AE source parameters during the primary, secondary, and tertiary stages of creep, identifying tensile cracking as the primary deformation mode. The second research thrust focused on enhancing the understanding of fracturing processes in natural rocks through triaxial compression testing, real-time AE monitoring, and ultrasonic monitoring. We investigated the impact of various factors such as fracture propagation regimes, injection parameters, rock types, and pre-existing conditions on the hydraulic fracture (HF) behavior using scaled true-triaxially loaded specimens of Barre granite and Lyons sandstone. Custom sensor housing facilitated concurrent active and passive monitoring to analyze hydro-mechanical responses and microseismicity associated with different HF scenarios. A coupled investigation of passive microseismicity and active signal attributes permitted a detailed comprehension of the various HF processes (aseismic deformation, fracture initiation and propagation, fluid permeation, and leak-off) and their dependence on the specific rock type. The findings of this research demonstrated the effectiveness of AE monitoring techniques in providing valuable insights into the impact of various factors on the behavior and dynamics of HF processes. The advancements in monitoring techniques, offering a more thorough and precise approach, represent a significant step towards optimizing HF practices and ensuring sustainable resource extraction.

58 GEOSCIENCES↗

In-Situ Process Monitoring Evaluation and Demonstration using Advanced Characterization with Laser Powder Bed Systems

Oak Ridge National Laboratory’s (ORNL) Manufacturing Demonstration Facility (MDF) worked with EOS Group to evaluate the current in-situ sensor capabilities of an EOS M290 Laser Powder Bed Fusion machine. The M290 was fitted with a 1 Mega-Pixel (MP) grayscale visible-light camera and a 5 MP temporally integrated (TI) near-infrared (NIR) camera. One print from stainless steel (SS) 316 and two from Inconel 625 (IN625) were performed where data including in-situ imaging and a machine log file were captured. These data were subsequently analyzed using a Dynamic Multi-Scale Segmentation Convolutional Neural Network (DMSCNN) trained on user defined classes and correlated to as-printed flaws, in the form of porosity, discovered in X-Ray Computed Tomography (XCT). In Phase I, two indications were detected in-situ and spatially correlated to stochastic lack-of-fusion flaws discovered using XCT. In Phase II, using these links from in-situ signatures to XCT flaw populations, a second neural network (NN) was trained to create a Voxelized Property Prediction Model (VPPM) to predict porosity percentages within the part using only features garnered from the in-situ data from two IN625 complex geometries. The VPPM was able to accurately predict porosity values for IN625 parts with an R 2 value of 0.764.

36 MATERIALS SCIENCE↗

In-Situ Process Monitoring Evaluation and Demonstration using Advanced Characterization with Laser Powder Bed Systems

Oak Ridge National Laboratory’s (ORNL) Manufacturing Demonstration Facility (MDF) worked with EOS Group to evaluate the current in-situ sensor capabilities of an EOS M290 Laser Powder Bed Fusion machine. The M290 was fitted with a 1 Mega-Pixel (MP) grayscale visible-light camera and a 5 MP temporally integrated (TI) near-infrared (NIR) camera. One print from stainless steel (SS) 316 and two from Inconel 625 (IN625) were performed where data including in-situ imaging and a machine log file were captured. These data were subsequently analyzed using a Dynamic Multi-Scale Segmentation Convolutional Neural Network (DMSCNN) trained on user defined classes and correlated to as-printed flaws, in the form of porosity, discovered in X-Ray Computed Tomography (XCT). In Phase I, two indications were detected in-situ and spatially correlated to stochastic lack-of-fusion flaws discovered using XCT. In Phase II, using these links from in-situ signatures to XCT flaw populations, a second neural network (NN) was trained to create a Voxelized Property Prediction Model (VPPM) to predict porosity percentages within the part using only features garnered from the in-situ data from two IN625 complex geometries. The VPPM was able to accurately predict porosity values for IN625 parts with an R 2 value of 0.764.

36 MATERIALS SCIENCE↗

Simulation study for particle identification with the dRICH of the ePIC experiment at the EIC

The dual-radiator Imaging Cherenkov detector (dRICH), employing an aerogel and a gas radiator, is a key component of the forward particle identification system for the ePIC experiment at the Electron-Ion Collider (EIC). This study evaluates the dRICH performance using Geant4 simulations in the context of the global ePIC simulation stack, focusing on the optimization of the aerogel radiator and the impact of sensor noise. We compare two aerogel configurations: the initial design (n = 1.019) and the current default (n = 1.026). The latter, characterized by improved optical properties and a higher refractive index, demonstrates enhanced π/K separation at high momenta, effectively extending the operational overlap with the C 2 F 6 gas radiator (n = 1.00076 at 25 °C, as implemented in the simulation software). Additionally, the study investigates the impact of Silicon Photomultiplier (SiPM) dark noise, showing that a 300 kHz noise rate per 3mm x 3mm channel leads to a moderate reduction (approximately 1.5 GeV/c) in the 3σ separation threshold. These results validate the current dRICH design and quantify the purity levels achievable for both radiators under expected experimental conditions.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗

Even Higher-Level Synthesis: An Exploration of AI Hardware Accelerators using HLS4ML

With the rise of artificial intelligence, the popularization of deep learning, and a constantly evolving industry, the demand for flexible and efficient tools has never been greater. As algorithms grow more complex, their runtime and energy consumption increase exponentially. Customized hardware accelerators, long used for specific mathematical operations, remain essential for managing modern applications' computational and power demands. Hardware accelerators can speed up complex computations by orders of magnitude, but their manual design and verification processes are often challenging and time-consuming. High-Level Synthesis (HLS) provides a solution by transforming high-level algorithm descriptions, typically written in C++ or SystemC, into synthesizable RTL suitable for hardware implementation. This approach reduces development time for RTL engineers while offering flexibility beyond what traditional handwritten RTL can provide. We extended this capability to the machine-learning domain with the open-source framework hls4ml, which allows neural networks trained in Python frameworks like Tensorflow or PyTorch to be synthesized into efficient hardware representations for the traditional FPGA and ASIC flows. This breakthrough addresses the growing need for reduced design turnaround and easy verification of ML hardware accelerators with low latency and power efficiency constraints. During this tutorial, we will demonstrate how Python complements HLS by simplifying the ML design process, bridging the gap between software and hardware development. Attendees will explore how we translate neural networks modeled in Python into fixed-point C++ models suitable for HLS workflows. We will dive into strategies like Value-Range Analysis and Quantization-Aware Training, which optimize these designs for deployment and evaluate their accuracy, power consumption, and energy efficiency. To exemplify these concepts, experts from Fermilab will share their experiences applying this technology to high-energy physics experiments, where real-time, low-latency processing is critical. Over the years, Fermilab engineers have demonstrated how deep neural networks, optimized for hardware using hls4ml, can meet the stringent requirements of trigger systems at the CERN Large Hadron Collider. These systems rely on rapid decision-making to process immense data volumes while retaining only the most relevant events for further analysis. The application of hls4ml has also been extended to innovative technologies like smart pixel arrays. These smart pixels integrate ML inference capabilities directly into sensor devices, enabling localized data processing at the pixel level. This approach drastically reduces the need to transmit raw data to external processing units, significantly decreasing power consumption and latency. By embedding neural networks within the pixel architecture, the smart pixels can identify and prioritize relevant data in real time, providing a highly efficient solution for edge computing in scenarios such as particle detectors and imaging systems. Fermilab's work highlights the potential of hardware-accelerated ML in scenarios where both speed and power efficiency are mission-critical. Through this tutorial, attendees will gain valuable insights into the challenges and solutions of deploying ML in hardware. Understanding how HLS and hls4ml streamline the development of neural network-based hardware accelerators is fundamental for the industry's future. Participants will learn how these technologies are shaping the future of AI and scientific computing.

Di Guglielmo, Giuseppe [Fermilab]↗

Fluorescence imaging of individual ions and molecules in pressurized noble gases for barium tagging in 136Xe

Abstract The imaging of individual Ba 2+ ions in high pressure xenon gas is one possible way to attain background-free sensitivity to neutrinoless double beta decay and hence establish the Majorana nature of the neutrino. In this paper we demonstrate selective single Ba 2+ ion imaging inside a high-pressure xenon gas environment. Ba 2+ ions chelated with molecular chemosensors are resolved at the gas-solid interface using a diffraction-limited imaging system with scan area of 1 × 1 cm 2 located inside 10 bar of xenon gas. This form of microscopy represents key ingredient in the development of barium tagging for neutrinoless double beta decay searches in 136 Xe. This also provides a new tool for studying the photophysics of fluorescent molecules and chemosensors at the solid-gas interface to enable bottom-up design of catalysts and sensors.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Assessing Heterogeneity of Surface Water Temperature Following Stream Restoration and a High-Intensity Fire from Thermal Imagery

Thermal heterogeneity of rivers is essential to support freshwater biodiversity. Salmon behaviorally thermoregulate by moving from patches of warm water to cold water. When implementing river restoration projects, it is essential to monitor changes in temperature and thermal heterogeneity through time to assess the impacts to a river’s thermal regime. Lightweight sensors that record both thermal infrared (TIR) and multispectral data carried via unoccupied aircraft systems (UASs) present an opportunity to monitor temperature variations at high spatial (<0.5 m) and temporal resolution, facilitating the detection of the small patches of varying temperatures salmon require. Here, we present methods to classify and filter visible wetted area, including a novel procedure to measure canopy cover, and extract and correct radiant surface water temperature to evaluate changes in the variability of stream temperature pre- and post-restoration followed by a high-intensity fire in a section of the river corridor of the South Fork McKenzie River, Oregon. We used a simple linear model to correct the TIR data by imaging a water bath where the temperature increased from 9.5 to 33.4 °C. The resulting model reduced the mean absolute error from 1.62 to 0.35 °C. We applied this correction to TIR-measured temperatures of wetted cells classified using NDWI imagery acquired in the field. We found warmer conditions (+2.6 °C) after restoration (p < 0.001) and median absolute deviation for pre-restoration (0.30) to be less than both that of post-restoration (0.85) and post-fire (0.79) orthomosaics. In addition, there was statistically significant evidence to support the hypothesis of shifts in temperature distributions pre- and post-restoration (KS test 2009 vs. 2019, p < 0.001, D = 0.99; KS test 2019 vs. 2021, p < 0.001, D = 0.10). Moreover, we used a Generalized Additive Model (GAM) that included spatial and environmental predictors (i.e., canopy cover calculated from multispectral NDVI and photogrammetrically derived digital elevation model) to model TIR temperature from a transect along the main river channel. This model explained 89% of the deviance, and the predictor variables showed statistical significance. Collectively, our study underscored the potential of a multispectral/TIR sensor to assess thermal heterogeneity in large and complex river systems.

Barker, Matthew I. (ORCID:0000000252864930)↗

Thermomechanical Degradation of Sintered Copper Under High-Temperature Thermal Shock

The need for reliable bonded interface materials is critical to realize the performance benefits of wide-bandgap devices in power electronics modules, especially in operating temperatures greater than 150 degrees C. In this paper, we investigate the thermomechanical performance of sintered copper (Cu) as a large-area attachment, bonded between Cu baseplates and active-metal-bonded substrates, under accelerated thermal shock (-40 degrees C to 200 degrees C) conditions. In the fabrication phase of the samples, we used different stencil patterns and found that the grid and stripe patterns resulted in a better outgassing of the residual organics during the sintering process, thereby ensuring a substantially improved bond quality compared to a full-area print. The paste consisted of Cu microflakes, and we performed sintering using a Budatec SP300 sintering press at 275 degrees C with 15 MPa of bonding pressure for 5 minutes in a nitrogen atmosphere. Under accelerated experiments, we monitored the degradation of the sintered Cu bond in the samples through C-mode scanning acoustic microscope (C-SAM) images. To quantify the defect percentage in C-SAM images, we investigated image denoising techniques to exclude the pattern prints. Finally, we cross-sectioned a sample and obtained scanning electron microscope images, which revealed adhesive fracture as the dominant failure mechanism.

ADVANCED PROPULSION SYSTEMS,INORGANIC, ORGANIC, PH↗

One-shot gas detection with transformer paired neural networks in Mako collected longwave infrared hyperspectral imagery

To date, careful data treatment workflows and statistical detectors are used to perform hyperspectral image (HSI) detection of any gas contained in a spectral library, which is often expanded with physics models to incorporate different spectral characteristics. In general, surrounding evidence or known gas-release parameters are used to provide confidence in or confirm detection capability, respectively. This makes quantifying detection performance difficult as it is nearly impossible to develop an absolute ground truth for gas target pixel presence in collected HSI. Consequently, developing and comparing new detection methods, especially machine learning (ML)-based methods, is susceptible to subjectivity in derived detection map quality. Here, in this work, we demonstrate the first use of transformer-based paired neural networks (PNNs) for one-shot gas target detection for multiple gases while providing quantitative classification and detection metrics for their use on labeled data. Terabytes of training data are generated from a database of long-wave infrared HSI obtained from historical Mako sensor campaigns over Los Angeles. By incorporating labels, singular signature representations, and a model development pipeline, we can tune and select PNNs to detect multiple gas targets that are not seen in training on a quantitative basis. We additionally assess our test set detections using interpretability techniques widely employed with ML-based predictors, but less common with detection methods relying on learned latent spaces.

Hyperspectral imaging↗

Visualizing energy transfer between redox-active colloids

Redox-active colloids (RACs) represent a novel class of energy carriers that exchange electrical energy upon contact. Understanding contact-mediated electron transfer dynamics in RACs offers insights into physical contact events in colloidal suspensions and enables quantification of electrical energy transport in nonconjugated polymers. Redox-based electron transport was directly observed in monolayers of micron-sized RACs containing ethyl-viologen side groups via fluorescence microscopy through an unexpected nonlinear electrofluorochromism that is quantitatively coupled to the redox state of the colloid. Via imaging studies, using this electrofluorochromism, the apparent charge transfer diffusion coefficient D CT of the RAC was easily determined. The visualization of energy transport within suspensions of redox-active colloids was also demonstrated. Our work elucidates fundamental mechanisms of energy transport in colloidal systems, informs the development of next-generation redox flow batteries, and may inspire new designs of smart active soft matter including conductive polymers for applications ranging from electrochemical sensors and organic electronics to colloidal robotics.

Qu, Alan Subing [Univ. of Illinois at Urbana-Champ↗

Bolometric Superconducting Optical Nanoscopy (BOSON)

Superconducting transition-edge sensors are renowned for their extraordinary photon sensitivity and energy resolution, finding applications spanning quantum information, astronomy, and nanophotonics. Here, we report the development of bolometric superconducting optical nanoscopy (BOSON), a novel platform that integrates bolometric detection at the superconducting transition edges with near-field optical techniques. BOSON enables the mapping of photoinduced changes in superconductivity with unprecedented spatial resolution and photon sensitivity. By incorporating BOSON with low-dimensional materials, we achieved polariton imaging at nanowatt excitation levels—at least 4 orders of magnitude lower than the power typically required in prior near-field nanoscopy experiments. Our findings highlight the potential for BOSON to advance scanning-probe-based optical platforms to enable the detection of photons, polaritons, and Cooper pair dynamics at the nanoscale. This paves the way for quantum sensing applications using single-polariton detection and can offer deeper insights into quasiparticle dynamics.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Low-symmetry vacancy-related spin qubit in hexagonal boron nitride

Abstract Point defect qubits in semiconductors have demonstrated their outstanding capabilities for high spatial resolution sensing generating broad multidisciplinary interest. Hexagonal boron nitride (hBN) hosting point defect qubits have recently opened up new horizons for quantum sensing by implementing sensing foils. The sensitivity of point defect sensors in hBN is currently limited by the linewidth of the magnetic resonance signal, which is broadened due to strong hyperfine couplings. Here, we report on a vacancy-related spin qubit with an inherently low symmetry configuration, the VB2 center, giving rise to a reduced magnetic resonance linewidth at zero magnetic fields. The VB2 center is also equipped with a classical memory that can be utilized for storing population information. Using scanning transmission electron microscopy imaging, we confirm the existence of the VB2 configuration in free-standing monolayer hBN.

Chemistry↗

A Multi-Sensor Approach for Measuring Bird and Bat Collisions with Offshore Wind Turbines (Final Technical Report)

Collision of birds and bats with wind turbines is a conservation concern for both land-based and offshore wind projects. The fatality rates of birds and bats at land-based turbines are well documented. The measurement strategies on land focus on finding carcasses following collision, estimating the number of carcasses missed through searcher efficiency, carcass persistence trials and carcass fall distributions, and modeling statistically robust fatality rates. Few technologies have been developed to monitor offshore bird and bat collisions, and many that have been developed focused on detecting collisions with large birds. The few studies that have attempted to document collisions at offshore turbines do not account for smaller bodied animals or for collisions that might be missed, which prevents the calculation of statistically robust fatality rates. The overall goal of this report, A Multi-Sensor Approach for Measuring Bird and Bat Collisions with Offshore Wind Turbines (Project), was to develop an effective multi-sensor system for quantifying bird and bat collision rates, specifically for offshore wind facilities. The Project goal and resulting automated collision detection system was achieved through two major technological advancements: 1) refining The Netherlands Organisation for Applied Scientific Research’s (TNO’s) existing WT-Bird® vibration sensing system, that had successfully detected large bird collisions during daytime, to allow for improved detection of smaller birds and bats during both daytime and nighttime hours and 2) improving image processing systems and developing and integrating machine learning algorithms to automatically detect and classify small and large bird and bat collisions with offshore turbines. This final technical report (FTR) summarizes Methods , Results , Conclusions , and Lessons Learned during each of the five Tasks identified for this research and development effort. This FTR includes summaries of the following: Task 1. Initial Engineering Tests to Improve WT-Bird® Task 2. Installation of WT‐Bird® on a Utility-scale Turbine at the National Wind Technology Center – National Renewable Energy Laboratory Task 3. Field Tests and Refinement of the Object Detection System Task 4. Validation of WT-Bird® on a Land-based Turbine Task 5. Preparation for the Implementation of WT-Bird® on an Offshore Turbine. This research and development effort documented successful improvement of the WT Bird® collision detection system to detect small birds and bats, and WT-Bird® is the first collision detection system to validate results compared to land-based post-construction monitoring. The collision trials provide estimates of missed targets that can be used to estimate fatality rates, a significant improvement relative to other offshore collision monitoring systems. Advances were made in developing an edge-processing solution to reduce data storage requirements, which is important if the system is deployed for long periods of time at offshore turbines. The improved WT-Bird® system also provides an important option for wind operators on land or offshore who need to document specific details about when collisions occur, particularly efforts to further research on bat impact minimization, or when standard fatality searches are impractical (e.g. offshore) or inadequate (e.g. challenging locations on land).

17 WIND ENERGY↗

A semi–automatic analytical methodology for characterizing the energy consumption of MRI systems using load duration curves

Background and purpose: Magnetic resonance imaging (MRI) scanners are a major contributor to greenhouse gas emissions from the healthcare sector, and efforts to improve energy efficiency and reduce energy consumption rely on quantification of the characteristics of energy consumption. The purpose of this work was to develop a semi-automatic analytical methodology for the characterization of the energy consumption of MRI systems using only the load duration curve (LDC). LDCs are a fundamental tool used across various fields to analyze and understand the behavior of loads over time. Methods: An electric current transformer sensor and data logger were installed on two 3T MRI scanners from two vendors, termed M1 (outpatient scanner) and M2 (inpatient/emergency scanner). Data was collected for 1 month (7/11/2023 to 8/11/2023). Active power was calculated, assuming a balanced three-phase system, using the average current measured across all three phases, a 480 V reference voltage for both machines, and vendor-provided power factors. An LDC was constructed for each system by sorting the active power values in descending order and computing the cumulative time (in units of percentage) for each data point. The first derivative of the LDC was then computed (LDC’), smoothed by convolution with a window function (sLDC’), and used to detect transitions between different system modes including (in descending power levels): scan, prepared-to-scan, idle, low-power, and off. The final, segmented LDC was used to measure time (% total time), total energy (kWh), and mean power (kW) for each system mode on both scanners. The method was validated by comparing mean power values, computed using the segmented 1-month LDC, for each nonproductive system mode (i.e., prepared-to-scan, idle, lower-power, and off) against power levels measured after a deliberate system shutdown was performed for each scanner (1 day worth of data). Results: The validation revealed differences in mean power values <1.4% for all nonproductive modes and both scanners. In the scan system mode, the mean power values ranged from 29.8 to 37.2 kW and the total energy consumed for 1 month ranged from 11 106 to 14 466 kWh depending on the scanner. Over the course of 1 month, the portion of time the scanners were in nonproductive modes ranged from 76% to 80% across scanners and the nonproductive energy consumption ranged from 8010 to 6722 kWh depending on the scanner. The M1 (outpatient) scanner consumed 99.9 and 183.9 kWh/day in idle mode for weekdays and weekends, respectively, because the scanner spent 23% more time proportionally in idle mode on the weekends. Conclusions: A semi-automatic method for quantifying energy consumption characteristics of MRI scanners was introduced and validated. This method is relatively simple to implement as it requires only power data from the scanners and avoids the technical challenges associated with extracting and processing scanner log files. Finally, the methodology enables quantitative evaluation of the power, time, and energy characteristics of MRI scanners in scan and nonproductive system modes, providing baseline data and the capability of identifying potential opportunities for enhancing the energy efficiency of MRI scanners.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

A Skipper-CCD Light Shield for X-Ray Detection in Space

We present advancements in the design of Skipper-CCD sensors for X-ray detection in environments with high optical backgrounds, such as those expected in space. These packages incorporate a custom-made aluminum shield on the CCD surface that blocks over 99% of visible light while preserving the efficiency for keV X-rays. These features allow us to perform precise X-ray measurements in environments challenged by visible light interference. Furthermore, we briefly discuss the potential implementation of this design concept in frame-transfer CCDs, opening opportunities for broader applications and advancements in imaging technologies.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Breaking the barrier of human-annotated training data for machine learning-aided plant research using aerial imagery

Machine learning (ML) can accelerate biological research. However, the adoption of such tools to facilitate phenotyping based on sensor data has been limited by (i) the need for a large amount of human-annotated training data for each context in which the tool is used and (ii) phenotypes varying across contexts defined in terms of genetics and environment. This is a major bottleneck because acquiring training data is generally costly and time-consuming. This study demonstrates how a ML approach can address these challenges by minimizing the amount of human supervision needed for tool building. A case study was performed to compare ML approaches that examine images collected by an uncrewed aerial vehicle to determine the presence/absence of panicles (i.e. “heading”) across thousands of field plots containing genetically diverse breeding populations of 2 Miscanthus species. Automated analysis of aerial imagery enabled the identification of heading approximately 9 times faster than in-field visual inspection by humans. Leveraging an Efficiently Supervised Generative Adversarial Network (ESGAN) learning strategy reduced the requirement for human-annotated data by 1 to 2 orders of magnitude compared to traditional, fully supervised learning approaches. The ESGAN model learned the salient features of the data set by using thousands of unlabeled images to inform the discriminative ability of a classifier so that it required minimal human-labeled training data. This method can accelerate the phenotyping of heading date as a measure of flowering time in Miscanthus across diverse contexts (e.g. in multistate trials) and opens avenues to promote the broad adoption of ML tools.

59 BASIC BIOLOGICAL SCIENCES↗

pixelvar79/ESGAN-Flowering-Detection-paper

Machine learning (ML) can accelerate biological research. However, the adoption of such tools to facilitate phenotyping based on sensor data has been limited by (i) the need for a large amount of human-annotated training data for each context in which the tool is used and (ii) phenotypes varying across contexts defined in terms of genetics and environment. This is a major bottleneck because acquiring training data is generally costly and time-consuming. This study demonstrates how a ML approach can address these challenges by minimizing the amount of human supervision needed for tool building. A case study was performed to compare ML approaches that examine images collected by an uncrewed aerial vehicle to determine the presence/absence of panicles (i.e. “heading”) across thousands of field plots containing genetically diverse breeding populations of 2 Miscanthus species. Automated analysis of aerial imagery enabled the identification of heading approximately 9 times faster than in-field visual inspection by humans. Leveraging an Efficiently Supervised Generative Adversarial Network (ESGAN) learning strategy reduced the requirement for human-annotated data by 1 to 2 orders of magnitude compared to traditional, fully supervised learning approaches. The ESGAN model learned the salient features of the data set by using thousands of unlabeled images to inform the discriminative ability of a classifier so that it required minimal human-labeled training data. This method can accelerate the phenotyping of heading date as a measure of flowering time in Miscanthus across diverse contexts (e.g. in multistate trials) and opens avenues to promote the broad adoption of ML tools.

Varela, Sebastian↗

Automated Fire Detection for Industrial Settings with Pretrained Convolutional Networks

Early fire detection in industrial environments is critical to preventing equipment damage, personal injury, and operational disruptions. Traditional smoke detectors, while effective, often experience delays due to the time required for smoke to reach sensors, allowing fires to spread. Manual fire watch operations and human surveillance of camera feeds are resource-intensive and prone to human error. To address these challenges, this paper explores the application of convolutional neural networks for automated fire detection, specifically in industrial settings. By leveraging 11 different pre-trained machine vision models from TensorFlow and enhancing them with transfer learning on a custom-built industrial fire dataset, we optimized fire detection performance. Here, we analyzed each machine vision model architecture in terms of its depth, width, and input image resolution, considering both resource requirements and detection accuracy. We further explored the option of combining multiple models into an ensemble classifier to evaluate whether the performance improvements could justify the much greater computational complexity and other practical impacts. A cost-benefit analysis is presented to evaluate the trade-offs between performance and computational expense. Our findings identify that EfficientNetV2L, specifically tailored for industrial applications, provides the optimal balance between costs involved in training and using the model versus the overall fire detection performance. Additionally, we present a qualitative analysis of model performance using the technique of gradient-based class activation mapping to provide explainability by visualizing model decisions.

artificial intelligence↗