Search NASA⌕ Search

SEARCH · Search NASA

Results for “RGB imagery”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

44 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Estimation of Corn Latent Heat Flux from High Resolution Thermal Imagery

Crop evapotranspiration (ET), which is directly related to latent heat flux, is also a key indicator in determining the water status of crops. In order to estimate the latent heat flux, two-source energy balance (TSEB) models have been developed for thermal imagery from satellite platforms. However, because of the coarse resolution of thermal sensors on the satellite, distinguishing soil and vegetation is difficult which complicates the calculation process and introduces errors in latent heat estimates. In this research, high-resolution thermal datasets (0.05 m) and corresponding RGB datasets (0.03 m) were used for calculating crop latent heat flux using an adapted TSEB model. The RGB datasets were used for supervised classification of soil and vegetation, and the classification results were then used to filter the thermal mosaics to separate vegetation and soil temperatures. The vegetation temperature is used for calculating latent heat flux and the results are validated against the ground reference measurements of latent heat using a handheld porometer. The objective of this research is to introduce a workflow including an adapted TSEB model which is customized for high resolution thermal images from unmanned aircraft systems (UAS) to estimate the latent heat flux of row crops in agricultural fields. Nine dates of data collection in 2018 and 2020 have been evaluated and the root mean square error (RMSE) varies between 16 to 106 W/m2 depending on the days after planting (DAP) and the time of measurement for each day. The results indicate that the workflow introduced here is able to provide estimates of instantaneous latent heat flux (evapotranspiration) measurements for row crops in agricultural fields which will enable people to make reliable decisions related to irrigation scheduling.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Evaluation of macadamia felted coccid (Hemiptera: Eriococcidae) damage and cultivar susceptibility using imagery from a small unmanned aerial vehicle ( sUAV ), combined with ground truthing

Abstract BACKGROUND Macadamia felted coccid, Acanthococcus ioronsidei (Williams) (Hemiptera: Eriococcidae), is a significant pest of macadamia nut, Macadamia integrifolia Maiden & Betche (Protaceae), in Hawaii, and heavy infestations can kill branches, resulting in characteristic dead, copper‐colored leaves. Small Unmanned Aerial Vehicles (sUAV) or ‘drones,’ combined with spatial data analysis, can provide growers with accurate and high‐resolution detection of plant stress due to pest infestations. We investigated the feasibility of using RGB (red‐green‐blue) color images from sUAV to detect dieback caused by macadamia felted coccid infestation and compared sUAV estimates with ground‐based damage estimates (ground truthing). RESULTS Spatial analysis showed clustering of foliar damage that reflected cultivar susceptibility to macadamia felted coccid infestation, with cultivars 344 and 856 being susceptible, and cultivars 800 and 333 being tolerant. sUAV and ground‐based estimates of foliar damage were similar for the cultivar 344, but ground‐based assessments were higher than sUAV for cultivar 856, possibly due to the differences in canopy architecture and significant early dieback in the lower canopy. At foliar damage levels <10%, sUAV and ground truthing data were significantly positively correlated, suggesting sUAV may be useful in detecting early stages of macadamia felted coccid infestation. CONCLUSIONS Cultivars showed varying susceptibility to macadamia felted coccid infestation and the foliage damage appeared in clusters. sUAV was able to detect the foliage damage under high and low infestation scenarios suggesting that it can be effectively used for the early detection of infestations. © 2022 The Authors. Pest Management Science published by John Wiley & Sons Ltd on behalf of Society of Chemical Industry. This article has been contributed to by U.S. Government employees and their work is in the public domain in the USA.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Event-to-Video Conversion for Overhead Object Detection

Collecting overhead imagery using an event camera is desirable due to the energy efficiency of the image sensor compared to standard cameras. However, event cameras complicate downstream image processing, especially for complex tasks such as object detection. In this paper, we investigate the viability of event streams for overhead object detection. We demonstrate that across a number of standard modeling approaches, there is a significant gap in performance between dense event representations and corresponding RGB frames. We establish that this gap is, in part, due to a lack of overlap between the event representations and the pre-training data that the object detectors were initially trained on through a number of experiments. Then, apply an off-the-shelf event-to-video conversion tool that converts event streams into gray-scale video to close this gap. We demonstrate that this approach results in a large performance increase, outperforming even event-specific object detection techniques on our overhead target task. These results suggest that better aligning event representations with existing large pre-trained models may result in greater short-term performance gains compared to end-to-end event-specific architectural improvements.

machine learning (ML), computer vision, Neuromorph↗
DOE OSTI2026

Surface and Buried Thermal, and RGB Unexploded Ordnance Data Collection

This document provides a description of a data collection campaign of unexploded ordnance (UXOI) set. The dataset captures a controlled UAV imaging campaign designed to support detection of UXO across varied environmental conditions. Data were collected during three campaigns in Norris and Northeast Knoxville, Tennessee, using RGB, and thermal sensors mounted on Parrot UKR. In total, the dataset contains 9925 images, 26 full-motion video, and approximately 81.99 GB of data, collected across late spring/summer conditions, every hour during sunlight, and multiple surface contexts, including tall grass, short grass, gravel, as well as buried in sand, and other gravel mixtures. The collection was designed to capture thermal and visual variability relevant to UXO detection in agricultural land, bare earth, and subsurface. Review of the imagery showed that ordnance was most detectable during periods of changing solar input, especially approximately 10-60 minutes after sunrise, approximately 20-60 minutes after sunset, and 2-3 min after cloud cover interrupted prolonged solar heating. These conditions increased thermal contrast because many ordnance items retained or released heat differently than the surrounding vegetation and ground surface. This dataset provides a useful resource for developing and evaluating airborne UXO detection methods under realistic field conditions. All ordnance used in the study was inert, and thermal behavior may differ from that of live ordnance. In addition, variation in ordnance type, composition, and placement introduced differences in thermal response that should be considered when interpreting results.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2020

Machine Learning for Automated Extraction of Building Geometry

As data science comes to buildings, the promise of using machine learning and novel sources of data has received much attention. Advances in machine learning and computer vision algorithms, combined with increased access to unstructured data (e.g., images and text), have created an opportunity for automated extraction of building characteristics – cost-effectively, and at scale. Acquisition of features such as footprint are time consuming and costly to acquire with today’s manual methods, but can be streamlined through intelligent software-based solutions applied to satellite images. When combined with aerial RGB and thermal images, full 3D geometries and thermal maps can be constructed to determine additional characteristics such as window to wall ratio, height, number of stories and envelope thermal characteristics. In this paper we present three contributions to accelerate these high potential opportunities: (1) a methodical analysis of how these features can be integrated into today’s simulation and data driven software tools to enhance efficiency measure identification and owner/operator decision making; (2) development and accuracy testing of open source deep neural network methods to extract building footprints from satellite imagery, including the curation and application of openly available GIS datasets for training and continued development by others; and (3) an open framework for drone-based image capture and creation of 3D building geometries. This work represents an important bridge between high-level studies that span diverse application areas and those that detail point solutions yet cannot be easily replicated or extended.

Touzani, Samir↗
DOE OSTI2024

Surface elevation, snow depth, vegetation height, and color imagery from multiple UAV surveys from 2018 to 2023 across a watershed near Teller road mile marker 27, Seward Peninsula, Alaska

Multiple photogrammetric surveys using an unoccupied aerial system (UAS) were performed across a watershed along Teller road on the Seward Peninsula (Alaska) to investigate terrain, vegetation and snowpack properties. This work was led by the environmental geophysics team from Lawrence Berkeley National Laboratory as part of the Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic). The multiple photogrammetric surveys used mostly a DJI Matrice 210 UAS with a DJI X5S camera, Ground Control Points (GCPs) surveyed with a Real Time Kinematic (RTK)-GPS, and a structure from motion (SfM) technique for photogrammetric reconstruction. Digital Surface elevation Models (DSMs) were inferred at various times of year, including near peak in plant and leaf density (July 19 2017), close to peak in snow depth (April 1 2019 and April 11 2022), and at low plant and leaf density of tall after the first bare-ground date (June 9 2019). Snow and canopy height were obtained by subtracting DSMs from a Digital Terrain Model (DTM) proxy inferred from the June 9 2019 survey. The derived products include ortho-mosaiced RGB map, DSMs, a DTM proxy, snow depth (April 2019 and 2022) and canopy height (July 2017). Unprocessed and processed data products are included in this package (processing levels 0-2). Data and metadata are provided as text (*.csv), image (*.jpg), and GeoTiff (*.tif) formats. This metadata document contains a description of the survey and processing steps and the inferred products.The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic) was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy’s Office of Biological and Environmental Research. The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska. Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy’s Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Designing Unmanned Aerial Survey Monitoring Program to Assess Floating Litter Contamination

Monitoring marine contamination by floating litter can be particularly challenging since debris are continuously moving over a large spatial extent pushed by currents, waves, and winds. Floating litter contamination have mostly relied on opportunistic surveys from vessels, modeling and, more recently, remote sensing with spectral analysis. This study explores how a low-cost commercial unmanned aircraft system equipped with a high-resolution RGB camera can be used as an alternative to conduct floating litter surveys in coastal waters or from vessels. The study compares different processing and analytical strategies and discusses operational constraints. Collected UAS images were analyzed using three different approaches: (i) manual counting (MC), using visual inspection and image annotation with object counts as a baseline; (ii) pixel-based detection, an automated color analysis process to assess overall contamination; and (iii) machine learning (ML), automated object detection and identification using state-of-the-art convolutional neural network (CNNs). Our findings illustrate that MC still remains the most precise method for classifying different floating objects. ML still has a heterogeneous performance in correctly identifying different classes of floating litter; however, it demonstrates promising results in detecting floating items, which can be leveraged to scale up monitoring efforts and be used in automated analysis of large sets of imagery to assess relative floating litter contamination.

Almeida, Sílvia (ORCID:0000000320636826)↗
DOE OSTI2026

202508 HAIIC IR Images with Attitude Data at BNF

This campaign aims to collect infrared imagery using a custom data acquisition system to improve and validate a previously developed attitude estimation algorithm, with a focus on ensuring reliable performance at higher altitudes. The system integrates a Boson+320 infrared camera, a VN-200 IMU for recording attitude data synchronized with image acquisition, and a Raspberry Pi 4B+ for onboard processing and storage. Image orientation was controlled using a Gremsy T7 gimbal. The primary dataset spans roll angles from −40° to 40° and pitch angles from −20° to 40°, sampled at 1° increments. Additional, smaller datasets were also collected at 2.5° angular intervals.

Boson+320↗