Search NASA⌕ Search

SEARCH · Search NASA

Results for “Multispectral”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
DOE OSTI2016

Long-Term Monitoring of Desert Land and Natural Resources and Application of Remote Sensing Technologies

Monitoring environmental impacts over large, remote desert regions for long periods of time can be very costly. Remote sensing technologies present a promising monitoring tool because they entail the collection of spatially contiguous data, automated processing, and streamlined data analysis. This report provides a summary of remote sensing products and refinement of remote sensing data interpretation methodologies that were generated as part of the U.S. Department of the Interior Bureau of Land Management Solar Energy Program. In March 2015, a team of researchers from Argonne National Laboratory (Argonne) collected field data of vegetation and surface types from more than 5,000 survey points within the eastern part of the Riverside East Solar Energy Zone (SEZ). Using the field data, remote sensing products that were generated in 2014 using very high spatial resolution (VHSR; 15 cm) multispectral aerial images were validated in order to evaluate potential refinements to the previous methodologies to improve the information extraction accuracy.

47 OTHER INSTRUMENTATION↗
DOE OSTI2017

Discussion of CoSA: Clustering of Sparse Approximations

The purpose of this talk is to discuss the possible applications of CoSA (Clustering of Sparse Approximations) to the exploitation of HSI (HyperSpectral Imagery) data. CoSA is presented by Moody et al. in the Journal of Applied Remote Sensing (“Land cover classification in multispectral imagery using clustering of sparse approximations over learned feature dictionaries”, Vol. 8, 2014) and is based on machine learning techniques.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Analysis of Remotely Sensed Datasets to Detect Changes in Waste Sites

This work evaluated various indirect remote techniques for detecting surficial changes and structural land deformation at the Hanford site. Given the partial collapse of the PUREX tunnel, and possible surface subsidence at other burial sites containing radioactive waste and contaminated equipment, timely alert and knowledge related to land surface elevation changes has emerged as a management priority. Findings of this study suggests that space borne RADAR and multispectral based-analysis would be of significant value in detecting changes in surficial and structural land features that may be otherwise undetectable or unnoticed from field observations alone. A continuous, and potentially semi-automated, monitoring program would add critical insight to recovering from, and predicting episodic type events, such as the tunnel collapse. Furthermore, an indirect approach ultimately saves resources and time, and avoids unnecessary risk associated with ground-based monitoring. Various options for supporting such an effort are described in the final section of this document.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2019

PBX-9501 High Explosive Infrared Thermography Test Report

High explosive safety requirements put in place by the Department of Defense necessitate that Los Alamos National Laboratory verify that high melting explosive-based plastic bonded explosive 9501 will not present a health or safety risk to personnel when exposed to various accident scenarios. The JT5R-14C test is being developed to validate this requirement in a scenario where PBX-9501 is exposed to a hydrocarbon fuel fire. Preliminary testing is required to establish benchmark data on the burning characteristics of PBX-9501. The PBX-9501 High Explosive Infrared Thermography test was designed to provide the benchmark burning characteristics of PBX-9501 in a simulated fuel fire environment using propane burners as a fuel source. The PBX-9501-HEIT was successfully completed using a 20.32 cm tall cylindrical sample of PBX-9501 with a radius of 10.16 cm, a volume of 6,589.63 cm 3 , a density of 1.83 g/cm 3 , and a mass of 1.2 kg. The PBX-9501-HEIT test was captured and recorded video sequence using a Telops Inc., Multispectral Infrared camera. The infrared sequence was reviewed to identify key events throughout the test and serves as a visual tool to cross reference against future testing to aid in the identification of PBX-9501 high explosive ignition and deflagration characteristics. The data obtained in the thermographic sequence confirmed that the temperatures emitted by the PBX-9501 were higher than the temperatures of the propane burner ignition source. The propane burner flames had a temperature range of 700-850 °C. The cylindrical sample of PBX-9501 burned at an average temperature of 1000-1200 °C on the surface with off-gassing temperatures averaging 1100-1250 °C. The heat map of the PBX-9501 obtained through the test was between 250-550 °C higher than the propane gas temperatures. The temperature differential between the PBX-9501 and the propane flame allowed for the identification of key burning features.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗
DOE OSTI2019

Understanding Plasma Divertor Detachment in Fusion Power Reactors

Key LLNL spectroscopic and modeling capabilities have been successfully applied to a range of ionizing and recombining plasmas in a magnetically confined fusion device to elucidate the roles of physical processes relevant to the ‘detached divertor’ regime essential for operation of future fusion power reactors. The primary goal of this work was improving theoretical models and the interpretability of plasmas near the ionizing/recombining balance, in order to improve predictive capability for divertor performance in state-of-the-art fluid-based modeling codes. To do so, contributors to a universal shortfall in predicted radiation, the underestimated impact of convective plasma drifts/flows, and the role of molecules in cold plasmas were identified in the DIII-D National Fusion Facility using newly installed multispectral extreme ultraviolet and visible spectroscopy, and advanced boundary modeling developed by LLNL. As a result of this LDRD, a powerful array of spectroscopic diagnostics that are each unique worldwide have been added to the DIII-D device for continued use in coming operational campaigns including research in boundary and core-edge integration to further expand operational space. Experiments scanning the detached regime have resulted in application of essential missing physics with plasma-boundary codes and a transformation in the recognition among international magnetic fusion programs of the formidable influence of convective plasma transport due to drifts in regimes including conditions necessary for future fusion power reactors.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2020

The Consortium for Advanced Sorghum Phenomics (CASP). Final report

The goal of CASP was to accelerate breeding of biomass sorghum [Sorghum bicolor (L.) Moench] by identifying genotypes exhibiting high yield under well-watered, pre- or post-drought and/or salinity-stress conditions. We did this by combining high-throughput, non-invasive drone phenotyping with genomics and molecular profiling. Field-based phenotyping utilized a multi-modal sensor suite of LiDAR, multispectral cameras, and thermal cameras mounted on a commercial drone to detect traits required for yield prediction and selection of drought and saline tolerant lines of sorghum. Traits of interest included plant height (PH), leaf area index (LAI), wet biomass (BMW), and biomass at 65% moisture (BM65) and were measured from emergence to harvest on a weekly basis over three growing seasons. The final output were measurements of traits on a plot-by-plot basis, identified by the plot ID used by the Proprietary data processing software enabled raw field data to be turned into plant traits and delivered to the PNNL and JGI within the same workday.

09 BIOMASS FUELS↗
DOE OSTI2021

Oregon Rivers Characterization Tool

DHS’s Regional Resiliency Assessment Program (RRAP) undertook the Oregon State Transportation Systems RRAP project between 2018-2021 to assess the seismic vulnerabilities of the state’s transportation system to a Cascadia Subduction Zone (CSZ) earthquake (CISA 2021). The project primarily focused on the effects of a CSZ earthquake on the mobility of emergency response efforts into the region. In the event that bridges located at crucial river crossings fail during a CSZ earthquake, rivers will become natural barriers affecting the ability to support response and recovery efforts. The characteristics of rivers (e.g., width, depth, and flow) are critical data to inform planning for the recovery of transportation systems across river barriers and determine reopening times following a CSZ earthquake. As part of the transportation system assessment, an Argonne National Laboratory (Argonne) project team developed a River Characterization Tool (RCT) to quantify the physical characteristics of the river system in Oregon, which can be used to inform a system-level analysis of transportation recovery and reopening times. This report mainly discusses approaches, methods, development, and applications of the RCT. The use of the river data generated from this tool for a system-level analysis of transportation recovery is discussed in the Oregon Transportation Systems RRAP Resiliency Assessment report (CISA 2021). The primary goal of the RCT is to generate statewide dataset of widths, depths, and flows for all rivers across Oregon to assess the effects of river barriers on emergency response and recovery efforts following a CSZ earthquake. The RCT leverages remote sensing data that multispectral sensors collect from satellites, employs a deep learning model to characterize river predictions, and computes river channel geometric dimensions with hydraulic relationships and river predictions. The entire process of river characterization is automated and implemented through the RCT.

58 GEOSCIENCES↗
DOE OSTI2023

Multiparametric optical label-free imaging to analyze plant cell wall assembly and metabolism. (Final Report)

Plant tissues are often considered not ideal for fluorescence imaging because of the pervasive intrinsic fluorescence of many plant metabolites and the intricate interactions with light of the many semi-crystalline polymers at the cell wall. Our project aims to take advantage of this observed shortcoming by developing a label-free, optical microscopy platform for characterizing multiple fingerprints of important cell wall components and stress-related, at subcellular scale resolution. The new imaging system can collect fingerprints from both emitted and scattered light that can inform on the chemical nature, subcellular distribution, anisotropy, and molecular environment of multiple cell wall components in intact plant tissues. We are combining these imaging capabilities with computational tools that enable correlated registration, integration, and analysis. This fully integrated, multiparametric optical system will be used to address biological problems connected to cell wall assembly in grasses. This includes a focus on developmental and environmental variation of cell wall impregnation with silica, lignin, suberin, and cutin in different tissues and cell types. Our research plan comprises three main goals: (1) To develop an accessible imaging platform and associated open-source software able to extract and integrate fingerprints from fluorescence-associated (multispectral emission, lifetime, and polarization), wide-field polarimetry, second harmonic generation (SHG), and stimulated Raman scattering signals (SRS); (2) To determine unique combination of fingerprints for various cell wall components and selected metabolites; (3) To analyze the process of cell wall silicification in grasses and determine how silicification affects cell wall properties and lignin, cutin, and suberin deposition in other cell types under differ stress conditions.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2022

Automated Sorghum Phenotyping and Trait Development Platform

There is an urgent need to accelerate energy crop development for the production of renewable transportation fuels from biomass. Our interdisciplinary team developed mobile, ground-based and aerial phenotyping platforms and advanced remote sensing data analysis tools to acquire and process imagery from different types of cameras (e.g. RGB, multispectral, hyperspectral, and thermal sensors) and LiDAR point cloud data in large-scale sorghum field trials during phase 1 of the project. Phase 2 focused on Technology to Market activities to deliver these systems to the market place coupled with targeted research programs to address specific limitations or challenges for these systems.

09 BIOMASS FUELS↗
DOE OSTI2023

Gumby: Quantifying multi-modal model resiliency

With the rise of cheap data and sensors, more use cases are emerging for multi-input models. Research has shown that including multiple data modalities can improve performance, suggesting that deep learning models can successfully learn to leverage complementary information from different modalities. However, this improved predictive power comes with unanticipated costs: additional inputs change model resiliency and expand the threat space for adversarial attacks. We first provide theoretical underpinnings for how adversarial success scales with input dimension. We then characterize the performance of a suite of multispectral deep learning models with different fusion approaches, quantify their relative reliance on different input bands, and evaluate their robustness to naturalistic and adversarial image corruptions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

CESER: wildfire mapping

Multispectral satellite imagery has been demonstrated to accurately detect wildfires over a variety of land cover types at coarse- and medium-resolution (i.e., 1km to 30m), typically by detecting burned area after the fire has caused substantial damage. We developed an algorithm to map active fire (i.e., flame) in 2-meter resolution WorldView time-series imagery and monitor fire trajectory over time. Our results depict robust mapping across scenes collected from different fires over grassy and forested land cover, identifying fires as small as 4m 2 throughout the image. Operational deployment at scale may provide valuable near-real time maps of active fire for responders to leverage for timely, targeted mitigation efforts. This white paper describes the current capability specifications and indicates requirements for scaling.

47 OTHER INSTRUMENTATION↗
DOE OSTI2026

Satellite-based Investigation of Power-Line Vegetation Encroachment in the US (SILVANUS)

Rapid wide-area assessments of vegetation encroachment on transmission and distribution line rights-of-way (ROW) is a highly desirable capability for understanding risks to the power grid during severe weather and wildfire events. Conventional assessments are time-consuming and expensive due to the need for in-situ inspections and the use of aerial assets. Performing conventional assessments on a wide area would require immense resources and time that might not be available within the horizon of an expected adverse event. Developing a capability to accurately assess vegetation encroachment into ROWs will enable faster analysis of potential grid vulnerabilities in NAERM. This project sought to develop a prototype capability for rapid ROW vegetation encroachment assessments by using Puerto Rico as a test case. Puerto Rico is a heavily forested island territory frequently impacted by tropical cyclones that threaten the electric grid by downing trees across transmission and distribution lines. Multispectral satellite imagery (MSI) enable very high resolution (i.e., 0.5 - 2 meter) assessment of vegetation conditions at scale and with revisit times appropriate for regular monitoring (e.g., weekly to quarterly, depending on cloud cover) of the entire island. Synthetic aperture radar (SAR) data from satellites was also investigated as solution to the cloud-cover issue as they are active sensors that emit and receive a microwave signal rather than relying on solar illumination, and are therefore unaffected by cloud cover and can collect data during day or night. Finally, MSI-derived digital surface models (DSMs) map the height of objects relative to sea level, and were assessed for their ability to estimate the height of forest canopies relative to coincident transmission lines. The results of the mapping investigation are described in this report.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2025

Co-Firing Switchgrass and Waste Coal in A Power Plant: A Techno-Economic and Life Cycle Evaluation for The Ohio River Valley (SWITCH) (Final Technical Report for Ohio State/FE0032204)

Abandoned coal mine lands (AMLs) represent one of the most persistent environmental challenges in the United States. Prior to the enactment of the Surface Mining Control and Reclamation Act (SMCRA) in 1977, coal mining operations were not legally required to reclaim disturbed lands, leaving behind approximately 500,000 AML sites nationwide. These sites pose severe environmental and health risks, including acid mine drainage, soil and water contamination, and spontaneous combustion of waste coal piles. Millions of Americans live within one mile of these AMLs, underscoring the urgency of remediation. Traditional reclamation practices, such as planting cool-season grasses, often fail to fully restore ecological function or leverage the economic potential of these lands. This project addressed these challenges by developing integrated strategies for resource recovery, land reclamation, and sustainable energy production. This project evaluated an integrated strategy to convert this liability into an opportunity by recovering waste coal and co-firing it with switchgrass (Panicum virgatum L.) cultivated on reclaimed or marginal AML areas in existing coal-fired power plants. Switchgrass not only provides a renewable feedstock but also aids in land reclamation and carbon sequestration. 1) Remote Sensing and Machine Learning for Waste Coal Identification Using Sentinel-2 satellite imagery and supervised classification, we applied four machine learning models to detect historical waste coal piles. Random Forest achieved the highest accuracy (precision: 86%, recall: 77%). Time-series analysis revealed gradual vegetation recovery since 1986, indicating natural reclamation processes in historical sites, while active mining areas showed ongoing disturbance. This workflow enables scalable monitoring and prioritization of reclamation efforts. 2) UAS-Based Stockpile Volume Estimation To quantify recoverable waste coal, we evaluated Unmanned Aerial Systems (UAS) equipped with Light Detection and Ranging (LiDAR) and multispectral sensors. Structure-from-Motion (SfM) photogrammetry combined with interpolated Digital Terrain Models (DTMs) achieved strong agreement with LiDAR reference volumes (Root Mean Square Error (RMSE) ≈147 m 3 , Mean Absolute Percentage Error (MAPE) ≈2%). Sensitivity analysis confirmed that spatial resolution significantly influences accuracy, emphasizing the need for high-resolution data for precise volume estimation. This approach offers a scalable, cost-effective, and accurate alternative to conventional ground-based surveys. 3) Switchgrass Cultivation for Bioenergy and Water Quality Improvement We assessed the hydrological and water quality impacts of converting AMLs to switchgrass production areas using the Soil and Water Assessment Tool (SWAT). Results showed that converting 10% of the watershed area into the switchgrass production zone reduced streamflow by 3.1%, total suspended solids by 18.1%, total nitrogen by 7.6%, and total phosphorus by 6.2%, while achieving biomass yields of 8.6–9.2 metric tons per hectare. These findings highlight switchgrass as a dual-benefit strategy for land reclamation and bioenergy feedstock production. 4) Integrated Co-Firing and CCS for Carbon-Negative Power Generation We modeled co-firing scenarios using the Power Plant Flexible Model (PPFM) to evaluate plant efficiency, greenhouse gas (GHG) emissions, and levelized cost of electricity (LCOE). Without carbon capture and storage (CCS), increasing switchgrass co-firing ratios reduced LCOE from $\$$150/MWh at 0% biomass to $\$$110/MWh at full substitution. Under CCS, costs remained higher (~$\$$250/MWh at 0% biomass) but decreased to $\$$200/MWh at 100% biomass, while enabling net-zero or carbon-negative electricity due to switchgrass sequestration benefits. Although CCS introduced efficiency penalties, pairing it with biomass co-firing offset these impacts and maximized climate benefits. Overall, optimizing co-firing ratios between 60-100%, supported by reliable logistics and storage strategies, emerged as a practical pathway to balance affordability, sustainability, and net-zero or negative GHG emissions while promoting productive reuse of AMLs.

01 COAL, LIGNITE, AND PEAT↗
DOE OSTI2020

SPRUCE Experimental Plot Top View Aerial Images beginning June 2019

This data set provides a record of the aerial images of the SPRUCE experimental plots obtained periodically using an unmanned aerial vehicle (UAV) with attached camera from 2019-05-05- to 2022-08-25. New images of the plots will be added periodically. The initial RGB images may be used for studies of greenness and snow coverage and compared with ground-based measurements and chamber-based tree and shrub Phenocam images (e.g. Schädel et al., 2022). Also included are NDVI (Normalized Difference Vegetation Index) images showing calculated difference between visible near-infrared (NIR) light reflectance from vegetation, as well as infrared (IR) and multispectral images. Files are presented in JPEG (*.jpg) or PDF (*.pdf) format inside of 28 compressed (*.zip) files. Images were collected for the 10 plots with enclosures, the 7 unchambered plots, and the environmental monitoring instrument cluster area. Images are slightly off-plot center at 12 to 15 meters above ground level or approximately 2 meters above the top of an experimental chamber.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

An Automated Method for Mapping Giant Kelp Canopy Dynamics from UAV

Satellite and aerial imagery have been used extensively for mapping the abundance and distribution of giant kelp ( Macrocystis pyrifera ) in southern California. There is now great potential for using unoccupied aerial vehicles (UAVs) to map kelp canopy at very high resolutions. However, tides and currents have been shown to affect the amount of floating kelp canopy on the water surface, and the impacts of these processes on remotely sensed kelp estimates in this region have not been fully quantified. UAVs were used to map fine-scale changes in canopy area due to tidal height and current speed at kelp forests off the coast of Palos Verdes, CA and Santa Barbara, CA. An automated method for detecting kelp canopy was developed that was 67% accurate using red-green-blue (RGB) UAV imagery and 93% accurate using multispectral UAV imagery across a range of weather, ocean, and illumination conditions. Increases in tidal height of 1 m reduced the amount of floating kelp canopy by 15% in Santa Barbara and by over 30% in Palos Verdes. The effect of current speed on visible kelp canopy was inconclusive, but there was a trend towards lower canopy area with increased current speed. Therefore, while tidal height and current speed can introduce significant variability to estimates of kelp abundance, the magnitude of this variability is site specific. Still, UAVs are a valuable tool for mapping of kelp canopy and can provide greater spatial resolution and temporal coverage than is possible from many satellite sensors. This data can provide insight into the patterns and drivers of high frequency fluctuations in kelp abundance.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2019

Arctic Vegetation Mapping Using Unsupervised Training Datasets and Convolutional Neural Networks

Land cover datasets are essential for modeling and analysis of Arctic ecosystem structure and function and for understanding land–atmosphere interactions at high spatial resolutions. However, most Arctic land cover products are generated at a coarse resolution, often limited due to cloud cover, polar darkness, and poor availability of high-resolution imagery. A multi-sensor remote sensing-based deep learning approach was developed for generating high-resolution (5 m) vegetation maps for the western Alaskan Arctic on the Seward Peninsula, Alaska. The fusion of hyperspectral, multispectral, and terrain datasets was performed using unsupervised and supervised classification techniques over a ~343 km 2 area, and a high-resolution (5 m) vegetation classification map was generated. An unsupervised technique was developed to classify high-dimensional remote sensing datasets into cohesive clusters. We employed a quantitative method to add supervision to the unlabeled clusters, producing a fully labeled vegetation map. We then developed convolutional neural networks (CNNs) using the multi-sensor fusion datasets to map vegetation distributions using the original classes and the classes produced by the unsupervised classification method. To validate the resulting CNN maps, vegetation observations were collected at 30 field plots during the summer of 2016, and the resulting vegetation products developed were evaluated against them for accuracy. Our analysis indicates the CNN models based on the labels produced by the unsupervised classification method provided the most accurate mapping of vegetation types, increasing the validation score (i.e., precision) from 0.53 to 0.83 when evaluated against field vegetation observations.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Understanding Growth Dynamics and Yield Prediction of Sorghum Using High Temporal Resolution UAV Imagery Time Series and Machine Learning

Unmanned aerial vehicles (UAV) carrying multispectral cameras are increasingly being used for high-throughput phenotyping (HTP) of above-ground traits of crops to study genetic diversity, resource use efficiency and responses to abiotic or biotic stresses. There is significant unexplored potential for repeated data collection through a field season to reveal information on the rates of growth and provide predictions of the final yield. Generating such information early in the season would create opportunities for more efficient in-depth phenotyping and germplasm selection. This study tested the use of high-resolution time-series imagery (5 or 10 sampling dates) to understand the relationships between growth dynamics, temporal resolution and end-of-season above-ground biomass (AGB) in 869 diverse accessions of highly productive (mean AGB = 23.4 Mg/Ha), photoperiod sensitive sorghum. Canopy surface height (CSM), ground cover (GC), and five common spectral indices were considered as features of the crop phenotype. Spline curve fitting was used to integrate data from single flights into continuous time courses. Random Forest was used to predict end-of-season AGB from aerial imagery, and to identify the most informative variables driving predictions. Improved prediction of end-of-season AGB (RMSE reduction of 0.24 Mg/Ha) was achieved earlier in the growing season (10 to 20 days) by leveraging early- and mid-season measurement of the rate of change of geometric and spectral features. Early in the season, dynamic traits describing the rates of change of CSM and GC predicted end-of-season AGB best. Late in the season, CSM on a given date was the most influential predictor of end-of-season AGB. The power to predict end-of-season AGB was greatest at 50 days after planting, accounting for 63% of variance across this very diverse germplasm collection with modest error (RMSE 1.8 Mg/ha). End-of-season AGB could be predicted equally well when spline fitting was performed on data collected from five flights versus 10 flights over the growing season. This demonstrates a more valuable and efficient approach to using UAVs for HTP, while also proposing strategies to add further value.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2022

Implementing Spatio-Temporal 3D-Convolution Neural Networks and UAV Time Series Imagery to Better Predict Lodging Damage in Sorghum

Unmanned aerial vehicle (UAV)-based remote sensing is gaining momentum in a variety of agricultural and environmental applications. Very-high-resolution remote sensing image sets collected repeatedly throughout a crop growing season are becoming increasingly common. Analytical methods able to learn from both spatial and time dimensions of the data may allow for an improved estimation of crop traits, as well as the effects of genetics and the environment on these traits. Multispectral and geometric time series imagery was collected by UAV on 11 dates, along with ground-truth data, in a field trial of 866 genetically diverse biomass sorghum accessions. We compared the performance of Convolution Neural Network (CNN) architectures that used image data from single dates (two spatial dimensions, 2D) versus multiple dates (two spatial dimensions + temporal dimension, 3D) to estimate lodging detection and severity. Lodging was detected with 3D-CNN analysis of time series imagery with 0.88 accuracy, 0.92 Precision, and 0.83 Recall. This outperformed the best 2D-CNN on a single date with 0.85 accuracy, 0.84 Precision, and 0.76 Recall. The variation in lodging severity was estimated by the best 3D-CNN analysis with 9.4% mean absolute error (MAE), 11.9% root mean square error (RMSE), and goodness-of-fit (R2) of 0.76. This was a significant improvement over the best 2D-CNN analysis with 11.84% MAE, 14.91% RMSE, and 0.63 R2. The success of the improved 3D-CNN analysis approach depended on the inclusion of “before and after” data, i.e., images collected on dates before and after the lodging event. The integration of geometric and spectral features with 3D-CNN architecture was also key to the improved assessment of lodging severity, which is an important and difficult-to-assess phenomenon in bioenergy feedstocks such as biomass sorghum. This demonstrates that spatio-temporal CNN architectures based on UAV time series imagery have significant potential to enhance plant phenotyping capabilities in crop breeding and Precision agriculture applications.

3D-convolution neural networks↗