Search NASA⌕ Search

SEARCH · Search NASA

Results for “Light Detection & Ranging (LIDAR)”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

Stand validation of lidar forest inventory modeling for a managed southern pine forest

We evaluated area-based approaches (ABAs) to light detection and ranging (lidar) predictions of plot- and stand-level forest attributes (tree count, height, basal area, volume, aboveground biomass, broadleaf/conifer, and diameter at breast height — “diameter”). ABA methods included post-stratification (PS), ordinary least squares (OLSs) regression, k nearest neighbors ( kNN), and random forest (RF). This study was conducted on the Savannah River Site in South Carolina, USA. Plot- and stand-level predictions were validated against fixed-radius 0.04 ha (0.1 acre) plots in 49 ≈2.0 ha (5 acre) stands. Our findings demonstrate that lidar can be incorporated operationally into forest inventory systems to provide stand-level inferences for a wide range of forest attributes. Volume predictions for specific diameter classes, however, often fared poorly (root mean squared error (RMSE) > 100%) for the methods we explored, especially for larger (less common) diameter trees. Stand-level results were consistently better than pixel-level results (10–200+ percentage points). kNN and RF performed similarly and better than OLS and PS, but RF was the most robust to model configurations, while kNN has practical advantages such as simultaneous predictions of many attributes.

Forestry↗
DOE OSTI2021

LiDAR For Heliostat Optical Assessment (Final Report)

This project has sought to develop new uses for surveying-quality Light Detecting and Ranging (LiDAR) 3D scanning sensors in the automatic/autonomous assessment of optical errors in largescale concentrating solar power heliostat fields. Past experiments have demonstrated the ability of a 3D-LiDAR to acquire highly accurate point cloud measurements across several Sandia NSTTF heliostats. The goal of this project is to expand upon this work to see if and how it can be used in large commercial heliostat fields.

14 SOLAR ENERGY↗
DOE OSTI2025

Stream bed topography in 2016 at the Lower Montane site in the East River Watershed, Colorado

This dataset contains stream bed topography data from the Lower Montane site in the East River Watershed, Colorado. It is intended to support hydro-biogeochemical analyses for the Watershed Function Scientific Focus Area (SFA). The stream bed was surveyed using a RTK-GPS (Real-Time Kinematic Global Positioning System) and a total station at hundreds of locations during two field campaigns, conducted in October 2015 and October 2016. The two surveys were merged into a single product under the assumption of minimal changes in stream bed topography between the years. A LiDAR (Light Detection and Ranging) derived ground surface elevation product from 2015 (see reference below) was used to interpolate the stream bed topography and estimate water depth at the time of the LiDAR survey. The dataset includes three GeoTIFF products, two *.csv data files, and three *.csv metadata files. Feel free to contact the author with any questions.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2026

Allometric and Mobile Terrestrial LiDAR Modeling of Aboveground Woody Biomass of Populus in Coppice Production

Poplars ( Populus spp.) and their hybrids are increasingly being grown in coppice production to generate bioenergy feedstocks at frequent intervals. Allometric equations are re-quired to predict aboveground biomass (AGB) of coppiced individuals with minimal field measurements. Likewise, remote sensing tools like LiDAR (light detection and ranging) can be used if models are available to predict AGB from point cloud data. Therefore, this study sought to develop equations to predict dry woody AGB from field measurements and LiDAR data from coppiced poplar field trials containing eastern cottonwood ( P. del-toides ) and hybrid poplar taxa. We found that taxa-specific allometric models containing the summed basal area of the three largest stems in the coppice provided the best predictive model, with stem height and stem count failing to provide additional explanatory power. The best predictive LiDAR-based model was independent of taxa but had slightly lower adjusted R 2 and higher RMSE than the allometric model. It contained four parameters including crown volume, leaf area index, variance of height returns, and the top point density (i.e., density metric 9 or the proportion of points in the highest point interval when the point cloud is evenly divided into ten vertical intervals). In total, these models can be used to quickly and efficiently estimate dry woody AGB of Populus coppice systems for bioenergy feedstock production.

AGB↗
DOE OSTI2024

DEM, DSM, and Cleaned LiDAR Point Cloud Data from the NGEE Arctic UAS Campaigns at the Teller 27 Field Site from 2017 and 2018, Seward Peninsula, Alaska

A Digital Elevation Model (DEM) and Digital Surface Model (DSM) were derived from airborne Light Detection and Ranging (LiDAR) data collected from Los Alamos National Laboratory's (LANL) heavy-lift unoccupied aerial system (UAS) quadcopter and hexacopter platforms operated by Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic) scientists from the EES-14 group at LANL. These data were collected in August 2017 and July 2018 at the NGEE Arctic field site near mile marker 27 of the Bob Blodgett Nome-Teller Memorial Highway between Nome, Alaska and Teller, Alaska. A Vulcan Raven X8 Airframe (Mitcheldean, Gloucestershire, UK), DJI Matrice 600 Pro Airframe (Shenzhen, China), and Routescene UAV LiDARSystem (Edinburgh, Scotland, UK) were used to collect LiDAR data. Following pre-processing in Routescene LidarViewer Pro software, the LiDAR point clouds were cleaned and processed using CloudCompare software to separate ground and off-ground points. A high resolution DEM and DSM were then created using ArcGIS Pro software. This data package contains fully cleaned point clouds of ground and off-ground points (.las), a 25 cm DEM (.tif), and a 25 cm DSM (.tif) for the Teller 27 field site. Ancillary aircraft data, flight mission parameters, weather conditions, and raw lidar data and imagery can be found in the L0 datasets for these campaigns: NGA299 (2017) and NGA297 (2018). Minimally processed point clouds and auxiliary files can be found in the L1 dataset: NGA304 (2017 and 2018).The Next-Generation Ecosystem Experiments: Arctic (NGEE Arctic), was a 15-year research effort (2012-2027) to reduce uncertainty in Earth System Models by developing a predictive understanding of carbon-rich Arctic ecosystems and feedbacks to climate. NGEE Arctic was supported by the Department of Energy's Office of Biological and Environmental Research.The NGEE Arctic project had two field research sites: 1) located within the Arctic polygonal tundra coastal region on the Barrow Environmental Observatory (BEO) and the North Slope near Utqiagvik (Barrow), Alaska and 2) multiple areas on the discontinuous permafrost region of the Seward Peninsula north of Nome, Alaska.Through observations, experiments, and synthesis with existing datasets, NGEE Arctic provided an enhanced knowledge base for multi-scale modeling and contributed to improved process representation at global pan-Arctic scales within the Department of Energy's Earth system Model (the Energy Exascale Earth System Model, or E3SM), and specifically within the E3SM Land Model component (ELM).

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Aboveground woody biomass estimation of young bioenergy plantations of Populus and its hybrids using mobile (backpack) LiDAR remote sensing

Woody aboveground biomass (AGB) including short-rotation Populus is used as a feedstock for renewable and carbon-neutral bioenergy. While woody AGB can be estimated with allometric equations requiring labor-intensive field data, remote sensing technologies like mobile terrestrial light detection and ranging (LiDAR) can estimate woody AGB quickly and accurately. Therefore, the goals of this study were to develop a model to predict woody AGB of 2-year-old Populus spp. from three taxa (P. deltoides, P. deltoides × P. maximowiczii and P. deltoides × P. trichocarpa) using allometric (height and diameter at breast height (DBH)) or LiDAR-derived metrics from a mobile terrestrial (backpack) system. Likewise, we sought to compare LiDAR-estimated tree height and DBH with field-measured values. We found that a taxa-specific model containing LiDAR-measured tree height, crown volume, and taxa interactions with the height of the 10 th percentile, and the density of the lowest interval (density metric 0) explained 84 % of the variation in woody AGB with a root mean square error (RMSE) of 28.7 % and performed slightly better than the allometric model. The best model excluding taxa had a slightly higher RMSE but lower bias than the allometric model. LiDAR-derived tree heights were highly correlated with field-measured heights, but DBH could not be estimated accurately. Therefore, terrestrial mobile LiDAR systems can accurately estimate woody AGB and tree height of Populus in short rotation systems to aid in the fast and efficient quantification of woody bioenergy production and renewable energy resources.

AGB↗
DOE OSTI2020

Application of multidimensional structural characterization to detect and describe moderate forest disturbance

The study of vegetation community and structural change has been central to ecology for over a century, yet the ways in which disturbances reshape the physical structure of forest canopies remain relatively unknown. Moderate severity disturbances affect different canopy strata and plant species, resulting in variable structural outcomes and ecological consequences. Terrestrial lidar (light detection and ranging) offers an unprecedented view of the interior arrangement and distribution of canopy elements, permitting the derivation of multidimensional measures of canopy structure that describe several canopy structural traits (CSTs) with known links to ecosystem function. We used lidar-derived CSTs within a machine learning framework to detect and describe the structural changes that result from various disturbance agents, including moderate severity fire, ice storm damage, age-related senescence, hemlock woolly adelgid, beech bark disease, and chronic acidification. We found that fire and ice storms primarily affected the amount and position of vegetation within canopies, while acidification, senescence, pathogen, and insect infestation altered canopy arrangement and complexity. Only two of the six disturbance agents significantly reduced leaf area, counter to common assumptions regarding many moderate severity disturbances. While findings are limited in their generalizability due to lack of replication among disturbances, they do suggest that the current limitations of standard disturbance detection methods—such as optical-based remote sensing platforms, which are often above-canopy perspectives—limit our ability to understand the full ecological and structural impacts of disturbance, and to evaluate the consistency of structural patterns within and among disturbance agents. A more broadly inclusive definition of ecological disturbance that incorporates multiple aspects of canopy structural change may potentially improve the modeling, detection, and prediction of functional implications of moderate severity disturbance as well as broaden our understanding of the ecological impacts of disturbance.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

November 2019 Initial Deployment of LiDAR in the H-Canyon Exhaust Tunnel

The H-Canyon Exhaust Tunnel (CAEX) structure is periodically inspected under the Structural Integrity Program using camera equipped crawlers or poles to remotely perform visual inspections. To explore the use of enhanced inspection methods a “Proof of Concept” using the Light Detection and Ranging (LiDAR) technology was performed over a 2-day period in November 2019. The purpose of the “Proof of Concept” deployment was to confirm whether a commercially available LiDAR unit could successfully operate and remotely transmit data from the tunnel CAEX environment and whether the data would provide quantitative information to establish baseline measurements. The LiDAR performance requirement was a measurement accuracy of ± 0.25-inches over a 30-foot distance. This report documents the work activities leading to the deployment, the deployment and processing of data, lessons learned from the deployment and the post data processing methods that will be applied to future deployments.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2020

Improving Land Cover Classification Using Extended Multi-Attribute Profiles (EMAP) Enhanced Color, Near Infrared, and LiDAR Data

Hyperspectral (HS) data have found a wide range of applications in recent years. Researchers observed that more spectral information helps land cover classification performance in many cases. However, in some practical applications, HS data may not be available, due to cost, data storage, or bandwidth issues. Instead, users may only have RGB and near infrared (NIR) bands available for land cover classification. Sometimes, light detection and ranging (LiDAR) data may also be available to assist land cover classification. A natural research problem is to investigate how well land cover classification can be achieved under the aforementioned data constraints. In this paper, we investigate the performance of land cover classification while only using four bands (RGB+NIR) or five bands (RGB+NIR+LiDAR). A number of algorithms have been applied to a well-known dataset (2013 IEEE Geoscience and Remote Sensing Society Data Fusion Contest). One key observation is that some algorithms can achieve better land cover classification performance by using only four bands as compared to that of using all 144 bands in the original hyperspectral data with the help of synthetic bands generated by Extended Multi-attribute Profiles (EMAP). Moreover, LiDAR data do improve the land cover classification performance even further.

58 GEOSCIENCES↗
DOE OSTI2025

Perspectives of active Si photonics devices for data communication and optical sensing

Si photonics has made rapid progress in research and commercialization in the past two decades. While it started with electronic–photonic integration on Si to overcome the interconnect bottleneck in data communications, Si photonics has now greatly expanded into optical sensing, light detection and ranging (LiDAR), optical computing, and microwave/RF photonics applications. From an applied physics point of view, this perspective discusses novel materials and integration schemes of active Si photonics devices for a broad range of applications in data communications, spectrally extended complementary metal–oxide–semiconductor (CMOS) image sensing, as well as 3D imaging for LiDAR systems. We also present a brief outlook of future synergy between Si photonic integrated circuits and Si CMOS image sensors toward ultrahigh capacity optical I/O, ultrafast imaging systems, and ultrahigh sensitivity lab-on-chip molecular biosensing.

electronic band structure↗
DOE OSTI2020

Savannah River Site H-Canyon Advancing Technologies for Remote Inspections - 20345

In 2017, the DOE Environmental Management Office of Technology Development (DOE-EM TD) sponsored the H-Canyon Advanced Technology Demonstration (ATD) to demonstrate to DOE facilities the value of using new commercial-off-the-shelf (COTS) and near-ready technologies to solve difficult problems and enhance worker safety. The DOE Savannah River Site (SRS) H-Canyon Air Exhaust Tunnel (HCAEX) inspection task was identified as representative of the hazardous, human denied environments which could benefit from advanced technologies. The HCAEX underground concrete tunnel is visually inspected biannually using a camera mounted on a remotely operated vehicle (ROV) designed and built by SRNL. While tunnel images have provided valuable visual information, it is desirable to have a higher order of understanding of the environment to support a more thorough structural integrity (SI) analysis and for long term planning purposes. As part of the ATD, the Concrete Integrated Product Team (CIPT) was formed to identify and evaluate available sensors and methods mature enough to remotely obtain tunnel concrete characterization data of high value and with a high probability of success. The team included SMEs and H-Canyon stakeholders in the field of concrete, nondestructive examination (NDE), structural integrity, sensors and remote systems from SRNL, SRNS, LANL, DOE-SR and the Army Corps of Engineering. The CIPT completed an in-depth identification of customer concrete inspection needs and potential technology solutions. Sensors and methods were evaluated on performance, data usefulness, cost and the feasibility of a successful deployment given the unique tunnel access challenges and environment. Two technologies were identified as promising by the CIPT for near term demonstration and evaluation: Lidar (Light Detection and Ranging) 3-dimensional (3D) mapping and remote robotic deployment of NDE instrumentation. Laser spectroscopy to characterize tunnel surface chemical changes was also of interest, but presently cost prohibitive. This paper will include a discussion of the two efforts underway to evaluate and implement the CIPT recommendations. First, the status of the November 2019 deployment of Lidar at a single location into the tunnel is presented. This initial deployment provided the team a learning curve and lessons learned on the challenges of tunnel deployment to include remote operation and data collection, stabilization of the sensor in high air flow (∼30 mph), ability to achieve a tolerance accuracy of 0.25-inches, and the probability to identify change in tunnel dimensions over time. Secondly, a discussion on the development of the Robotic Arm Concrete Inspection Test Bed capable of deploying NDE instruments to examine custom concrete forms will be presented. Concrete forms simulating the rough concrete surfaces, strength, composition and potential structural defects that can be found at our DOE EM facilities have been designed and built for the test bed. Two state-of-the art concrete NDE instruments have been identified as having potential to work on rough concrete walls, they are being tested and characterized as to their ability to provide desired structural integrity data to include wall thickness and defect identification on the developed test beams. Lastly, lessons learned, and the path forward will be presented. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Enhancing Automotive Intrusion Detection Through Multi-Modal Fusion: A CAN FD-LiDAR Approach

As vehicles become smarter and more autonomous, they increasingly depend on advanced sensors and communication technologies to operate securely. However, such growing dependence on technology—whether it’s CAN (Controller Area Network) for internal communication or LiDAR (Light Detection and Ranging) for sensing the world around them—also expands the attack surface for the types of cyber attacks. Traditional intrusion detection systems (IDS) typically monitor these systems in isolation, limiting their ability to detect sophisticated, crosssystem attacks. To address this, we propose a multi-modal fusion approach that combines real-world CAN FD signals (from the HCRL dataset) with LiDAR features (from the nuScenes dataset) to enhance attack detection. Our method employs a twostage ensemble approach. Calibrated XGBoost and LightGBM models initially process CAN FD (Fuzzing Data) and LiDAR data independently, detecting timing anomalies and space abnormalities. They are subsequently logarithmically combined with a logistic regression meta-model along with 17 engineered features capturing cross-modal behavior, prediction conflicts, and nonlinear interactions. This approach achieves an AUC of 0.87 and an F1-score of 0.82, surpassing single-modality baselines and early fusion methods, at merely 2 ms inference latency. Compared with deep learning competitors, it is 3 times more efficient, providing a lightweight, interpretable, and real time solution to automotive cybersecurity.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Mapping Vegetation at Species Level with High-Resolution Multispectral and Lidar Data Over a Large Spatial Area: A Case Study with Kudzu

Mapping vegetation species is critical to facilitate related quantitative assessment, and mapping invasive plants is important to enhance monitoring and management activities. Integrating high-resolution multispectral remote-sensing (RS) images and lidar (light detection and ranging) point clouds can provide robust features for vegetation mapping. However, using multiple sources of high-resolution RS data for vegetation mapping on a large spatial scale can be both computationally and sampling intensive. Here, we designed a two-step classification workflow to potentially decrease computational cost and sampling effort and to increase classification accuracy by integrating multispectral and lidar data in order to derive spectral, textural, and structural features for mapping target vegetation species. We used this workflow to classify kudzu, an aggressive invasive vine, in the entire Knox County (1362 km2) of Tennessee (U.S.). Object-based image analysis was conducted in the workflow. The first-step classification used 320 kudzu samples and extensive, coarsely labeled samples (based on national land cover) to generate an overprediction map of kudzu using random forest (RF). For the second step, 350 samples were randomly extracted from the overpredicted kudzu and labeled manually for the final prediction using RF and support vector machine (SVM). Computationally intensive features were only used for the second-step classification. SVM had constantly better accuracy than RF, and the producer’s accuracy, user’s accuracy, and Kappa for the SVM model on kudzu were 0.94, 0.96, and 0.90, respectively. SVM predicted 1010 kudzu patches covering 1.29 km2 in Knox County. We found the sample size of kudzu used for algorithm training impacted the accuracy and number of kudzu predicted. The proposed workflow could also improve sampling efficiency and specificity. Our workflow had much higher accuracy than the traditional method conducted in this research, and could be easily implemented to map kudzu in other regions as well as map other vegetation species.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2021

Investigating Application of LiDAR for Nuclear Power Plants

Many evaluation, assessment, and modeling tasks at nuclear power plants require spatial in-formation; this often requires physical visits to locations within the facility because the 2D or 3D schematics and current models do not contain enough detail or do not capture as-built and real-world conditions. These visits require extensive manual labor for not only the requesting party, but also support groups, such as security. Light Detection and Ranging (LiDAR) mapping is trying to solve that problem by providing very detailed 3D models for low costs. However, the use of these models can be very limited because either component reference information is missing and too costly to add or there is no way to extract specific spatial data needed for other tools. This report outlines two main efforts. First, to reduce the effort of “Tagging” data in large 3D models, a general Application Programming Interface (API) was developed to import a variety of existing plant database information into a 3D-visualization engine. Filters allow the user to have only zone-specific items listed; then, they can simply click and assign the information to a specific spot or component in the 3D model. The second part of the work is the development of an interface for importing pieces from the3D-LiDAR model into other systems needed for modeling and simulation, outlined around fire modeling. This interface allows for the retrieval of item location and boundaries, enabling the auto generation of models for varying tools.

3D Modelling↗
DOE OSTI2025

Environmental drivers of spatial variation in tropical forest canopy height: Insights from NASA’s GEDI spaceborne LiDAR

Forest canopy height is a fundamental ecosystem property—influencing patterns of forest carbon storage and forest ecosystem responses to climate variability and change. Previous studies have analyzed environmental drivers influencing spatial variation in canopy height at landscape-to-regional scales; however, far less is known about the environmental determinants underlying regional and global scale variation in forest canopy height. Using the canopy height metrics products from Global Ecosystem Dynamics Investigation (GEDI), a space-borne Light Detection and Ranging (LiDAR) instrument specifically designed to characterize forest structure, we analyze the environmental correlates of spatial variation of global tropical forest canopy height. Our study demonstrates that climate, topography, and soil properties account for 75% of the variation in tropical forest canopy height. Elevation, dry season length, and solar radiation are the most important drivers in determining canopy height both locally and regionally. These results emphasize the vulnerability of tropical forest structure to ongoing changes in the earth’s climate and provide a valuable empirical baseline for tropical forest management.

Science & Technology - Other Topics↗
DOE OSTI2020

Multi-Temporal Predictive Modelling of Sorghum Biomass Using UAV-Based Hyperspectral and LiDAR Data

High-throughput phenotyping using high spatial, spectral, and temporal resolution remote sensing (RS) data has become a critical part of the plant breeding chain focused on reducing the time and cost of the selection process for the “best” genotypes with respect to the trait(s) of interest. In this paper, the potential of accurate and reliable sorghum biomass prediction using visible and near infrared (VNIR) and short-wave infrared (SWIR) hyperspectral data as well as light detection and ranging (LiDAR) data acquired by sensors mounted on UAV platforms is investigated. Predictive models are developed using classical regression-based machine learning methods for nine experiments conducted during the 2017 and 2018 growing seasons at the Agronomy Center for Research and Education (ACRE) at Purdue University, Indiana, USA. The impact of the regression method, data source, timing of RS and field-based biomass reference data acquisition, and the number of samples on the prediction results are investigated. R2 values for end-of-season biomass ranged from 0.64 to 0.89 for different experiments when features from all the data sources were included. Geometry-based features derived from the LiDAR point cloud to characterize plant structure and chemistry-based features extracted from hyperspectral data provided the most accurate predictions. Evaluation of the impact of the time of data acquisition during the growing season on the prediction results indicated that although the most accurate and reliable predictions of final biomass were achieved using remotely sensed data from mid-season to end-of-season, predictions in mid-season provided adequate results to differentiate between promising varieties for selection. The analysis of variance (ANOVA) of the accuracies of the predictive models showed that both the data source and regression method are important factors for a reliable prediction; however, the data source was more important with 69% significance, versus 28% significance for the regression method.

09 BIOMASS FUELS↗
DOE OSTI2024

Quantitative comparison of power production and power quality onshore and offshore: a case study from the eastern United States

Abstract. A major issue in quantifying potential power generation from prospective wind energy sites is the lack of observations from heights relevant to modern wind turbines, particularly for offshore where blade tip heights are projected to increase beyond 250 m. We present analyses of uniquely detailed data sets from lidar (light detection and ranging) deployments in New York State and on two buoys in the adjacent New York Bight to examine the relative power generation potential and power quality at these on- and offshore locations. Time series of 10 min wind power production are computed from these wind speeds using the power curve from the International Energy Agency 15 MW reference wind turbine. Given the relatively close proximity of these lidar deployments, they share a common synoptic-scale meteorology and seasonal variability with lowest wind speeds in July and August. Time series of power production from the on- and offshore location are highly spatially correlated with the Spearman rank correlation coefficient dropping below 0.4 for separation distances of approximately 350 km. Hence careful planning of on- and offshore wind farms (i.e., separation of major plants by > 350 km) can be used reduce the system-wide probability of low wind energy power production. Energy density at 150 m height at the offshore buoys is more than 40 % higher, and the Weibull scale parameter is 2 m s−1 higher than at all but one of the land sites. Analyses of power production time series indicate annual energy production is almost twice as high for the two offshore locations. Further, electrical power production quality is higher from the offshore sites that exhibit a lower amplitude of diurnal variability, plus a lower probability of wind speeds below the cut-in and of ramp events of any magnitude. Despite this and the higher resource, the estimated levelized cost of energy (LCoE) is higher from the offshore sites mainly due to the higher infrastructure costs. Nonetheless, the projected LCoE is highly competitive from all sites considered.

Foody, Rebecca↗
DOE OSTI2024

Semi-automatic image annotation using 3D LiDAR projections and depth camera data

Efficient image annotation is necessary to utilize deep learning object recognition neural networks in nuclear safeguards, such as for the detection and localization of target objects like nuclear material containers (NMCs). This capability can help automate the inventory accounting of different types of NMCs within nuclear storage facilities. The conventional manual annotation process is labor-intensive and time-consuming, hindering the rapid deployment of deep learning models for NMC identifications. This paper introduces a novel semi-automatic method for annotating 2D images of nuclear material containers (NMCs) by combining 3D light detection and ranging (LiDAR) data with color and depth camera images collected from a handheld scan system. The annotation pipeline involves an operator manually marking new target objects on a LiDAR-generated map, and projecting these 3D locations to images, thereby automatically creating annotations from the projections. The semi-automatic approach significantly reduces manual efforts and the expertise in image annotation that is required to perform the task, allowing deep learning models to be trained on-site within a few hours. The paper compares the performance of models trained on datasets annotated through various methods, including semi-automatic, manual, and commercial annotation services. The evaluation demonstrates that the semi-automatic annotation method achieves comparable or superior results, with a mean average precision (mAP) above 0.9, showcasing its efficiency in training object recognition models. Additionally, the paper explores the application of the proposed method to instance segmentation, achieving promising results in detecting multiple types of NMCs in various formations.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗