Search NASA⌕ Search

SEARCH · Search NASA

Results for “3D image processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

WE-AB-BRA-07: Quantitative Evaluation of 2D-2D and 2D-3D Image Guided Radiation Therapy for Clinical Trial Credentialing, NRG Oncology/RTOG

Purpose: 2D-2D kV image guided radiation therapy (IGRT) credentialing evaluation for clinical trial qualification was historically qualitative through submitting screen captures of the fusion process. However, as quantitative DICOM 2D-2D and 2D-3D image registration tools are implemented in clinical practice for better precision, especially in centers that treat patients with protons, better IGRT credentialing techniques are needed. The aim of this work is to establish methodologies for quantitatively reviewing IGRT submissions based on DICOM 2D-2D and 2D-3D image registration and to test the methodologies in reviewing 2D-2D and 2D-3D IGRT submissions for RTOG/NRG Oncology clinical trials qualifications. Methods: DICOM 2D-2D and 2D-3D automated and manual image registration have been tested using the Harmony tool in MIM software. 2D kV orthogonal portal images are fused with the reference digital reconstructed radiographs (DRR) in the 2D-2D registration while the 2D portal images are fused with DICOM planning CT image in the 2D-3D registration. The Harmony tool allows alignment of the two images used in the registration process and also calculates the required shifts. Shifts calculated using MIM are compared with those submitted by institutions for IGRT credentialing. Reported shifts are considered to be acceptable if differences are less than 3mm. Results: Several tests have been performed on the 2D-2D and 2D-3D registration. The results indicated good agreement between submitted and calculated shifts. A workflow for reviewing these IGRT submissions has been developed and will eventually be used to review IGRT submissions. Conclusion: The IROC Philadelphia RTQA center has developed and tested a new workflow for reviewing DICOM 2D-2D and 2D-3D IGRT credentialing submissions made by different cancer clinical centers, especially proton centers. NRG Center for Innovation in Radiation Oncology (CIRO) and IROC RTQA center continue their collaborative efforts to enhance quality assurance services and to be consistently adaptive to the new advances in radiation therapy. This project was supported by NCI grants U10CA180868, U10CA180822, U24CA180803, U24CA12014 and PA CURE Grant.

60 APPLIED LIFE SCIENCES↗

Implementation of Remote 3-Dimensional Image Guided Radiation Therapy Quality Assurance for Radiation Therapy Oncology Group Clinical Trials

Purpose: To report the process and initial experience of remote credentialing of three-dimensional (3D) image guided radiation therapy (IGRT) as part of the quality assurance (QA) of submitted data for Radiation Therapy Oncology Group (RTOG) clinical trials; and to identify major issues resulting from this process and analyze the review results on patient positioning shifts. Methods and Materials: Image guided radiation therapy datasets including in-room positioning CT scans and daily shifts applied were submitted through the Image Guided Therapy QA Center from institutions for the IGRT credentialing process, as required by various RTOG trials. A centralized virtual environment is established at the RTOG Core Laboratory, containing analysis tools and database infrastructure for remote review by the Physics Principal Investigators of each protocol. The appropriateness of IGRT technique and volumetric image registration accuracy were evaluated. Registration accuracy was verified by repeat registration with a third-party registration software system. With the accumulated review results, registration differences between those obtained by the Physics Principal Investigators and from the institutions were analyzed for different imaging sites, shift directions, and imaging modalities. Results: The remote review process was successfully carried out for 87 3D cases (out of 137 total cases, including 2-dimensional and 3D) during 2010. Frequent errors in submitted IGRT data and challenges in the review of image registration for some special cases were identified. Workarounds for these issues were developed. The average differences of registration results between reviewers and institutions ranged between 2 mm and 3 mm. Large discrepancies in the superior-inferior direction were found for megavoltage CT cases, owing to low spatial resolution in this direction for most megavoltage CT cases. Conclusion: This first experience indicated that remote review for 3D IGRT as part of QA for RTOG clinical trials is feasible and effective. The magnitude of registration discrepancy between institution and reviewer was presented, and the major issues were investigated to further improve this remote evaluation process.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Contour interpolated radial basis functions with spline boundary correction for fast 3D reconstruction of the human articular cartilage from MR images

Purpose: The aim of this work is to demonstrate a new image processing technique that can provide a “near real-time” 3D reconstruction of the articular cartilage of the human knee from MR images which is user friendly. This would serve as a point-of-care 3D visualization tool which would benefit a consultant radiologist in the visualization of the human articular cartilage. Methods: The authors introduce a novel fusion of an adaptation of the contour method known as “contour interpolation (CI)” with radial basis functions (RBFs) which they describe as “CI-RBFs.” The authors also present a spline boundary correction which further enhances volume estimation of the method. A subject cohort consisting of 17 right nonpathological knees (ten female and seven male) is assessed to validate the quality of the proposed method. The authors demonstrate how the CI-RBF method dramatically reduces the number of data points required for fitting an implicit surface to the entire cartilage, thus, significantly improving the speed of reconstruction over the comparable RBF reconstruction method of Carr. The authors compare the CI-RBF method volume estimation to a typical commercial package (3D DOCTOR), Carr’s RBF method, and a benchmark manual method for the reconstruction of the femoral, tibial, and patellar cartilages. Results: The authors demonstrate how the CI-RBF method significantly reduces the number of data points (p-value < 0.0001) required for fitting an implicit surface to the cartilage, by 48%, 31%, and 44% for the patellar, tibial, and femoral cartilages, respectively. Thus, significantly improving the speed of reconstruction (p-value < 0.0001) by 39%, 40%, and 44% for the patellar, tibial, and femoral cartilages over the comparable RBF model of Carr providing a near real-time reconstruction of 6.49, 8.88, and 9.43 min for the patellar, tibial, and femoral cartilages, respectively. In addition, it is demonstrated how the CI-RBF method matches the volume estimation of a typical commercial package (3D DOCTOR), Carr’s RBF method, and a benchmark manual method for the reconstruction of the femoral, tibial, and patellar cartilages. Furthermore, the performance of the segmentation method used for the extraction of the femoral, tibial, and patellar cartilages is assessed with a Dice similarity coefficient, sensitivity, and specificity measure providing high agreement to manual segmentation. Conclusions: The CI-RBF method provides a fast, accurate, and robust 3D model reconstruction that matches Carr’s RBF method, 3D DOCTOR, and a manual benchmark method in accuracy and significantly improves upon Carr’s RBF method in data requirement and computational speed. In addition, the visualization tool has been designed to quickly segment MR images requiring only four mouse clicks per MR image slice.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

SU-E-QI-21: Iodinated Contrast Agent Time Course In Human Brain Metastasis: A Study For Stereotactic Synchrotron Radiotherapy Clinical Trials

Purpose: Synchrotron stereotactic radiotherapy (SSRT) is an innovative treatment combining the selective accumulation of heavy elements in tumors with stereotactic irradiations using monochromatic medium energy x-rays from a synchrotron source. Phase I/II clinical trials on brain metastasis are underway using venous infusion of iodinated contrast agents. The radiation dose enhancement depends on the amount of iodine in the tumor and its time course. In the present study, the reproducibility of iodine concentrations between the CT planning scan day (Day 0) and the treatment day (Day 10) was assessed in order to predict dose errors. Methods: For each of days 0 and 10, three patients received a biphasic intravenous injection of iodinated contrast agent (40 ml, 4 ml/s, followed by 160 ml, 0.5 ml/s) in order to ensure stable intra-tumoral amounts of iodine during the treatment. Two volumetric CT scans (before and after iodine injection) and a multi-slice dynamic CT of the brain were performed using conventional radiotherapy CT (Day 0) or quantitative synchrotron radiation CT (Day 10). A 3D rigid registration was processed between images. The absolute and relative differences of absolute iodine concentrations and their corresponding dose errors were evaluated in the GTV and PTV used for treatment planning. Results: The differences in iodine concentrations remained within the standard deviation limits. The 3D absolute differences followed a normal distribution centered at zero mg/ml with a variance (∼1 mg/ml) which is related to the image noise. Conclusion: The results suggest that dose errors depend only on the image noise. This study shows that stable amounts of iodine are achievable in brain metastasis for SSRT treatment in a 10 days interval.

60 APPLIED LIFE SCIENCES↗

X-ray tomography system to investigate granular materials during mechanical loading

We integrate a small and portable medical x-ray device with mechanical testing equipment to enable in situ, non-invasive measurements of a granular material's response to mechanical loading. We employ an orthopedic C-arm as the x-ray source and detector to image samples mounted in the materials tester. We discuss the design of a custom rotation stage, which allows for sample rotation and tomographic reconstruction under applied compressive stress. We then discuss the calibration of the system for 3D computed tomography, as well as the subsequent image reconstruction process. Using this system to reconstruct packings of 3D-printed particles, we resolve packing features with 0.52 mm resolution in a (60 mm){sup 3} field of view. By analyzing the performance bounds of the system, we demonstrate that the reconstructions exhibit only moderate noise.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Multiple-view spectrally resolved x-ray imaging observations of polar-direct-drive implosions on OMEGA

We present spatially, temporally, and spectrally resolved narrow- and broad-band x-ray images of polar-direct-drive (PDD) implosions on OMEGA. These self-emission images were obtained during the deceleration phase and bang time using several multiple monochromatic x-ray imaging instruments fielded along two or three quasi-orthogonal lines-of-sight, including equatorial and polar views. The instruments recorded images based on K-shell lines from a titanium tracer located in the shell as well as continuum emission. These observations constitute the first such data obtained for PDD implosions. The image data show features attributed to laser imprinting and zero-order hydrodynamics. Equatorial-view images show a “double bun” structure that is consistent with synthetic images obtained from post-processing 2D and 3D radiation-hydrodynamic simulations of the experiment. Polar-view images show a pentagonal, petal pattern that correlates with the PDD laser illumination used on OMEGA, thus revealing a 3D aspect of PDD OMEGA implosions not previously observed. Differences are noted with respect to a PDD experiment performed at National Ignition Facility.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Recent Advances in Soft Matter Characterization Capabilities Developed at NASA GRC for Lunar Exploration: Differential Dynamic Microscopy to Spectroscopy to Computer Vision

In 1991, famous French scientist Pierre-Gilles de Genes was awarded Nobel prize for his impactful research in soft matter, more specifically polymers. He is defined as the founding father of soft matter. In his Nobel lecture (https://www.nobelprize.org/uploads/2018/06/gennes-lecture.pdf ) he described soft matter aka complex fluids as materials with two primary features – (a) complexity and (b) flexibility. The sub-categories of soft matter (e.g.- granular materials, polymers, foams, colloids etc.) are defined on the basis of Pierre-Gilles de Gennes’ definition. At NASA GRC, we are pushing the boundaries for fundamental study of soft matter on Lunar Surface. With regard to Lunar surface science, we are focusing on developing capabilities pertaining to granular materials and bio-soft/active matter to facilitate future efforts in ISRU and bio-ISRU capabilities. In order to achieve fundamental goals of soft matter research within the limitations of Lunar environment, the scientific capabilities need to be small, flexible, modular, off the shelf and the focus needs to be more on developing an interdisciplinary capability that leverages the recent growth in AI/ML and Computer Vision to augment our understanding of fundamental science. This strategy would allow us to reduce our resource requirement during launch, installation, and occupied real estate footprint on Lunar surface In this talk, we will go over 3 different capabilities that we have developed in house and in close collaboration – (a) Differential Dynamic Microscopy (DDM), (b) Portable In-situ Chemical Spectroscopy (PICS) and (c) Computer Vision Enabled Observation. At very high level, Differential Dynamic Microscopy (DDM) allows us to study the structure-property-process relation (microrheology) of bio-soft/active matter using optical microscope and improved image analysis capabilities. PICS uses AI/ML-based advanced signal deconvolution and analysis technique that can work with existing portable spectroscopy tools to perform materials analysis (e.g.- granular materials and bio-soft/active matter) inspection on the go. Finally, computer vision enabled analysis allows us to use simple camera images for 3D reconstruction of experimental process and tracking of objects of interest in an experiment. We expect that this detailed process will allow us reach a thorough understanding of soft matter in Lunar environment. The capabilities developed by us will help to validate and establish fundamental understanding in Lunar environment. This will, in turn, allow us to guide future space exploration missions and expand the knowledge base of the scientific and engineering communities.

Suman Sinha Ray↗

Recent Advances in Soft Matter Characterization Capabilities Developed at NASA GRC for Lunar Exploration: Differential Dynamic Microscopy to Spectroscopy to Computer Vision

In 1991, famous French scientist Pierre-Gilles de Genes was awarded Nobel prize for his impactful research in soft matter, more specifically polymers. He is defined as the founding father of soft matter. In his Nobel lecture (https://www.nobelprize.org/uploads/2018/06/gennes-lecture.pdf ) he described soft matter aka complex fluids as materials with two primary features – (a) complexity and (b) flexibility. The sub-categories of soft matter (e.g.- granular materials, polymers, foams, colloids etc.) are defined on the basis of Pierre-Gilles de Gennes’ definition. At NASA GRC, we are pushing the boundaries for fundamental study of soft matter on Lunar Surface. With regard to Lunar surface science, we are focusing on developing capabilities pertaining to granular materials and bio-soft/active matter to facilitate future efforts in ISRU and bio-ISRU capabilities. In order to achieve fundamental goals of soft matter research within the limitations of Lunar environment, the scientific capabilities need to be small, flexible, modular, off the shelf and the focus needs to be more on developing an interdisciplinary capability that leverages the recent growth in AI/ML and Computer Vision to augment our understanding of fundamental science. This strategy would allow us to reduce our resource requirement during launch, installation, and occupied real estate footprint on Lunar surface. In this talk, we will go over 3 different capabilities that we have developed in house and in close collaboration – (a) Differential Dynamic Microscopy (DDM), (b) Portable In-situ Chemical Spectroscopy (PICS) and (c) Computer Vision Enabled Observation. At very high level, Differential Dynamic Microscopy (DDM) allows us to study the structure-property-process relation (microrheology) of bio-soft/active matter using optical microscope and improved image analysis capabilities. PICS uses AI/ML-based advanced signal deconvolution and analysis technique that can work with existing portable spectroscopy tools to perform materials analysis (e.g.- granular materials and bio-soft/active matter) inspection on the go. Finally, computer vision enabled analysis allows us to use simple camera images for 3D reconstruction of experimental process and tracking of objects of interest in an experiment. We expect that this detailed process will allow us reach a thorough understanding of soft matter in Lunar environment. The capabilities developed by us will help to validate and establish fundamental understanding in Lunar environment. This will, in turn, allow us to guide future space exploration missions and expand the knowledge base of the scientific and engineering communities.

Suman Sinha-Ray↗

Recent Advances in Soft Matter Characterization Capabilities Developed at NASA GRC for Lunar Exploration: Differential Dynamic Microscopy to Spectroscopy to Computer Vision

In 1991, famous French scientist Pierre-Gilles de Genes was awarded Nobel prize for his impactful research in soft matter, more specifically polymers. He is defined as the founding father of soft matter. In his Nobel lecture (https://www.nobelprize.org/uploads/2018/06/gennes-lecture.pdf ) he described soft matter aka complex fluids as materials with two primary features – (a) complexity and (b) flexibility. The sub-categories of soft matter (e.g.- granular materials, polymers, foams, colloids etc.) are defined on the basis of Pierre-Gilles de Gennes’ definition. At NASA GRC, we are pushing the boundaries for fundamental study of soft matter on Lunar Surface. With regard to Lunar surface science, we are focusing on developing capabilities pertaining to granular materials and bio-soft/active matter to facilitate future efforts in ISRU and bio-ISRU capabilities. In order to achieve fundamental goals of soft matter research within the limitations of Lunar environment, the scientific capabilities need to be small, flexible, modular, off the shelf and the focus needs to be more on developing an interdisciplinary capability that leverages the recent growth in AI/ML and Computer Vision to augment our understanding of fundamental science. This strategy would allow us to reduce our resource requirement during launch, installation, and occupied real estate footprint on Lunar surface In this talk, we will go over 3 different capabilities that we have developed in house and in close collaboration – (a) Differential Dynamic Microscopy (DDM), (b) Portable In-situ Chemical Spectroscopy (PICS) and (c) Computer Vision Enabled Observation. At very high level, Differential Dynamic Microscopy (DDM) allows us to study the structure-property-process relation (microrheology) of bio-soft/active matter using optical microscope and improved image analysis capabilities. PICS uses AI/ML-based advanced signal deconvolution and analysis technique that can work with existing portable spectroscopy tools to perform materials analysis (e.g.- granular materials and bio-soft/active matter) inspection on the go. Finally, computer vision enabled analysis allows us to use simple camera images for 3D reconstruction of experimental process and tracking of objects of interest in an experiment. We expect that this detailed process will allow us reach a thorough understanding of soft matter in Lunar environment. The capabilities developed by us will help to validate and establish fundamental understanding in Lunar environment. This will, in turn, allow us to guide future space exploration missions and expand the knowledge base of the scientific and engineering communities.

Suman Sinha Ray↗

Recent Advances in Soft Matter Characterization Capabilities Developed at NASA GRC

In 1991, famous French scientist Pierre-Gilles de Genes was awarded Nobel prize for his impactful research in soft matter, more specifically polymers. He is defined as the founding father of soft matter. In his Nobel lecture (https://www.nobelprize.org/uploads/2018/06/gennes-lecture.pdf ) he described soft matter aka complex fluids as materials with two primary features – (a) complexity and (b) flexibility. The sub-categories of soft matter (e.g.- granular materials, polymers, foams, colloids etc.) are defined on the basis of Pierre-Gilles de Gennes’ definition. At NASA GRC, we are pushing the boundaries for fundamental study of soft matter on Lunar Surface. With regard to Lunar surface science, we are focusing on developing capabilities pertaining to granular materials and bio-soft/active matter to facilitate future efforts in ISRU and bio-ISRU capabilities. In order to achieve fundamental goals of soft matter research within the limitations of Lunar environment, the scientific capabilities need to be small, flexible, modular, off the shelf and the focus needs to be more on developing an interdisciplinary capability that leverages the recent growth in AI/ML and Computer Vision to augment our understanding of fundamental science. This strategy would allow us to reduce our resource requirement during launch, installation, and occupied real estate footprint on Lunar surface In this talk, we will go over 3 different capabilities that we have developed in house and in close collaboration – (a) Differential Dynamic Microscopy (DDM), (b) Portable In-situ Chemical Spectroscopy (PICS) and (c) Computer Vision Enabled Observation. At very high level, Differential Dynamic Microscopy (DDM) allows us to study the structure-property-process relation (microrheology) of bio-soft/active matter using optical microscope and improved image analysis capabilities. PICS uses AI/ML-based advanced signal deconvolution and analysis technique that can work with existing portable spectroscopy tools to perform materials analysis (e.g.- granular materials and bio-soft/active matter) inspection on the go. Finally, computer vision enabled analysis allows us to use simple camera images for 3D reconstruction of experimental process and tracking of objects of interest in an experiment. We expect that this detailed process will allow us reach a thorough understanding of soft matter in Lunar environment. The capabilities developed by us will help to validate and establish fundamental understanding in Lunar environment. This will, in turn, allow us to guide future space exploration missions and expand the knowledge base of the scientific and engineering communities.

Suman Sinha Ray↗

Probe the Localized Electrochemical Environment Effects and Electrode Reaction Dynamics for Metal Batteries using In Situ 3D Microscopy

Uncontrollable dendrite growth is closely related to non-uniform reaction environments. However, there is a lack of understanding and analysis methods to probe the localized electrochemical environment (LEE). Here the effects of the LEE are investigated, including localized ion concentrations, current density, and electric potential, on metal plating/stripping dynamics and dendrite minimization. A novel in situ 3D microscopy technique is developed to image the morphology dynamics and deposition rate of Zn plating/stripping processes on 3D Zn–Mn anodes. Using the in situ 3D microscope, the electrode morphology changes during the reactions are directly imaged and Zn deposition rate maps at different time points are obtained. It is found that reaction kinetics are highly correlated to LEE and electrode morphology. To further quantify the LEE effects, the digital twin technique is employed that allows the accurate calculation of the electrochemical environments, such as localized ion concentrations, current density, and electric potential, which cannot be directly measured from experiments. We found that the curvature of the 3D electrode surface determines the LEE and significantly influences reaction kinetics. This provides a new strategy to minimize the dendrite formation by designing and optimizing the 3D geometry of the electrode to control the LEE.

36 MATERIALS SCIENCE↗

Method for phase retrieval to reduce a sampling requirement when imaging a dynamic process

A method for retrieving phase information in a coherent diffraction imaging process includes acquiring a plurality of 3D data sets, each 3D data set corresponding to one of a plurality of time states, and reconstructing a 3D image of the object at a given time state using the 3D data set from all of the time states. Each 3D data set is acquired by: illuminating an object positioned in a first position with a coherent beam; measuring a first 2D diffraction pattern using an area detector; rotating the object around a tilt axis thereof to a second position that is different from the first position; re-illuminating the object positioned in the second position with the coherent beam; re-measuring a second 2D diffraction pattern using the area detector; and repeating the rotating, re-illuminating and re-measuring steps such that each 3D data set includes a predetermined number of diffraction patterns.

36 MATERIALS SCIENCE↗

In Situ 3D Imaging of Catalysis Induced Strain in Gold Nanoparticles

Multielectron transfer processes are crucially important in energy and biological science but require favorable catalysts to achieve fast kinetics. Nanostructuring catalysts can dramatically improve their properties, which can be difficult to understand due to strain- and size-dependent thermodynamics, the influence of defects, and substrate-dependent activities. Here, we report three-dimensional (3D) imaging of single gold nanoparticles during catalysis of ascorbic acid decomposition using Bragg coherent diffractive imaging (BCDI). Local strains were measured in single nanoparticles and modeled using reactive molecular dynamics (RMD) simulations and finite element analysis (FEA) simulations. RMD reveals the pathway for local strain generation in the gold lattice: chemisorption of hydroxyl ions. FEA reveals that the RMD results are transferable to the nanocrystal sizes studied in the experiment. Our study probes the strain-activity connection and opens a powerful avenue for theoretical and experimental studies of nanocrystal catalysis.

Ulvestad, Andrew↗

Reconstruction of shapes of near symmetric and asymmetric objects

A system processes 2D images of 2D or 3D objects, creating a model of the object that is consistent with the image and as veridical as the perception of the 2D image by humans. Vertices of the object that are hidden in the image are recovered by using planarity and symmetry constraints. The 3D shape is recovered by maximizing 3D compactness of the recovered object and minimizing its surface area. In some embodiments, these two criteria are weighted by using the geometric mean.

97 MATHEMATICS AND COMPUTING↗

Reconstruction of shapes of near symmetric and asymmetric objects

A system processes 2D images of 2D or 3D objects, creating a model of the object that is consistent with the image and as veridical as the perception of the 2D image by humans. Vertices of the object that are hidden in the image are recovered by using planarity and symmetry constraints. The 3D shape is recovered by maximizing 3D compactness of the recovered object and minimizing its surface area. In some embodiments, these two criteria are weighted by using the geometric mean.

97 MATHEMATICS AND COMPUTING↗

Characterization, comparison, and optimization of lattice light sheets

Lattice light sheet microscopy excels at the noninvasive imaging of three-dimensional (3D) dynamic processes at high spatiotemporal resolution within cells and developing embryos. Recently, several papers have called into question the performance of lattice light sheets relative to the Gaussian sheets most common in light sheet microscopy. Here, we undertake a theoretical and experimental analysis of various forms of light sheet microscopy, which demonstrates and explains why lattice light sheets provide substantial improvements in resolution and photobleaching reduction. The analysis provides a procedure to select the correct light sheet for a desired experiment and specifies the processing that maximizes the use of all fluorescence generated within the light sheet excitation envelope for optimal resolution while minimizing image artifacts and photodamage. We also introduce a new type of “harmonic balanced” lattice light sheet that improves performance at all spatial frequencies within its 3D resolution limits and maintains this performance over lengthened propagation distances allowing for expanded fields of view.

59 BASIC BIOLOGICAL SCIENCES↗

Aerial 3D Building Reconstruction from Drone Imagery (A3DBR) v1

This toolkit is composed of several modules for extracting buildings geometrical and thermal characteristics from RGB and thermal imagery captured using a drone. - Building 3D reconstruction module: leverage a photogrammetry software to construct a 3D point cloud from RGB drone imagery, which is then used in conjunction with image processing and geometric methods to extract building footprint and building height (i.e., 3D model of the building). - Windows to wall ratio estimation module: leverage deep learning semantic segmentation modeling to detect windows on 2D drone RGB images. The detected windows are then projected onto the extracted building 3D model (using building 3D reconstruction module) and their area is computed to obtain window to wall ratio estimation. - Thermal anomalies detection module: leverage image processing and machine learning algorithm to detect on 2D drone thermal images potential thermal anomalies within building's facades and roofs.

Granderson, Jessica↗