MegaStitch: Robust Large-Scale Image Stitching
Not Available
37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
SEARCH · Search NASA
Results for “image stitching”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Image Stitching in Neutron Radiography for Surface Extraction of Additively Manufactured Parts
Explore the source record for details and available documents.
Physics - Nuclear physics and radiation physics↗
A bi-channel aided stitching of atomic force microscopy images
Microscopy is an essential tool in scientific research, enabling the visualization of structures at micro- and nanoscale resolutions. However, the field of microscopy often encounters limitations in field-of-view (FOV), restricting the amount of sample that can be imaged in a single capture. To overcome this limitation, image stitching techniques have been developed to seamlessly merge multiple overlapping images into a single, high-resolution composite. The images collected from microscope need to be optimally stitched before accurate physical information can be extracted from post analysis. However, the existing stitching tools either struggle to stitch images together when the microscopy images are feature sparse or cannot address all the transformations of images when performing image stitching. To address these issues, we propose a bi-channel aided feature-based image stitching method and demonstrate its use on Atomic Force Microscopy (AFM) generated Pantoea sp. YR343 biofilm and PTO thin film sample images as experimental data. The topographical channel image of AFM data captures the morphological details of the sample, and a stitched topographical image is desired for researchers. We utilize the amplitude and phase channels of AFM data to maximize the matching features and to estimate the position of the original topographical images and show that the proposed bi-channel aided stitching method outperforms the traditional direct stitching approach in AFM topographical image stitching task. Here, we demonstrated the application on AFM, but similar approaches could be employed of optical microscopy with brightfield and fluorescence channels. We believe this proposed workflow can serve as a valuable augmentation strategy for microscopy image stitching tasks and will benefit the experimentalist to avoid erroneous analysis and discovery due to incorrect stitching.
Atomic force microscopy↗
Development of techniques for gantryless associated-particle imaging
To move fast-neutron radiography using the associated-particle imaging technique from the laboratory to the field, the development of new analysis techniques is required. In particular, the relative positions of the source and detectors need to be determined when they have been placed by hand, the normalization for a particular source–detector geometry needs to be determined without a measurement in the same geometry with no object present, and accurate image stitching is required when multiple detector positions are necessary to image an object. The present work describes methods that employ transmission neutron data to localize a fast-neutron imaging panel with respect to the neutron source, calculate a normalization for a given source–detector geometry, stitch images together, and describes the required system calibrations. The reported techniques enable in-field neutron radiography for cases in which the source–detector geometry is not well known a priori and where operational constraints preclude a normalization measurement.
Heath, Matthew↗
FDTR Subsurface Imaging and Stitching
Explore the source record for details and available documents.
Antiporda, Logan Michael↗
Characterization of Lab-Grown Cracks for Aerosol Transmission Testing
Motivation: Determine the length and opening of two lab-grown cracks, designated as LT-14 and LT-28, representative of stress corrosion cracks in spent nuclear fuel dry storage casks to supplement future testing of gas and aerosol transport. Problem: The extreme aspect ratio of the crack length to opening requires that imaging occurs in stages with the results merged before final analysis. Method: High magnification (1500x) optical images of both sides of the two plates were acquired. 20x stitched images with LSCM were acquired, fully stitched along the length, and leveled with newly developed PLATES Method in MATLAB®. Conclusion for LT-14: Side 1 is 47.25 mm long and has 366 separate crack features with an average length of 23.50 µm and an average opening of 8.27 µm. Side 2 is 69.44 mm long and has 550 separate crack features with an average length of 81.63 µm and an average opening of 67.70 µm. Conclusion for LT-28: Side 1 is 71.95 mm long and has 1,127 separate crack features with an average length of 42.27 µm and an average opening of 10.31 µm. Side 2 is 74.88 mm long and has 520 separate crack features with an average length of 98.13 µm and an average opening of 14.99 µm. The adjacent crack on side 1 is 18.95 mm long and has 37 separate crack features with an average length of 17.46 µm and an average opening of 10.42 µm. The adjacent crack on side 2 is 26.40 mm long and has 55 separate crack features with an average length of 87.26 µm and an average opening of 48.29 µm. Each adjacent crack is approximately 26 mm from the main crack.
11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
Computer vision-based rock bolt detection in orthomosaic imagery obtained in the Waste Isolation Pilot Plant underground facility
Assessing structural integrity of large underground tunnel facilities is often a time consuming and human-labor intensive task. Thus, research using various modes of sensing and automated detection of key structural components in mines is posed to aid in safety assessments and establishing overall structural health. We propose an approach utilizing off-the-shelf camera and lidar technology fixed to a custom sensing platform, image stitching techniques, fine-tuned object detection models, and specialized model-inference methods to automatically detect, count, and map roof bolts for assessment of structural safety in man-made underground tunnels. Results show a novel workflow for effective object counting in orthomosaic tunnel ceiling images generated from collections in GPS-denied mining environments. Additionally, we demonstrate effective fine-tuning of EfficientDet object detectors utilizing state-of-the-art image augmentation techniques known as the mosaic and mixup transformations. Our work is demonstrated on sensed data and imagery collected from the Department of Energy (DOE) Waste Isolation Pilot Plant (WIPP) where miles of tunnel ceiling must be assessed for structural integrity.
42 ENGINEERING↗
Wide‐Field Bond Quality Evaluation Using Frequency Domain Thermoreflectance with Deep Neural Network Feature Reconstruction
Heterogeneous integration of microelectronic components provides a pathway to improve circuit/component performance; however, this comes with assembly challenges, in particular due to complex interfaces via subsurface bump bonds. The ability of these bonds to transmit electrical signals and conduct heat to the carrier substrate limits component performance. In this work, hyperspectral frequency‐domain thermoreflectance (FDTR) imaging is demonstrated as a robust technique for evaluating the quality of subsurface indium bump bonds in a surrogate microelectronic sample. By performing microscale FDTR imaging with coarse motion image stitching, thermal phase maps that cover a 4 mm by 4 mm field‐of‐view with subsurface feature sensitivity at depths greater than 50 µm are obtained. The resulting FDTR hyperspectral data contains more than three million pixels and reveal the quality of subsurface microbump arrays. Wide‐field analysis of bonded versus gap regions is enabled by deep neural network feature reconstruction, that after training, rapidly provides an interpretable representation of bond quality. Utility of noisy higher frequency FDTR phase maps, i.e., near the computationally predicted sensing depth limit, results in an average prediction error of 11%. Taken together, FDTR with neural network‐based analysis demonstrates subsurface bond monitoring at length scales relevant for heterogeneously integrated microelectronics.
FDTR↗
Analysis of biofilm assembly by large area automated AFM
Biofilms are complex microbial communities critical in medical, industrial, and environmental contexts. Understanding their assembly, structure, genetic regulation, interspecies interactions, and environmental responses is key to developing effective control and mitigation strategies. While atomic force microscopy (AFM) offers critically important high-resolution insights on structural and functional properties at the cellular and even sub-cellular level, its limited scan range and labor-intensive nature restricts the ability to link these smaller scale features to the functional macroscale organization of the films. We begin to address this limitation by introducing an automated large area AFM approach capable of capturing high-resolution images over millimeter-scale areas, aided by machine learning for seamless image stitching, cell detection, and classification. Large area AFM is shown to provide a very detailed view of spatial heterogeneity and cellular morphology during the early stages of biofilm formation which were previously obscured. Using this approach, we examined the organization of Pantoea sp. YR343 on PFOTS-treated glass surfaces. Our findings reveal a preferred cellular orientation among surface-attached cells, forming a distinctive honeycomb pattern. Detailed mapping of flagella interactions suggests that flagellar coordination plays a role in biofilm assembly beyond initial attachment. Additionally, we use large-area AFM to characterize surface modifications on silicon substrates, observing a significant reduction in bacterial density. This highlights the potential of this method for studying surface modifications to better understand and control bacterial adhesion and biofilm formation.
59 BASIC BIOLOGICAL SCIENCES↗
A New Reflected Target Optical Assessment System: Stage 1 Development Results
NREL has completed stage 1 development of an indoor optical measurement tool for fully assembled heliostats and single facets. This tool began as an indoor version of NREL’s outdoor Non-Intrusive Optical (NIO) measurement technique [1]. It uses similar techniques to other available tools (deflectometry, photogrammetry, etc.), but is designed to require very little infrastructure, labor, and time to set up and collect surface slope and canting measurements, making it a valuable tool for quality assurance and laboratory measurement of heliostat optics. It accomplishes this by using computer vision, photogrammetry, and multiple images stitched together to minimize the printed target size and required setup precision. This adaptable setup is useful for taking measurements at a variety of heliostat pointing angles, and for measuring fully assembled heliostats on the assembly line. In this paper, we describe the methodology behind the measurement system, present an initial analysis of its uncertainty and sensitivity, and compare it with established optical measurement systems.
Kesseli, Devon (ORCID:0000000193113036)↗
A New Reflected Target Optical Assessment System - Stage 1 Development Results: Preprint
NREL has completed stage 1 development of an indoor optical measurement tool for fully assembled heliostats and single facets. This tool began as an indoor version of NREL's NIO technique. It uses similar techniques to other available tools (deflectometry, photogrammetry, etc.), but is designed require very little infrastructure, labor, and time to set up and collect surface slope and canting measurements on fully assembled heliostats and parabolic trough facets, making it a valuable tool for quality assurance and laboratory measurement of helio-stat optics. It accomplishes this by using computer vision, photogrammetry, and multiple images stitched together to minimize the printed target size and required setup precision. This adaptable setup is useful for taking measurements at a variety of heliostat pointing angles, and for measuring fully assembled heliostats on the assembly line. The measurement system's methodology and an analysis of its uncertainty, sensitivity and comparison with established optical measurement systems is described below.
canting↗
GOES-R Solar UltraViolet Imager Extended Coronal Imaging
GOES-16 and GOES-17 each hosts a Solar UltraViolet Imager (SUVI) that images the Sun in six extreme ultraviolet (EUV) wavelengths: 9.4 nm, 13.1nm, 17.1nm, 19.5nm, 28.4nm, and 30.4nm. The SUVI is nominally Sun-pointed and has a four-minute imaging sequence covering all the channels and meeting the dynamic range requirements. Based on the SUVI capabilities observed on-orbit, a campaign to image the extended solar corona was undertaken in 2018. This was performed by off-pointing the SUVI line-of-sight to the left and right of the Sun and producing a composite image by stitching together the off-pointed and the Sun-centered images. The imaging area in the composite is about three times the nominal image area in the East-West direction (about 5 RSun versus 1.8 RSun for nominal images). The campaign was conducted in February (4 hours), June (72 hours), and August-September of 2018 (5 weeks). Results from the campaign indicated the presence of solar corona to three solar radii, even in the quiet Sun part of the solar cycle. NOAA can operationalize this concept by tasking the SUVI on one of GOES-E and GOES-W. Such long-term operation will provide data that is needed to establish the much needed connectivity between the EUV and white light coronagraph data for the CME events.
Extended Coronal↗
Helicopter Flight Test of a Compact, Real-Time 3-D Flash Lidar for Imaging Hazardous Terrain During Planetary Landing
A second generation, compact, real-time, air-cooled 3-D imaging Flash Lidar sensor system, developed from a number of cutting-edge components from industry and NASA, is lab characterized and helicopter flight tested under the Autonomous Precision Landing and Hazard Detection and Avoidance Technology (ALHAT) project. The ALHAT project is seeking to develop a guidance, navigation, and control (GN&C) and sensing system based on lidar technology capable of enabling safe, precise crewed or robotic landings in challenging terrain on planetary bodies under any ambient lighting conditions. The Flash Lidar incorporates a 3-D imaging video camera based on Indium-Gallium-Arsenide Avalanche Photo Diode and novel micro-electronic technology for a 128 x 128 pixel array operating at a video rate of 20 Hz, a high pulse-energy 1.06 μm Neodymium-doped: Yttrium Aluminum Garnet (Nd:YAG) laser, a remote laser safety termination system, high performance transmitter and receiver optics with one and five degrees field-of-view (FOV), enhanced onboard thermal control, as well as a compact and self-contained suite of support electronics housed in a single box and built around a PC-104 architecture to enable autonomous operations. The Flash Lidar was developed and then characterized at two NASA-Langley Research Center (LaRC) outdoor laser test range facilities both statically and dynamically, integrated with other ALHAT GN&C subsystems from partner organizations, and installed onto a Bell UH-1H Iroquois "Huey" helicopter at LaRC. The integrated system was flight tested at the NASA-Kennedy Space Center (KSC) on simulated lunar approach to a custom hazard field consisting of rocks, craters, hazardous slopes, and safe-sites near the Shuttle Landing Facility runway starting at slant ranges of 750 m. In order to evaluate different methods of achieving hazard detection, the lidar, in conjunction with the ALHAT hazard detection and GN&C system, operates in both a narrow 1deg FOV raster-scanning mode in which successive, gimbaled images of the hazard field are mosaicked together as well as in a wider, 4.85deg FOV staring mode in which digital magnification, via a novel 3-D superresolution technique, is used to effectively achieve the same spatial precision attained with the more narrow FOV optics. The lidar generates calibrated and corrected 3-D range images of the hazard field in real-time and passes them to the ALHAT Hazard Detection System (HDS) which stitches the images together to generate on-the-fly Digital Elevation Maps (DEM's) and identifies hazards and safe-landing sites which the ALHAT GN&C system can then use to guide the host vehicle to a safe landing on the selected site. Results indicate that, for the KSC hazard field, the lidar operational range extends from 100m to 1.35 km for a 30 degree line-of-sight angle and a range precision as low as 8 cm which permits hazards as small as 25 cm to be identified. Based on the Flash Lidar images, the HDS correctly found and reported safe sites in near-real-time during several of the flights. A follow-on field test, planned for 2013, seeks to complete the closing of the GN&C loop for fully-autonomous operations on-board the Morpheus robotic, rocket-powered, free-flyer test bed in which the ALHAT system would scan the KSC hazard field (which was vetted during the present testing) and command the vehicle to landing on one of the selected safe sites.
Roback, VIncent E.↗
Celestial Mapping System Video Demonstration Part 4
The current presentation focuses on the work performed by the authors, to consume a unique dataset of super-enhanced images of the permanently shadowed regions (PSRs) at the lunar south pole which were produced by the Hyper-effective nOise Removal U-net Software (HORUS) tool. This tool was developed in direct support of NASA's VIPER and Artemis programs to enhance the extremely low-light images of the interior of PSRs and provide the first-time ability to see within these regions at 3m scale visibility. We focused on the region near Nobili crater, selected site for VIPER mission and stitched several images to create a high-resolution map of B01 crater, that included the visualization of PSRs. We have developed an in-built line of sight analysis tool in CMS, that analyzes the terrain profile and obstructions and provides the visibility of a given terrain for a remote observer. This tool was utilized to perform viewshed analysis to investigate the area inside the PSR B01, a remote observer such as a rover could see without actually crossing the region. This analysis was extended further to set different heights for various observers and then perform the viewshed analysis. The combined visibility profile at different locations could subsequently lead to traverse planning.
Mapping↗
Global 3D Data Visualization and Analysis Platform With Advanced Machine Learning Capabilities in Support of Lunar Exploration
Introduction: The science goals for NASA’s Artemis program include: a) Understanding the character and origin of lunar polar volatiles, b) Conducting experimental science in the lunar environment and c) Investigating and mitigating exploration risks [1]. The permanently shadowed regions (PSRs) on the Lunar south pole are expected to host large quantities of water-ice and volatiles that are important for sustainable Lunar exploration [2]. There are several missions such as onboard Korea Pathfinder Lunar Orbiter (KPLO: Korean name Danuri) with onboard ShadowCam camera [3], Astrobotic Peregrine Mission One [4], and other efforts underway to obtain high resolution topographic, minerals, volatiles and other information on the moon. We envision a need in immediate future for platforms to integrate these data sets, provide rendering and visualization capabilities in the context of a 3D Lunar globe for easier information access and analysis. NASA's Celestial Mapping System (CMS) [5] is developed to address the need for 3D tools for planetary science investigations, mission planning, in-situ operations, in a 3D-first design constructed around a unified view of a planetary globe. At present CMS provides many critical functionalities that include: 1) equipment planning and optimized placement on Lunar surface 2) line-of-sight (LOS) analysis 3) powerful measurement tools based on 3D terrain with realistic 3D models to represent rovers, astronauts and equipment 4) visualization of derived mapping products (e.g. resource maps), and 5) a data engine for hosting new observations that are not available in other contemporary lunar data tools [5, 7]. Planetary Data Ingestion: CMS can consume and analyze data from locally hosted and external third party sources. It is compatible with Open Geospatial Consortium (OGC) data and file standards and currently integrates datasets from the Astrogeology Science Center of USGS. This includes global and local data acquired from NASA (LRO, Clementine, Lunar Orbiter) and JAXA (SELENE/Kaguya), with capability of integrating more datasets. In addition, users can specify other WMS-hosted data endpoints, which CMS can then query and stream data from automatically. To set-up an automated process for ingestion and accurate rendering, visualization and analysis of external 3rd party planetary datasets within CMS, we initiated the process of ingesting unique dataset of super-enhanced images of the permanently shadowed regions (PSRs) at the lunar poles which were produced by the Hyper-effective nOise Removal U-net Software (HORUS) tool [8]. This tool was developed to enhance the extremely low-light images of the interior of PSRs and provide the ability to see within these regions at and discern surface features (i.e. boulders and craters) down to 3 meters in size. We focused on the Nobile region on the Lunar south pole, selected site for VIPER mission and stitched several images to create a high-resolution map within one of the PSR of Nobile crater. Figure 1 shows the dark PSR zone form the original NAC layer of LRO as the base layer (left image) and the illuminated areas within that crater (center) which was created by ingesting and merging several of HORUS generated images. At present we employ a semi-automated process to ensure spatial accuracy and merger of several overlapping zones. However, we are in the process of completely automating this process by employing AI based techniques that would rank, sort, and stack the images based on their information density. The georectification of the images would employ selected features. Analysis on Ingested Planetary Datasets: Once an external planetary data-set is successfully ingested, georectified and merged seamlessly as a data-layer; CMS’ numerous analysis tools can be used on this data. A Line of Sight (LOS) tool has been developed for CMS which analyzes terrain profiles and obstructions to determine visibility for remote observers [5,6]. Figure 1 (right image) shows the viewshed analysis on the same PSR in the Nobile region. The yellow pin shows the observer location outside the PSR. The yellow area shows the visible part of PSR. The obstructed area with no visibility for the observer is shown in red. The Measurements tool allows the user to take area and distance measurements of features on the terrain using various shapes. Measurement type can be specified in a number of ways: Line, Path, Polygon, Circle, Ellipse, Square, Rectangle or Freehand. Once the shape is specified, elevation information can then be extracted along each of these shapes. Figure 2 (left) shows the measurements performed on a crater n illuminated PSR in Nobile region. The equipment placement tool allows the user to place a 3D equipment model at a desired location and analyze its coverage area. The equipment placement tool is coupled with LOS to determine the coverage. Figure 2 (right) shows an equipment placed on the Lunar terrain and it’s coverage area. The red rays are blocked sight lines and the green rays are non-obstructed sight lines with the cyan lines showing the point of intersection with the terrain. More details are provided in the video demonstrations in Reference 5. Overcoming Polar Distortions: 3D geospatial applications exhibit significant distortions in polar imagery due to several reasons: 1) distortions in the source imagery, 2) incompatible tessellation algorithms at the poles, and 3) map projections. We are leveraging new tessellation algorithms and reprojecting data using projections that are better suited for Lunar poles. The goal is to seamlessly switch to polar projections while maintaining 3D view and navigation.
Maps↗
Global 3D Data Visualization and Analysis Platform with Advanced Machine Learning Capabilities in Support of Lunar Exploration
Introduction: The science goals for NASA’s Artemis program include: a) Understanding the character and origin of lunar polar volatiles, b) Conducting experimental science in the lunar environment and c) Investigating and mitigating exploration risks. The permanently shadowed regions (PSRs) on the Lunar south pole are expected to host large quantities of water-ice and volatiles that are important for sustainable Lunar exploration. There are several missions such as onboard Korea Pathfinder Lunar Orbiter (KPLO: Korean name Danuri) with onboard ShadowCam camera, Astrobotic Peregrine Mission One [4], and other efforts underway to obtain high resolution topographic, minerals, volatiles and other information on the moon. We envision a need in immediate future for platforms to integrate these data sets, provide rendering and visualization capabilities in the context of a 3D Lunar globe for easier information access and analysis. NASA's Celestial Mapping System (CMS) is developed to address the need for 3D tools for planetary science investigations, mission planning, in-situ operations, in a 3D-first design constructed around a unified view of a planetary globe. At present CMS provides many critical functionalities that include: 1) equipment planning and optimized placement on Lunar surface 2) line-of-sight (LOS) analysis 3) powerful measurement tools based on 3D terrain with realistic 3D models to represent rovers, astronauts and equipment 4) visualization of derived mapping products (e.g. resource maps), and 5) a data engine for hosting new observations that are not available in other contemporary lunar data tools. Planetary Data Ingestion: CMS can consume and analyze data from locally hosted and external third party sources. It is compatible with Open Geospatial Consortium (OGC) data and file standards and currently integrates datasets from the Astrogeology Science Center of USGS. This includes global and local data acquired from NASA (LRO, Clementine, Lunar Orbiter) and JAXA (SELENE/Kaguya), with capability of integrating more datasets. In addition, users can specify other WMS-hosted data endpoints, which CMS can then query and stream data from automatically. To set-up an automated process for ingestion and accurate rendering, visualization and analysis of external 3rd party planetary datasets within CMS, we initiated the process of ingesting unique dataset of super-enhanced images of the permanently shadowed regions (PSRs) at the lunar poles which were produced by the Hyper-effective nOise Removal U-net Software (HORUS) tool. This tool was developed to enhance the extremely low-light images of the interior of PSRs and provide the ability to see within these regions at and discern surface features (i.e. boulders and craters) down to 3 meters in size. We focused on the Nobile region on the Lunar south pole, selected site for VIPER mission and stitched several images to create a high-resolution map within one of the PSR of Nobile crater. Figure 1 shows the dark PSR zone form the original NAC layer of LRO as the base layer (left image) and the illuminated areas within that crater (center) which was created by ingesting and merging several of HORUS generated images. At present we employ a semi-automated process to ensure spatial accuracy and merger of several overlapping zones. However, we are in the process of completely automating this process by employing AI based techniques that would rank, sort, and stack the images based on their information density. The georectification of the images would employ selected features. Analysis on Ingested Planetary Datasets: Once an external planetary data-set is successfully ingested, georectified and merged seamlessly as a data-layer; CMS’ numerous analysis tools can be used on this data. A Line of Sight (LOS) tool has been developed for CMS which analyzes terrain profiles and obstructions to determine visibility for remote observers. Figure 1 (right image) shows the viewshed analysis on the same PSR in the Nobile region. The yellow pin shows the observer location outside the PSR. The yellow area shows the visible part of PSR. The obstructed area with no visibility for the observer is shown in red. The Measurements tool allows the user to take area and distance measurements of features on the terrain using various shapes. Measurement type can be specified in a number of ways: Line, Path, Polygon, Circle, Ellipse, Square, Rectangle or Freehand. Once the shape is specified, elevation information can then be extracted along each of these shapes. Figure 2 (left) shows the measurements performed on a crater n illuminated PSR in Nobile region. The equipment placement tool allows the user to place a 3D equipment model at a desired location and analyze its coverage area. The equipment placement tool is coupled with LOS to determine the coverage. Figure 2 (right) shows an equipment placed on the Lunar terrain and it’s coverage area. The red rays are blocked sight lines and the green rays are non-obstructed sight lines with the cyan lines showing the point of intersection with the terrain. More details are provided in the video demonstrations in Reference 5. Overcoming Polar Distortions: 3D geospatial applications exhibit significant distortions in polar imagery due to several reasons: 1) distortions in the source imagery, 2) incompatible tessellation algorithms at the poles, and 3) map projections. We are leveraging new tessellation algorithms and reprojecting data using projections that are better suited for Lunar poles. The goal is to seamlessly switch to polar projections while maintaining 3D view and navigation.
Maps↗
Lunar Science Investigations and Exploration in Celestial Mapping System
Introduction: As NASA expands the mission portfolio on the lunar surface, there is a need for applications with a broad range of analytical and functional capabilities that can be simultaneously deployed onto multiple mobile and desktop platforms to perform in-situ operations and hence enabling extensive Lunar exploration. Celestial Mapping System (CMS) [1,2] is developed to address the need for tools for science investigations, mission planning, operations and support for planetary sciences. Built on top of NASA WorldWind libraries, CMS can be simultaneously deployed onto multiple platforms, has the flexibility to update to the latest imagery and terrain datasets as they are being acquired (in real time) before and/or during the exploration mission and has the potential to enable traverse path planning suited for rovers, EVA and surface mobility units. It can provide critical functionalities such as equipment planning and optimized placement on Lunar surface, line of sight analysis to inform the coverage area for various equipment, powerful measurement tools based on 3D terrain, 3D COLLADA models to represent rovers, humans and equipment, visualization of derived mapping products (e.g. resource maps), and a data engine for hosting new observations that are not available in other contemporary lunar data tools [1]. Visualization of PSRs: The current presentation focuses on the work performed by the authors, to consume a unique dataset of super-enhanced images of the permanently shadowed regions (PSRs) at the lunar poles which were produced by the Hyper-effective nOise Removal U-net Software (HORUS) tool [3]. This tool was developed in direct support of NASA's VIPER and Artemis programs to enhance the extremely low-light images of the interior of PSRs and provide the first-time ability to see within these regions at and discern surface features (i.e. boulders and craters) down to 3 meters in size. We focused on the region near Nobili crater near Lunar south pole, selected site for VIPER mission and stitched several images to create a high-resolution map within one of the PSR of Nobile crater. Line of Sight Analysis and Traverse Planning in PSRs: We have developed an in-built line of sight analysis (LOS) tool in CMS that analyzes the terrain profile and obstructions and provides the visibility of a given terrain for a remote observer. This tool was utilized to perform viewshed analysis to investigate the area inside the PSR, a remote observer such as a rover could see without actually crossing the region. Figure 1 shows the viewshed analysis on the PSR in Nobile region. The yellow pin shows the observer location outside the PSR. The yellow area shows the visible part of PSR. The obstructed area with no visibility for the observer is shown in red. Figure 1: (left) PSR image on top of a high-resolution mosaic of sunlit images of a crater, in Nobile region (right) Viewshed Analysis of the same PSR with observer location shown by yellow pin. This analysis was extended further to set different heights for various observers and then perform the viewshed analysis. Combining the different visibility profiles can help designing improved traverses within the crater. Future plans: Eventually, HORUS datasets will be integrated into CMS as a layer in selected lunar polar regions. Hazard Maps will then be created based on terrain analysis in those regions. This integration will enable multiple scientific and exploration applications, such as designing traverses within PSRs, analyzing potential landing and science mission targets, investigating the meter-scale geomorphology of PSRs, including craters, boulder, surface roughness, mass wasting features and other indications of the presence of water-ice and other volatiles. Acknowledgments: CMS developers team including Kaitlyn J. Dickinson, Tyler A. Lucarz, Tyler W. Choi from USRA, NASA WorldWind Advisory team including Mark Peterson and Guillermo Miguel Del Castillo, HORUS team member V.T. Bickel, Robinson, M., LRO MOON LROC 2 EDR V1.0, LRO-L-LROC-2-EDR-V1.0, NASA Planetary Data System (PDS), 2009. https://doi.org/10.17189/1520643 References: [1] https://celestial.arc.nasa.gov [2] Agrawal et. al. “Celestial Mapping System for Lunar Surface Mapping and Analytics”, Lunar Surface Innovation Consortium, 2021 [3] Bickel V. et al. (2021) Nat Commun 12, 5607
Lunar Mapping↗
Multispectral and Thermal Imager Onboard Aerial Platforms Instrument Handbook
The MicaSense Altum imager is an off-the-shelf, synchronized multispectral and thermal camera, combined with a Global Positioning System (GPS) unit and downwelling light sensor (DLS). The Altum takes images of the land surface within its field of view (FOV) across five visible bands and one longwave infrared thermal band. The sensor records the radiance and converts it to digital numbers. Imagery is radiometrically corrected, taking into account the sensor calibration, lens distortions, vignette effects, sun angle, and atmospheric effects (scattering and absorption). The photogrammetry software Agisoft PhotoScan v 1.4 is used to align and stitch the images into a larger composite image using the technique of structure from motion image capture to construct a dense cloud and 3D model of the surface, which is used to produce a digital elevation model of the terrain surveyed and orthomosaic imagery. Land surface leaf area index, albedo, and surface skin temperature are provided for the user. The user can perform raster calculations on the imagery to produce various other vegetative indices, which are used to indicate plant health and land surface characteristics, including Normalized Difference Vegetation Index (NDVI), Green Normalized Difference Vegetation Index (GNDVI), Normalized Difference Water Index (NDWI), surface temperature, and Enhanced_vegetation_index (EVI). This code is provided with the readme file for each data set. The images have a resolution of 20-60 cm/pixel, which are subsampled to 100 cm/pixel.
47 OTHER INSTRUMENTATION↗