Search NASA⌕ Search

SEARCH · Search NASA

Results for “multi-view”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Development of 3-D Gamma-camera

BNL and Gamma Medical Technologies (GMT) will jointly develop a compact three-dimensional (3-D) gamma camera capable of localizing cancerous tumors within the prostate gland. The new gamma-ray camera will consist of pixilated cadmium-zinc-telluride (CZT) detector arrays, which will be flip-chip bonded to a suitable substrate. Application specific integrated circuits (ASIC) will also be developed to read out the electronic signals from the pixels. The detector/ASIC coupled to a multi-view collimator would be integrated into a small probe capable of imaging shaped radioactive phantoms to simulate the presence of cancerous tumors within the prostate gland.

99 GENERAL AND MISCELLANEOUS↗

Applications Of Machine Learning to Gas Plume Analysis In Longwave Infrared Hyperspectral Images

Longwave infrared hyperspectral images can be used for gas plume analysis, as many gases exhibit distinct absorption features in this portion of the electromagnetic spectrum. In practice, accurately identifying weak gas signatures is difficult because the observed radiance is dominated by background radiance, which varies with material, temperature, and viewing conditions. Many gas plume analysis pipelines operate on single images, limiting the ability to leverage spatial and multi-view information that could enhance the analysis. The goal of this dissertation is to explore how machine learning and deep learning methods can complement classical approaches to improve gas plume identification in longwave infrared hyperspectral imagery, and to investigate the use of neural radiance fields for hyperspectral scene reconstruction.

3D Scene Reconstruction↗

Multi-modal dynamic radiography using short-pulse laser-generated probe beams

Radiography is an important tool for the interrogation of dynamic experiments in the fields of dynamic properties of materials, and in condensed matter, high explosive, and high-energy-density physics. Multi-modal radiography advances the hypothesis that combining the information delivered by multiple radiographic modalities can lead to more constrained (improved) “reconstruction” of the scene than can be obtained from a single probe. We identify four modalities: multi-probe, time sequence, multi-view, and multi-messenger. Multi-probe radiography is a promising candidate for a next-generation dynamic radiographic facility. High-energy X-rays are the most frequently used probe for dynamic radiography, although recent developments show the utility of proton (pRad), electron (eRad), and neutron probe beams. Because each probing species interacts with material in the radiographic scene through quantitatively different mechanisms, each returns independent information about the scene, which can add extra constraints to the reconstruction process. How to conduct detailed, quantitative “co-analysis” of multiple data streams remains an area of active research. Multi-beam, short-pulse, laser-generated probes offer sufficient dose, an appropriate spectrum, and appropriate spatio-temporal resolution to produce high-quality dynamic radiographs. This paper reports on technology development to advance the state of the art of multi-modal/multi-probe radiography and the pursuit of both deterministic and inferential (AI/ML assisted) co-analysis methodologies to produce more constrained reconstructions from multi-modal data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Vehicular Re-Identification from Uncontrolled Multiple Views

Vehicle re-identification (re-ID) across disparate sensing modalities remains a fundamental challenge for transportation research. In this work, we introduce a deep multi-view vehicle re-ID framework that leverages Siamese networks to compare pairs of vehicle images and produce matching scores, enabling robust association across drastically different viewpoints such as those from UAVs, surveillance cameras, and ground sensors. The model exploits convolutional neural networks to learn features that remain discriminative under changes in angle, distance, and illumination, supporting more generalizable re-ID performance. As part of this effort, we also developed an automated pipeline to synchronize roadside and UAV video streams, producing a multi-perspective dataset that complements preexisting real collections and a synthetic dataset generated in this study. Together, these contributions advance the capability to re-identify vehicles across wide viewing baselines; establish a foundation for scalable, reproducible research in vehicle re-ID; and open pathways for future applications, such as inferring routine behaviors, movement patterns, and daily habits of the individual associated with the vehicle.

convolutional neural networks↗

Deep Learning and Photogrammetric Reconstruction for Automated Crack Detection and Dimensional Measurement in Mining Operations

Surface crack detection and dimensional measurement at active mining sites present significant safety and operational challenges. Manual inspection methods are labor-intensive, spatially incomplete, and expose personnel to hazardous environments, while existing automated approaches have been developed primarily for concrete civil infrastructure and have not been validated on the complex, variable surfaces characteristic of mining environments. This dissertation presents an automated pipeline that integrates deep learning semantic segmentation with Structure-from-Motion photogrammetry to detect surface cracks and measure their aperture, length, and vertical displacement from standard RGB imagery acquired during routine Uncrewed Aerial Vehicle (UAV) survey operations, without requiring additional sensor hardware or manual measurement. The pipeline combines a U-Net architecture with an EfficientNet-B0 encoder, pretrained on the SDNET2018 concrete crack dataset and fine-tuned on a mining-specific dataset spanning laboratory concrete specimens, coal refuse impoundment embankments, and post-blast limestone quarry benches. Photogrammetric reconstruction is performed using COLMAP Structure-from-Motion and Multi-View Stereo, with crack segmentation masks projected into the reconstructed point cloud to enable three-dimensional vertical displacement measurement through local plane fitting and bimodal surface detection. The pipeline was validated across 36 controlled laboratory specimens at three imaging distances and four vertical displacement levels, achieving aperture measurement RMSE of 0.047 cm and R² of 0.954, and vertical displacement RMSE of 0.140 cm and R² of 0.966, against independent caliper measurements. Field application at a coal refuse impoundment in southwestern Pennsylvania detected 71 crack components across the embankment crest, with a dominant longitudinal crack exhibiting aperture values reaching 28 cm and a 95th percentile vertical displacement of 35.53 cm, consistent in magnitude and spatial distribution with simultaneously acquired LiDAR-derived estimates. Application across four post-blast limestone quarry bench datasets in California successfully characterized blast-induced fracture networks at ground sampling distances ranging from 0.59 to 1.23 cm/pixel, with detected crack geometries physically consistent with observable surface conditions at each site. The results demonstrate that deep learning-based crack detection and photogrammetric measurement can be integrated into routine UAV inspection workflows at mining sites, providing repeatable, scalable, and quantitative crack characterization across surface types, crack scales, and displacement magnitudes not previously addressed in the literature. The pipeline requires no dedicated surveying equipment beyond the UAV platforms already deployed at mine sites for survey and monitoring purposes, supporting practical adoption within existing operational workflows.

Crack detection, Dimensional Measurement↗

Using snowflake surface-area-to-volume ratio to model and interpret snowfall triple-frequency radar signatures

Abstract. The snowflake microstructure determines the microwave scattering properties of individual snowflakes and has a strong impact on snowfall radar signatures. In this study, individual snowflakes are represented by collections of randomly distributed ice spheres where the size and number of the constituent ice spheres are specified by the snowflake mass and surface-area-to-volume ratio (SAV) and the bounding volume of each ice sphere collection is given by the snowflake maximum dimension. Radar backscatter cross sections for the ice sphere collections are calculated at X-, Ku-, Ka-, and W-band frequencies and then used to model triple-frequency radar signatures for exponential snowflake size distributions (SSDs). Additionally, snowflake complexity values obtained from high-resolution multi-view snowflake images are used as an indicator of snowflake SAV to derive snowfall triple-frequency radar signatures. The modeled snowfall triple-frequency radar signatures cover a wide range of triple-frequency signatures that were previously determined from radar reflectivity measurements and illustrate characteristic differences related to snow type, quantified through snowflake SAV, and snowflake size. The results show high sensitivity to snowflake SAV and SSD maximum size but are generally less affected by uncertainties in the parameterization of snowflake mass, indicating the importance of snowflake SAV for the interpretation of snowfall triple-frequency radar signatures.

54 ENVIRONMENTAL SCIENCES↗

pccp.c1

Point Cloud of Cloud Points (PCCP) VAP provides a stereo reconstructed Point Cloud of Cloud Points (PCCP) that correspond to the x,y,z coordinates of cloud features detected from stereo image pairs genrated from a multi-view stereo system deployed to collect exclusive set of data on shallow cumulus clouds overhead.

54 ENVIRONMENTAL SCIENCES↗

pccpa.c1

Point Cloud of Cloud Points (PCCP) VAP provides a stereo reconstructed Point Cloud of Cloud Points (PCCP) that correspond to the x,y,z coordinates of cloud features detected from stereo image pairs genrated from a multi-view stereo system deployed to collect exclusive set of data on shallow cumulus clouds overhead.

54 ENVIRONMENTAL SCIENCES↗

pccpb.c1

Point Cloud of Cloud Points (PCCP) VAP provides a stereo reconstructed Point Cloud of Cloud Points (PCCP) that correspond to the x,y,z coordinates of cloud features detected from stereo image pairs generated from a multi-view stereo system deployed to collect exclusive set of data on shallow cumulus clouds overhead.

54 ENVIRONMENTAL SCIENCES↗

Advanced NDE research in electromagnetic, thermal, and coherent optics

A new inspection technology called magneto-optic/eddy current imaging was investigated. The magneto-optic imager makes readily visible irregularities and inconsistencies in airframe components. Other research observed in electromagnetics included (1) disbond detection via resonant modal analysis; (2) AC magnetic field frequency dependence of magnetoacoustic emission; and (3) multi-view magneto-optic imaging. Research observed in the thermal group included (1) thermographic detection and characterization of corrosion in aircraft aluminum; (2) a multipurpose infrared imaging system for thermoelastic stress detection; (3) thermal diffusivity imaging of stress induced damage in composites; and (4) detection and measurement of ice formation on the space shuttle main fuel tank. Research observed in the optics group included advancements in optical nondestructive evaluation (NDE).

Skinner, S. Ballou↗

Simulator Investigation of Pilot Aids for Helicopter Terminal Area Operations with One Engine Inoperative

Two recent piloted simulation experiments have investigated advanced display concepts applied to civil transport helicopter terminal area operations. Civil Category A helicopter operations apply to multi-engine helicopters wherein a safe recovery (land or fly out) is required in the event of a single engine failure. The investigation used the NASA Ames Research Center Vertical Motion Simulator, which has a full six degrees of freedom, to simulate the flight task as closely as possible. The goal of these experiments was to use advanced cockpit displays to improve flight safety and enhance the mission performance of Category A terminal area operations in confined areas. The first experiment investigated the use of military display formats to assist civil rotorcraft in performing a Category A takeoff in confined terminal areas. Specifically, it addressed how well a difficult hovering backup path could be followed using conventional instruments in comparison to panel mounted integrated displays. The hovering backup takeoff, which enables pilots to land back to the confined area pad in the event of an engine failure, was chosen since it is a difficult task to perform. Seven NASA and Army test pilots participated in the experiment. Evaluations, based on task performance and pilot workload, showed that an integrated display enabled the pilot to consistently achieve adequate or desired performance with reasonable pilot workload. Use of conventional instruments, however, frequently resulted in unacceptable performance (poor flight path tracking), higher pilot workload, and poor situational awareness. Although OEI landbacks were considered a visual task, the improved performance on the backup portion, in conjunction with increased situational awareness resulting from use of integrated displays, enabled the pilots to handle an engine failure and land back safely. In contrast, use of conventional instruments frequently led to excessive rates of sink at touchdown. A second simulation (in progress - July - August) is being conducted to investigate the use of advanced displays to perform vertical and short takeoffs and landings. One Engine Inoperative trajectories, which were optimized based on safety of flight restrictions, are utilized. Based on comments from the first experiment and further analytic development, appropriate fly out and approach guidance was added. Displays include conventional instruments with raw data, and the following integrated displays: multi-view and side-view hover displays based on the Apache Pilot Night Vision System, and variations of the pathway-in-the-sky displays with a flight-path-vector, a leader and flight director modifications. Panel mounted and head-up displays are being evaluated. Engine modifications have been incorporated to simulate 30 second and 2 minute contingency power ratings. Evaluations are based on task performance and pilot workload. NASA, Army, FAA, and industry test pilots participated. Details concerning the design, conduct, and the results of the experiment will be reported in the proposed paper.

Iseler, Laura↗

Photogrammetry Toolbox Reference Manual

Specialized photogrammetric and image processing MATLAB functions useful for wind tunnel and other ground-based testing of aerospace structures are described. These functions include single view and multi-view photogrammetric solutions, basic image processing to determine image coordinates, 2D and 3D coordinate transformations and least squares solutions, spatial and radiometric camera calibration, epipolar relations, and various supporting utility functions.

Liu, Tianshu↗

Neural Radiance Fields for Shadow Removal and Relighting of Satellite Imagery

Multi-view stereo photogrammetric techniques have been conventionally utilized to generate Global Digital Elevation Models (GDEM) of planetary and lunar surfaces. However, these methods, relying on conventional feature detectors, are often subject to inaccuracies caused by changes in lighting conditions, including diffuse reflection and harsh shading. This has limited the ability of these methods to accurately reconstruct shadowed regions in orbital imagery, such as highly shaded urban areas and the permanently shadowed regions (PSRs) located in the lunar surface, which are critical targets for NASA's Artemis program. Neural Radiance Fields (NeRFs) offer a novel solution to these limitations by breaking away from traditional photogrammetric assumptions of ridged, opaque surfaces. NeRFs are capable of reconstructing 3D objects with variably transmissive properties, such as fluids, PSRs, and reflective surfaces. In this work, we demonstrate the robustness of NeRFs in generating high-fidelity 3D models of terrain from highly shaded orbital imagery acquired from small satellites in low earth orbit (LEO). Our results showcase the ability of NeRF to overcome the limitations of traditional photogrammetric methods and provide a promising solution for reconstructing complex scenes in challenging lighting conditions.

Caleb Ashmore Adams↗

3D Cloud Tomography and Droplet Size Retrieval from Multi-Angle Polarimetric Imaging of Scattered Sunlight from Above

Tomography aims to recover a three-dimensional (3D) density map of a medium or an object. In medical imaging,it is extensively used for diagnostics via X-ray computed tomography (CT). We define and derive a tomographyof cloud droplet distributions via passive remote sensing. We use multi-view polarimetric images to fit a 3Dpolarized radiative transfer (RT) forward model. Our motivation is 3D volumetric probing of vertically-developedconvectively-driven clouds that are ill-served by current methods in operational passive remote sensing. Currenttechniques are indeed based on strictly 1D RT modeling and applied to a single cloudy pixel, where cloud geometrydefaults to that of a plane-parallel slab. Incident unpolarized sunlight, once scattered by cloud droplets, changesits polarization state according to droplet size. Therefore, polarimetric measurements in the rainbow and gloryangular regions can be used to infer the droplet size distribution. This work defines and derives a framework for afull 3D tomography of cloud droplets for both their mass concentration in space and their distribution across arange of sizes. This gridded 3D retrieval of key microphysical properties is made tractable by our novel approachthat involves a restructuring and partial linearization of an open-source polarized 3D RT code to accommodate aspecial two-step iterative optimization technique. Physically-realistic synthetic clouds are used to demonstrate themethodology with rigorous uncertainty quantification, while a real-world cloud imaged by AirMSPI is processedto illustrate the new remote sensing capability

Schechner, Yoav Y.↗

Introduction to structure from motion and its applications in remote sensing

This talk discusses my experience at Los Alamos National Laboratories developing the Wide Area Persistent Surveillance (WAPS) system AngelFire and the problems with working with low resolution surface models. This experience provided a motivation to seek solutions to utilize the redundant WAPS imagery to build surface models of the urban environment. Structure from Motion (SfM) is a process that takes multiple view imagery and compute the 3D structure of a scene. We will walk through the basic algorithm and discuss areas for optimization. Military services and intelligence agencies face long-standing challenges with processing, exploiting, and disseminating ISR data. The problem is that too much data is being produced and not enough people to look at it and the problem is not going away. As a result of this data overload, we need to shift the way we think about data and find creative ways to use and present it so it can be easily digested by decision makers. SfM also provides a means for developing a data processing and organization architecture. Applications for various remote sensing applications will be discussed for motivation for why SfM and Multi-View Stereo rendering is an important area that needs to be continued to be developed.

47 OTHER INSTRUMENTATION↗

Visual Analytics for Roof Savings Calculator Ensembles

The Roof Savings Calculator (RSC) has been deployed for DOE as an industry-consensus, web-based tool for easily running complex building energy simulations. These simulations allow both homeowners and experts to determine building-specific cost and energy savings for modern roof and attic technologies. Using a database of over 3 million RSC simulations for different combinations of parameters, we have built a visual analytics tool to assist in the exploration and identification of features in the data. Since the database contains multiple variables, both categorical and continuous, we employ a coordinated multi-view approach that allows coordinated feature exploration through multiple visualizations at once. The main component of our system, a parallel coordinates view, has been adapted to handle large-scale, mixed data types as are found in RSC simulations. Other visualizations include map coordinated plots, high dynamic range (HDR) line plot rendering, and an intuitive user interface. We demonstrate these techniques with several use cases that have helped identify software and parametric simulation issues.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

Novel Gamma Attenuation Methods Utilized for Waste Characterization of UO{sub 2}F{sub 2}-Bearing Materials at the Paducah GDP - 17327

The Paducah Gaseous Diffusion Plant (PGDP) is currently under deactivation with demolition in the decades to follow. UO{sub 2}F{sub 2}-bearing waste is generated at PGDP by UF{sub 6} hydrolysing to materials such as pipes, valves, PPE, etc. when UF{sub 6} is exposed to humid air. In addition, Al{sub 2}O{sub 3} and NaF trap materials contain significant amounts of Uranium. The UO{sub 2}F{sub 2} deposits within the generated waste can be of sub-gram levels to several hundreds of localized grams and are much denser than the surrounding interfering matrix materials and may be of very complex geometric and chemical forms such as with the Al{sub 2}O{sub 3} and NaF trap materials. The main objective is to characterize the fissile (U-235) content of the UO{sub 2}F{sub 2}-bearing waste so as to meet the Data Quality Objectives (DQO) for proper disposal. If a waste container cannot meet the DQO then it must be subjected to costly remediation, repackaging and re-characterization processes. We have developed, at PGDP, several novel model-based methods and techniques that vastly improve the standard gamma attenuation correction methods and do not require Working Reference Materials (WRM) for calibration. These new methods involve rotating and non-rotating 18.9 liter (5 U.S. gallon) waste containers with and without a transmission modality. A new model-based variant of differential attenuation has been developed that provides a high-quality self-absorption correction that does not require knowledge of the Uranium enrichment or isotopic ratios. For more challenging waste containers, a method using multi-view (non-rotating) 18.9 liter waste containers has been considered using a recently developed Advanced ISOCS{sup C} Uncertainty Estimator (AIUE) package. The new methods suffice to significantly improve accuracy and precision and to lower the Total Measurement Uncertainty (TMU) leading to satisfactory DQO's that were not previously achievable using the standard gamma attenuation correction methods. In this paper we present real 18.9 liter waste container and Working Reference Material (WRM) data subjected to the new methods and compared to standard methods depicting the significant improvement in the DQO that is realized. (authors)

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

A Real2Sim Digital Twin Pipeline for Photorealistic Robot Simulation: Evaluating VLA Policy Deployment on a Bimanual Mobile Robot

Digital twins that are automatically constructed from robot sensor data offer a promising pathway for scalable Real2Sim and Sim2Real transfer. However, it remains an open question whether photorealistic reconstruction alone is sufficient to support reliable deployment of vision-language-action (VLA) policies. We present a generative-AI-assisted Real2Sim pipeline that generates simulation-ready digital twins from real-world RGB observations with minimal manual intervention. The pipeline uses prompted segmentation to isolate scene components and a generative 3D model to directly produce simulation assets, eliminating the need for traditional multi-view reconstruction or manual 3D modeling.\r\nTo evaluate simulation fidelity, we deploy and compare policies from two VLA models in both the real robot and the reconstructed\r\nsimulation under identical tasks and initial conditions. We compare joint-level action trajectories and analyze how divergence evolves over time in closed-loop execution. Although the reconstructed environments are visually accurate, we observe increasing trajectory divergence during closedloop operation. These results indicate that photorealistic reconstruction alone is insufficient to preserve closed-loop control behavior\r\nin VLA policies, particularly in contact-rich manipulation settings where small perceptual errors compound over time.

97 MATHEMATICS AND COMPUTING↗