Search NASA⌕ Search

SEARCH · Search NASA

Results for “3d reconstruction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS2012

Dig Hazard Assessment Using a Stereo Pair of Cameras

This software evaluates the terrain within reach of a lander s robotic arm for dig hazards using a stereo pair of cameras that are part of the lander s sensor system. A relative level of risk is calculated for a set of dig sectors. There are two versions of this software; one is designed to run onboard a lander as part of the flight software, and the other runs on a PC under Linux as a ground tool that produces the same results generated on the lander, given stereo images acquired by the lander and downlinked to Earth. Onboard dig hazard assessment is accomplished by executing a workspace panorama command sequence. This sequence acquires a set of stereo pairs of images of the terrain the arm can reach, generates a set of candidate dig sectors, and assesses the dig hazard of each candidate dig sector. The 3D perimeter points of candidate dig sectors are generated using configurable parameters. A 3D reconstruction of the terrain in front of the lander is generated using a set of stereo images acquired from the mast cameras. The 3D reconstruction is used to evaluate the dig goodness of each candidate dig sector based on a set of eight metrics. The eight metrics are: 1. The maximum change in elevation in each sector, 2. The elevation standard deviation in each sector, 3. The forward tilt of each sector with respect to the payload frame, 4. The side tilt of each sector with respect to the payload frame, 5. The maximum size of missing data regions in each sector, 6. The percentage of a sector that has missing data, 7. The roughness of each sector, and 8. Monochrome intensity standard deviation of each sector. Each of the eight metrics forms a goodness image layer where the goodness value of each sector ranges from 0 to 1. Goodness values of 0 and 1 correspond to high and low risk, respectively. For each dig sector, the eight goodness values are merged by selecting the lowest one. Including the merged goodness image layer, there are nine goodness image layers for each stereo pair of mast images.

Rankin, Arturo L.↗
NASA NTRSDate not supplied

Using Machine Learning to Infer Material Properties of Debris Fragments from X-ray Images in the DebriSat Project

The DebriSat project is a collaboration effort with the NASA Orbital Debris Program Office, the U.S. Space Force Space Systems Command Center, The Aerospace Corporation, and the University of Florida. To date, over 200,000 fragments from this ground-based, hypervelocity impact experiment have been collected, and processing is underway to determine their physical characteristics, such as material, shape, color, characteristic length, and average cross-sectional area. The x-ray process is primarily used to identify the location of the fragments and estimated size for extraction, so that these physical characteristics can be assessed. This paper proposes a machine learning-based approach to characterize materials from x-ray images of debris fragments embedded in soft-catch foam used in the DebriSat project. The novel methodology discussed in this paper will highlight the use of x-ray imagery data to characterize these fragments without extraction or a human-in-the-loop. Both supervised and unsupervised machine learning techniques are utilized with this approach to infer the physical parameters of the fragments embedded in the soft-catch foam panels used in the impact experiment based on x-ray images of the foam panels. Additionally, 3D reconstructions of the extracted fragments are created with images taken from two different angles using the structure from motion (SfM) method. The characteristic lengths and shape from the 3D reconstruction, alongside the physical characteristics of the debris, are used in the inference of the material type. To develop and test the approach, a dataset of x-ray images of debris fragments of varying sizes and materials is collected. Supervised learning methods such as convolutional neural networks (CNNs), support vector machines (SVM), decision trees, and random forest classifiers are used due to the high-dimensional feature spaces of the debris and nonlinear decision boundaries for material categorization. Given the limited pre-labeled data of embedded debris materials smaller than 10 mm, unsupervised machine learning techniques such as clustering algorithms and autoencoders are used, in addition to supervised learning methods. The clustering algorithms group similar fragments together based on their physical properties, and autoencoders reduce the dimensionality of the x ray images and extract relevant features. The performance of the proposed approach's is analyzed using a range of statistical methods, including confusion matrices, receiver operating characteristic curves, and precision-recall curves. The results are compared with those obtained using a baseline approach that relies on manual identification and classification of debris fragments. To evaluate the effectiveness of different machine learning methods, statistical tests such as t-tests, ANOVA, and cross-validation are performed, comparing the performance of CNNs, SVMs, clustering algorithms, and autoencoders. Additional analysis needs to be conducted to identify any sources of bias or variability that may affect the results, such as variations in imaging conditions or fragmentation patterns. Other topics explored are limitations, refinements, and the potential use of semi-supervised learning techniques, such as self-training to label unlabeled datasets and co-training using x-ray images taken from two different angles as two different models.

Saik Anam Siam↗
NASA NTRS2023

Using Machine Learning to Infer Material Properties of Debris Fragments from X-ray Images in the DebriSat Project

The DebriSat project is a collaboration effort with the NASA Orbital Debris Program Office, the U.S. Space Force Space Systems Command Center, The Aerospace Corporation, and the University of Florida. To date, over 200,000 fragments from this ground-based, hypervelocity impact experiment have been collected, and processing is underway to determine their physical characteristics, such as material, shape, color, characteristic length, and average cross-sectional area. The x-ray process is primarily used to identify the location of the fragments and estimated size for extraction, so that these physical characteristics can be assessed. This paper proposes a machine learning-based approach to characterize materials from x-ray images of debris fragments embedded in soft-catch foam used in the DebriSat project. The novel methodology discussed in this paper will highlight the use of x-ray imagery data to characterize these fragments without extraction or a human-in-the-loop. Both supervised and unsupervised machine learning techniques are utilized with this approach to infer the physical parameters of the fragments embedded in the soft-catch foam panels used in the impact experiment based on x-ray images of the foam panels. Additionally, 3D reconstructions of the extracted fragments are created with images taken from two different angles using the structure from motion (SfM) method. The characteristic lengths and shape from the 3D reconstruction, alongside the physical characteristics of the debris, are used in the inference of the material type. To develop and test the approach, a dataset of x-ray images of debris fragments of varying sizes and materials is collected. Supervised learning methods such as convolutional neural networks (CNNs), support vector machines (SVM), decision trees, and random forest classifiers are used due to the high-dimensional feature spaces of the debris and nonlinear decision boundaries for material categorization. Given the limited pre-labeled data of embedded debris materials smaller than 10 mm, unsupervised machine learning techniques such as clustering algorithms and autoencoders are used, in addition to supervised learning methods. The clustering algorithms group similar fragments together based on their physical properties, and autoencoders reduce the dimensionality of the x ray images and extract relevant features. The performance of the proposed approach's is analyzed using a range of statistical methods, including confusion matrices, receiver operating characteristic curves, and precision-recall curves. The results are compared with those obtained using a baseline approach that relies on manual identification and classification of debris fragments. To evaluate the effectiveness of different machine learning methods, statistical tests such as t-tests, ANOVA, and cross-validation are performed, comparing the performance of CNNs, SVMs, clustering algorithms, and autoencoders. Additional analysis needs to be conducted to identify any sources of bias or variability that may affect the results, such as variations in imaging conditions or fragmentation patterns. Other topics explored are limitations, refinements, and the potential use of semi-supervised learning techniques, such as self-training to label unlabeled datasets and co-training using x-ray images taken from two different angles as two different models.

Saik Anam Siam↗
NASA NTRS2007

Automated Recognition of 3D Features in GPIR Images

A method of automated recognition of three-dimensional (3D) features in images generated by ground-penetrating imaging radar (GPIR) is undergoing development. GPIR 3D images can be analyzed to detect and identify such subsurface features as pipes and other utility conduits. Until now, much of the analysis of GPIR images has been performed manually by expert operators who must visually identify and track each feature. The present method is intended to satisfy a need for more efficient and accurate analysis by means of algorithms that can automatically identify and track subsurface features, with minimal supervision by human operators. In this method, data from multiple sources (for example, data on different features extracted by different algorithms) are fused together for identifying subsurface objects. The algorithms of this method can be classified in several different ways. In one classification, the algorithms fall into three classes: (1) image-processing algorithms, (2) feature- extraction algorithms, and (3) a multiaxis data-fusion/pattern-recognition algorithm that includes a combination of machine-learning, pattern-recognition, and object-linking algorithms. The image-processing class includes preprocessing algorithms for reducing noise and enhancing target features for pattern recognition. The feature-extraction algorithms operate on preprocessed data to extract such specific features in images as two-dimensional (2D) slices of a pipe. Then the multiaxis data-fusion/ pattern-recognition algorithm identifies, classifies, and reconstructs 3D objects from the extracted features. In this process, multiple 2D features extracted by use of different algorithms and representing views along different directions are used to identify and reconstruct 3D objects. In object linking, which is an essential part of this process, features identified in successive 2D slices and located within a threshold radius of identical features in adjacent slices are linked in a directed-graph data structure. Relative to past approaches, this multiaxis approach offers the advantages of more reliable detections, better discrimination of objects, and provision of redundant information, which can be helpful in filling gaps in feature recognition by one of the component algorithms. The image-processing class also includes postprocessing algorithms that enhance identified features to prepare them for further scrutiny by human analysts (see figure). Enhancement of images as a postprocessing step is a significant departure from traditional practice, in which enhancement of images is a preprocessing step.

Park, Han↗
NASA NTRSDate not supplied

The Satellite Flythrough and Reconstruction Softwares at CCMC

The next-generation of model data visualization to be offered at the Community Coordinated Modeling Center (CCMC) will be based on Kamodo, an open source python package. To increase the usefulness of our services, we are also developing new capabilities based on this software, called the satellite flythrough and the reconstruction tools, to be offered both as packages for offline analysis and through an online interface (coming soon). The satellite flythrough software ‘flies’ a satellite trajectory, whether real or imaginary, through either model data hosted at CCMC or on a personal machine. This service greatly simplifies the complexity of users’ access to model data, abstracting away the time-consuming details of model data formats and interpolation. We demonstrate execution times of a few seconds to a few minutes for several example flythroughs of a trajectory stretching over a few days, depending on the parameters chosen. We also demonstrate a reconstruction tool built on top of the satellite flythrough software, for use with mission planning and model-data comparisons. This tool, based on reconstructions provided for the GDC Science and Technology Definition Team, converts multiple, simultaneous satellite flythroughs into two-dimensional reconstructions. The reconstruction tool provides a software capability for satellite constellations to determine how many satellites are needed and in what configuration to resolve the desired features in the model data. Both tools are currently available through GitHub for a selection of CCMC-hosted ITM models. Finally, we present initial results from work in progress and plans for future work, including an expansion of the reconstruction tool to provide 3D reconstruction capabilities and a line-of-sight calculation tool.

software, python↗
NASA NTRS2021

3D Shape Reconstruction of Small Bodies from Sparse Features

The autonomous approach of spacecraft to a small body (comet or asteroid) relies on using all available information at each phase of the approach. This paper presents new algorithms for global shape reconstructions from sparse tracked surface points. These methods leverage estimates from earlier phases, such as rotation pole, as well as a priori knowledge, such as a genus-0 body (i.e. without boundaries or topological holes). A mapping algorithm is proposed, which performs faithful reconstructions while enforcing genus-0 output through spherical parameterization. To estimate the shape of permanently shadowed regions of the body, a symmetry reconstruction method is added to the reconstruction algorithms. This method is shown to substantially increase the reconstruction accuracy but is subject to the symmetry of the body perpendicular to the rotation pole. The proposed mapping algorithm is compared to stateof- the-practice surface reconstruction algorithms, assessing their accuracy and ability to correctly generate genus-0 shape models for 2400 datasets and three small bodies. The proposed spherical parameterization algorithm performed consistently with the state-of-the-practice while being the only algorithm to always produce genus-0 shape models.

Nesnas, Issa↗
NASA NTRSDate not supplied

Modeling Methods for 3D Lightning Mapping from Space

Global lightning detection has advanced greatly over the past few decades both on ground and from orbit. Ground-based systems like the Lightning Mapping Array (LMA) excel at high-precision 3D reconstruction of local flashes, while spaceborne lightning sensors have much larger potential coverage but are limited by coarser resolution and often rely on data from other instruments to determine 3D flash locations. CubeSpark is a new mission concept focused on combining these two methods in the form of six small satellites in low-Earth orbit. CubeSpark will combine RF and bispectral optical measurements of lightning in order to map the 3D structure of both individual flashes and their parent thunderstorms at 1-2 km spatial resolution on a global scale, enabling a host of new atmospheric, climate, and space electricity studies. The goal of this study is to assess the feasibility and expected resolution of lightning mapping via indivudal VHF sources using different methods and detector combinations. Flashes were simulated beneath orbital configurations consisting of 1-6 satellites, taking into account the complicated interactions with Earth's ionosphere. In the multi-satellite (>5) approach, RF detectors on each satellite measure the arrival times of impulsive VHF sources to collectively pinpoint their locations in 3D and reconstruct flashes with higher resolution than has been achieved from space. The same can process can be performed with 3-4 satellites by constraining sources' horizontal locations with onboard optical imagers. A 1-2 station approach follows the established method of determining the height of an RF source using the arrival time difference between direct RF waves and their reflections off the Earth's surface. Here we present preliminary results of the expected accuracy of these methods to inform potential satellite missions like CubeSpark.

Lightning↗
NASA NTRSDate not supplied

Modeling Methods for 3D Lightning Mapping from Space

Global lightning detection has advanced greatly over the past few decades both on ground and from orbit. Ground-based systems like the Lightning Mapping Array (LMA) excel at high-precision 3D reconstruction of local flashes, while spaceborne lightning sensors have much larger potential coverage but have been limited by coarser resolution and often rely on data from other instruments to determine flash location. The primary focus of this study is to examine the level of flash detail that can be expected from one or more low-Earth orbiting small satellites that combine VHF and optical measurements of lightning, which is a new mission concept called CubeSpark. The goal of CubeSpark is to map the 3D charge structure of thunderstorms at 1-2 km spatial resolution on a global scale, enabling a host of new atmospheric and space electricity studies. In order to maximize the potential data quality and minimize potential cost, flashes were simulated beneath single- and multi-satellite configurations. In the multi-satellite approach, RF detectors on each of the six satellites would measure the arrival times of impulsive VHF sources to collectively pinpoint their locations in 3D and reconstruct flashes with higher resolution than has been achieved from space. A single-station approach for 3D observation of lightning would follow the method of determining altitudes of strong VHF sources that produce trans-ionospheric pulse pairs (TIPPs) while relying on an on-board high-resolution optical day/night lightning mapper for approximate horizontal flash locations. Here we present preliminary results comparing the expected data fidelity and accuracy between these methods to inform potential satellite missions like CubeSpark.

lightning↗
NASA NTRS2001

[Real time 3D echocardiography]

Three-dimensional representation of the heart is an old concern. Usually, 3D reconstruction of the cardiac mass is made by successive acquisition of 2D sections, the spatial localisation and orientation of which require complex guiding systems. More recently, the concept of volumetric acquisition has been introduced. A matricial emitter-receiver probe complex with parallel data processing provides instantaneous of a pyramidal 64 degrees x 64 degrees volume. The image is restituted in real time and is composed of 3 planes (planes B and C) which can be displaced in all spatial directions at any time during acquisition. The flexibility of this system of acquisition allows volume and mass measurement with greater accuracy and reproducibility, limiting inter-observer variability. Free navigation of the planes of investigation allows reconstruction for qualitative and quantitative analysis of valvular heart disease and other pathologies. Although real time 3D echocardiography is ready for clinical usage, some improvements are still necessary to improve its conviviality. Then real time 3D echocardiography could be the essential tool for understanding, diagnosis and management of patients.

Review↗
NASA NTRS2018

Artificial Neural Networks for Determining Magnetospheric Conditions

This chapter presents a neural-network-based technique that allows for the reconstruction of the global, time-varying distribution of some physical quantity Q, that has been sparsely sampled at various locations within the magnetosphere, and at different times. We begin with a general introduction to the problem of prediction and specification, and why it is important and difficult to achieve with existing methods. We then provide a basic introduction to neural networks, and describe our technique using the specific example of reconstructing the electron plasma density in the Earth's inner magnetosphere on the equatorial plane. We then show more advanced uses of the technique, including 3D reconstruction of the plasma density, specification of chorus and hiss waves, and energetic particle fluxes. We summarize and conclude with a general discussion of how machine learning techniques might be used to advance the state-of-the-art in space weather prediction, and insight discovery.

Bortnik, Jacob↗