Norman Fitz-Coy | Search NASA

NASA NTRS2023

Using Machine Learning to Infer Material Properties of Debris Fragments from X-ray Images in the DebriSat Project

The DebriSat project is a collaboration effort with the NASA Orbital Debris Program Office, the U.S. Space Force Space Systems Command Center, The Aerospace Corporation, and the University of Florida. To date, over 200,000 fragments from this ground-based, hypervelocity impact experiment have been collected, and processing is underway to determine their physical characteristics, such as material, shape, color, characteristic length, and average cross-sectional area. The x-ray process is primarily used to identify the location of the fragments and estimated size for extraction, so that these physical characteristics can be assessed. This paper proposes a machine learning-based approach to characterize materials from x-ray images of debris fragments embedded in soft-catch foam used in the DebriSat project. The novel methodology discussed in this paper will highlight the use of x-ray imagery data to characterize these fragments without extraction or a human-in-the-loop. Both supervised and unsupervised machine learning techniques are utilized with this approach to infer the physical parameters of the fragments embedded in the soft-catch foam panels used in the impact experiment based on x-ray images of the foam panels. Additionally, 3D reconstructions of the extracted fragments are created with images taken from two different angles using the structure from motion (SfM) method. The characteristic lengths and shape from the 3D reconstruction, alongside the physical characteristics of the debris, are used in the inference of the material type. To develop and test the approach, a dataset of x-ray images of debris fragments of varying sizes and materials is collected. Supervised learning methods such as convolutional neural networks (CNNs), support vector machines (SVM), decision trees, and random forest classifiers are used due to the high-dimensional feature spaces of the debris and nonlinear decision boundaries for material categorization. Given the limited pre-labeled data of embedded debris materials smaller than 10 mm, unsupervised machine learning techniques such as clustering algorithms and autoencoders are used, in addition to supervised learning methods. The clustering algorithms group similar fragments together based on their physical properties, and autoencoders reduce the dimensionality of the x ray images and extract relevant features. The performance of the proposed approach's is analyzed using a range of statistical methods, including confusion matrices, receiver operating characteristic curves, and precision-recall curves. The results are compared with those obtained using a baseline approach that relies on manual identification and classification of debris fragments. To evaluate the effectiveness of different machine learning methods, statistical tests such as t-tests, ANOVA, and cross-validation are performed, comparing the performance of CNNs, SVMs, clustering algorithms, and autoencoders. Additional analysis needs to be conducted to identify any sources of bias or variability that may affect the results, such as variations in imaging conditions or fragmentation patterns. Other topics explored are limitations, refinements, and the potential use of semi-supervised learning techniques, such as self-training to label unlabeled datasets and co-training using x-ray images taken from two different angles as two different models.

Saik Anam Siam↗

NASA NTRS2003

Thruster Limitation Consideration for Formation Flight Control

Physical constraints of any real system can have a drastic effect on its performance. Some of the more recognized constraints are actuator and sensor saturation and bandwidth, power consumption, sampling rate (sensor and control-loop) and computation limits. These constraints can degrade system s performance, such as settling time, overshoot, rising time, and stability margins. In order to address these issues, researchers have investigated the use of robust and nonlinear controllers that can incorporate uncertainty and constraints into a controller design. For instance, uncertainties can be addressed in the synthesis model used in such algorithms as H(sub infinity), or mu. There is a significant amount of literature addressing this type of problem. However, there is one constraint that has not often been considered; that is, actuator authority resolution. In this work, thruster resolution and controller schemes to compensate for this effect are investigated for position and attitude control of a Low Earth Orbit formation flight system. In many academic problems, actuators are assumed to have infinite resolution. In real system applications, such as formation flight systems, the system actuators will not have infinite resolution. High-precision formation flying requires the relative position and the relative attitude to be controlled on the order of millimeters and arc-seconds, respectively. Therefore, the minimum force resolution is a significant concern in this application. Without the sufficient actuator resolution, the system may be unable to attain the required pointing and position precision control. Furthermore, fuel may be wasted due to high-frequency chattering phenomena when attempting to provide a fine control with inadequate actuators. To address this issue, a Sliding Mode Controller is developed along with the boundary Layer Control to provide the best control resolution constraints. A Genetic algorithm is used to optimize the controller parameters according to the states error and fuel consumption criterion. The tradeoffs and effects of the minimum force limitation on performance are studied and compared to the case without the limitation. Furthermore, two methods are proposed to reduce chattering and improve precision.

Yunjun Xu↗

NASA NTRS2003

Coupled Attitude and Orbit Dynamics and Control in Formation Flying Systems

Formation flying systems can range from global constellations offering extended service coverage to clusters of highly coordinated vehicles that perform distributed sensing. Recently, the use of groups of micro-satellites in the areas of near Earth explorations, deep space explorations, and military applications has received considerable attention by researchers and practitioners. To date, most proposed control strategies are based on linear models (e.g., Hill-Clohessy-Wiltshire equations) or nonlinear models that are restricted to circular reference orbits. Also, all models in the literature are uncoupled between relative position and relative attitude. In this paper, a generalized dynamic model is proposed. The reference orbit is not restricted to the circular case. In this formulation, the leader or follower satellite can be in either a circular or an elliptic orbit. In addition to maintaining a specified relative position, the satellites are also required to maintain specified relative attitudes. Thus the model presented couples vehicle attitude and orbit requirements. Orbit perturbations are also included. In particular, the J(sub 2) effects are accounted in the model. Finally, a sliding mode controller is developed and used to control the relative attitude of the formation and the simulation results are presented.

Yunjun Xu↗

NASA NTRSDate not supplied

Using Machine Learning to Infer Material Properties of Debris Fragments from X-ray Images in the DebriSat Project

The DebriSat project is a collaboration effort with the NASA Orbital Debris Program Office, the U.S. Space Force Space Systems Command Center, The Aerospace Corporation, and the University of Florida. To date, over 200,000 fragments from this ground-based, hypervelocity impact experiment have been collected, and processing is underway to determine their physical characteristics, such as material, shape, color, characteristic length, and average cross-sectional area. The x-ray process is primarily used to identify the location of the fragments and estimated size for extraction, so that these physical characteristics can be assessed. This paper proposes a machine learning-based approach to characterize materials from x-ray images of debris fragments embedded in soft-catch foam used in the DebriSat project. The novel methodology discussed in this paper will highlight the use of x-ray imagery data to characterize these fragments without extraction or a human-in-the-loop. Both supervised and unsupervised machine learning techniques are utilized with this approach to infer the physical parameters of the fragments embedded in the soft-catch foam panels used in the impact experiment based on x-ray images of the foam panels. Additionally, 3D reconstructions of the extracted fragments are created with images taken from two different angles using the structure from motion (SfM) method. The characteristic lengths and shape from the 3D reconstruction, alongside the physical characteristics of the debris, are used in the inference of the material type. To develop and test the approach, a dataset of x-ray images of debris fragments of varying sizes and materials is collected. Supervised learning methods such as convolutional neural networks (CNNs), support vector machines (SVM), decision trees, and random forest classifiers are used due to the high-dimensional feature spaces of the debris and nonlinear decision boundaries for material categorization. Given the limited pre-labeled data of embedded debris materials smaller than 10 mm, unsupervised machine learning techniques such as clustering algorithms and autoencoders are used, in addition to supervised learning methods. The clustering algorithms group similar fragments together based on their physical properties, and autoencoders reduce the dimensionality of the x ray images and extract relevant features. The performance of the proposed approach's is analyzed using a range of statistical methods, including confusion matrices, receiver operating characteristic curves, and precision-recall curves. The results are compared with those obtained using a baseline approach that relies on manual identification and classification of debris fragments. To evaluate the effectiveness of different machine learning methods, statistical tests such as t-tests, ANOVA, and cross-validation are performed, comparing the performance of CNNs, SVMs, clustering algorithms, and autoencoders. Additional analysis needs to be conducted to identify any sources of bias or variability that may affect the results, such as variations in imaging conditions or fragmentation patterns. Other topics explored are limitations, refinements, and the potential use of semi-supervised learning techniques, such as self-training to label unlabeled datasets and co-training using x-ray images taken from two different angles as two different models.

Saik Anam Siam↗