Search NASASearch

SEARCH · Search NASA

Results for “machine learning visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Probabilistic Modeling of Heavy Machinery Using Machine Learning

NASA Glenn Research Center’s facility operations seeks to leverage its extensive instrumentation and historical data with machine learning to increase system efficiencies. The ultimate goal of this effort is to probabilistically model the behavior of Glenn’s central air service compressors for optimal decision making and planning. This project is a first step in that direction. We propose a multimodel approach that uses high-dimensional models to ask simple questions about complex dependent structures, and low-dimensional models to ask complex questions about simple dependent structures. While the low-dimensional models make strong assumptions, they can be visualized and they can be insightful. We show good fits for univariate models of compressor sensors, and preliminary work on high-dimensional multivariate models.

Machine learning

Transitioning TEMPO Data for Air Quality Management Applications at the NASA SPoRT Center

The TEMPO mission has been observing air pollutants every hour during the daytime across its Field of Regard (FoR) covering greater North America since First Light on August 2, 2023. The highly anticipated public release of TEMPO data occurred on May 20, 2024, consisting of level 2 and level 3 trace gas data products of nitrogen dioxide, formaldehyde, and ozone. The NASA SPoRT Center is developing value-added products and tools to support the TEMPO mission and Early Adopters program with special attention on stakeholder from air agencies. One component of our work is focused on evaluating the TEMPO products over stakeholder target areas using Pandora and surface monitor observations to characterize the uncertainties and develop best practices for processing and analyzing TEMPO data. Methods for oversampling TEMPO data to 1 km resolution are being applied over the target areas to resolve fine-scale emission sources and pollutant gradients. Machine learning techniques using TEMPO, surface monitor, and model data to estimate surface-level nitrogen dioxide concentrations are being developed over the target areas. A SPoRT viewer for TEMPO has been launched for providing visualizations of the TEMPO products and an ArcGIS dashboard is being designed for enabling air agency stakeholders to efficiently analyze TEMPO data. Training materials including user guides are being developed to ensure the effective and sustained use of TEMPO data at our stakeholder agencies. One major goal of our TEMPO initiatives at SPoRT is to better enable the inclusion of TEMPO data in air quality management applications such as exceptional event demonstrations through our close engagement with stakeholders. This talk will provide an update on our SPoRT activities and showcase use cases of TEMPO data for monitoring different emission sources including wildland fire smoke.

Air Quality

Genomics Study of Effect of Redox-Active Metalloporphyrin on Murine Retina During Spaceflight

Astronauts returning from spaceflight have experienced eye problems, which may decrease retinal performance and lead to long-term effects on visual acuity. This study leverages the collected data from spaceflown murine retinas that were treated with redox-active metalloporphyrin (BuOE) to mitigate spaceflight-induced changes. 10-week-old adult C57BL/6 male mice (n=5 in each of BuOE treated and saline control groups) were flown on Space-X 24 to the ISS national lab, kept in low earth orbit for 35 days and returned to Earth alive. Our analysis of RNA-sequencing data generated from subsequent murine retina tissues uncovered genes, pathways, and epigenetic modifications consistent with therapeutic potential of BuOE. For spaceflown murine samples, the treatment group show differentially expressed genes relative to saline controls that reached significance (adjusted p-value < 0.05) and included genes Gpx3 and Crhbp, which are related to protection against cell oxidative damage and cellular response to organonitrogen compounds. Ranked fold-changes from the same contrast were used for gene set enrichment analysis, which showed biological processes reaching significance (adjusted p-value < 0.05) including glutathione metabolic processes and cellular response to xenobiotic stimulus. The findings from this investigation have the potential to provide valuable insights into the molecular mechanisms underlying conditions like spaceflight associated neuro-ocular syndrome and assess the effectiveness of BuOE as a countermeasure for astronauts experiencing neuro-ophthalmic abnormalities, which can lead to long-term effects on visual acuity.

Machine Learning

Genomics Study of Effect of Redox-Active Metalloporphyrin on Murine Retina During Spaceflight

Astronauts returning from spaceflight have experienced eye problems, which may decrease retinal performance and lead to long-term effects on visual acuity. This study leverages the collected data from spaceflown murine retinas that were treated with redox-active metalloporphyrin (BuOE) to mitigate spaceflight-induced changes. 10-week-old adult C57BL/6 male mice (n=5 in each of BuOE treated and saline control groups) were flown on Space-X 24 to the ISS national lab, kept in low earth orbit for 35 days and returned to Earth alive. Our analysis of RNA-sequencing data generated from subsequent murine retina tissues uncovered genes, pathways, and epigenetic modifications consistent with therapeutic potential of BuOE. For spaceflown murine samples, the treatment group show differentially expressed genes relative to saline controls that reached significance (adjusted p-value < 0.05) and included genes Gpx3 and Crhbp, which are related to protection against cell oxidative damage and cellular response to organonitrogen compounds. Ranked fold-changes from the same contrast were used for gene set enrichment analysis, which showed biological processes reaching significance (adjusted p-value < 0.05) including glutathione metabolic processes and cellular response to xenobiotic stimulus. The findings from this investigation have the potential to provide valuable insights into the molecular mechanisms underlying conditions like spaceflight associated neuro-ocular syndrome and assess the effectiveness of BuOE as a countermeasure for astronauts experiencing neuro-ophthalmic abnormalities, which can lead to long-term effects on visual acuity.

Machine Learning

Discovering Communicable Scientific Knowledge from Spatio-Temporal Data

This paper describes how we used regression rules to improve upon a result previously published in the Earth science literature. In such a scientific application of machine learning, it is crucially important for the learned models to be understandable and communicable. We recount how we selected a learning algorithm to maximize communicability, and then describe two visualization techniques that we developed to aid in understanding the model by exploiting the spatial nature of the data. We also report how evaluating the learned models across time let us discover an error in the data.

Schwabacher, Mark

Discovering Communicable Models from Earth Science Data

This chapter describes how we used regression rules to improve upon results previously published in the Earth science literature. In such a scientific application of machine learning, it is crucially important for the learned models to be understandable and communicable. We recount how we selected a learning algorithm to maximize communicability, and then describe two visualization techniques that we developed to aid in understanding the model by exploiting the spatial nature of the data. We also report how evaluating the learned models across time let us discover an error in the data.

Schwabacher, Mark

The Application of Artificial Intelligence Deep Learning to Visually Identify Micrometeoroid and Orbital Debris Impacts

Recent advances in Artificial Intelligence (AI) are changing the World. Novel approaches to training AI systems have led to dramatic reductions in the amount of time required. Training an AI system could take years and teams of people using traditional methods, but with the advancements of Deep Learning (DL) models this training can now be accomplished by an individual in a matter of minutes. The development of “fast AI” libraries has delivered AI to essentially everyone. Democratization of AI power has inspired many to revisit past problems that will benefit from DL approaches. For example, the application of AI has improved detection of breast cancer by 20% compared to traditional detection methods. Computer vision and machine learning are being used to identify soil deficiencies and provide planting recommendations to farmers. Success stories like these and many others have provided inspiration to see if AI can help improve one of our needed capabilities – that of visually identifying micrometeoroid and orbital debris (MMOD) impact damage to spacecraft from images of the spacecraft exterior. The need to visually locate and characterize spacecraft MMOD impact damage has been present since the early days of space travel. This is often done by either having a crew member take photographs of the spacecraft through a window using a hand-held camera or ground personnel directing externally-mounted cameras. The photographs are then transmitted back to Earth for visual analysis. This method of MMOD damage inspection works well and has been used on various spacecraft including the Space Shuttle and the International Space Station (ISS). One of the issues with the current method that we believe AI could improve is the speed and possibly the accuracy in identifying MMOD impacts. Note that detecting MMOD impacts in images can be very difficult. The visual appearance of an MMOD impact can change dramatically with lighting conditions, size of impact, depth of penetration, material types, surface waviness, fabric coverings, camera & lens, distance to surface, spacecraft orientation, analyst experience, and many other factors. Currently, this takes a team of highly-experienced specialists in both the fields of Image Analysis and MMOD impacts. This paper documents our initial research in training an AI DL model using the fast-AI library to identify actual and simulated MMOD impacts and perforations into exposed flat surfaces. While we recognize that this initial goal seems modest, it must be noted that what we have done would have taken teams of individuals and years of training just ten years ago. Our long-term goal is to add complexity and use-cases to the DL model being trained to expand the capabilities of this model so that it can be used to identify MMOD impacts on all types of spacecraft surfaces.

Cameron M Collins

Phenomena Portal: Large- Scale Visual Exploration of Atmospheric Phenomena

The Earth science community is experiencing a high influx of remote sensing data due to recent advancements in sensor technology. This enables the community to extend their research on a larger scale than ever before. Unfortunately, traditional data processing techniques do not scale well to these new, high volume data sources. State-of-the-art machine learning (ML) pipelines have been proven to overcome these burdens in various other fields but are underexploited within the physical sciences community. Moreover, ML is reliant on labeled data, which is currently sparsely available, owing to the fact that ML adoption is still in the early stages within the Earth and atmospheric science communities. To address these issues, we developed the Phenomena Portal, a visual exploration tool that uses ML to detect various atmospheric phenomena on a global scale. This allows the Earth and atmospheric science communities to view trends of occurrences of phenomena, identify potential relationships between them, and analyze spatiotemporal patterns over time. These detections can also serve as initial labeled data for ML research pertaining to the respective phenomena. The tool also incorporates feedback from subject matter experts to further improve the model detection accuracy, thereby facilitating human-in-the-loop. This presentation will provide an overview of the ML model development and cloud deployment. We also discuss the capabilities of the user interface for displaying the detections.

Muthukumaran Ramasubramanian

NASA GeneLab Multi-study Visualization Portal

NASA GeneLab has helped advance the field of Space Biology by providing a public repository where researchers can store, share, analyze and visualize the results of space flight related omics experiments. The GeneLab data visualization portal allows any user, regardless of bioinformatics knowledge or access to computational resources, to interact with the experimental data, draw their own conclusions, and gain insights about the effects of space on living systems. These tools help democratize scientific research and foster the NASA Open Science initiative. The new multi-study feature of the GeneLab visualization platform allows users to mine study metadata from RNA sequencing (RNA-seq) experiments to identify samples of interest by filtering datasets based on organism, tissue, assay technology type, and/or factor. Once samples are selected from multiple datasets, users can combine and normalize the sample data, then utilize the visualization displays, including Principal Component Analysis (PCA) plots, to assess sample distributions. Finally, users can perform differential gene expression analysis on the combined data and visualize the results through PCA plots, Volcano plots, Pair plots, Heatmap, Ideogram and Gene Set Enrichment Analysis. All user-generated results and visualizations will be available for download. Here, we present a biological study using samples from multiple GeneLab RNA-seq datasets and analyzed using the multi-study visualization platform to demonstrate inter- and intra-study variability, as well as commonly differentially expressed genes between spaceflight and ground control conditions across datasets. This new feature opens a wide range of possibilities and opportunities for further development including combining other assay technology types and integration with batch effect correction techniques and machine learning applications. Overall, this tool allows users to increase the statistical power of individual experiments, validate hypothesis, identify patterns, and opens the door to new and exciting research.

space biology

Time series comparisons in Deep Space Network

The Deep Space Network (DSN) is NASA’s international array of antennas that support interplanetary spacecraft missions. DSN provides radar and radio astronomy observations that enhance our understanding of the solar system and the larger universe. A track is a block of continuous multi-dimensional time series from the beginning to end of DSN communication with the target spacecraft, containing 129 monitor data items lasting several hours at a frequency of 0.2-1Hz. Monitor data on each track reports on the performance of specific spacecraft operations and the DSN itself. DSN is receiving signals from 32 spacecraft across the solar system. DSN has pressure to reduce costs while maintaining the quality of support for DSN mission users. DSN operators need to simultaneously monitor multiple tracks and identify anomalies in real time. DSN has seen that as the number of missions increases, the data that needs to be processed increases over time. In this project, we look at the last 8 years of data for analysis. Any anomaly in the track indicates a problem with either the spacecraft, DSN equipment, or weather conditions. DSN operators typically write “discrepancy reports” for further analysis. It is recognized that it would be quite helpful to identify 10 similar historical tracks out of the huge database to quickly find/match anomalies. This tool has three functions: (1) identification of the top 10 similar historical tracks, (2) detection of anomalies compared to the reference normal track, and (3) comparison of statistical differences between two given tracks. The requirements for these features were confirmed by survey responses from 21 DSN operators and engineers. The preliminary machine learning model has shown promising performance (AUC=0.92). We plan to increase the number of data sets and perform additional testing to improve performance further before its planned integration into the Track Visualizer to assist DSN field operators and engineers.

Rebbapragada, Umaa

Development of TEMPO Products and Tools to Support Air Quality Management Decisions

The TEMPO mission has been observing air pollutants every hour during the daytime across its Field of Regard (FoR) covering greater North America since First Light on August 2, 2023. The highly anticipated public release of TEMPO data occurred on May 20, 2024, consisting of level 2 and level 3 trace gas data products of nitrogen dioxide, formaldehyde, and ozone. Our project at the NASA SPoRT Center is developing value-added products and tools to support the TEMPO mission and Early Adopters program with special attention on the air quality management community. The initial focus of this project is evaluating the TEMPO products over stakeholder target areas using Pandora and surface monitor observations. Methods for oversampling TEMPO data to 1 km resolution are being applied over the target areas to resolve fine-scale emission sources and pollutant gradients. Machine learning techniques using TEMPO, surface monitor, and model data to estimate surface-level nitrogen dioxide concentrations are being developed over the target areas. Our SPoRT viewer has been updated to include visualizations of the TEMPO products and an ArcGIS dashboard is being designed for enabling air quality management stakeholders to efficiently analyze TEMPO data. Training materials including user guides are being developed to ensure the effective and sustained use of TEMPO data in air quality management applications. The major outcome of this project is to support the inclusion of TEMPO data in exceptional event demonstrations by active engagement with stakeholders and ultimately enable more informed air quality management decisions in the future. This talk will provide an update on our project activities and showcase use cases of TEMPO data for monitoring different emission sources including wildland fire smoke.

air quality

A Method for Obtaining Surface Flow Vectors and Its Implementation in Interferometric Skin Friction Measurement

A new method was developed to extract surface flow vectors from an oilflow visualization image that has oil streaklines. The method is analogous to the PIV processing where the image is divided into interrogation windows. A representative flow direction is obtained for each interrogation window using image processing with a line-detection algorithm. Repeating the process for the entire image, one can find the surface vector field. The Hough transformation, Radon transformation and Machine Learning were used as line-detection algorithms. The obtained vector field is then postprocessed to filter spurious vectors and to apply smoothing. The method was tested on 2D and 3D models with different flow complexities. The method was able to predict surface flow vectors for all cases tested. The predicted surface flow vectors were used in obtaining the surface skin friction. The successful implementation of the surface flow vectors enables interferometric skin friction measurements on surfaces beneath 3D complex flows. In addition, the surface flow vectors can be superimposed on the oilflow visualization images to better explain the surface flow topology.

Surface flow vectors

A Method for Obtaining Surface Flow Vectors and Its Implementation in Interferometric Skin Friction Measurement

A new method was developed to extract surface flow vectors from an oilflow visualization image that has oil streaklines. The method is analogous to the PIV processing where the image is divided into interrogation windows. A representative flow direction is obtained for each interrogation window using image processing with a line-detection algorithm. Repeating the process for the entire image, one can find the surface vector field. The Hough transformation, Radon transformation and Machine Learning were used as line-detection algorithms. The obtained vector field is then postprocessed to filter spurious vectors and to apply smoothing. The method was tested on 2D and 3D models with different flow complexities. The method was able to predict surface flow vectors for all cases tested. The predicted surface flow vectors were used in obtaining the surface skin friction. The successful implementation of the surface flow vectors enables interferometric skin friction measurements on surfaces beneath 3D complex flows. In addition, the surface flow vectors can be superimposed on the oilflow visualization images to better explain the surface flow topology.

Surface flow vectors

Acting to gain information

This report is concerned with agents that act to gain information. In previous work, we developed agent models combining qualitative modeling with real-time control. That work, however, focused primarily on actions that affect physical states of the environment. The current study extends that work by explicitly considering problems of active information-gathering and by exploring specialized aspects of information-gathering in computational perception, learning, and language. In our theoretical investigations, we analyzed agents into their perceptual and action components and identified these with elements of a state-machine model of control. The mathematical properties of each was developed in isolation and interactions were then studied. We considered the complexity dimension and the uncertainty dimension and related these to intelligent-agent design issues. We also explored active information gathering in visual processing. Working within the active vision paradigm, we developed a concept of 'minimal meaningful measurements' suitable for demand-driven vision. We then developed and tested an architecture for ongoing recognition and interpretation of visual information. In the area of information gathering through learning, we explored techniques for coping with combinatorial complexity. We also explored information gathering through explicit linguistic action by considering the nature of conversational rules, coordination, and situated communication behavior.

Rosenchein, Stanley J.

Engine Icing Data - An Analytics Approach

Engine icing researchers at the NASA Glenn Research Center use the Escort data acquisition system in the Propulsion Systems Laboratory (PSL) to generate and collect a tremendous amount of data every day. Currently these researchers spend countless hours processing and formatting their data, selecting important variables, and plotting relationships between variables, all by hand, generally analyzing data in a spreadsheet-style program (such as Microsoft Excel). Though spreadsheet-style analysis is familiar and intuitive to many, processing data in spreadsheets is often unreproducible and small mistakes are easily overlooked. Spreadsheet-style analysis is also time inefficient. The same formatting, processing, and plotting procedure has to be repeated for every dataset, which leads to researchers performing the same tedious data munging process over and over instead of making discoveries within their data. This paper documents a data analysis tool written in Python hosted in a Jupyter notebook that vastly simplifies the analysis process. From the file path of any folder containing time series datasets, this tool batch loads every dataset in the folder, processes the datasets in parallel, and ingests them into a widget where users can search for and interactively plot subsets of columns in a number of ways with a click of a button, easily and intuitively comparing their data and discovering interesting dynamics. Furthermore, comparing variables across data sets and integrating video data (while extremely difficult with spreadsheet-style programs) is quite simplified in this tool. This tool has also gathered interest outside the engine icing branch, and will be used by researchers across NASA Glenn Research Center. This project exemplifies the enormous benefit of automating data processing, analysis, and visualization, and will help researchers move from raw data to insight in a much smaller time frame.

Engine Icing

Celestial Mapping System and Digital Lunar Library Initiative

We are preparing to create an interactive, global 3D lunar environment with integrated dataset and AI/ML tools to provide unique value to mission planners, scientists and the entire lunar community. This lunar environment will be based on NASA Ames Celestial Mapping System (CMS) [1] and Digital Lunar Library (DLL) Initiative. CMS provides a 3D virtual Lunar Globe with extensive user friendly tool sets, that include high resolution terrain visualization, elevation profiles, measurement kits, slope analysis, path optimization, line of sight analysis, equipment planning and placement tools and many other functionalities [1]. It has a thick client with less overhead to access hardware resources. This allows features such as terrain profiling and distance calculations to be performed on the client and on the fly. The application is developed to provide situational and domain awareness on the Lunar surface, planning capabilities for equipment placements and traverse path optimization. As data becomes available, CMS has the capabilities to integrate data sets that change dynamically in real-time, which will be useful for monitoring satellites and remotely-sensed data on the Lunar surface. CMS supports importing synthetic features in a variety of 3D, 2D, vector and raster formats. In the future, these capabilities will be enhanced by incorporating AI/ML tools and a plug-in architecture to enable customization by the user groups. With the help of DLL we will be able to : 1) Amplify the value of lunar information with AI-powered data enhancements 2) Acquire and integrate lunar data with AI-assisted georectification and homogenization 3) Analyze lunar data with advanced 3D visualization, intelligent search-by-example 4) Apply lunar data insights to specific use cases with an open plug-in architecture. The CMS-DLL initiative will have several potential use cases for NASA and the lunar community in general, including subsurface lava tube visualization and analysis, soil analysis, in-situ lunar resource visualization and representation on 3D globe, and data analytics for utilization. REFERENCES: [1] https://celestial.arc.nasa.gov/

3D Globe

Toward Design Assurance of Machine-Learning Airborne Systems

In recent years, Artificial Intelligence (AI) systems, enabled by Machine Learning (ML)technology, have demonstrated impressive progress and provides historic opportunities for the aviation industry. However, several key aspects of ML technology are not compatible with existing design assurance standards and make certification problematic. In this paper, we present a case study of a visual system with a Deep Neural Network (DNN) intended to detect and identify airport runway signs. Different use cases and variants of this system exhibit different levels of criticality ranging from design assurance level (DAL) D to B. We use the case study to illustrate the challenges of certification according to the current standards, such asDO-178C. We present the system design, data generation, training, and verification in detail and describe how the design assurance objectives can be met for a DAL D variant of the system. We also discuss gaps and potential approaches for the higher design assurance levels.

Avionics