Results for “machine learning potentials” — Page 10

NASA NTRS2021

Machine Learning Models to Predict Cognitive Impairment of Rodents Subjected to Space Radiation

This research uses machine-learned computational analyses to predict the cognitive performance impairment of rats induced by irradiation. The experimental data in the analyses is from a rodent model exposed to ≤ 15 cGy of individual Galactic Cosmic Radiation (GCR) ions: 4He, 16O, 28Si, 48Ti, or 56Fe, expected for a Lunar or Mars mission. This work investigates rats at a subject-based level and uses performance scores taken before irradiation to predict impairment in Attentional Set-shifting (ATSET) data post-irradiation. Here, the worst performing rats of the control group define the impairment thresholds based on population analyses via cumulative distribution functions, leading to the labeling of impairment for each subject. A significant finding is the exhibition of a dose-dependent increasing probability of impairment for 1 to 10 cGy of 28Si or 56Fe in the Simple Discrimination (SD) stage of the ATSET, and for 1 to 10 cGy of 56Fe in the Compound Discrimination (CD) stage. On a subject-based level, implementing Machine Learning (ML) classifiers such as the Gaussian Naïve Bayes, Support Vector Machine, and Artificial Neural Networks identifies rats that have a higher tendency for impairment after GCR exposure. The algorithms employ the experimental prescreenperformance scores as multidimensional input features to predict each rodent’s susceptibility to cognitive impairment due to space radiation exposure. The receiver operating characteristic and the precision-recall curves of the ML models show a better prediction of impairment when 56Feis the ion in question in both SD and CD stages. They, however, do not depict impairment due to 4Hein SD and 28Siin CD, suggesting no dose-dependent impairment response in these cases. One key finding of our study is that prescreen performance scores can be used to predict the ATSET performance impairments. This result is significant to crewed space missions as it supports the potential of predicting an astronaut’s impairment in a specific task before spaceflight through the implementation of appropriately trained ML tools. Future research can focus on constructing ML ensemble methods to integrate the findings from the methodologies implemented in this study for morerobust predictionsof cognitive decrements due to space radiation exposure.

space radiation↗

NASA NTRSDate not supplied

Machine Learning Algorithms for Aerosol and Cloud Detection Using CATS on the ISS

Clouds and aerosols are one of the largest uncertainties in understanding and forecasting the Earth’s changing climate system. The type and height of aerosols are important factors in determining the top-of-atmosphere (TOA) radiation budget, either direct reflection of solar radiation back to space and/or absorption of solar radiation. In addition to their impact on the Earth’s climate system, aerosols near the surface from wildfires, man-made pollution events, and dust storms are hazardous to human health. The phase and height of clouds also play a critical role in determining the role of clouds in the Earth’s climate system. Cirrus clouds in the upper troposphere can induce a significant daytime TOA warming effect, while liquid water clouds near the surface cause a large corresponding cooling effect. Lidar measurements provide accurate vertically resolved information about clouds and aerosols, including complex multi-layer scenes where passive sensors are challenged and at night, when passive sensors are unable to measure cloud and aerosol properties. The Cloud-Aerosol Transport System (CATS) is a lidar instrument that operated for 33 months on the International Space Station (ISS) at the 1064 nm wavelength to measure attenuated total backscatter and depolarization ratio. These fundamental measurements are used to derive “vertical feature mask” cloud and aerosol products, including layer top/base heights, layer geometrical thickness, aerosol type, and cloud phase. While space-based lidar systems like CATS provide cloud and aerosol vertical distributions that improve our understanding of the climate system, averaging of the daytime data from these sensors is required, at the expense of spatial resolution, to improve the daytime signal-to noise (SNR) and thus atmospheric layer detection. This presentation shows results from machine learning (ML) techniques that, when applied to CATS data: 1. improve the 1064 nm SNR 2. enable detection of atmospheric features during daytime with a horizontal resolution of 350 m or 5 km (compared to the 60 km required for standard CATS data products) 3. increase the number of atmospheric layers detected in the CATS data. A Convolutional Neural Network (CNN) trained using CATS standard data products also demonstrated the potential for improved cloud-aerosol discrimination, cloud phase, and aerosol typing compared to the operational CATS algorithms for cloud edges and complex near-surface scenes during daytime. The ML tools described in this paper can facilitate the development of smaller, low-cost lidar systems in the future and enable real-time accessibility of lidar data products from future lidar systems for monitoring and forecasting of hazardous events.

John Yorks↗

NASA NTRSDate not supplied

Human Interfaces and Management of Information (HIMI) Challenges for “In-time” Aviation Safety Management Systems (IASMS)

The envisioned transformation of the National Airspace System to integrate an In-time Aviation Safety Management System(IASMS)to assure safety in Advanced Air Mobility(AAM)brings unprecedented challenges to the design of human interfaces and management of safety information. Safety in design and operational safety assurance are critical factors for how humans will interact with increasingly autonomous systems. The IASMS Concept of Operations builds from traditional commercial operator safety management and scales in complexity to AAM. The transformative changes in future aviation systems pose potential new critical safety risks with novel types of aircraft and other vehicles having different performance capabilities, flying in increasingly complex airspace, and using adaptive contingencies to manage normal and non-normal operations. These changes compel development of new and emerging capabilities that enable innovative ways for humans to interact with data and manage information. In-creasing complexity of AAM corresponds with use of predictive modeling, data analytics, machine learning, and artificial intelligence to effectively address known hazards and emergent risks. The roles of humans will dynamically evolve in increments with this technological and operational evolution. The interfaces for how humans will interact with increasingly complex and assured systems designed to operate autonomously and how information will need to be presented are important challenges to be resolved.

Lawrence J Prinzel↗

NASA NTRSDate not supplied

TPS Certification by Analysis: Model-Driven Characterization of Properties and Failure in Woven Thermal Protection Systems

Woven, ablative thermal protection system (TPS) materials provide a robust option for aggressive (re)entries and thus have been baselined for the upcoming Mars Sample Return (MSR) mission's Earth Entry System (EES). The reliability requirements for MSR-EES necessitate understanding of material property variability, which could be significant given the complex structure and anisotropic nature of properties in TPS weaves, as well as the response to potential impact with micrometeoroids or orbital debris during the EES re-entry. The TPS Certification by Analysis effort within the Entry Systems Modeling project seeks to provide computational models and analyses that support the certification against such material-based risks. For the present talk, focus will be given to the characterization of baseline woven TPS material properties and mechanical failure limits, which entails (1) use of computational techniques (e.g., machine learning) to interpret computed tomography images of the weave to generate representative structural models and (2) application of multiscale material modeling approaches to characterize thermomechanical and failure properties.

thermal protection systems↗

NASA NTRSDate not supplied

TPS Certification by Analysis: Model-Driven Characterization of Properties and Failure in Woven Thermal Protection Systems

Woven, ablative thermal protection system (TPS) materials provide a robust option for aggressive (re)entries and thus have been baselined for the upcoming Mars Sample Return (MSR) mission’s Earth Entry System (EES). The reliability requirements for MSR-EES necessitate understanding of material property variability, which could be significant given the complex structure and anisotropic nature of properties in TPS weaves, as well as the response to potential impact with micrometeoroids or orbital debris during the EES re-entry. The TPS Certification by Analysis effort within the Entry Systems Modeling project seeks to provide computational models and analyses that support the certification against such material-based risks. For the present talk, focus will be given to the characterization of baseline woven TPS material properties and mechanical failure limits, which entails (1) use of computational techniques (e.g., machine learning) to interpret computed tomography images of the weave to generate representative structural models and (2) application of multiscale material modeling approaches to characterize thermomechanical and failure properties.

Justin B. Haskins↗

NASA NTRS2023

Use of Machine Learning and Principal Component Analysis to Retrieve Nitrogen Dioxide (NO 2 ) With Hyperspectral Imagers and Reduce Noise in Spectral Fitting

Nitrogen dioxide (NO 2 ) is an important trace-gas pollutant and climate agent whose presence also leads to spectral interference in ocean color retrievals. NO 2 column densities have been retrieved with satellite UV–Vis spectrometers such as the Ozone Monitoring Instrument (OMI) and the Tropospheric Monitoring Instrument (TROPOMI) that typically have spectral resolutions of the order of 0.5 nm or better and spatial footprints as small as 3.6 km × 5.6 km. These NO 2 observations are used to estimate emissions, monitor pollution trends, and study effects on human health. Here, we investigate whether it is possible to retrieve NO 2 amounts with lower-spectral-resolution hyperspectral imagers such as the Ocean Color Instrument (OCI) that will fly on the Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) satellite set for launch in early 2024. OCI will have a spectral resolution of 5 nm and a spatial resolution of ∼ 1 km with global coverage in 1–2 d. At this spectral resolution, small-scale spectral structure from NO 2 absorption is still present. We use real spectra from the OMI to simulate OCI spectra that are in turn used to estimate NO 2 slant column densities (SCDs) with an artificial neural network (NN) trained on target OMI retrievals. While we obtain good results with no noise added to the OCI simulated spectra, we find that the expected instrumental noise substantially degrades the OCI NO 2 retrievals. Nevertheless, the NO 2 information from OCI may be of value for ocean color retrievals. OCI retrievals can also be temporally averaged over timescales of the order of months to reduce noise and provide higher-spatial-resolution maps that may be useful for downscaling lower-spatial-resolution data provided by instruments such as OMI and TROPOMI; this downscaling could potentially enable higher-resolution emissions estimates and be useful for other applications. In addition, we show that NNs that use coefficients of leading modes of a principal component analysis of radiance spectra as inputs appear to enable noise reduction in NO 2 retrievals. Once trained, NNs can also substantially speed up NO 2 spectral fitting algorithms as applied to OMI, TROPOMI, and similar instruments that are flying or will soon fly in geostationary orbit.

NO2↗

NASA NTRSDate not supplied

Earth Independent Medical Operations (EIMO) Datascope: Challenges and Potential Solutions

Data flows and storage/retrieval capacity are severely constrained during missions in space and challenges will become even greater during exploration class missions. There is a need for an artificial intelligence (AI)-based clinical decision support system (CDSS) to monitor and analyze data to provide real-time consultative support for crew medical officer (CMO) decision-making. EIMO is defined as the gradual transition of medical care and decision making from terrestrial to space-based assets, enabling support of astronaut health and performance and reducing overall mission risk. While a hallmark of this paradigm shift from low-earth orbit is that on-board care will increasingly become the responsibility of the astronauts for primary management and decision making, terrestrial assets will continue to be paramount in pre-mission screening and planning, as well as prevention, health maintenance and long-term care contingencies. New capabilities and systems that enable progressively more robust and resilient systems and crews will be necessary to reduce risk and increase probability of deep space exploration mission success. An aspiration for EIMO is to develop AI-enhanced solutions for analysis of crew health & performance data and to facilitate clinical decision support for autonomous medical operations. A “system of systems” approach is envisioned whereby EIMO will deploy AI-supported natural language processing and machine learning (ML) techniques to utilize embedded reference databases and real-time data streams [input vectors] from multiple data sources. Constituent input vectors may include environmental controls, countermeasures data, behavioral data, physiologic wearables, point-of-care laboratory tests, personalized medical records, inventory trade space risk assessments, COTS medical databases, and ground support inputs. An ideal AI capability would possess trained fusion algorithms to cross reference input vectors with medical ‘knowledge’ [cultivated database] to stratify relevant data streams for predictive and actionable capabilities. In addition, EIMO will feature mobility, in that it can be accessed and can push/pull data within and between multiple vehicles/habitats. Large amounts and variable sources of data can be leveraged to diagnose, inform treatment strategies, and potentially predict medical events and performance decrements. Inclusion of advanced training tools using extended reality will enable increasingly autonomous medical care to aid a CMO when ground support is unavailable or time-delayed beyond required action window, e.g., emergent medical situations. EIMO CDSS would require very large datasets to train pre-flight and significant amounts of data are needed to support ML via in-flight CDSS operations. An additional challenge will be to find sufficient data to train a model relevant to astronaut demographics. The rapid, accelerating evolution of this field creates a propitious solution space to leverage multi-modal AI through public-private partnership(s). The status of multi-modal AI systems today would preclude their use for long duration missions as they remain unreliable and are subject to “digital hallucinations” and other errors that could pose operational risk. A federated labs structure is being considered to test and optimize data flow from the multiple input vectors leading to field testing in suitable ground/flight analogs. Critical to the success of an EIMO CDSS will be integration and interoperability and success will be defined by a system that can serve as an in-flight medical consult for the CMO providing critical support during medical contingencies. Benefits to terrestrial medicine may be significant as an outflow of the EIMO medical system, particularly for remote areas and communities lacking significant infrastructure, personnel and resources.

J Lemery↗

NASA NTRS2024

Earth Independent Medical Operations (EIMO) Datascope: Challenges and Potential Solutions

Data flows and storage/retrieval capacity are severely constrained during missions in space and challenges will become even greater during exploration class missions. There is a need for an artificial intelligence (AI)-based clinical decision support system (CDSS) to monitor and analyze data to provide real-time consultative support for crew medical officer (CMO) decision-making. EIMO is defined as the gradual transition of medical care and decision making from terrestrial to space-based assets, enabling support of astronaut health and performance and reducing overall mission risk. While a hallmark of this paradigm shift from low-earth orbit is that on-board care will increasingly become the responsibility of the astronauts for primary management and decision making, terrestrial assets will continue to be paramount in pre-mission screening and planning, as well as prevention, health maintenance and long-term care contingencies. New capabilities and systems that enable progressively more robust and resilient systems and crews will be necessary to reduce risk and increase probability of deep space exploration mission success. An aspiration for EIMO is to develop AI-enhanced solutions for analysis of crew health & performance data and to facilitate clinical decision support for autonomous medical operations. A “system of systems” approach is envisioned whereby EIMO will deploy AI-supported natural language processing and machine learning (ML) techniques to utilize embedded reference databases and real-time data streams [input vectors] from multiple data sources. Constituent input vectors may include environmental controls, countermeasures data, behavioral data, physiologic wearables, point-of-care laboratory tests, personalized medical records, inventory trade space risk assessments, COTS medical databases, and ground support inputs. An ideal AI capability would possess trained fusion algorithms to cross reference input vectors with medical ‘knowledge’ [cultivated database] to stratify relevant data streams for predictive and actionable capabilities. In addition, EIMO will feature mobility, in that it can be accessed and can push/pull data within and between multiple vehicles/habitats. Large amounts and variable sources of data can be leveraged to diagnose, inform treatment strategies, and potentially predict medical events and performance decrements. Inclusion of advanced training tools using extended reality will enable increasingly autonomous medical care to aid a CMO when ground support is unavailable or time-delayed beyond required action window, e.g., emergent medical situations. EIMO CDSS would require very large datasets to train pre-flight and significant amounts of data are needed to support ML via in-flight CDSS operations. An additional challenge will be to find sufficient data to train a model relevant to astronaut demographics. The rapid, accelerating evolution of this field creates a propitious solution space to leverage multi-modal AI through public-private partnership(s). The status of multi-modal AI systems today would preclude their use for long duration missions as they remain unreliable and are subject to “digital hallucinations” and other errors that could pose operational risk. A federated labs structure is being considered to test and optimize data flow from the multiple input vectors leading to field testing in suitable ground/flight analogs. Critical to the success of an EIMO CDSS will be integration and interoperability and success will be defined by a system that can serve as an in-flight medical consult for the CMO providing critical support during medical contingencies. Benefits to terrestrial medicine may be significant as an outflow of the EIMO medical system, particularly for remote areas and communities lacking significant infrastructure, personnel and resources.

Medical Operations↗

NASA NTRSDate not supplied

An Open-Science Approach to Address Individual Response to Simulated GCR In Genetically Diverse Populations of Mice and Humans

This project addresses the challenge of understanding and predicting individual radiation sensitivity by integrating genetics, demographics and biomarker characteristics across species (mice and humans). We hypothesize that ex vivo DNA repair response to GCR components is a central determinant of cancer risk from space radiation and can serve as a biomarker of radiation risk in combination with genetics. Automated image quantification of 53BP1+ radiation-induced foci (RIF) during the first 4-48 h post-irradiation was performed as a function of dose and LET in non-immortalized primary skin fibroblasts derived from 76 mice across 15 strains (5 inbred reference strains and 10 collaborative-cross strains) exposed to X rays (0.1, 1 and 4 Gy), 350 MeV/n 40Ar and 600 MeV/n 56Fe (1.1 and 3 particles/100sq. μm), as well as in peripheral blood mononuclear cells (PBMCs) from 768 healthy donors (matched ethnicity, 50/50 male/female, 18-70 years old) exposed to gamma rays (0.1 and 1 Gy), 350 MeV/n 28Si, 350 MeV/n 40Ar and 600 MeV/n 56Fe (1.1 and 3 particles/100sq. μm). A genome-wide association study (GWAS) was performed on the mouse strains between DNA damage responses to space radiation and single nucleotide polymorphisms (SNPs). We found SNPs, which were significantly associated to the RIF phenotype, mapped to genes and pathways that are functionally linked to health hazards for deep space exploration (e.g. carcinogenesis, nervous system damage and immune dysfunction). Some of these SNPs were located within protein coding regions, potentially interfering with protein functions and providing promising genetic targets for countermeasures. We also found correlations between both spontaneous and radiation-induced DNA damage and SNPs mapped to pathways associated with cellular metabolism. GWAS is undergoing for the human data. All data have been made available via the NASA Space Biology Open-Science database (genelab.nasa.gov) and we will discuss how various genomic and transcriptomic datasets can be accessed for modeling and integrated using machine learning methods for discovering new radiation biology.

Sylvain V Costes↗

NASA NTRSDate not supplied

Artificial Neural Networks to Predict Cognitive Impairment of Rodents Subjected to Space Radiation

INTRODUCTION We use artificial neural networks (ANNs) as an example machine learning (ML) tool to predict the cognitive performance impairment of rats induced by irradiation. The experimental data in the analyses is attentional set-shifting (ATSET) test scores from a rodent model exposed to ≤15 cGy of individual galactic cosmic radiation (GCR) ions: 4He, 28Si, or 56Fe, expected for a Lunar or Mars mission [1]. This work investigates rats at a subject-based level and uses applied dose and performance scores taken before irradiation to predict whether a rat will be impaired when irradiated. The results of this study are significant to crewed space missions as they support the potential of predicting an astronaut’s impairment in a specific task before spaceflight through the implementation of appropriately trained ML tools. METHODS Data used in this work are scores from the ATSET, a multi-stage constrained cognitive flexibility test [2]. Our computational model utilizes the number of attempts to reach the criterion to pass a stage as a behavioral performance measure for rats. We use the post-irradiation scores, generate thresholds from cumulative distribution plots of non-irradiated rats, and calculate the percent of irradiated rats whose scores fall below the threshold to infer how each radiation type/dose affects a population. Rats scoring above the threshold are labeled impaired while the others are non-impaired. We then employ ANNs as a typical ML technique, and use each subject’s individual scores taken before radiation along with the applied dose, to predict their personal susceptibility to cognitive impairment due to space radiation exposure. RESULTS AND CONCLUSION A significant finding is the exhibition of a dose-dependent increasing probability of impairment for 1 to 10 cGy of 28Si or 56Fe in the simple discrimination (SD) stage of the ATSET, and for 1 to 10 cGy of 56Fe in the compound discrimination (CD) stage. On a subject-based level, implementing ML classifiers such as ANNs identifies rats that have a higher tendency for impairment after GCR exposure [1]. The receiver operating characteristic (ROC) and the precision-recall (PR) curves of the ML models show a better prediction of impairment when 56Fe is the ion in question in both SD (Figure 1) and CD stages. They, however, do not depict impairment due to 4He in SD (Figure 1) and 28Si in CD, suggesting no dose-dependent impairment response in these cases. In this work, “good” prediction pertains to “better-than-random-chance”, due to the limited sample size and the high inter- and intra-individual variabilities in response to brain stimulation paradigms, as applicable to both animals and humans. More behavioral tests and biomarkers should be investigated on the same subjects, to be fed to the ML models to capture the agents responsible for performance alterations of some individuals versus others.

machine learning↗

NASA NTRSDate not supplied

Machine Learning Models to Predict Cognitive Impairment of Rodents Subjected to Space Radiation

INTRODUCTION We use artificial neural networks (ANNs) as an example machine learning (ML) tool to predict the cognitive performance impairment of rats induced by irradiation. The experimental data in the analyses is attentional set-shifting (ATSET) test scores from a rodent model exposed to ≤15 cGy of individual galactic cosmic radiation (GCR) ions: 4He, 28Si, or 56Fe, expected for a Lunar or Mars mission [1]. This work investigates rats at a subject-based level and uses applied dose and performance scores taken before irradiation to predict whether a rat will be impaired when irradiated. The results of this study are significant to crewed space missions as they support the potential of predicting an astronaut’s impairment in a specific task before spaceflight through the implementation of appropriately trained ML tools. METHODS Data used in this work are scores from the ATSET, a multi-stage constrained cognitive flexibility test [2]. Our computational model utilizes the number of attempts to reach the criterion to pass a stage as a behavioral performance measure for rats. We use the post-irradiation scores, generate thresholds from cumulative distribution plots of non-irradiated rats, and calculate the percent of irradiated rats whose scores fall below the threshold to infer how each radiation type/dose affects a population. Rats scoring above the threshold are labeled impaired while the others are non-impaired. We then employ ANNs as a typical ML technique, and use each subject’s individual scores taken before radiation along with the applied dose, to predict their personal susceptibility to cognitive impairment due to space radiation exposure. RESULTS AND CONCLUSION A significant finding is the exhibition of a dose-dependent increasing probability of impairment for 1 to 10 cGy of 28Si or 56Fe in the simple discrimination (SD) stage of the ATSET, and for 1 to 10 cGy of 56Fe in the compound discrimination (CD) stage. On a subject-based level, implementing ML classifiers such as ANNs identifies rats that have a higher tendency for impairment after GCR exposure [1]. The receiver operating characteristic (ROC) and the precision-recall (PR) curves of the ML models show a better prediction of impairment when 56Fe is the ion in question in both SD (Figure 1) and CD stages. They, however, do not depict impairment due to 4He in SD (Figure 1) and 28Si in CD, suggesting no dose-dependent impairment response in these cases. In this work, “good” prediction pertains to “better-than-random-chance”, due to the limited sample size and the high inter- and intra-individual variabilities in response to brain stimulation paradigms, as applicable to both animals and humans. More behavioral tests and biomarkers should be investigated on the same subjects, to be fed to the ML models to capture the agents responsible for performance alterations of some individuals versus others.

machine learning↗

NASA NTRSDate not supplied

Generation of Land Surface Reflectance with Combined Geo-KOMPSAT-2A AMI and Himawari 8 AHI Observations

The latest generation of geostationary satellites has opened a new era of Earth observations with unprecedented spatiotemporal resolution and spectral range. Together with GOES 16/17 ABI, FY4-A AGRI, and Himawari-8 AHI, a new Korean geostationary satellite (Geo-KOMPSAT-2A AMI) has operationally collected a full-disk image in 16 channels every ten minutes since July 2019, allowing diurnal land surface monitoring over a large proportion of Asia and all of Oceania. Retrieving accurate surface reflectance (SR) over land from GK-2A/AMI is a challenging but high priority objective. One of the challenges is the absence of a spectral band in the 2.2 m SWIR range from AMI, which is required by many atmospheric correction algorithms to retrieve atmospheric aerosol properties. To remedy this issue, we adopt a strategy that combines concurrent GK-2A/AMI and Himawari 8/AHI observations in order to derive AMI SR. We have adapted the NASA Multi-Angle Implementation of Atmospheric Correction (MAIAC) algorithm to process the data stream from Himawari 8/AHI. The advantages of the MAIAC algorithm is its capability to exploit the high temporal frequency and varying illumination geometry of the geostationary data for advanced cloud/snow detection, aerosol retrieval, and characterization of surface bidirectional reflectance properties. Leveraging the similarities of spectral bands and the sun-target-sensor geometry between AMI and AHI, we are able to create denser time series of observations and enhanced BRDF samples over most of the spatial coverage of AMI (and AHI). The combined stereo-type observations not only help derive SR for AMI but also enhance retrievals of the corresponding AHI surface products. We evaluate the resulting AMI SR using ground (AERONET) observations and corresponding MODIS products. Further, we discuss potential challenges in utilizing the geostationary satellite data for land surface monitoring.

geostationary satellite↗

NASA NTRSDate not supplied

Convolutional Autoencoder for Defect Detection in Additive Manufacturing

The core idea behind using machine learning (ML) for defect detection is that it can be used to detect flaws as they are being formed in an AM part. As the part is being made, a near-infrared (NIR) sensor records each layer and creates an image of the entire build layer. These images, usually thousands, can be compiled into a ‘3D’ array of the entire part. ML tools, such as a convolutional autoencoder (CAE) can go through these images and highlight potential anomalous regions of your part.

In-Situ Monitoring↗

NASA NTRSDate not supplied

SWIPE: Spectral Water Inversion Processor and Emulator

Degradation of Earth’s inland water resources due to anthropogenic perturbations and climate anomalies at both local and global scales continues to place human health at substantial risk. There is now a growing necessity to develop pragmatic approaches that allow timely and effective extrapolation of local processes, to spatially resolved global products, and to promote operational and sustainable resource policy management. This presentation will be discussing the progress made developing SWIPE: Spectral Water Inversion Processor and Emulator. SWIPE is a platform for advanced modeling of coastal and inland aquatic habitats. The goal is create a comprehensive and cohesive system to leverage recent advancements in computation and machine learning to develop a synthetic training ground for sensitivity studies and algorithm development. The four principal facets of SWIPE include: 1. Advanced two-layer coated sphere bio-optical modeling and GPU radiative transfer modeling, 2. Big Data involving massive synthetic spectral libraries of optical properties of various global aquatic particles, surface reflectance, and top-of-atmosphere reflectance, all at hyperspectral resolution leveraging high-end computing systems at NASA Ames Research Center, 3. Deep Learning for algorithm development for water quality inversion of concentrations of common biogeophysical variables as well as optics, full uncertainty characterization by water type, and forward emulation, and lastly, 4. Image Processing for application of developed retrieval algorithms for both hyperspectral and multispectral sensors with experimental corrections for global adjacency, noise, sunglint, and benthic reflectance. This presentation will demonstrate the Equivalent Algal Populations (EAP) two-layer coated sphere scattering model which has been used develop spectral libraries of hyperspectral inherent optical properties of roughly 80 species of phytoplankton, covering 15 different classes and nine taxonomic functional types. The EAP model was also used to derive spectral properties of 10 different non-algal particle functional types. Examples of how the SMART-G (Speed-up Monte-carlo Advanced Radiative Transfer using GPU) radiative transfer code is used to model optically complex aquatic signals will be presented and discussed in the context of creating a massive synthetic database which can leverage the full power of next generation machine learning techniques and high end computing for water quality inversion. We will discuss our active investigation in things like appropriate model architectures, dimensionality reduction techniques such as PCA and autoencoders, uncertainty quantification and abstaining, and which variables actually benefit most from hyperspectral information versus multispectral resolution. We are also curious about questions relating to cost/benefit analysis in terms of computation resources, neural network complexity, and data volumes. Answers to these questions will hopefully elaborate on cost efficiency for potential future sensor design considerations.

SWIPE↗

NASA NTRS2020

Flood Mapping Using UAVSAR and Convolutional Neural Networks

We have mapped flooded areas in data collected by the NASA/JPL Uninhabited Aerial Vehicle Synthetic Aperture Radar (UAVSAR) using two convolutional neural network (CNN) image classifier architectures: U-Net and SegNet. Our study area was a region around Houston, TX, USA affected by widespread flooding in 2017 due to Hurricane Harvey. To train and test the classifiers, we manually labelled over 10000 image segments in two flight lines. Both U-Net and SegNet yielded higher accuracy than a previous non-machine learning classifier we used as a baseline. U-Net had slightly higher accuracy than SegNet. The classifiers performed better in areas with more homogeneous land cover. To independently validate the classifier accuracy we used NOAA aerial imagery, with overall accuracy around 80%. Future work includes assessing the classifier robustness in other study areas, assessing the classifier dependence on UAVSAR incidence angle, particularly for open water and bare ground, and collecting more training data, particularly in urban areas. This study demonstrates the potential of CNN image classifiers for mapping flooded areas in airborne polarimetric SAR imagery, and for land cover classification of polarimetric SAR imagery more generally.

Denbina, Michael W↗

NASA NTRSDate not supplied

A Science-Focused Artificial Intelligence (AI) Responding in Real-Time to New Information: Capability Demonstration for Ocean World Missions

Introduction: Artificial intelligence (AI) has long been considered a potential mechanism to explore increasingly challenging environments, including those with extreme temperatures and pressures, limited communication capabilities, or those with demanding terrain. We posit that missions in extreme environments could deploy an onboard AI focused on science observations and goals in order to augment a traditional concept(s) of operations (ConOps). An onboard AI capability could perform functions such as data analysis in order to make high-level decisions, including prioritized data transmission for analysis by ground-based teams or autonomously-guided follow-on analyses that maximize science return. Such a capability would empower missions to respond to scientific data of interest in real-time; a mission could make observations and perform a preliminary analysis to alert ground-based scientists to an observation of interest, enabling an informed, rapid response from Earth-based teams. Enceladus Case Study for Onboard AI: We are developing an onboard AI capability for real-time telemetry response that formulates and carries-out informed decisions in service to established mission goals, enabling increased science return of a mission. We focus our AI development for use on a constellation of SmallSats orbiting Enceladus. Our Enceladus case study tests autonomous decision-making capabilities in scenarios with complex orbital dynamics, plume ejecta, extreme cold environments, power restrictions, and a requirement to maximize science return for a potential positive detection of life, while critically evaluating the potential for false positives. Telemetry includes simulated scientific data, spacecraft onboard operational data (e.g., position, velocity, and rotation), and engineering hardware performance data. Enceladus SmallSat Constellation. Our constellation includes eight SmallSat spacecraft in an 8:35 resonant orbit-based formation, leveraging Saturn’s gravitational forces to maintain stable orbits with global coverage around Enceladus. To our knowledge, we simulate the first stable configuration of multiple spacecraft in closed orbits around Enceladus, using a full ephemeris force model (Russell and Lara, 2009). Each spacecraft’s orbit will precess, causing an eastward ground track shift (from an orbiter’s perspective) of each spacecraft for each orbit. However, all spacecraft return to their original positions relative to Enceladus after eight Enceladus revolutions around Saturn. We model communication pathways between SmallSats to understand how information would need to be transmitted across the constellation to enable AI-driven decision-making and resource allocation across the fleet. Capability Demonstration. Our simulated capability demonstration inputs position, velocity, and rotation telemetry from our Enceladus-focused constellation simulations, and mass spectrometry data collected from abiotic and biotic laboratory-analog ocean world experiments (Theiling et al., 2018; Theiling, 2021; Da Poian et al., 2023). Data from these experiments are used to simulate MS measurements and different scenarios of science observations for onboard analysis performed on each of the eight spacecraft. For these demonstrations, we integrate 24 machine learning (ML) algorithms into an onboard intelligence as a ‘knowledge base’, including algorithms evaluating data quality and those predicting (with % confidence) gas composition, ocean aqueous chemistry, and whether the sample was influenced by microbial life. The onboard AI capability is designed to use the knowledge base to come to a consensus-based decision in the interpretation of the observed data in order to request additional action outside of a pre-defined ConOps. Requested actions could include e.g., prioritized downlink to Earth (for analysis by ground-based teams) or follow-on analyses performed across the constellation. The spacecraft’s intelligent onboard planner must then determine whether sufficient resources (e.g., time, power, etc.) are available and weigh the request with mission priorities. In our simulation, the constellation is able to identify potential biosignatures using onboard ML algorithms, evaluate the confidence of that prediction, and perform follow-on analyses across the fleet to confirm the detection, in order to best prepare a transmission of these data to Earth-based teams.

astrobiology↗

NASA NTRSDate not supplied

Celestial Mapping System and Digital Lunar Library Initiative

We are preparing to create an interactive, global 3D lunar environment with integrated dataset and AI/ML tools to provide unique value to mission planners, scientists and the entire lunar community. This lunar environment will be based on NASA Ames Celestial Mapping System (CMS) [1] and Digital Lunar Library (DLL) Initiative. CMS provides a 3D virtual Lunar Globe with extensive user friendly tool sets, that include high resolution terrain visualization, elevation profiles, measurement kits, slope analysis, path optimization, line of sight analysis, equipment planning and placement tools and many other functionalities [1]. It has a thick client with less overhead to access hardware resources. This allows features such as terrain profiling and distance calculations to be performed on the client and on the fly. The application is developed to provide situational and domain awareness on the Lunar surface, planning capabilities for equipment placements and traverse path optimization. As data becomes available, CMS has the capabilities to integrate data sets that change dynamically in real-time, which will be useful for monitoring satellites and remotely-sensed data on the Lunar surface. CMS supports importing synthetic features in a variety of 3D, 2D, vector and raster formats. In the future, these capabilities will be enhanced by incorporating AI/ML tools and a plug-in architecture to enable customization by the user groups. With the help of DLL we will be able to : 1) Amplify the value of lunar information with AI-powered data enhancements 2) Acquire and integrate lunar data with AI-assisted georectification and homogenization 3) Analyze lunar data with advanced 3D visualization, intelligent search-by-example 4) Apply lunar data insights to specific use cases with an open plug-in architecture. The CMS-DLL initiative will have several potential use cases for NASA and the lunar community in general, including subsurface lava tube visualization and analysis, soil analysis, in-situ lunar resource visualization and representation on 3D globe, and data analytics for utilization. REFERENCES: [1] https://celestial.arc.nasa.gov/

3D Globe↗

NASA NTRS2023

EVA Task and 3D Pose Recognition from Video

Extravehicular Activity (EVA) has been known to involve potential risks of biomechanical stresses and injuries to crewmembers. Gathering of EVA motion patterns is necessary for risk analysis and mitigation. However, many existing techniques, such as motion capture systems, are not only cost-prohibitive but are impractical for retrospective analysis of past missions. In this work, a software tool was developed, which can estimate the 3D poses of a spacesuit from photographs or videos, without using special sensors or equipment. The tool is based on the state-of-the-art artificial intelligence and machine learning (AI/ML) system, which was trained by studying and capturing motion patterns of past and current spacesuit test data. The AI/ML tool was further enhanced using synthetically generated data, in which the suit postures, backgrounds, camera angles and illumination conditions were parametrically adjusted and rendered for training. The tool, incorporated the methodologies of Convolutional Neural Network (CNN), was trained, and tested in the cloud computing environment. The trained model was then applied on new imagery and video to extract estimated joint positions and suit outlines. The joint positions were further processed to capture activity (“digging”), pose labels (“bending”), and other useful downstream information. The model performance on new imagery and video was successfully assessed for accuracy and reliability. This AI/ML based posture recognition tool thus allows for the quantification of injury risk and task performance characterization for both current and past missions and training, which can immensely help to improve EVA task and suit design.

Kyung Han Kim↗