SEARCH · Search NASA

Results for “interpretable AI”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

All sources NASA NTRS DOE OSTI

NASA NTRS2018

Metrology-based Techniques for Optical System Alignment for the OSIRIS-Rx Visual and InfraRed Spectrometer

The alignment, integration, and test group (AI&T) in the optics branch at NASA Goddard Space Flight Center (GSFC) specializes in optical and opto-mechanical alignment and metrology for project ranging from building and testing instrument such as spectrometers and cameras to larger structures such as telescopes to large volume metrology and alignment at the observatory level for spacecraft payloads. One of the projects that involved the support of the AI&T group was the OSIRIS-Rex Visual and Infra-Red Spectrometer (OVIRS) for the Origins-Spectral Interpretation-Resource Identification-Security-Regolith Explorer (OSIRIS-Rex) mission. The purpose of this report is to outline the tools, methods, and approaches to metrology utilized by the AI&T group and how they were applied specifically to the optical alignment of the elements on OVIRS during the ambient I&T phase.

Young, Jerrod↗

NASA NTRS2025

Limitations and Feasibility of Mini X-Ray Devices in Space Environments

LIMITATIONS AND FEASIBILITY OF MINI X-RAY DEVICES IN SPACE ENVIRONMENTS As space exploration advances toward long-duration missions, reliable medical diagnostic tools become increasingly critical. The miniature x-ray (XR) technology demonstrations by the Exploration Medical Capability (ExMC) and the Exploration Medical Integrated Product Team (XMIPT) aim to assess the feasibility and utility of miniature XR devices in spaceflight. This abstract explores the limitations of current miniature XR systems, the challenges of training crew members, the potential role of clinical decision support systems (CDSS), and the feasibility of ground-based image interpretation. We also propose the integration of miniature XR into other ExMC efforts aimed at identifying the capabilities and resources needed for future exploration class missions. One of the primary challenges with miniature XR devices is the ability to achieve specific anatomical views, particularly in the confined and weightless conditions of a spacecraft. Operators may struggle to acquire diagnostic-quality images when space is limited for proper patient positioning and the volume of the imaging device. Since space radiation and detector limitations may further impact image quality, the flexibility of the operating procedures of these devices will be critical for their success in space applications. CHALLENGES IN TRAINING CREW TO OPERATE IMAGING DEVICES Training in the skills necessary to acquire diagnostic-quality scans may be a barrier for non-clinician crewmembers. The curriculum developed for crew medical officers (CMOs) will require simplification and adaptation to fit into the highly truncated pre-flight training period. Therefore, hands-on familiarization and simulation, both pre-flight and just-in-time training during missions, will be crucial to ensuring the crew can operate the devices in real-life situations. The ability to adjust acquisition parameters must be simplified or made automatic through exam selections on equipment user interfaces, and subject and operator positioning should be assisted with laser guidance and pictorial guides. POTENTIAL FOR CDSS OR ARTIFICIAL INTELLIGENCE (AI)-ASSISTED CDSS CDSS and AI-assisted CDSS offer significant promise in assisting crew members with limited medical training. These systems could provide real-time feedback on image quality and interpretation, helping to mitigate the risks of human error during space missions. Integrating procedural guidance tools, such as virtual and augmented reality, will support crewmembers in accurately positioning patients and obtaining high-quality images. However, the success of such systems will depend on the development of robust training datasets, integration with spaceflight-rated hardware, and the medical decision-making capabilities of operators. FEASIBILITY OF GROUND INTERPRETATION AND DATA TRANSMISSION Reliance on ground-based interpretation may prove difficult for acute care during exploration class-missions due to delays in transmission with increasing distance from Earth or complete communication blackout periods. In such instances where immediate interpretation for clinical intervention is required, crew must be able to interpret the images independently or utilize AI-based assistance to do so. File sizes for XR exams can also be large if numerous images are acquired and bandwidth constraints may limit data transmissions for both radiography and ultrasound exams. FUTURE WORK AND INTEGRATION INTO THE EVIDENCE LIBRARY Future work proposes integrating miniature XR devices into NASA’s Evidence Library to address medical conditions identified as significant contributors to crew morbidity and mortality. The possibility of combining miniature XR with other imaging modalities, such as ultrasound devices, is also under investigation. In conclusion, while miniature XR technology holds potential for extraterrestrial medical systems, there are significant challenges to overcome. Training, integration of AI tools, dedicated exam protocols for microgravity, and improved data transmission systems will be key to realizing the full benefits of miniature XR technology in space.

A M Nelson↗

NASA NTRS2018

Space Technology - Game Changing Development NASA Facts: Autonomous Medical Operations

The AMO (Autonomous Medical Operations) Project is working extensively to train medical models on the reliability and confidence of computer-aided interpretation of ultrasound images in various clinical settings, and of various anatomical structures. AI (Artificial Intelligence) algorithms recognize and classify features in the ultrasound images, and these are compared to those features that clinicians use to diagnose diseases. The acquisition of clinically validated image assessment and the use of the AI algorithms constitutes fundamental baseline for a Medical Decision Support System that will advise crew on long-duration, remote missions.

Autonomous Medical Operations Project↗

NASA NTRS1985

Application of AIS Technology to Forest Mapping

Concerns about environmental effects of large scale deforestation have prompted efforts to map forests over large areas using various remote sensing data and image processing techniques. Basic research on the spectral characteristics of forest vegetation are required to form a basis for development of new techniques, and for image interpretation. Examination of LANDSAT data and image processing algorithms over a portion of boreal forest have demonstrated the complexity of relations between the various expressions of forest canopies, environmental variability, and the relative capacities of different image processing algorithms to achieve high classification accuracies under these conditions. Airborne Imaging Spectrometer (AIS) data may in part provide the means to interpret the responses of standard data and techniques to the vegetation based on its relatively high spectral resolution.

Yool, S. R.↗

NASA NTRSDate not supplied

Designing and Evaluating NASA SPoRT Center’s DustTracker-AI Model for Detecting Dust in NASA/NOAA Geostationary Satellite Imagery

- Near real-time identification of airborne dust in satellite imagery is important for mitigating the adverse effects of dust storms on human activities. - False color Red-Green-Blue (RGB) imagery has been used for dust detection, but it has limitations and can be difficult to interpret. - The NASA Short-term Research and Transition (SPoRT) center has developed a night-time dust detection random forest (NT-DustTracker-AI, Berndt et al. 2021) model using NASA/NOAA Geostationary Operational Environmental Satellite-16 (GOES-16) Advanced Baseline Imager (ABI) infrared imagery as inputs. - The SPoRT center has partnered with the NOAA National Weather Service to evaluate the model for use in weather forecasting operations, and preliminary results have been positive. - The SPoRT center has expanded the model to cover both day and night, continuing to use infrared imagery as inputs. This new model, known as DustTracker-AI, has shown good agreement with available dust observations

Robert A. Junod↗

NASA NTRS1985

Preliminary evaluation of the airborne imaging spectrometer for vegetation analysis in the Klamath National Forest of northeastern California

The experiences and results associated with a project entitled Preliminary Evaluation of the Airborne Imaging Spectrometer for Vegetation Analysis is documented. The primary goal of the project was to provide ground truth, manual interpretation, and computer processing of data from an experimental flight of the Airborne Infrared Spectrometer (AIS) to determine the extent to which high spectral resolution remote sensing could differentiate among plant species, and especially species of conifers, for a naturally vegetated test site. Through the course of the research, JPL acquired AIS imagery of the test areas in the Klamath National Forest, northeastern California, on two overflights of both the Dock Well and Grass Lake transects. Over the next year or so, three generations of data was also received: first overflight, second overflight, and reprocessed second overflight. Two field visits were made: one trip immediately following the first overflight to note snow conditions and temporally-related vegetation states at the time of the sensor overpass; and a second trip about six weeks later, following acquisition of prints of the images from the first AIS overpass.

Strahler, A. H.↗

NASA NTRS1994

Thunderstorm Hypothesis Reasoner

THOR is a knowledge-based system which incorporates techniques from signal processing, pattern recognition, and artificial intelligence (AI) in order to determine the boundary of small thunderstorms which develop and dissipate over the area encompassed by KSC and the Cape Canaveral Air Force Station. THOR interprets electric field mill data (derived from a network of electric field mills) by using heuristics and algorithms about thunderstorms that have been obtained from several domain specialists. THOR generates two forms of output: contour plots which visually describe the electric field activity over the network and a verbal interpretation of the activity. THOR uses signal processing and pattern recognition to detect signatures associated with noise or thunderstorm behavior in a near real time fashion from over 31 electrical field mills. THOR's AI component generates hypotheses identifying areas which are under a threat from storm activity, such as lightning. THOR runs on a VAX/VMS at the Kennedy Space Center. Its software is a coupling of C and FORTRAN programs, several signal processing packages, and an expert system development shell.

Mulvehill, Alice M.↗

NASA NTRSDate not supplied

A Science-Focused Artificial Intelligence (AI) Responding in Real-Time to New Information: Capability Demonstration for Ocean World Missions

Introduction: Artificial intelligence (AI) has long been considered a potential mechanism to explore increasingly challenging environments, including those with extreme temperatures and pressures, limited communication capabilities, or those with demanding terrain. We posit that missions in extreme environments could deploy an onboard AI focused on science observations and goals in order to augment a traditional concept(s) of operations (ConOps). An onboard AI capability could perform functions such as data analysis in order to make high-level decisions, including prioritized data transmission for analysis by ground-based teams or autonomously-guided follow-on analyses that maximize science return. Such a capability would empower missions to respond to scientific data of interest in real-time; a mission could make observations and perform a preliminary analysis to alert ground-based scientists to an observation of interest, enabling an informed, rapid response from Earth-based teams. Enceladus Case Study for Onboard AI: We are developing an onboard AI capability for real-time telemetry response that formulates and carries-out informed decisions in service to established mission goals, enabling increased science return of a mission. We focus our AI development for use on a constellation of SmallSats orbiting Enceladus. Our Enceladus case study tests autonomous decision-making capabilities in scenarios with complex orbital dynamics, plume ejecta, extreme cold environments, power restrictions, and a requirement to maximize science return for a potential positive detection of life, while critically evaluating the potential for false positives. Telemetry includes simulated scientific data, spacecraft onboard operational data (e.g., position, velocity, and rotation), and engineering hardware performance data. Enceladus SmallSat Constellation. Our constellation includes eight SmallSat spacecraft in an 8:35 resonant orbit-based formation, leveraging Saturn’s gravitational forces to maintain stable orbits with global coverage around Enceladus. To our knowledge, we simulate the first stable configuration of multiple spacecraft in closed orbits around Enceladus, using a full ephemeris force model (Russell and Lara, 2009). Each spacecraft’s orbit will precess, causing an eastward ground track shift (from an orbiter’s perspective) of each spacecraft for each orbit. However, all spacecraft return to their original positions relative to Enceladus after eight Enceladus revolutions around Saturn. We model communication pathways between SmallSats to understand how information would need to be transmitted across the constellation to enable AI-driven decision-making and resource allocation across the fleet. Capability Demonstration. Our simulated capability demonstration inputs position, velocity, and rotation telemetry from our Enceladus-focused constellation simulations, and mass spectrometry data collected from abiotic and biotic laboratory-analog ocean world experiments (Theiling et al., 2018; Theiling, 2021; Da Poian et al., 2023). Data from these experiments are used to simulate MS measurements and different scenarios of science observations for onboard analysis performed on each of the eight spacecraft. For these demonstrations, we integrate 24 machine learning (ML) algorithms into an onboard intelligence as a ‘knowledge base’, including algorithms evaluating data quality and those predicting (with % confidence) gas composition, ocean aqueous chemistry, and whether the sample was influenced by microbial life. The onboard AI capability is designed to use the knowledge base to come to a consensus-based decision in the interpretation of the observed data in order to request additional action outside of a pre-defined ConOps. Requested actions could include e.g., prioritized downlink to Earth (for analysis by ground-based teams) or follow-on analyses performed across the constellation. The spacecraft’s intelligent onboard planner must then determine whether sufficient resources (e.g., time, power, etc.) are available and weigh the request with mission priorities. In our simulation, the constellation is able to identify potential biosignatures using onboard ML algorithms, evaluate the confidence of that prediction, and perform follow-on analyses across the fleet to confirm the detection, in order to best prepare a transmission of these data to Earth-based teams.

astrobiology↗

NASA NTRSDate not supplied

Multispectral Imagery Research and Applications

The NASA Short-term Prediction Research and Transition (SPoRT) Center developed techniques to improve the quality and interpretation of multispectral imagery derived from NASA/NOAA geostationary satellites using statistical and machine learning approaches. A physically-based machine learning approach, DustTracker-AI, was developed to overcome the problem of night-time dust detection and to augment dust analysis with satellite products such as the Dust RGB. Additionally, an updated limb-correction and intercalibration methodology for short-wave, near-infrared, thermal infrared, and water vapor bands was developed for the purpose of developing a suite of high-quality RGB imagery that can be used at high viewing angles and across the constellation of geostationary sensors. This presentation will briefly highlight the techniques developed to detect dust in difficult night-time scenes and improve the quality and interpretation of multispectral imagery.

Emily Berndt↗

NASA NTRS1988

A knowledge-based object recognition system for applications in the space station

A knowledge-based three-dimensional (3D) object recognition system is being developed. The system uses primitive-based hierarchical relational and structural matching for the recognition of 3D objects in the two-dimensional (2D) image for interpretation of the 3D scene. At present, the pre-processing, low-level preliminary segmentation, rule-based segmentation, and the feature extraction are completed. The data structure of the primitive viewing knowledge-base (PVKB) is also completed. Algorithms and programs based on attribute-trees matching for decomposing the segmented data into valid primitives were developed. The frame-based structural and relational descriptions of some objects were created and stored in a knowledge-base. This knowledge-base of the frame-based descriptions were developed on the MICROVAX-AI microcomputer in LISP environment. The simulated 3D scene of simple non-overlapping objects as well as real camera data of images of 3D objects of low-complexity have been successfully interpreted.

Dhawan, Atam P.↗

NASA NTRS2011

Investigation of the Crust of the Pannonian Basin, Hungary Using Low-Altitude CHAMP Horizontal Gradient Magnetic Anomalies

The Pannonian Basin is a deep intra-continental basin that formed as part of the Alpine orogeny. It is some 600 by 500 km in area and centered on Hungary. This area was chosen since it has one of the thinnest continental crusts in Europe and is the region of complex tectonic structures. In order to study the nature of the crustal basement we used the long-wavelength magnetic anomalies acquired by the CHAMP satellite. The SWARM constellation, scheduled to be launched next year, will have two lower altitude satellites flying abreast, with a separation of between ca. 150 to 200 km. to record the horizontal magnetic gradient. Since the CHAMP satellite has been in orbit for eight years and has obtained an extensive range of data, both vertically and horizontally there is a large enough data base to compute the horizontal magnetic gradients over the Pannonian Basin region using these many CHAMP orbits. We recomputed a satellite magnetic anomaly map, using the spherical-cap method of Haines (1985), the technique of Alsdorf et al. (1994) and from spherical harmonic coefficients of MF6 (Maus et aI., 2008) employing the latest and lowest altitude CHAMP data. We then computed the horizontal magnetic anomaly gradients (Kis and Puszta, 2006) in order to determine how these component data will improve our interpretation and to preview what the SW ARM mission will reveal with reference to the horizontal gradient anomalies. The gradient amplitude of an 1000 km northeast-southwest profile through our horizontal component anomaly map varied from 0 to 0.025 nT/km with twin positive anomalies (0.025 and 0.023 nT/km) separated by a sharp anomaly negative at o nT/km. Horizontal gradient indicate major magnetization boundaries in the crust (Dole and Jordan, 1978 and Cordell and Grauch, 1985). Our gradient anomaly was modeled with a twodimensional body and the anomaly, of some 200 km, correlates with a 200 km area of crustal thinning in the southwestern Pannonian Basin.

Taylor, Patrick T.↗

NASA NTRS2019

Deep Learning Method for Detecting Precursors to Adverse Events

With the recent advancements in Deep Learning methods, the ability to model large complex heterogeneous data sets are fundamentally changing industry and research. Coupled with hardware improvements, and ease of implementation, a wide variety of deep neural network architectures can quickly be developed to solve a sweeping range of problems such as: object detection in images, automatic healthcare diagnosis using heterogenous data sources, real time language translating and sentence prediction, upscaling low resolution images, and forecasting of multivariate timeseries. Generally, many of these architectures outperform classical machine learning approaches in their respective tasks, however, this typically comes at a cost of interpretability. These black box algorithms generally suffer from lack of transparency in both model complexity as well as the rationale behind the prediction. This lack of comprehension, is driving an emerging area of interest in “Explainable AI”. An algorithm called: “Deep Temporal Multiple Instance Learning”1 was a recently developed to identify precursors to adverse events and has been applied in the aviation domain. The deep learning architecture is designed to capture the evolution of the probability of the outcome over the time preceding the adverse event using a multiple instance learning approach as illustrated in Figure 1. Precursors are defined when the probability of the event has exceeded a threshold at some point in the timeseries, at which point, a sensitivity analysis is performed to determine contributing factors. The contributing factors are used to explain and define the precursor during the periods where the probability score is high. The identified contributing factors are then presented to subject matter experts to provide objective insights into the leading factors associated with the particular adverse event. The algorithm has been tested on flight data from a commercial airline and has the ability to discover precursors to known adverse events that take the form of safety critical operations, such as unstable approach events on final approach. Apart from detecting precursors to adverse events, the converse can also be leveraged to discover corrective actions. These positive actions manifest themselves as periods in the timeseries when the precursor score has been lowered from an elevated state; meaning that if the system had been left uncorrected, it would have eventually reached the adverse event state. Characterizing these state changes can help identify successful interventions that may not have been known before. Policy makers and procedure designers can use this additional knowledge to craft more safety and efficient resilient procedures for future operations and therefore improve the overall performance of the National Airspace.

Matthews, Bryan L.↗

NASA NTRS1987

Task-level robot programming: Integral part of evolution from teleoperation to autonomy

An explanation is presented of task-level robot programming and of how it differs from the usual interpretation of task planning for robotics. Most importantly, it is argued that the physical and mathematical basis of task-level robot programming provides inherently greater reliability than efforts to apply better known concepts from artificial intelligence (AI) to autonomous robotics. Finally, an architecture is presented that allows the integration of task-level robot programming within an evolutionary, redundant, and multi-modal framework that spans teleoperation to autonomy.

Reynolds, James C.↗

NASA NTRS2002

Experiments and Spectral Studies of Martian Volcanic Rocks: Implications for the Origin of Pathfinder Rocks and Soils

The composition and spectral properties of the Mars Pathfinder rocks and soils together with the identification of basaltic and andesitic Mars terrains based on Thermal Emission Spectrometer (TES) data raised interesting questions regarding the nature and origin of Mars surface rocks. We have investigated the following questions: (1) are the Pathfinder rocks igneous and is it possible these rocks could have formed by known igneous processes, such as equilibrium or fractional crystallization, operating within SNC magmas known to exist on Mars? If it is possible, what P (depth) and PH2O conditions are required? (2) whether TES-based interpretations of plagioclase-rich basalt and andesitic terrains in the south and north regions of Mars respectively are unique. Are the surface compositions of these regions plagioclase-rich, possibly indicating the presence of old AI-rich crust of Mars, or are the spectra being affected by something like surface weathering processes that might determine the spectral pyroxene to plagioclase ratio?

Rutherford, Malcolm J.↗

NASA NTRS1993

Space Shuttle main engine OPAD: The search for a hardware enhanced plume

The process of applying spectroscopy to the Space Shuttle Main Engine (SSME) for plume diagnostics, as it exists today, originated at Marshall Space Flight Center in Huntsville, Alabama, and its implementation was assured largely through the efforts of Sverdrup AEDC, in Tullahoma, Tennessee. This team continues to lead and guide efforts in the plume diagnostics arena. The process, Optical Plume Anomaly Detection (OPAD), formed the basis for various activities in the development of ground-based systems as well as the development of in-flight plume spectroscopy. OPAD currently provides and will continue to provide valuable information relative to future systems definitions, instrumentation development, code validation, and data diagnostic processing. OPAD is based on the detection of anomalous atomic and molecular species in the SSME plume using two complete, stand-alone optical spectrometers. To-date OPAD has acquired data on 44 test firings of the SSME at the Technology Test Bed (TTB) at MSFC. The purpose of this paper will be to provide an introduction to the OPAD system by discussing the process of obtaining data as well as the methods of examining and interpreting the data. It will encompass such issues as selection of instrumentation correlation of data to nominal engine operation, investigation of SSME component erosion via OPAD spectral data, necessity and benefits of plume seeding, application of artificial intelligence (AI) techniques to data analysis, and the present status of efforts to quantify specie erosion utilizing standard plume and chemistry codes as well as radiative models currently under development.

Powers, W. T.↗

NASA NTRS1986

STAR - A computer language for hybrid AI applications

Constructing Artificial Intelligence application systems which rely on both symbolic and non-symbolic processing places heavy demands on the communication of data between dissimilar languages. This paper describes STAR (Simple Tool for Automated Reasoning), a computer language for the development of AI application systems which supports the transfer of data structures between a symbolic level and a non-symbolic level defined in languages such as FORTRAN, C and PASCAL. The organization of STAR is presented, followed by the description of an application involving STAR in the interpretation of airborne imaging spectrometer data.

Borchardt, G. C.↗

NASA NTRS1989

Simple models for complex natural surfaces - A strategy for the hyperspectral era of remote sensing

A two-step strategy for analyzing multispectral images is described. In the first step, the analyst decomposes the signal from each pixel (as expressed by the radiance or reflectance values in each channel) into components that are contributed by spectrally distinct materials on the ground, and those that are due to atmospheric effects, instrumental effects, and other factors, such as illumination. In the second step, the isolated signals from the materials on the ground are selectively edited, and recombined to form various unit maps that are interpretable within the framework of field units. The approach has been tested on multispectral images of a variety of natural land surfaces ranging from hyperarid deserts to tropical rain forests. Data were analyzed from Landsat MSS (multispectral scanner) and TM (Thematic Mapper), the airborne NS001 TM simulator, Viking Lander and Orbiter, AIS, and AVRIS (Airborne Visible and Infrared Imaging Spectrometer).

Adams, John B.↗

NASA NTRS1989

Intelligent hypertext manual development for the Space Shuttle hazardous gas detection system

This research is designed to utilize artificial intelligence (AI) technology to increase the efficiency of personnel involved with monitoring the space shuttle hazardous gas detection systems at the Marshall Space Flight Center. The objective is to create a computerized service manual in the form of a hypertext and expert system which stores experts' knowledge and experience. The resulting Intelligent Manual will assist the user in interpreting data timely, in identifying possible faults, in locating the applicable documentation efficiently, in training inexperienced personnel effectively, and updating the manual frequently as required.

Lo, Ching F.↗