SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
The software provides a flexible pipeline for artificial intelligence (AI) assisted analysis of data collected from an electron microscope. This tool distinctly provides near real-time image quantification results during data collection, incorporating feedback from a user to tune performance.
It was experimentally determined whether induced differences in forest canopy chemical composition can be detected using data from the Airborne Imaging Spectrometer (AIS). Treatments were applied to an even-aged forest of Douglas fir trees. Work to date has stressed wet chemical analysis of foilage samples and correction of AIS data. Plot treatments were successful in providing a range of foliar N2 concentrations. Much time was spent investigating and correcting problems with the raw AIS data. Initial problems with groups of drop out lines in the AIS data were traced to the tape recorder and the tape drive. Custom adjustment of the tape drive led to recovery of most missing lines. Remaining individual drop out lines were replaced using average of adjacent lines. Application of a notch filter to the Fourier transform of the image in each band satisfactorily removed vertical striping. The aspect ratio was corrected by resampling the image in the line direction using nearest neighbor interpolation.
Imaging methods driven by probes, electrons, and ions have played a dominant role in modern science and engineering. Opportunities for machine vision and AI that focus on consumer problems like driving and feature recognition, are now presenting themselves for automating aspects of the scientific processes. This proposal aims to enable and drive discovery in ultra-low energy implantation by taking advantage of faster processing, flexible control and detection methods, and architecture-agnostic workflows that will result in higher efficiency and shorter scientific development cycles. Custom microscope control, collection and analysis hardware will provide a framework for conducting novel in situ experiments revealing unprecedented insight into surface dynamics at the nanoscale. Ion implantation is a key capability for the semiconductor industry. As devices shrink, novel materials enter the manufacturing line, and quantum technologies transition to being more mainstream. Traditional implantation methods fall short in terms of energy, ion species, and positional precision. Here we demonstrate 1 keV focused ion beam Au implantation into Si and validate the results via atom probe tomography. We show the Au implant depth at 1 keV is 0.8 nm and that identical results for low energy ion implants can be achieved by either lowering the column voltage, or decelerating ions using bias – while maintaining a sub-micron beam focus. We compare our experimental results to static calculations using SRIM and dynamic calculations using binary collision approximation codes TRIDYN and IMSIL. A large discrepancy between the static and dynamic simulation is found that is due to lattice enrichment with high stopping power Au and surface sputtering. Additionally, we demonstrate how model details are particularly important to the simulation of these low-energy heavy-ion implantations. Finally, we discuss how our results pave a way to much lower implantation energies, while maintaining high spatial resolution.
The Airborne Imaging Spectrometer (AIS) is a high spectral resolution (9.6-nm-wide bands between 0.9 and 2.4 microns) instrument. Analysis of AIS data revealed significant differences in characteristics of the spectral radiance curves of four types of wetland vegetation canopies (trees, broadleaf herbaceous, Spartina alterniflora, and S. patens/Distichlis spicata) in Delaware, enabling them to be distinguished. The single most useful spectral region was that between 1.40 and 1.90 microns. Differences in radiance values at various wavelengths between samples of the same vegetation type could potentially be used to estimate biomass. Thus, high spectral resolution spectrometry appears to have significant value for remote sensing studies of wetland vegetation.
Canopy lignin concentration is strongly related to annual rates of nitrogen mineralization in a series of Wisconsin forest ecosystems. High spectral resolution Airborne Imaging Spectrometer (AIS) data were acquired over these forests to investigate the potential of remotely estimating canopy lignin content. Analysis of the data using a derivative transformation and correlative techniques suggests that lignin or a closely associated cellular constituent is influential in canopy reflectance. Spatial distributions of percent canopy lignin and annual rates of nitrogen mineralization for Blackhawk Island, WI, have been estimated from a mosaic of AIS imagery.
In response to the ongoing global food crisis, the United Nations has identified “Zero Hunger” as one of its Sustainable Development Goals. A central contributor to the crisis is the process in which agricultural lands go through desertification. Research has shown a direct correlation between soil salinity and desertification - increased salinity levels indicate a higher risk for desertification. Furthermore, researchers have explored various techniques to map soil salinity, but these methods are oftentimes inefficient and don’t address future salinity predictions. To improve desertification monitoring, soil salinity can be observed via hyperspectral imaging on unmanned aerial vehicles (UAVs) to predict the risk of agricultural desertification using artificial intelligence (AI) and machine learning (ML) techniques. A significant gap exists in past research that applies ML and imaging techniques to soil salinity: convolutional neural networks (CNNs) and regression models are rarely leveraged together, despite the efficiency and accuracy of these models. To compensate for this gap, the proposed system leverages the use of these AI and ML models to improve soil assessment and prediction techniques. This approach involves three steps - data collection, image analysis, and future prediction. Using hyperspectral cameras on UAVs to collect the data from the region, a trained CNN model will output estimated soil salinity levels at a specific time. The estimations will then be analyzed by a regression model to assess the accuracy of future soil salinity predictions. The proposed system will identify regions at risk of desertification to help farmers mitigate agricultural loss, in turn helping alleviate the food crisis.
Summaries of 17 papers presented at the workshop are published. After an overview of the imaging spectrometer program, time was spent discussing AIS calibration, performance, information extraction techniques, and the application of high spectral resolution imagery to problems of geology and botany.
The rapid adoption of artificial intelligence methods in healthcare is coupled with the critical need for techniques to rigorously introspect models and thereby ensure that they behave reliably. This has led to the design of explainable AI techniques that uncover the relationships between discernible data signatures and model predictions. In this context, counterfactual explanations that synthesize small, interpretable changes to a given query while producing desired changes in model predictions have become popular. This under-constrained, inverse problem is vulnerable to introducing irrelevant feature manipulations, particularly when the model’s predictions are not well-calibrated. Hence, in this paper, we propose the TraCE (training calibration-based explainers) technique, which utilizes a novel uncertainty-based interval calibration strategy for reliably synthesizing counterfactuals. Given the wide-spread adoption of machine-learned solutions in radiology, our study focuses on deep models used for identifying anomalies in chest X-ray images. Using rigorous empirical studies, we demonstrate the superiority of TraCE explanations over several state-of-the-art baseline approaches, in terms of several widely adopted evaluation metrics. Our findings show that TraCE can be used to obtain a holistic understanding of deep models by enabling progressive exploration of decision boundaries, to detect shortcuts, and to infer relationships between patient attributes and disease severity.
The automated analysis of SSME injector assemblies has been investigated for the cases of LOX post surface defects and injector-baffle deterioration. Defects are isolated via 2D feature extraction from borescope and camera images; temporal-frequency transforms are then used to create a multiresolution set of feature vectors representing image contents. The potential flaws thus discriminated are then segmented and classified according to known categories. AI is applied in the form of a blackboard architecture that is controlled by a rule-based production system.
This study evaluated the utility of data collected by the high-spectral resolution airborne imaging spectrometer (AIS-2, tree mode, spectral range 0.8-2.2 microns) and the broad-band Daedalus airborne thematic mapper (ATM, spectral range 0.42-13.0 micron) in assessing forest decline damage at a predominantly Scotch pine forest in the FRG. Analysis of spectral radiance values from the ATM and raw digital number values from AIS-2 showed that higher reflectance in the near infrared was characteristic of high damage (heavy chlorosis, limited needle loss) in Scotch pine canopies. A classification image of a portion of the AIS-2 flight line agreed very well with a damage assessment map produced by standard aerial photointerpretation techniques.
This presentation explores the transformative potential of autonomous electron microscopy and artificial intelligence (AI) in accelerating materials science discovery, particularly for energy applications and materials operating in extreme environments. We discuss pioneering self-driving laboratories at NREL designed to intelligently probe material synthesis and degradation across multiple scales, aiming to rapidly bridge the gap between atomic-level understanding and the development of high-performance, reliable materials. Utilizing advanced machine learning techniques, such as few-shot learning and multimodal analysis integrating imaging and spectroscopy, we demonstrate methods to extract actionable descriptors for material behavior, quantify complex microstructural evolution, and statistically link synthesis parameters to defect populations. This AI-driven approach promises to accelerate the creation of predictive materials tailored for specific missions, enabling faster development cycles and enhanced material assurance.
This presentation explores the transformative potential of autonomous electron microscopy and artificial intelligence (AI) in accelerating materials science discovery, particularly for energy applications and materials operating in extreme environments. We discuss pioneering self-driving laboratories at NREL designed to intelligently probe material synthesis and degradation across multiple scales, aiming to rapidly bridge the gap between atomic-level understanding and the development of high-performance, reliable materials. Utilizing advanced machine learning techniques, such as few-shot learning and multimodal analysis integrating imaging and spectroscopy, we demonstrate methods to extract actionable descriptors for material behavior, quantify complex microstructural evolution, and statistically link synthesis parameters to defect populations. This AI-driven approach promises to accelerate the creation of predictive materials tailored for specific missions, enabling faster development cycles and enhanced material assurance.
Introduction: The science goals for NASA’s Artemis program include: a) Understanding the character and origin of lunar polar volatiles, b) Conducting experimental science in the lunar environment and c) Investigating and mitigating exploration risks. The permanently shadowed regions (PSRs) on the Lunar south pole are expected to host large quantities of water-ice and volatiles that are important for sustainable Lunar exploration. There are several missions such as onboard Korea Pathfinder Lunar Orbiter (KPLO: Korean name Danuri) with onboard ShadowCam camera, Astrobotic Peregrine Mission One [4], and other efforts underway to obtain high resolution topographic, minerals, volatiles and other information on the moon. We envision a need in immediate future for platforms to integrate these data sets, provide rendering and visualization capabilities in the context of a 3D Lunar globe for easier information access and analysis. NASA's Celestial Mapping System (CMS) is developed to address the need for 3D tools for planetary science investigations, mission planning, in-situ operations, in a 3D-first design constructed around a unified view of a planetary globe. At present CMS provides many critical functionalities that include: 1) equipment planning and optimized placement on Lunar surface 2) line-of-sight (LOS) analysis 3) powerful measurement tools based on 3D terrain with realistic 3D models to represent rovers, astronauts and equipment 4) visualization of derived mapping products (e.g. resource maps), and 5) a data engine for hosting new observations that are not available in other contemporary lunar data tools. Planetary Data Ingestion: CMS can consume and analyze data from locally hosted and external third party sources. It is compatible with Open Geospatial Consortium (OGC) data and file standards and currently integrates datasets from the Astrogeology Science Center of USGS. This includes global and local data acquired from NASA (LRO, Clementine, Lunar Orbiter) and JAXA (SELENE/Kaguya), with capability of integrating more datasets. In addition, users can specify other WMS-hosted data endpoints, which CMS can then query and stream data from automatically. To set-up an automated process for ingestion and accurate rendering, visualization and analysis of external 3rd party planetary datasets within CMS, we initiated the process of ingesting unique dataset of super-enhanced images of the permanently shadowed regions (PSRs) at the lunar poles which were produced by the Hyper-effective nOise Removal U-net Software (HORUS) tool. This tool was developed to enhance the extremely low-light images of the interior of PSRs and provide the ability to see within these regions at and discern surface features (i.e. boulders and craters) down to 3 meters in size. We focused on the Nobile region on the Lunar south pole, selected site for VIPER mission and stitched several images to create a high-resolution map within one of the PSR of Nobile crater. Figure 1 shows the dark PSR zone form the original NAC layer of LRO as the base layer (left image) and the illuminated areas within that crater (center) which was created by ingesting and merging several of HORUS generated images. At present we employ a semi-automated process to ensure spatial accuracy and merger of several overlapping zones. However, we are in the process of completely automating this process by employing AI based techniques that would rank, sort, and stack the images based on their information density. The georectification of the images would employ selected features. Analysis on Ingested Planetary Datasets: Once an external planetary data-set is successfully ingested, georectified and merged seamlessly as a data-layer; CMS’ numerous analysis tools can be used on this data. A Line of Sight (LOS) tool has been developed for CMS which analyzes terrain profiles and obstructions to determine visibility for remote observers. Figure 1 (right image) shows the viewshed analysis on the same PSR in the Nobile region. The yellow pin shows the observer location outside the PSR. The yellow area shows the visible part of PSR. The obstructed area with no visibility for the observer is shown in red. The Measurements tool allows the user to take area and distance measurements of features on the terrain using various shapes. Measurement type can be specified in a number of ways: Line, Path, Polygon, Circle, Ellipse, Square, Rectangle or Freehand. Once the shape is specified, elevation information can then be extracted along each of these shapes. Figure 2 (left) shows the measurements performed on a crater n illuminated PSR in Nobile region. The equipment placement tool allows the user to place a 3D equipment model at a desired location and analyze its coverage area. The equipment placement tool is coupled with LOS to determine the coverage. Figure 2 (right) shows an equipment placed on the Lunar terrain and it’s coverage area. The red rays are blocked sight lines and the green rays are non-obstructed sight lines with the cyan lines showing the point of intersection with the terrain. More details are provided in the video demonstrations in Reference 5. Overcoming Polar Distortions: 3D geospatial applications exhibit significant distortions in polar imagery due to several reasons: 1) distortions in the source imagery, 2) incompatible tessellation algorithms at the poles, and 3) map projections. We are leveraging new tessellation algorithms and reprojecting data using projections that are better suited for Lunar poles. The goal is to seamlessly switch to polar projections while maintaining 3D view and navigation.
Introduction: The science goals for NASA’s Artemis program include: a) Understanding the character and origin of lunar polar volatiles, b) Conducting experimental science in the lunar environment and c) Investigating and mitigating exploration risks [1]. The permanently shadowed regions (PSRs) on the Lunar south pole are expected to host large quantities of water-ice and volatiles that are important for sustainable Lunar exploration [2]. There are several missions such as onboard Korea Pathfinder Lunar Orbiter (KPLO: Korean name Danuri) with onboard ShadowCam camera [3], Astrobotic Peregrine Mission One [4], and other efforts underway to obtain high resolution topographic, minerals, volatiles and other information on the moon. We envision a need in immediate future for platforms to integrate these data sets, provide rendering and visualization capabilities in the context of a 3D Lunar globe for easier information access and analysis. NASA's Celestial Mapping System (CMS) [5] is developed to address the need for 3D tools for planetary science investigations, mission planning, in-situ operations, in a 3D-first design constructed around a unified view of a planetary globe. At present CMS provides many critical functionalities that include: 1) equipment planning and optimized placement on Lunar surface 2) line-of-sight (LOS) analysis 3) powerful measurement tools based on 3D terrain with realistic 3D models to represent rovers, astronauts and equipment 4) visualization of derived mapping products (e.g. resource maps), and 5) a data engine for hosting new observations that are not available in other contemporary lunar data tools [5, 7]. Planetary Data Ingestion: CMS can consume and analyze data from locally hosted and external third party sources. It is compatible with Open Geospatial Consortium (OGC) data and file standards and currently integrates datasets from the Astrogeology Science Center of USGS. This includes global and local data acquired from NASA (LRO, Clementine, Lunar Orbiter) and JAXA (SELENE/Kaguya), with capability of integrating more datasets. In addition, users can specify other WMS-hosted data endpoints, which CMS can then query and stream data from automatically. To set-up an automated process for ingestion and accurate rendering, visualization and analysis of external 3rd party planetary datasets within CMS, we initiated the process of ingesting unique dataset of super-enhanced images of the permanently shadowed regions (PSRs) at the lunar poles which were produced by the Hyper-effective nOise Removal U-net Software (HORUS) tool [8]. This tool was developed to enhance the extremely low-light images of the interior of PSRs and provide the ability to see within these regions at and discern surface features (i.e. boulders and craters) down to 3 meters in size. We focused on the Nobile region on the Lunar south pole, selected site for VIPER mission and stitched several images to create a high-resolution map within one of the PSR of Nobile crater. Figure 1 shows the dark PSR zone form the original NAC layer of LRO as the base layer (left image) and the illuminated areas within that crater (center) which was created by ingesting and merging several of HORUS generated images. At present we employ a semi-automated process to ensure spatial accuracy and merger of several overlapping zones. However, we are in the process of completely automating this process by employing AI based techniques that would rank, sort, and stack the images based on their information density. The georectification of the images would employ selected features. Analysis on Ingested Planetary Datasets: Once an external planetary data-set is successfully ingested, georectified and merged seamlessly as a data-layer; CMS’ numerous analysis tools can be used on this data. A Line of Sight (LOS) tool has been developed for CMS which analyzes terrain profiles and obstructions to determine visibility for remote observers [5,6]. Figure 1 (right image) shows the viewshed analysis on the same PSR in the Nobile region. The yellow pin shows the observer location outside the PSR. The yellow area shows the visible part of PSR. The obstructed area with no visibility for the observer is shown in red. The Measurements tool allows the user to take area and distance measurements of features on the terrain using various shapes. Measurement type can be specified in a number of ways: Line, Path, Polygon, Circle, Ellipse, Square, Rectangle or Freehand. Once the shape is specified, elevation information can then be extracted along each of these shapes. Figure 2 (left) shows the measurements performed on a crater n illuminated PSR in Nobile region. The equipment placement tool allows the user to place a 3D equipment model at a desired location and analyze its coverage area. The equipment placement tool is coupled with LOS to determine the coverage. Figure 2 (right) shows an equipment placed on the Lunar terrain and it’s coverage area. The red rays are blocked sight lines and the green rays are non-obstructed sight lines with the cyan lines showing the point of intersection with the terrain. More details are provided in the video demonstrations in Reference 5. Overcoming Polar Distortions: 3D geospatial applications exhibit significant distortions in polar imagery due to several reasons: 1) distortions in the source imagery, 2) incompatible tessellation algorithms at the poles, and 3) map projections. We are leveraging new tessellation algorithms and reprojecting data using projections that are better suited for Lunar poles. The goal is to seamlessly switch to polar projections while maintaining 3D view and navigation.
Motivation Multiple deep learning model architectures can be used to segment bacterial membranes in cryoEM images. However, an AI-based tool advancement is often presented with only a single segmentation model for broad use, and this single model may show inconsistent results across datasets from different users. Here, we present the Top Model Decision Tree, a model screening framework to screen for the best model to generate bacterial inner and outer membrane masks based on user priorities. We use pre-trained segmentation models from YOLOv11, YOLO26, U-Net, Detectron2 and SAM3 fine-tuned on bacterial inner and outer membranes imaged with cryoEM. Run the Framework This notebook must be opened in Google Colab. Mount Google Drive and run with a GPU-based runtime. Open the notebook and follow steps to git clone in folders and files within this repository. There will be a repeating top_model_decision_tree.ipynb (notebook clone) that will not be used. Save your .png binary mask files and .csv table outputs within your Google Drive or download before closing the notebook. The models and all analysis/training scripts are available at [GitHub: https://github.com/Lynnicia/CryoEM_membranes_top_model_decision_tree and https://github.com/Sireesiru/Semantic-Segmentation-of-bacterial-cell-envelope-using-U-Nets.
Multipolarization Synthetic Aperture Radar (SAR) data from the NASA/JPL aircraft SAR were used in conjunction with LANDSAT Thematic Mapper (TM), Thermal Infrared Multispectral Scanner (TIMS), and Airborne Imaging Spectrometer (AIS) data as part of a three-year research program to evaluate the utility of remote sensing measurements for analysis of sedimentary basins. The purpose of this research effort is to construct stratigraphic columns, map variations in the lithology, geometry, and structure of sedimentary rocks in the Wind River/Bighorn Basin area, Wyoming, and to integrate remote sensing data with conventional rain models of basin formation and evolution.
Secondary Ion Mass Spectrometry (SIMS) is an outstanding technique for Mass Spectral Imaging (MSI) due to its notable advantages, including high sensitivity, selectivity, and high dynamic range. As a result, SIMS has been employed across many domains of science. In this review, we provide an in-depth overview of the fundamental principles underlying SIMS, followed by an account of the recent development of SIMS instruments. The review encompasses various applications of specific SIMS instruments, notably static SIMS with time-of-flight SIMS (ToF-SIMS) as a widely used platform and dynamic SIMS with Nano SIMS and large geometry SIMS as successful instruments. We particularly focus on SIMS utility in microanalysis and imaging of metals and alloys as materials of interest. Additionally, we discuss the challenges in big SIMS data analysis and give examples of machine leaning (ML) and Artificial Intelligence (AI) for effective MSI data analysis. Finally, we recommend the outlook of SIMS development. It is anticipated that in situ and operando SIMS has the potential to significantly enhance the investigation of metals and alloys by enabling real-time examinations of material surfaces and interfaces during dynamic transformations.
Several techniques are becoming common in the analysis of imaging spectrometer data that can lead to spurious absorption features or to changes in the position, width, and shape of actual absorption features. It is a common practice to calibrate AIS or other imaging spectrometer data by averaging each pixel along the flight line. The average is used to calibrate the spectral data by dividing the spectrum at each pixel by the average. If some pixels in the data set contain an absorption, then the average will also show an absorption. Some AIS data has had problems with wavelength stability from one scan line to the next which can produce spurious features with some analysis methods. If a pixel has a spectrum with an absorption having a different position or width than the spectrum used in a ratio, then the ratio can produce a spurious absorption at a different position and width than the true absorption feature. An average spectrum ratioed to each pixel will produce band shifts, and changes in width or shape. If continuum removal is performed by substraction rather than division, band positions can also be shifted.