Search NASA⌕ Search

SEARCH · Search NASA

Results for “Computer Vision”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 505 records · Page 28
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Elucidating the formation mechanisms of zeolites using data-driven modelling and in-situ characterization

Zeolites are the main solid catalysts used by the chemical industry. The use of zeolites in separations and as shape selective catalysts requires control of the width and connectivity of their pores. 235 distinct zeolite frameworks have been synthesized to date, of over 2 million that have been proposed. Recent work indicates that the limitation is in large part kinetic: new synthetic pathways are required to access new zeolites. Organic cations are used to direct the synthesis towards specific zeolites. However, the molecular mechanisms by which cations direct the nucleation towards specific zeolites is not known. Elucidating these mechanisms is key to realize new zeolites for catalysis and separations, and is the focus of this project. This project developed and implemented a synergistic, data-driven computational and experimental approach to resolve the molecular pathways of nucleation, growth, and polymorph selection of zeolites and the role of organic cations in directing their formation. The project developed computationally efficient and accurate models for the study of the nucleation and growth of pure silica zeolites in molecular simulations, using machine learning with data from experiments. Simulations with these models were integrated with scanning tunneling electron microscopy, computer vision, and deep learning to unveil the molecular pathways of formation of a zeolite. Of particular interest in this project was to elucidate the role of amorphous precursors in the nucleation of the zeolite. Previous experiments indicate that zeolites are born within non-crystalline aggregates in which the silicates and organic cations have local and medium range order similar to that of the zeolite. The organic cations that direct the formation of zeolites and those that direct the formation of ordered mesoporous silicas are similar. We hypothesized that the frustrated attraction that for large organic cations leads to the formation of stable mesophases that direct the synthesis of mesoporous silicas, could promote the formation of metastable mesophases that can assist in the nucleation and polymorph selection of zeolites. The simulations resolved how structure directing agents build crystalline order and showed that mesoscopic pre-ordering occurs is not required to facilitate the nucleation of zeolites, because the synthesis occurs at high driving forces, where the barriers for nucleation are negligible. This project unveiled that polymorph selection in zeolite synthesis occurs after nucleation, opening a distinct area of control through the kinetics of growth and not through nucleation barriers.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Extraction of Vibration Data with Imaging

To date, the primary sensing technology used to measure the vibration response has been accelerometers and strain gages mounted directly to the structure and using either wired or, more recently, wireless telemetry. Cost issues with these sensors and the associated data acquisition systems typically limit the numbers that are deployed on in situ structures. Although there are a few structures with larger sensing counts that in some cases exceed over 1000 sensors, more typical numbers range from ten to one hundred sensors resulting in low spatial resolution when they are applied to physically large systems. When one considers that nuclear power plant structures usually have complex geometries, material properties, connectivity and boundary conditions, it is clear these current approaches to vibration measurements can only provide limited information about a system’s dynamics response characteristics. As an alternative, many non-contact measurement technologies have emerged, including point wise measurement methods such as Global Positioning System (GPS), microwave interferometry, and laser Doppler vibrometry (LDV), as well as simultaneous full-field measurement methods such as electronic speckle pattern interferometry, holography interferometry, and muon tomography, some of which can provide high spatial resolution measurements. Among these methods, digital video imaging techniques have emerged as a feasible solution for full-field vibration measurements that provide significantly more detailed dynamic response information because every pixel becomes a measurement point. Furthermore, recent advances in image processing and computer vision algorithms have been successfully used to process video data for experimental and operational modal analysis. Such full-field measurements have the potential to significantly improve many current structural assessment procedures including system identification (modal parameter estimation), structural health monitoring, load reconstruction, model validation, and model updating. Furthermore, more recent full-field imaging techniques can be accomplished with relatively low-cost, commercially-available off-the-shelf cameras. However, these measurement procedures have other limitations that must be considered such as the ability to only measure visibly accessible points on a structure and a more limited dynamic range and bandwidth than can be achieved with accelerometers or strain gages.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2024

Identifying Neutrino Final States and Energies in MicroBooNE with New Deep-Learning Based LArTPC Reconstruction Frameworks

MicroBooNE, a Liquid Argon Time Projection Chamber (LArTPC) located in the $\nu_{\mu}$-dominated Booster Neutrino Beam at Fermilab, has been studying $\nu_{e}$ charged-current (CC) interaction rates to shed light on the MiniBooNE low energy excess. The LArTPC technology employed by MicroBooNE provides the capability to image neutrino interactions with mm-scale precision. Computer vision and other machine learning techniques are promising tools for image processing that could boost efficiencies for selecting $\nu_{e}$-CC and other rare signals, reduce cosmic and beam-induced backgrounds, and improve the reconstruction of neutrino energies. The MicroBooNE experiment has been at the forefront of developing and testing such techniques for use in physics analyses. In this poster we overview deep-learning based reconstruction methods. We will showcase the use of a recurrent neural network to estimate neutrino energies and present a new reconstruction framework that uses convolutional neural networks to locate neutrino interaction vertices, tag pixels with track and shower labels, and perform particle identification on reconstructed clusters. We will present studies characterizing the performance of these new tools and demonstrate their effectiveness through their use in an inclusive $\nu_{e}$-CC event selection.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

Interpreting and Accelerating Transformers for Jet Tagging

Attention-based transformers are ubiquitous in machine learning applications from natural language processing to computer vision. In high energy physics, one central application is to classify collimated particle showers in colliders based on the particle of origin, known as jet tagging. In this work, we study the interpretatbility and prospects for acceleration of Particle Transformer (ParT), a state-of-the-art model, leverages particle-level attention to improve jet-tagging performance. We analyzing ParT's attention maps and particle-pair correlations in the eta-phi plane, revealing intriguing features, such as a binary attention pattern that identifies critical substructure in jets. These insights enhance our understanding of the model's internal workings and learning process and hint at ways to improve its efficiency. Along these lines, we also explore low-rank attention, attention alternatives, and dynamic quantization to accelerate transformers for jet tagging. With quantization, we achieve a 50% reduction in model size and a 10% increase in inference speed without compromising accuracy. These combined efforts enhance both the performance and the interpretability of transformers in high-energy physics, opening avenues for more efficient and physics-driven model designs.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2024

From Chaos to Clarity: Autonomous Materials Discovery for Extreme Environments [Slides]

The pursuit of advanced functional materials for energy applications demands an understanding of their behavior under the most challenging conditions. Extreme environments, characterized by intense radiation, high temperatures, and corrosive chemistries, push materials to their limits, often revealing unexpected behaviors and degradation pathways. Traditional materials research approaches, relying on trial-and-error experimentation, are often slow and resource-intensive, ill-suited to the complexities of extreme environments. This talk will explore the transformative potential of autonomous materials science in revolutionizing our understanding of materials synthesis and degradation in extreme environments. By integrating advanced microscopy techniques, artificial intelligence, and robotic experimentation, we can accelerate the discovery and design of resilient materials for a sustainable future. The presentation will highlight recent breakthroughs in autonomous microscopy, computer vision, and machine learning, showcasing their ability to unravel complex material transformations at the atomic scale. The talk will also delve into the challenges and opportunities associated with deploying autonomous systems to probe extreme environments, emphasizing the importance of robust algorithms, real-time data analysis, and adaptive experimentation. The ultimate goal is to empower scientists with unprecedented capabilities to explore, understand, and engineer materials that can withstand the harshest conditions, paving the way for innovations in energy, aerospace, and beyond.

14 SOLAR ENERGY↗
DOE OSTI2025

Robotic Assembly of Multi-Chip Modules Using Artificial Intelligence

With many properties of dark matter remaining a mystery, the OSCURA experiment aims to detect light dark matter particles using 1,536 Multi-Chip Modules (MCMs), containing a total of 24,576 skipper CCDs. Currently, each MCM is assembled by hand a time-consuming and error-prone process that can be automated. In this ongoing work, we present an automated assembly robot that leverages modern computer vision and artificial intelligence to assemble the OSCURA MCMs. This approach reduces cost, time, and error in the packaging of OSCURA sensors.

Arteaga, Matthew [Northern Illinois U.; Fermilab]↗
DOE OSTI2023

Robotic Systems integration for cleanroom SRF assembly at Fermilab

Superconducting Radio Frequency (SRF) cryomodule assembly is a critical process that demands the highest levels of contamination control in a cleanroom to ensure product quality and reliability. Within the cleanroom environment, human-driven activities remain the major source of uncontrolled particulate. Moreover, the precise manual alignment of components often exceeds expected timeframes, increasing the risk of particulate migration into the critical inner space of the SRF resonant cavity, and causing extended discomfort for workers. Automation comes as a natural solution to address these challenges. The goal of this activity is to set up and integrate a robotic system to support cavity coupler installation in the cleanroom environment. Initially, remote control of a 6-axis collaborative robot arm will be implemented as an introductory step towards automation in the cleanroom. Subsequently, the system will be further enhanced by integrating manipulation capabilities through an appropriate end-effector, and computer vision technology to enable accurate pose estimation. This comprehensive approach aims to achieve a fully automated and adaptable assembly process in the partially structured cleanroom environment, thereby enhancing efficiency and mitigating existing challenges for better product quality and workers safety.

42 ENGINEERING↗
DOE OSTI2025

AI Applications to Physics Experiments at Jefferson Lab

We survey how AI/ML is being deployed across Jefferson Lab's experimental and accelerator programs. In EPSCI, Hydra applies computer vision to automate real-time data-quality monitoring across all four experimental halls, replacing manual inspection of hundreds to thousands of histograms per shift. AIEC (AI Experiment Controls) uses ML to stabilize drift chamber gains and is now part of standard CEBAF production running, while AI Optimized Polarization (AIOP) targets autonomous control of polarized targets and photon beam angular alignment. In CASA, cavity fault classification models identify faulted cavities and trip types from waveform data with ~85% and ~78% agreement to labeled data, respectively, and are deployed in production; a separate effort applies LLMs and hybrid search to make the CEBAF operations logbook AI-ready. QCD-focused work includes transformer- and GAN-based generative models for particle-level event simulation, with distributed GAN training scaling studies on Polaris. Additional efforts span ML-on-FPGA for the EIC and a new Data Science Department coordinating anomaly detection, uncertainty quantification, and HPC-scalable ML lab-wide. Collectively, these projects illustrate AI's growing role in improving efficiency across JLab's nuclear physics mission.

Mei, Xinxin [Thomas Jefferson National Accelerator↗
DOE OSTI2019

Investigating Camera Calibration Methods for Naturalistic Driving Studies

Naturalistic driving studies typically utilize a variety of sensors, including radar, kinematic sensors, and video cameras. While the main objective of such sensors is typically safety focused, with a goal of recording accidents and near accidents for later review, the instrumentation provides a valuable resource for a variety of transportation research. Some applications, however, require additional processing to improve the utility of the data. In this work, we describe a computer vision procedure for calibrating front view cameras for the Second Strategic Highway Research Project. A longitudinal stability study of the estimated parameters across a small sample set of cameras is presented along with a proposed procedure for calibrating a larger number of cameras from the study. A simple use case is presented as one example of the utility of this work. Finally, we discuss plans for calibrating the complete set of approximately 3000 cameras from this study.

Paone, Jeffrey R.↗
DOE OSTI2023

Wave Detection and Tracking Within a Rotating Detonation Engine Through Object Detection

As the operational time window of experimental rotating detonation engines (RDEs) is expanded and the technology matures toward integration within gas turbines, monitoring techniques must evolve to offer computationally efficient and highly time-resolved diagnostics. In this study, computer vision object detection methodology that seeks to reduce data processing time and calculate wave velocity within drastically reduced time intervals as compared to traditional high-frame-rate RDE images analysis techniques is proposed. The adapted you-only-look-once object detection network is trained to detect individual detonation waves within single down-axis RDE images. The wave location and rotational direction detected within a frame are tracked through a series of high-speed images to calculate the frame-to-frame wave velocity with the time-step resolution of $\mathrm{20 μs}$ across a series of frames. The analysis of the annotation box size and image linearization effects is presented, demonstrating the lowest frame-to-frame velocity total uncertainty of $\mathrm{±3.8\%}$ and the highest classification speed of 9.5 frames per second using linearized images. Linearized images “unwrap” the RDE annulus pixel region to a reduced image size. Here, this new method offers great reductions in data processing times and unsteady detonation behavior insight at intervals more comparable to the timescales of detonation wave interactions via the application of machine learning to experimental RDE data.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2024

Understanding Generative AI Content with Embedding Models

The construction of high-quality numerical features is critical to any quantitative data analysis. Feature engineering has been historically addressed by carefully hand-crafting data representations based on domain expertise. This work views the internal representations of modern deep neural networks (DNNs), called embeddings, as an implicit form of traditional feature engineering. For trained DNNs, we show that these embeddings can reveal interpretable, high-level concepts in unstructured sample data. We use these embeddings in natural language and computer vision tasks to uncover both inherent heterogeneity in the underlying data and human-understandable explanations for it. In particular, we find empirical evidence that there is inherent separability between real data and those generated from AI models.

Vargas, Max↗
DOE OSTI2025

The Mantis Shrimp Dataset

The Mantis Shrimp Dataset (MSD) is a combination of matched cutouts of galaxies with known redshift in the ultra-violet, optical, and infrared wavelengths. MSD redshifts come from ''high-quality'' (as reported by the spectroscopic experiment) redshift measurements from a variety of spectroscopic surveys, including: SDSS, DESI early release, DEEP2, GAMA, VVDS, VIPERS, 6dF, and WiggleZ. Each redshift is accompanies with astrometry (ra,dec) pairs that were used to query cutout image services from PanSTARRs, UnWISE, and GALEX servers. The main data products are image vectors of these cutouts accompanied by the redshift value to be used to train computer vision networks on the supervised photometric redshift task. We also provide extinction values pre-queried at each galaxies' astrometry from the PLANCK and SFD dutstmaps, the SDSS MGS photometric redshift from Beck 2014 (if available) and the WISE x PS1 STRM photometric redshift for the galaxy (if available).

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2024

Sensorium: commissioning abundant sensors with augmented reality and QR codes

In the future, it will be possible to build high-quality models of building interiors based on data from a dense fleet of sensors reporting on air volumes much smaller than a room or zone. To enable such models, we are creating technologies that allow a fleet of sensors to be commissioned quickly at low cost. Our sensor commissioning process builds a 3D model of each building interior that includes sensor positions and sensor networking information such as sensor MAC addresses. It employs multiple technologies, including augmented reality, LiDAR, QR codes, and computer vision. Sensors can be commissioned at more than 10x the speed and at less than one tenth the cost of traditional approaches.

Bier, Eric A.↗
DOE OSTI2025

You Only Look Once v5 and Multi-Template Matching for Small-Crack Defect Detection on Metal Surfaces

This paper compares the performance of Deep Learning (DL) and multi-template matching (MTM) models for detecting small defects. DL models extract distinguishing features of objects but require a large dataset of images. In contrast, alternative computer vision techniques like MTM need a relatively small dataset. The lack of large datasets for small metal-surface defects has inhibited the adoption of automation in small-defect detection in remanufacturing settings. This motivated this preliminary study to compare template-based approaches, like MTM, with feature-based approaches, such as DL models, for small-defect detection on an initial laboratory and remanufacturing industry dataset. This study used You Only Look Once v5 (YOLOv5) as the DL model and compared its performance against the MTM model for small-crack detection. The findings of our preliminary investigation are as follows: (i) YOLOv5 demonstrated higher performance than MTM in detecting small cracks; (ii) an extra-large variant of YOLOv5 outperformed a small-size variant; (iii) the size and object variety of the data are crucial in achieving robust pre-trained weights for use in transfer learning; and (iv) enhanced image resolution contributes to precise object detection.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2023

DL-TODA: A Deep Learning Tool for Omics Data Analysis

Metagenomics is a technique for genome-wide profiling of microbiomes; this technique generates billions of DNA sequences called reads. Given the multiplication of metagenomic projects, computational tools are necessary to enable the efficient and accurate classification of metagenomic reads without needing to construct a reference database. The program DL-TODA presented here aims to classify metagenomic reads using a deep learning model trained on over 3000 bacterial species. A convolutional neural network architecture originally designed for computer vision was applied for the modeling of species-specific features. Using synthetic testing data simulated with 2454 genomes from 639 species, DL-TODA was shown to classify nearly 75% of the reads with high confidence. The classification accuracy of DL-TODA was over 0.98 at taxonomic ranks above the genus level, making it comparable with Kraken2 and Centrifuge, two state-of-the-art taxonomic classification tools. DL-TODA also achieved an accuracy of 0.97 at the species level, which is higher than 0.93 by Kraken2 and 0.85 by Centrifuge on the same test set. Application of DL-TODA to the human oral and cropland soil metagenomes further demonstrated its use in analyzing microbiomes from diverse environments. Compared to Centrifuge and Kraken2, DL-TODA predicted distinct relative abundance rankings and is less biased toward a single taxon.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

A Data-Driven Framework for Direct Local Tensile Property Prediction of Laser Powder Bed Fusion Parts

This article proposes a generalizable, data-driven framework for qualifying laser powder bed fusion additively manufactured parts using part-specific in situ data, including powder bed imaging, machine health sensors, and laser scan paths. To achieve part qualification without relying solely on statistical processes or feedstock control, a sequence of machine learning models was trained on 6299 tensile specimens to locally predict the tensile properties of stainless-steel parts based on fused multi-modal in situ sensor data and a priori information. A cyberphysical infrastructure enabled the robust spatial tracking of individual specimens, and computer vision techniques registered the ground truth tensile measurements to the in situ data. The co-registered 230 GB dataset used in this work has been publicly released and is available as a set of HDF5 files. The extensive training data requirements and wide range of size scales were addressed by combining deep learning, machine learning, and feature engineering algorithms in a relay. The trained models demonstrated a 61% error reduction in ultimate tensile strength predictions relative to estimates made without any in situ information. Lessons learned and potential improvements to the sensors and mechanical testing procedure are discussed.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Deep-Learning-Based Segmentation of Keyhole in In-Situ X-ray Imaging of Laser Powder Bed Fusion

In laser powder bed fusion processes, keyholes are the gaseous cavities formed where laser interacts with metal, and their morphologies play an important role in defect formation and the final product quality. The in-situ X-ray imaging technique can monitor the keyhole dynamics from the side and capture keyhole shapes in the X-ray image stream. Keyhole shapes in X-ray images are then often labeled by humans for analysis, which increasingly involves attempting to correlate keyhole shapes with defects using machine learning. However, such labeling is tedious, time-consuming, error-prone, and cannot be scaled to large data sets. To use keyhole shapes more readily as the input to machine learning methods, an automatic tool to identify keyhole regions is desirable. In this paper, a deep-learning-based computer vision tool that can automatically segment keyhole shapes out of X-ray images is presented. The pipeline contains a filtering method and an implementation of the BASNet deep learning model to semantically segment the keyhole morphologies out of X-ray images. The presented tool shows promising average accuracy of 91.24% for keyhole area, and 92.81% for boundary shape, for a range of test dataset conditions in Al6061 (and one AliSi10Mg) alloys, with 300 training images/labels and 100 testing images for each trial. Prospective users may apply the presently trained tool or a retrained version following the approach used here to automatically label keyhole shapes in large image sets.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Vegetation Detection Using Deep Learning and Conventional Methods

Land cover classification with the focus on chlorophyll-rich vegetation detection plays an important role in urban growth monitoring and planning, autonomous navigation, drone mapping, biodiversity conservation, etc. Conventional approaches usually apply the normalized difference vegetation index (NDVI) for vegetation detection. In this paper, we investigate the performance of deep learning and conventional methods for vegetation detection. Two deep learning methods, DeepLabV3+ and our customized convolutional neural network (CNN) were evaluated with respect to their detection performance when training and testing datasets originated from different geographical sites with different image resolutions. A novel object-based vegetation detection approach, which utilizes NDVI, computer vision, and machine learning (ML) techniques, is also proposed. The vegetation detection methods were applied to high-resolution airborne color images which consist of RGB and near-infrared (NIR) bands. RGB color images alone were also used with the two deep learning methods to examine their detection performances without the NIR band. The detection performances of the deep learning methods with respect to the object-based detection approach are discussed and sample images from the datasets are used for demonstrations.

58 GEOSCIENCES↗