Search NASA⌕ Search
Home/Archive/DOE OSTI

DOE OSTI · 3014898

Revealing the evolution of order in materials microstructures using multi-modal computer vision

Ter-Petrosyan, Arman [Univ. of California, Irvine, CA (United States); Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)]·Holden, Michael J. [Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)]·Bilbrey, Jenna A. [Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)]·Akers, Sarah M. [Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)]·Doty, Christina M. [Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)]·Yano, Kayla H. [Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)]·Wang, Le [Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)]·Paudel, Rajendra [Auburn Univ., AL (United States)]·Lang, Eric [Univ. of New Mexico, Albuquerque, NM (United States)]·Hattar, Khalid [Univ. of Tennessee, Knoxville, TN (United States)]·Comes, Ryan [Auburn Univ., AL (United States); Univ. of Delaware, Newark, DE (United States)]·Du, Yingge [Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)]·Matthews, Bethany [Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)]·Spurgeon, Steven [Pacific Northwest National Laboratory (PNNL), Richland, WA (United States); National Renewable Energy Laboratory (NREL), Golden, CO (United States); Univ. of Colorado, Boulder, CO (United States). Renewable and Sustainable Energy Institute (RSEI)]
View original source ↗Read source document ↗Export metadata ↓

Abstract

The development of high-performance materials for microelectronics, energy storage, and extreme environments depends on our ability to describe and direct property-defining microstructural order. Our present understanding is typically derived from laborious manual analysis of imaging and spectroscopy data, which is difficult to scale, challenging to reproduce, and lacks the ability to reveal latent associations needed for mechanistic models. Here, we demonstrate a multi-modal machine learning (ML) approach to describe order from electron microscopy analysis of the complex oxide La 1−x Sr x FeO 3 . We construct a hybrid pipeline based on fully and semi-supervised classification, allowing us to evaluate both the characteristics of each data modality and the value each modality adds to the ensemble. We observe distinct differences in the performance of uni- and multi-modal models, from which we draw general lessons in describing crystal order using computer vision.

Explore related subjects

36 MATERIALS SCIENCE97 MATHEMATICS AND COMPUTINGcomputer visionelectron microscopymicrostructuresmulti-modal machine learningorderradiation damagesegmentation

Keep this discovery

BibTeXRIS

Ter-Petrosyan, Arman [Univ. of California, Irvine, CA (United States); Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)], Holden, Michael J. [Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)], Bilbrey, Jenna A. [Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)], Akers, Sarah M. [Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)], Doty, Christina M. [Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)], Yano, Kayla H. [Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)], Wang, Le [Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)], Paudel, Rajendra [Auburn Univ., AL (United States)], Lang, Eric [Univ. of New Mexico, Albuquerque, NM (United States)], Hattar, Khalid [Univ. of Tennessee, Knoxville, TN (United States)], Comes, Ryan [Auburn Univ., AL (United States); Univ. of Delaware, Newark, DE (United States)], Du, Yingge [Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)], Matthews, Bethany [Pacific Northwest National Laboratory (PNNL), Richland, WA (United States)], Spurgeon, Steven [Pacific Northwest National Laboratory (PNNL), Richland, WA (United States); National Renewable Energy Laboratory (NREL), Golden, CO (United States); Univ. of Colorado, Boulder, CO (United States). Renewable and Sustainable Energy Institute (RSEI)]. 2025-11-21. Revealing the evolution of order in materials microstructures using multi-modal computer vision. https://doi.org/10.1038/s41524-025-01831-y

Cite the original work for its findings. Save a collection to share your selection of sources.

Discover connections

36 MATERIALS SCIENCE subject97 MATHEMATICS AND COMPUTING subjectComputer vision subjectelectron microscopy subjectmicrostructures subjectmulti-modal machine learning subjectorder subject

Connections use source metadata and explicit phrase matches, not verified experimental comparisons.

KEEP EXPLORING

Related discoveries

DOE OSTI2026

Predicting Atomistic Transitions with Transformers

Accurate knowledge of the atomistic transition pathways in materials and material surfaces is crucial for many material science problems. However, conventional simulation techniques used to find these transitions are extremely computationally intensive. Even with large-scale, accelerated material simulations, the computational cost constrains the applicable domain in practice. Machine learning models, with the potential to learn the complex emergent behaviors governing atomistic transitions as a fast surrogate model, have great promise to predict transitions with a vastly reduced computational cost. Here, we demonstrate how transformers can be trained to predict atomistic transitions in nano-clusters. We show how we evaluate physical validity of the predictions and how a multitude of additional, different microstates can be generated by slightly varying the data provided to the model.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Revealing the Hidden Third Dimension of Point Defects in Two-Dimensional MXenes

Point defects govern many important functional properties of two-dimensional (2D) materials. However, resolving the three-dimensional (3D) arrangement of these defects in multi-layer 2D materials remains a fundamental challenge, hindering rational defect engineering. Here, we overcome this limitation using an artificial intelligence-guided electron microscopy workflow to map the 3D topology and clustering of atomic vacancies in Ti3C2TX MXene. Our approach reconstructs the 3D coordinates of vacancies across hundreds of thousands of lattice sites, generating robust statistical insight into their distribution that can be correlated with specific synthesis pathways. This large-scale data enables us to classify a hierarchy of defect structures-from isolated vacancies to nanopores-revealing their preferred formation and interaction mechanisms, as corroborated by molecular dynamics simulations. This work provides a generalizable framework for understanding and ultimately controlling point defects across large volumes, paving the way for the rational design of defect-engineered functional 2D materials.

2D materials↗
DOE OSTI2026

SENTRA: A Modular Computational Graph Framework for Critical Mineral and Materials Supply Chains: Part I: Network Construction Latent-Quantity Estimation, and Temporal Graph Forecasting

Global supply chains for critical minerals and materials are complex, evolving networks of countries, products, production stages, and trade relationships. Existing analytical approaches are limited by fragmented data and static network representations that do not capture the dynamic production dependencies linking raw materials, intermediate products, and final goods across multiple countries. Trade and production statistics provide only a partial view of domestic production, inventories, and material flows, making it difficult to identify indirect sourcing pathways, hidden dependencies, and embedded foreign exposures. This paper introduces the Supply Chain Exposure Network Tracking and Risk Assessment (SENTRA) framework, a modular graph-based computational framework for constructing, analyzing, and forecasting dynamic supply chain networks. As the first paper in a three-part methodological series, it establishes the computational foundation of SENTRA by constructing a temporal attributed multi-relational graph whose nodes represent product–country pairs and whose edges encode observed trade and within-country value-chain relationships. Statistical estimation and constrained optimization recover latent production, final demand, and product input dependency coefficients while enforcing economic accounting constraints. Graph-derived exposure measures quantify direct, transshipment, value-chain, and multi-hop supply chain dependencies independently of the forecasting model. A temporal graph forecasting architecture based on a relational graph neural network then forecasts the evolution of the graph under mass-balance constraints with distribution-free conformal uncertainty quantification. Validation on the global aluminum supply chain shows that the learned graph representations recover economically meaningful supply chain structure, accurately forecast out-of-sample trade relationships, and produce well-calibrated prediction intervals. Subsequent papers apply this computational foundation to exposure assessment, disruption analysis, and scenario-based policy analysis, and extend the framework to multimaterial supply chain modeling and decision support.

36 MATERIALS SCIENCE↗