Search NASA⌕ Search

SEARCH · Search NASA

Results for “multi-modal”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2026

Multi-Modal Bayesian Neural Network Surrogates with Conjugate Last-Layer Estimation

As data collection and simulation capabilities advance, multi-modal learning, the task of learning from multiple modalities and sources of data, is becoming an increasingly important area of research. Surrogate models that learn from data of multiple auxiliary modalities to support the modeling of a highly expensive quantity of interest have the potential to aid outer loop applications such as optimization, inverse problems, or sensitivity analyses when multi-modal data are available. We develop two multi-modal Bayesian neural network surrogate models and leverage conditionally conjugate distributions in the last layer to estimate model parameters using stochastic variational inference (SVI). We provide a method to perform this conjugate SVI estimation in the presence of partially missing observations. Here, we demonstrate improved prediction accuracy and uncertainty quantification compared to unimodal surrogate models for both scalar and time series data.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Curation and Dissemination of Complex Multi-Modal Datasets for Radiation Detection, Localization, and Tracking

The PANDAWN sensor network in Chicago, IL, is a state-of-the-art testbed for networked, multi-modal sensing. It integrates AI/data science methods into its operation, from data acquisition to automated data labeling and curation workflows. The curation and dissemination of diverse multi-modal datasets will enable the development of new radiological/nuclear (R/N) detection, localization, and tracking algorithms and methods relevant across the nonproliferation mission space. This article first introduces the PANDAWN sensor network and the features that make it stand out from previous multi-modal data acquisition efforts. We then review the various data streams acquired on the PANDAWN nodes and present the implementation of an automated data curation pipeline that includes the labeling of radiation and contextual data streams. Here, we finally provide a short overview of different studies that leveraged the curated datasets.

Data curation↗
DOE OSTI2026

Multi-modal dynamic radiography using short-pulse laser-generated probe beams

Radiography is an important tool for the interrogation of dynamic experiments in the fields of dynamic properties of materials, and in condensed matter, high explosive, and high-energy-density physics. Multi-modal radiography advances the hypothesis that combining the information delivered by multiple radiographic modalities can lead to more constrained (improved) “reconstruction” of the scene than can be obtained from a single probe. We identify four modalities: multi-probe, time sequence, multi-view, and multi-messenger. Multi-probe radiography is a promising candidate for a next-generation dynamic radiographic facility. High-energy X-rays are the most frequently used probe for dynamic radiography, although recent developments show the utility of proton (pRad), electron (eRad), and neutron probe beams. Because each probing species interacts with material in the radiographic scene through quantitatively different mechanisms, each returns independent information about the scene, which can add extra constraints to the reconstruction process. How to conduct detailed, quantitative “co-analysis” of multiple data streams remains an area of active research. Multi-beam, short-pulse, laser-generated probes offer sufficient dose, an appropriate spectrum, and appropriate spatio-temporal resolution to produce high-quality dynamic radiographs. This paper reports on technology development to advance the state of the art of multi-modal/multi-probe radiography and the pursuit of both deterministic and inferential (AI/ML assisted) co-analysis methodologies to produce more constrained reconstructions from multi-modal data.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2026

mmbo (Multi-modal Bayesian Optimization) [SWR-25-119]

This package implements Bayesian Neural Network (BNN) based surrogate models for multi-modal data. These models are fit using a custom Variational Bayes procedure leveraging conjugate posteriors in the last layer of the network, offering more accurate predictions with better-calibrated uncertainty quantification than mean-field Variational Bayes.

Taylor, Ian [National Laboratory of the Rockies (N↗
DOE OSTI2026

Towards Secure Autonomous Vehicles: An Integrated Edge and Multi-Modal Machine Learning Framework for Intrusion Detection

Autonomous vehicles (AVs) are vulnerable to cyberattacks targeting both internal communication networks and external perception sensors. While edge-based intrusion de- tection for Controller Area Network (CAN) buses offers real-time protection, it cannot detect cross-modal threats. Conversely, multi-modal fusion approaches improve coverage but often lack efficiency for in-vehicle deployment. This thesis integrates two complemen- tary solutions: (1) a lightweight, edge-deployable machine learning framework for CAN bus intrusion detection, and (2) a late-fusion system combining CAN FD and LiDAR data. Together, they form a hierarchical defense capable of handling single-modality and coordi- nated attacks. Simulations show that CAN-only models reach 93% accuracy on simulated DoS, spoofing, replay, and fuzzy attacks, while the fusion system achieves 0.87 AUC and 0.82 F1-score at 2 ms latency. This unified framework establishes a scalable, explainable, and field-ready strategy for AV cybersecurity.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Thermal cycling-driven microstructural changes of eutectic Al–Si phase change materials in SS304 containers revealed by multi-modal imaging

Aluminum-based Al–Si alloys are widely used as phase change materials (PCMs) in thermal energy storage (TES) systems owing to their high volumetric latent heat and superior thermal conductivity. However, their long-term reliability is limited by degradation processes that remain insufficiently understood. In this work, we employ a multimodal, correlative characterization framework to systematically resolve the degradation behavior of eutectic Al–Si PCMs in contact with SS304 containers under repeated thermal cycling. By integrating high-resolution electron microscopy, three-dimensional X-ray fluorescence (3D XRF) imaging, and differential scanning calorimetry (DSC), we directly link spatially resolved compositional and microstructural evolution to changes in thermophysical properties. The correlative analysis reveals that elemental leaching of Fe, Cr, and Ni from the stainless-steel container into the PCM drives the formation of intermetallic compounds (IMCs) both at the interface and within the bulk PCM, leading to pronounced compositional heterogeneity. These interfacial reactions and diffusion-induced transformations progressively destabilize the Al–Si eutectic, reducing the effective phase-transforming fraction. Consistent with these observations, DSC measurements show a decrease in melting temperature and latent heat of fusion with thermal cycling. These results underscore the critical influence of interfacial reactions and material compatibility on the stability, durability, and overall performance of Al–Si-based TES systems.

25 ENERGY STORAGE↗
DOE OSTI2026

Decoding THz‐Driven Dynamic Fingerprints of Ferroelectric Nanotwin Networks

Ultrafast polarization dynamics in ferroelectrics are of considerable interest for high-speed tunable dielectrics and electro-optics. Extended domain wall networks formed in ferroelectric twin nanodomains can support collective dynamics in the terahertz regime but require techniques that track polarization and strain evolution driven by ultrafast stimulus. Here, we use multi-modal probing of THz-pulse-driven excitations in PbTiO 3 /SrTiO 3 superlattices by combining X-ray free electron laser measurements that directly tracks lattice changes, with optical second harmonic generation that tracks the electronic potential coupled with the lattice potential. Dynamical phase-field modeling enables fingerprinting of these collective modes as superpositions of domain “breathing” through wall oscillations and polarization “rotations” with still walls. Ultrafast domain wall motion at 0.1–0.5 THz is observed at practical fields of 100 kV/cm with wall velocities of >4000 m/s, approaching typical speed of sound in PbTiO 3 . A unique “charging” mode is discovered that can electrically charge and discharge domain walls on ∼4 ps time scale thus dynamically tuning wall conductivity. Integrated experimental and theoretical fingerprinting of the dynamical landscape presented here enables ultrafast control of ferroics for high-speed microelectronics and optical applications.

THz dynamics↗
DOE OSTI2024

Quantifying concentration distributions in redox flow batteries with neutron radiography

Abstract The continued advancement of electrochemical technologies requires an increasingly detailed understanding of the microscopic processes that control their performance, inspiring the development of new multi-modal diagnostic techniques. Here, we introduce a neutron imaging approach to enable the quantification of spatial and temporal variations in species concentrations within an operating redox flow cell. Specifically, we leverage the high attenuation of redox-active organic materials (high hydrogen content) and supporting electrolytes (boron-containing) in solution and perform subtractive neutron imaging of active species and supporting electrolyte. To resolve the concentration profiles across the electrodes, we employ an in-plane imaging configuration and correlate the concentration profiles to cell performance with polarization experiments under different operating conditions. Finally, we use time-of-flight neutron imaging to deconvolute concentrations of active species and supporting electrolyte during operation. Using this approach, we evaluate the influence of cell polarity, voltage bias and flow rate on the concentration distribution within the flow cell and correlate these with the macroscopic performance, thus obtaining an unprecedented level of insight into reactive mass transport. Ultimately, this diagnostic technique can be applied to a range of (electro)chemical technologies and may accelerate the development of new materials and reactor designs.

Science & Technology - Other Topics↗
DOE OSTI2026

Throughput Estimation of Data Transport Networks From Digital Twin Measurements

Digital twins of networked infrastructures, known as Virtual Infrastructure Twins (VITs), are increasingly used for software development, pre-deployment testing, and design space exploration. While VITs avoid the costs and potential disruptions associated with experiments on operational networks, their throughput measurements are typically not sufficiently accurate for performance profiling of wide-area networks that they emulate. Here, machine learning (ML) methods are developed to transform these inaccurate VIT network throughput measurements to closely match in peak and overall profile of those from a physical testbed or production network. First, a micro kernel network reflecting a physical network is utilized to collect one-time measurements on a host to support this ML transformation. Then, a generic multi-modal ML method is developed to learn a map that transforms measurements from subsequent VITs on the same host to match past, current and follow-on testbed and cloud networks. ML generalization equations are derived to establish its correctness and probabilistically guarantee its generalization accuracy. Experimental results are presented for a variety of VIT hosts with target testbed and cloud networks; they include a case study of a four-site science ecosystem wherein inaccurate convex VIT measurement profiles are transformed into accurate concave profiles of target networks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

RealisticSensors

An Unreal Engine 5 plugin for generating synchronized, timestamped multi-modal sensor data for machine learning and robotics applications.

Greenwood, Scott↗
DOE OSTI2026

Forensic characterization of surrogate nuclear explosion debris: radiochemical and spectroscopic strategies for method validation

Surrogate nuclear explosion debris (SNED) has emerged as a critical platform for advancing post-detonation nuclear forensic analysis in the absence of readily accessible historic materials. SNED enables controlled investigation and validation of analytical methodologies used to interrogate the chemical, isotopic, radiological, and microstructural signatures preserved in nuclear explosion debris. This review presents an integrated assessment of destructive and non-destructive analytical techniques commonly employed within decision-driven nuclear forensic workflows. Each technique is discussed individually while highlighting how it contributes to different stages of post-detonation analysis. Core methods – including gamma and alpha spectrometry, ICP-MS, TIMS, SIMS, SEM-EDS, XRF, LIBS, vibrational spectroscopy, and X-ray absorption spectroscopy – are critically evaluated with respect to forensic maturity, information content, and matrix limitations. Emphasis is placed on the role of SNED in benchmarking multi-modal workflows and identifying gaps in reproducing heterogeneity, fractionation, and radiation-driven evolution relevant to forensic attribution.

X-ray spectroscopic methods↗
DOE OSTI2026

LAF-Net: A Deep Residual and Cross-Attention Framework for Day-Ahead Load Forecasting: Preprint

Accurate day-ahead load forecasting is essential for reliable power system operations and market efficiency. System operators such as the Midcontinent Independent System Operator (MISO) rely on forecasts from multiple vendors, yet combining them effectively remains a persistent challenge due to vendor-specific biases. This paper presents a novel LSTM-Attention Fusion Network with Error Representation (LAF-Net) that enhances day-ahead hourly load forecasting through deep residual learning and multi-modal cross-attention. The proposed model builds a historical error memory from past vendor performance and dynamically queries it with future hour context to generate adaptive, hour-specific trust weights for each vendor. A bounded residual correction further refines forecasts by mitigating systematic and temporally localized errors. Tested on real MISO LBA data with multi-vendor forecasts, LAF-Net consistently outperforms the best vendor baseline across all 38 LBAs, achieving more than a 40% reduction in system-level mean absolute error (MAE) during peak load hours relative to the best vendor baseline.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Entropy-defect synergy for dual luminescence mechanism in spinel: Time-resolved anti-counterfeiting and fingerprint visualization

Multimodal luminescent materials, while promising for anti-counterfeiting, often lack dynamic time-dependent responses and controllable spatial distribution, limiting their encryption capabilities in the spatiotemporal dimension. Here, this work presents a coordinated control strategy based on entropy and defect engineering, and uses a backpropagation (BP) neural network for material screening to successfully prepare spinel Mg 0.8 (Fe 0.04 Co 0.04 Ni 0.04 Cu 0.04 Zn 0.04 )Cr 2 O 4 (MgA 5 CO) phosphors with time-dependent dynamic luminescence behavior. This phosphor simultaneously activated the d-d transition luminescence (∼618 nm) derived from Co 2+ /Cr 3+ and the defect luminescence (∼398 nm) related to zinc vacancies (V Zn ) in a single-phase solid solution. The phosphor exhibits a time-dependent color evolution from pink to purple under fixed-wavelength excitation, due to the different excited-state dynamics and decay lifetimes associated with the d-d transition and defect luminescence. Structural characterization and spectral analysis confirmed the existence of V Zn and its significant role in defect luminescence process. The fluorescent and dynamic luminescent properties of entropy-based spinel oxide enable its use in advanced anti-counterfeiting applications like fingerprint recognition and color-changing dedicated anti-counterfeiting mark, showing promise in high-end and time-dynamic anti-counterfeiting fields. This research not only developed a new type of fluorescent dynamic anti-counterfeiting material, but also provided a new idea for constructing advanced optical functional materials with multiple luminescence mechanisms.

Defect project↗
DOE OSTI2026

Ripening of Rh Nanoparticle Catalysts in Reverse Water–Gas Shift via a Data-Driven Model Combining Physics, Theory, and Experiment

Degradation via sintering is an ongoing challenge that impedes the broad commercial success of supported metallic nanoparticle catalysts. To mitigate degradation via informed catalyst design and process operations, here we aim to disambiguate the underlying mechanisms of sintering by combining theory and experiment in a quantitative framework. While mechanistic sintering models exist, they only model a single sintering pathway, even though multiple sintering mechanisms can occur simultaneously or dominate at different stages of the process. Data-driven machine learning models have emerged as a means to represent complex processes through data regression. However, machine learning models have very large data needs and lack mechanistic insights due to their black-box encoding. To develop an interpretive model of catalyst degradation via sintering, we constructed a hybrid model combining mechanistic “physics-based” models and data-driven methods to obtain both reliable predictions and mechanistic insights regarding experimentally observed sintering phenomena. Focusing on nanoparticle sintering in the Rh–TiO 2 catalyst for the reverse water–gas shift (RWGS) reaction, the hybrid model couples a mechanistic term for Ostwald ripening with energy values calculated via density functional theory (DFT) with a parametric, data-driven discrepancy function term for unmodeled mechanisms. The hybrid model is trained using Bayesian inference with data collected from small-angle X-ray scattering (SAXS) in situ experiments wherein average nanoparticle diameter versus time was measured at three relevant operating temperatures. The calibrated hybrid model results show that an Ostwald ripening-only model parameterized with fixed DFT energies does not fully capture the time and temperature dependence of the SAXS-observed sintering kinetics, and that an additional functional contribution, or DFT energy calibration, is required to reconcile simulation and experiment. Analysis of the hybrid-model error confirms that the hybrid model outperforms both the purely mechanistic and purely data-driven alternatives in terms of expected predictive accuracy for time-evolving average particle sizes. Furthermore, the results support the hypothesis that the Ostwald ripening mechanism is less important for explaining the sintering phenomena as operating temperature increases under an assumed fixed DFT parameterization. This could be explained in one of two ways: either latent, unmodeled sintering mechanisms dominate at higher temperatures, or the DFT uncertainty increases with temperature. The proposed modeling approach directly links theory to experiments and simulations via a statistical hybrid modeling framework and can be extended to other catalytic systems to improve predictive models and mechanistic understanding.

Bayesian hybrid modeling↗