Search NASA⌕ Search

SEARCH · Search NASA

Results for “multi-modal”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Integration and Demonstration of Monitoring, Modeling, and Prediction of DV-1 Amendment Performance at the Bench Scale: DV-1 Amendment Demonstration

During fiscal years 2024 and 2025, the U.S. Department of Energy’s Hanford Field Office commissioned Pacific Northwest National Laboratory to conduct applied research aimed at reducing the cost, time, and uncertainty associated with in situ treatment of vadose zone contaminants at the Hanford Site. This report outlines the integration of three key research efforts into a meso-scale demonstration designed to advance field-scale solutions that aim to (1) optimize the delivery of chemical amendments to contaminated soils, (2) reduce uncertainty in amendment delivery performance assessment using advanced monitoring techniques, and (3) provide real-time insights into when and where amendment-induced precipitation reactions occur in the subsurface. To achieve these objectives, the tank-scale (~ 1 cubic meter) Geophysical Imaging of Flow and Transport (GIFT) system was developed. GIFT enables experimental testing of amendment delivery while incorporating automated multi-modal monitoring approaches, including pressure measurements, direct fluid sampling, and remote time-lapse geophysical imaging. The data generated from these monitoring techniques will serve as inputs for a generative artificial-intelligence-driven digital twin – a numerical simulation model designed to honor observed data while quantifying uncertainty in simulation accuracy. Using this simulator, researchers will refine an amendment injection strategy to maximize delivery efficiency within a low-permeability soil zone. Monitoring data will be interpreted through simulated outputs to enhance understanding of the injection process. The efficacy of this integrated approach will be evaluated through direct sampling at the conclusion of the experiment.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Illuminating the Night: A Survey of Super-Resolution Methods for Nighttime Light Images

Nighttime Light (NTL) images provide critical insights into urbanization, disaster response, and energy consumption. The VIIRS Day/Night Band (DNB) sensor offers high-quality NTL imagery with daily revisit rates, but the available spatial resolution hinders fine-grained accurate analysis. Super-resolution techniques aim to increase the resolution of NTL images, enabling more detailed assessments of infrastructure, light pollution, economic activity, and power outages. However, existing state-of-the-art super-resolution methods designed for natural images struggle with the unique characteristics of NTL data. This work provides a comprehensive review of super-resolution methods across multiple image modalities, evaluates their effectiveness on VIIRS DNB data, and proposes a multi-modal super-resolution approach tailored to NTL imagery. The proposed approach integrates VIIRS DNB data with road networks and land use information to improve reconstruction accuracy and spatial detail. Code is available for this project at https://code.ornl.gov/viirs-sr/sr-demos.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Quantum-Inspired Bayesian Sampling for Uncertainty Quantification and Machine Learning (Final Technical Report)

With increasing simulation and measurement data, machine learning and artificial intelligence have been widely used in computational decision-making of complex engineering systems. The resulting tools, such as uncertainty quantification solvers, reinforcement learning, and physics-informed machine learning, have achieved great success in critical DOE tasks such as material discovery and design, energy system modeling and control, and numerical weather and climate prediction. A core topic in scientific machine learning and artificial intelligence is Bayesian inference: given an observed data set, people want to estimate the posterior distribution of a (possibly large) number of hidden parameters. Due to the flexibility and weak assumptions, Bayesian sampling has been the mainstream Bayesian inference solvers despite the rapid progress of approximate Bayesian inference. Classical Bayesian sampling methods such as Markov-chain Monte Carlo suffer from a low-acceptance rate due to the random walk nature, therefore state-of-the-art techniques use Hamiltonian Monte Carlo and its variants to efficiently draw posterior samples in a high dimension. The key idea of Hamiltonian Monte Carlo and its variants is to simulate the Hamiltonian dynamics of a classical particle with a fixed mass, and their performance significantly degrades when the posterior distribution is highly spiky or has multiple modes. Leveraging the idea of quantum physics, this project has investigated new theory, algorithms and applications of Bayesian inference (especially Bayesian sampling). The main results include: (1) novel quantum-inspired Bayesian sampling methods that can lead to better accuracy for challenging multi-modal or spiky distributions, (2) more scalable machine learning framework leveraging tensor-compressed Bayesian inference, and (3) Bayesian and sampling approaches for verifying the robustness of continuous and binary neural networks.

97 MATHEMATICS AND COMPUTING↗

Multi-fidelity is the new annealing: Gradient-free learning of posterior densities via transport maps

To tackle concentrated, multi-modal Bayesian inference problems, we propose using an annealed importance sampling procedure. To do this, we form a sequence of annealed distributions and employ transport maps to act as a surrogate of each distribution. This process is demonstrated on a few examples, favorably showing its potential for efficiently parallelizing the process of PDE evaluations and allowing for surrogates that we can sample from exactly.

van Bloemen Waanders, Bart G [Sandia National Labo↗

Scalable foundation models for numerical simulations on HPC platforms

In recent years, foundation models (FMs) have begun to reshape numerical simulations on high-performance computing (HPC) platforms. These large, pre-trained AI models enable rapid predictions across a broad range of physical domains, including Earth system modeling, fluid dynamics, materials science, as well as complex multi-modal simulations in aerospace engineering and fusion research. By training on diverse datasets, FMs learn intricate relationships and underlying physical behavior while also enabling the quantification of uncertainty in their predictions. This capability allows simulations that once required days of numerical calculation to be completed in minutes (FM inference), supporting real-time design optimization, uncertainty-aware decision making, and more comprehensive exploration of complex scenarios.

AI↗

Low-Temperature Annealing of Nanoscale Defects in Polycrystalline Graphite

Polycrystalline graphite contains multi-scale defects, which are difficult to anneal thermally because of the extremely high temperatures involved in the manufacturing process. In this study, we demonstrate annealing of nuclear graphite NBG-18 at temperatures below 28 °C, exploiting the electron wind force, a non-thermal stimulus. High current density pulses were passed through the specimens with a very low-duty cycle so that the electron momentum could mobilize the defects without heating the specimen. The effectiveness of this technique is presented with a significant decrease in electrical resistivity, defect counts from X-ray computed tomography, Raman spectroscopy, and nanoindentation-based mechanical characterization. Such multi-modal evidence highlights the feasibility of nanoscale defect control at temperatures about two orders of magnitude below the graphitization temperature.

Liu, Gongyuan↗

AEPF: Attention-Enabled Point Fusion for 3D Object Detection

Current state-of-the-art (SOTA) LiDAR-only detectors perform well for 3D object detection tasks, but point cloud data are typically sparse and lacks semantic information. Detailed semantic information obtained from camera images can be added with existing LiDAR-based detectors to create a robust 3D detection pipeline. With two different data types, a major challenge in developing multi-modal sensor fusion networks is to achieve effective data fusion while managing computational resources. With separate 2D and 3D feature extraction backbones, feature fusion can become more challenging as these modes generate different gradients, leading to gradient conflicts and suboptimal convergence during network optimization. To this end, we propose a 3D object detection method, Attention-Enabled Point Fusion (AEPF). AEPF uses images and voxelized point cloud data as inputs and estimates the 3D bounding boxes of object locations as outputs. An attention mechanism is introduced to an existing feature fusion strategy to improve 3D detection accuracy and two variants are proposed. These two variants, AEPF-Small and AEPF-Large, address different needs. AEPF-Small, with a lightweight attention module and fewer parameters, offers fast inference. AEPF-Large, with a more complex attention module and increased parameters, provides higher accuracy than baseline models. Experimental results on the KITTI validation set show that AEPF-Small maintains SOTA 3D detection accuracy while inferencing at higher speeds. AEPF-Large achieves mean average precision scores of 91.13, 79.06, and 76.15 for the car class’s easy, medium, and hard targets, respectively, in the KITTI validation set. Results from ablation experiments are also presented to support the choice of model architecture.

Chemistry↗

Towards Next-Generation Urban Decision Support Systems through AI-Powered Construction of Scientific Ontology Using Large Language Models—A Case in Optimizing Intermodal Freight Transportation

The incorporation of Artificial Intelligence (AI) models into various optimization systems is on the rise. However, addressing complex urban and environmental management challenges often demands deep expertise in domain science and informatics. This expertise is essential for deriving data and simulation-driven insights that support informed decision-making. In this context, we investigate the potential of leveraging the pre-trained Large Language Models (LLMs) to create knowledge representations for supporting operations research. By adopting ChatGPT-4 API as the reasoning core, we outline an applied workflow that encompasses natural language processing, Methontology-based prompt tuning, and Generative Pre-trained Transformer (GPT), to automate the construction of scenario-based ontologies using existing research articles and technical manuals of urban datasets and simulations. From these ontologies, knowledge graphs can be derived using widely adopted formats and protocols, guiding various tasks towards data-informed decision support. The performance of our methodology is evaluated through a comparative analysis that contrasts our AI-generated ontology with the widely recognized pizza ontology, commonly used in tutorials for popular ontology software. We conclude with a real-world case study on optimizing the complex system of multi-modal freight transportation. Our approach advances urban decision support systems by enhancing data and metadata modeling, improving data integration and simulation coupling, and guiding the development of decision support strategies and essential software components.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Myna

The additive manufacturing (AM) community has been developing digital factory tools over the past decade to better leverage the multi-modal process data coming out of the advanced manufacturing process. As a result, numerous databases of additive manufacturing process data exist in the literature and in the archival storage of disparate research groups. While some efforts have been made to create a standard ontology for storing and sharing AM data, in practice a variety of data structures are used to store AM build data, even within a single institution. This causes many problems for maintainability and extensibility when attempting to integrate computational modeling tools with experimental data to either validate models or to provide further insight into results and trends. Myna is a Python-based framework that aims to decrease the effort needed to connect individual computational models to the variety of AM process data that exist in different research groups and institutions. This type of software is sometimes referred to as "middleware" or “glueware,” in that it connects disparate databases and applications into a single computational ecosystem. Instead of maintaining unique interfaces between each application and each database, developers can create a single interface from each application to Myna and thereby gain access to the implemented database connections. Similarly, developing a database connection in Myna provides access to the developed simulation applications. This framework greatly simplifies the maintainability of model applications that rely on experimental data. Using external simulation tools, users will also be able to run pre-configured workflows using the built-in workflow manager. Several examples of input files are provided with Myna for different workflows, including melt pool geometry predictions and detailed melt pool and solidification microstructure predictions.

Knapp, GerryL. [Oak Ridge National Laboratory (ORN↗

Anode Upcycling via Tailored Solvent Treatment

To achieve a truly closed-loop direct recycling process for lithium-ion batteries, all component materials must be recovered. To date, direct recycling method development has primarily focused on the high-value transition-metal cathode materials, while the inherently lower-value graphite has been challenging to recover in a cost-effective manner. However, end-of-life graphite contains a unique engineered value due to the presence of the solid electrolyte interphase (SEI). Growth of the SEI during the cell's active lifetime stabilizes the electronically reactive graphite surface through an irreversible consumption of Li, and thus necessitates both excess lithiation of the cathode and a costly and time-intensive formation procedure during manufacturing. An optimized pre-formed SEI that capitalizes on existing SEI components from end-of-life batteries has the potential to significantly reduce cathode lithiation requirements and eliminate the critical bottleneck of formation cycling during cell remanufacturing. Further, retaining Li at the anode obviates the need for a separate Li leaching and recovery step, improving the overall efficiency of the direct recycling line. In this work, we present a novel approach to "upcycling" spent graphite through use of tailored chemical treatment to remove adverse (i.e., highly resistive and/or poorly passivating) SEI species while retaining beneficially passivating components. We have explored a rational set of solvents spanning a range of polarity, proticity, and molecular size to evaluate structure-property-performance relationships between applied solvent(s), removed and remaining SEI species, and electrochemical response of the resulting graphite product. Further, we have developed and optimized a robust and holistic analysis procedure that couples symmetric-cell electrochemical testing, multi-modal materials characterization, and advanced electrochemical modeling. These analysis results inform a set of correlative metrics for graphite performance relative to both solvent properties and upcycled SEI composition. We demonstrate effective tunability in the residual SEI composition by varying solvent identity and concentration, and report on several promising solvent systems that achieve comparable or performance to pristine graphite.

anode recycling↗

Elucidating the corrosion mechanism of Ni-based superalloys in the presence of uranium-containing chloride molten salt

The United States Department of Energy (DOE) is committed to the advancement of nuclear reactor technology through initiatives such as the Advanced Reactor Development Program (ARDP), in an effort to diversify the United States energy portfolio towards more sustainable energy options. The ARDP includes demonstration by industry partners of molten chloride fast reactors (MCFRs). Construction of MCFRs requires qualified nuclear structural materials. Unfortunately, there are no current materials that are fully qualified by the Nuclear Regulatory Commission for the construction of molten salt reactors, including MCFRs. Adapting current structural material qualifications requires expansion of our current knowledgebase on the property-performance relationships regarding corrosion performance. In this investigation, we assess microstructural changes in a Ni-based superalloy after exposure to a UCl3¬-containing chloride salt eutectic mixture through a correlated multi-modal approach combining several advanced characterization techniques, including scanning electron microscopy/focused ion beam (SEM/FIB) and transmission electron microscopy (TEM). SEM/FIB analysis will illustrate changes in elemental composition, microstructure, and isotopic information acquired from energy x-ray dispersive spectroscopy (EDS), electron backscatter diffraction (EBSD), and secondary ion mass spectroscopy (SIMS), respectively. This information will then aid in identifying localized regions to elucidate the corrosion mechanism with TEM through a combination of electron diffraction, electron energy loss spectroscopy (EELS), and additional EDS. The findings from this investigation will further expand our assessment of the corrosion performance of structural materials in molten salt chloride systems, aiding to developing fully qualified materials for construction of MCFRs.

36 MATERIALS SCIENCE↗

Elucidating the corrosion mechanism of commercial Ni-based Superalloys in UCl3 containing-chloride Molten Salt Systems

Molten salt reactors (MSRs) have gained renewed interest, providing several advantages over their predecessors, including the capability to consume spent fuels, enhancing the environmental sustainability of the uranium fuel cycle. For example, molten chloride fast reactors (MCFRs) can reach criticality with molten chloride spent fuel containing high concentrations of impurities, such as actinide products like uranium chloride (UCl3). However, the redox potential of chloride molten salt fuels may change in the presence of these impurities, dictating their corrosivity and in turn the corrosion performance of structural components, such as those constructed from nickel (Ni)-based alloys. The purpose of this investigation is to assess the extent of corrosion of Ni-based alloy, Inconel 617, when exposed to UCl3-LiCl-KCl eutectic salt. Inconel 617 one of only six structural materials that are fully qualified by the American Society for Mechanical Engineers (ASME) Boiler and Pressure Vessel Code for high-temperature nuclear reactor components, making it a technologically mature material to consider for constructing MCFRs. Inconel 617 specimens were submerged in a static LiCl-KCl-UCl3 eutectic salt mixture heated at 700 C for 1000 h under an inert atmosphere. Upon completion, the extent of corrosion was analyzed through a multi-modal characterization approach spanning the engineering to nanoscale, employing computed tomography, focused-ion beam, and transmission electron microscopy techniques. Results from this investigation will enhance our understanding of property-to-performance relationships of candidate structural materials for MSRs with respect to corrosion resistance and interactions between the salt and alloy interface.

36 MATERIALS SCIENCE↗

Hiding-in-Plain-Sight (HiPS) Attack on CLIP for Targetted Object Removal from Images

Machine learning models are known to be vulnerable to adversarial attacks, but prior works have mostly focused on single-modalities. With the rise of large multi-modal models (LMMs) like CLIP, which combine vision and language capabilities, new vulnerabilities have emerged. However, these multimodal targeted attacks aim to completely change the model's output to what the adversary wants. In many realistic scenarios, an adversary might seek to make only subtle modifications to the output, so that the changes go unnoticed by downstream models or even by humans. We introduce Hiding-in-Plain-Sight (HiPS) attacks, a novel class of adversarial attacks that subtly modifies model predictions by selectively concealing target object(s), as if the target object was absent from the scene. We propose two HiPS attack variants, HiPS-cls and HiPS-cap, and demonstrate their effectiveness in transferring to downstream image captioning models, such as CLIP-Cap, for targeted object removal from image captions.

Daw, Arka [ORNL] (ORCID:0009000633191271)↗

Characterization of the degradation of gamma-irradiated elastomers using Raman spectroscopy

This report presents key findings from Raman spectroscopic analysis of gamma-irradiated rubber samples extracted from a laminated lead-damped rubber (LDR) seismic isolation device. The samples were exposed to gamma radiation from a 60Co source in a Foss Therapy Services gamma irradiator, reaching absorbed doses up to 1600 kGy. A distinct threshold near 400 kGy was identified, beyond which significant spectral changes were observed. Two Raman peaks - at approximately 425 cm-1 and 2440 cm-1 - were tracked as a function of dose using Gaussian fitting. The 425 cm-1 peak, attributed to sulfur–sulfur (S–S) bond stretching (resulting from vulcanization of the rubber), exhibited a dose-dependent upshift, indicating radiation-induced crosslinking within the sulfur-based polymer network. Conversely, the 2440 cm-1 peak, likely associated with vibrational modes of additives or impurities, showed a downward shift with increasing dose, suggesting chain scission and degradation of non-rubber constituents. These results provide first-of-a-kind insights into the microstructural evolution of elastomers under high-dose gamma irradiation and establish a preliminary dose threshold for significant degradation. Future work will incorporate multi-modal characterization—including Fourier Transform Infrared (FTIR) spectroscopy, scanning electrom microscopy (SEM) of the rubber surface morphology, thermogravimetric analysis (TGA) to determine changes in thermal stability, and mechanical testing—to correlate molecular-level changes with macroscopic performance of these elastomers as damping media in seismic isolation devices. These findings are expected to provide regulatory guidance and design criteria for qualifying low-damping rubber seismic isolators in advanced nuclear reactor applications.

36 - MATERIALS SCIENCE↗

Elucidating the corrosion mechanism of commercial Ni-based superalloys in UCl3 containing-chloride molten salt systems

Elucidating the role of UCl3 in the corrosion mechanism of Ni-based superalloys exposed to chloride molten salts Trishelle Copeland-Johnson1, Michael Woods1, Ruchi Gakhar1, Daniel J. Murray1, Guoping Cao1, Lingfeng He1 1Idaho National Laboratory, Idaho Falls, ID, United States The United States Department of Energy (DOE) aims to diversify the domestic energy portfolio towards more sustainable options, including implementation of molten salt reactor (MSR) technology. Chloride molten salts have been investigated as an appropriate MSR coolant and fuel because their relatively inexpensive, abundant, and exhibit favorable thermophysical properties. However, the corrosivity of chloride molten salts have not been extensively studied, especially with the inclusion of actinide products, such as UCl3. Accordingly, the development of nuclear structural materials with excellent corrosion performance is critical to the successful implementation of MSRs, particularly from a mechanistic perspective. In this investigation, we attempt to elucidate the interfacial corrosion mechanism between Ni-based structural materials, such as Inconel 617, and UCl3-containing salt systems through a multi-modal advanced characterization approach, including electron microscopy techniques. The findings from this investigation will expand the knowledgebase of chloride molten salt corrosion of MSR structural materials for strategic property-to-performance design.

36 - MATERIALS SCIENCE↗

LAF-Net: A Deep Residual and Cross-Attention Framework for Day-Ahead Load Forecasting: Preprint

Accurate day-ahead load forecasting is essential for reliable power system operations and market efficiency. System operators such as the Midcontinent Independent System Operator (MISO) rely on forecasts from multiple vendors, yet combining them effectively remains a persistent challenge due to vendor-specific biases. This paper presents a novel LSTM-Attention Fusion Network with Error Representation (LAF-Net) that enhances day-ahead hourly load forecasting through deep residual learning and multi-modal cross-attention. The proposed model builds a historical error memory from past vendor performance and dynamically queries it with future hour context to generate adaptive, hour-specific trust weights for each vendor. A bounded residual correction further refines forecasts by mitigating systematic and temporally localized errors. Tested on real MISO LBA data with multi-vendor forecasts, LAF-Net consistently outperforms the best vendor baseline across all 38 LBAs, achieving more than a 40% reduction in system-level mean absolute error (MAE) during peak load hours relative to the best vendor baseline.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Entropy-defect synergy for dual luminescence mechanism in spinel: Time-resolved anti-counterfeiting and fingerprint visualization

Multimodal luminescent materials, while promising for anti-counterfeiting, often lack dynamic time-dependent responses and controllable spatial distribution, limiting their encryption capabilities in the spatiotemporal dimension. Here, this work presents a coordinated control strategy based on entropy and defect engineering, and uses a backpropagation (BP) neural network for material screening to successfully prepare spinel Mg 0.8 (Fe 0.04 Co 0.04 Ni 0.04 Cu 0.04 Zn 0.04 )Cr 2 O 4 (MgA 5 CO) phosphors with time-dependent dynamic luminescence behavior. This phosphor simultaneously activated the d-d transition luminescence (∼618 nm) derived from Co 2+ /Cr 3+ and the defect luminescence (∼398 nm) related to zinc vacancies (V Zn ) in a single-phase solid solution. The phosphor exhibits a time-dependent color evolution from pink to purple under fixed-wavelength excitation, due to the different excited-state dynamics and decay lifetimes associated with the d-d transition and defect luminescence. Structural characterization and spectral analysis confirmed the existence of V Zn and its significant role in defect luminescence process. The fluorescent and dynamic luminescent properties of entropy-based spinel oxide enable its use in advanced anti-counterfeiting applications like fingerprint recognition and color-changing dedicated anti-counterfeiting mark, showing promise in high-end and time-dynamic anti-counterfeiting fields. This research not only developed a new type of fluorescent dynamic anti-counterfeiting material, but also provided a new idea for constructing advanced optical functional materials with multiple luminescence mechanisms.

Defect project↗

Ripening of Rh Nanoparticle Catalysts in Reverse Water–Gas Shift via a Data-Driven Model Combining Physics, Theory, and Experiment

Degradation via sintering is an ongoing challenge that impedes the broad commercial success of supported metallic nanoparticle catalysts. To mitigate degradation via informed catalyst design and process operations, here we aim to disambiguate the underlying mechanisms of sintering by combining theory and experiment in a quantitative framework. While mechanistic sintering models exist, they only model a single sintering pathway, even though multiple sintering mechanisms can occur simultaneously or dominate at different stages of the process. Data-driven machine learning models have emerged as a means to represent complex processes through data regression. However, machine learning models have very large data needs and lack mechanistic insights due to their black-box encoding. To develop an interpretive model of catalyst degradation via sintering, we constructed a hybrid model combining mechanistic “physics-based” models and data-driven methods to obtain both reliable predictions and mechanistic insights regarding experimentally observed sintering phenomena. Focusing on nanoparticle sintering in the Rh–TiO 2 catalyst for the reverse water–gas shift (RWGS) reaction, the hybrid model couples a mechanistic term for Ostwald ripening with energy values calculated via density functional theory (DFT) with a parametric, data-driven discrepancy function term for unmodeled mechanisms. The hybrid model is trained using Bayesian inference with data collected from small-angle X-ray scattering (SAXS) in situ experiments wherein average nanoparticle diameter versus time was measured at three relevant operating temperatures. The calibrated hybrid model results show that an Ostwald ripening-only model parameterized with fixed DFT energies does not fully capture the time and temperature dependence of the SAXS-observed sintering kinetics, and that an additional functional contribution, or DFT energy calibration, is required to reconcile simulation and experiment. Analysis of the hybrid-model error confirms that the hybrid model outperforms both the purely mechanistic and purely data-driven alternatives in terms of expected predictive accuracy for time-evolving average particle sizes. Furthermore, the results support the hypothesis that the Ostwald ripening mechanism is less important for explaining the sintering phenomena as operating temperature increases under an assumed fixed DFT parameterization. This could be explained in one of two ways: either latent, unmodeled sintering mechanisms dominate at higher temperatures, or the DFT uncertainty increases with temperature. The proposed modeling approach directly links theory to experiments and simulations via a statistical hybrid modeling framework and can be extended to other catalytic systems to improve predictive models and mechanistic understanding.

Bayesian hybrid modeling↗