Search NASA⌕ Search

SEARCH · Search NASA

Results for “multi-modal”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

A Perspective on Data and Privacy for AI in Healthcare [Industrial and Governmental Activities]

As large language models continue to push the bounds of AI model size, they are also being trained on unprecedented volumes of data. While individual hospitals are estimated to produce petabytes of data per year, only a small fraction is currently being used for developing AI models. Additionally, with such data resources available, healthcare is well-positioned to benefit from the current trends in AI. Moreover, the inherently multi-modal and longitudinal nature of clinical data – from omics to imaging to unstructured notes – provides a fertile ground for the development and application of cutting-edge architectures like foundation models.

Gounley, John [Oak Ridge National Laboratory (ORNL↗
DOE OSTI2026

Throughput Estimation of Data Transport Networks From Digital Twin Measurements

Digital twins of networked infrastructures, known as Virtual Infrastructure Twins (VITs), are increasingly used for software development, pre-deployment testing, and design space exploration. While VITs avoid the costs and potential disruptions associated with experiments on operational networks, their throughput measurements are typically not sufficiently accurate for performance profiling of wide-area networks that they emulate. Here, machine learning (ML) methods are developed to transform these inaccurate VIT network throughput measurements to closely match in peak and overall profile of those from a physical testbed or production network. First, a micro kernel network reflecting a physical network is utilized to collect one-time measurements on a host to support this ML transformation. Then, a generic multi-modal ML method is developed to learn a map that transforms measurements from subsequent VITs on the same host to match past, current and follow-on testbed and cloud networks. ML generalization equations are derived to establish its correctness and probabilistically guarantee its generalization accuracy. Experimental results are presented for a variety of VIT hosts with target testbed and cloud networks; they include a case study of a four-site science ecosystem wherein inaccurate convex VIT measurement profiles are transformed into accurate concave profiles of target networks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

RealisticSensors

An Unreal Engine 5 plugin for generating synchronized, timestamped multi-modal sensor data for machine learning and robotics applications.

Greenwood, Scott↗
DOE OSTI2026

Forensic characterization of surrogate nuclear explosion debris: radiochemical and spectroscopic strategies for method validation

Surrogate nuclear explosion debris (SNED) has emerged as a critical platform for advancing post-detonation nuclear forensic analysis in the absence of readily accessible historic materials. SNED enables controlled investigation and validation of analytical methodologies used to interrogate the chemical, isotopic, radiological, and microstructural signatures preserved in nuclear explosion debris. This review presents an integrated assessment of destructive and non-destructive analytical techniques commonly employed within decision-driven nuclear forensic workflows. Each technique is discussed individually while highlighting how it contributes to different stages of post-detonation analysis. Core methods – including gamma and alpha spectrometry, ICP-MS, TIMS, SIMS, SEM-EDS, XRF, LIBS, vibrational spectroscopy, and X-ray absorption spectroscopy – are critically evaluated with respect to forensic maturity, information content, and matrix limitations. Emphasis is placed on the role of SNED in benchmarking multi-modal workflows and identifying gaps in reproducing heterogeneity, fractionation, and radiation-driven evolution relevant to forensic attribution.

X-ray spectroscopic methods↗
DOE OSTI2026

Data & Code from Phoenix CPPP Phase 2 Analysis

This data and code package supports the analysis presented in “Beyond Surface Cooling: Comprehensive Field Assessment of Reflective Pavement Thermal Performance in Phoenix, Arizona” and provides fully reproducible workflows for evaluating the thermal performance of cool pavement treatments in a hot urban environment. The dataset integrates multi-modal field measurements collected across residential and nonresidential settings, including mobile air temperature traverses, stationary air temperature monitoring, residential mean radiant temperature (MRT) measurements, subsurface temperature profiles, and controlled testbed observations. The data package contains raw and processed datasets in comma-separated value (CSV) format, accompanying metadata files describing site characteristics and measurement protocols, and R scripts (.R files) used for data cleaning, time synchronization, spatial and temporal matching, quality control filtering, statistical comparison, and figure generation. All analyses were conducted using R (version ≥ 4.2.0) with commonly available packages (e.g., tidyverse, lubridate, data.table, ggplot2). No proprietary software is required to reproduce results. Field campaigns were designed to quantify the effects of high-reflectance pavement coatings on surface temperature, near-surface air temperature, subsurface heat propagation, and radiative heat exposure. Temporal alignment procedures include standardized timestamp conversion and nearest-neighbor matching of high-frequency sensor measurements to stop-based metadata within defined tolerance windows to ensure comparability across instruments. The workflows generate summary statistics, treatment–control contrasts, depth-dependent thermal gradients, and time-series visualizations used in the associated publication. By integrating mobile, stationary, radiative, and subsurface measurements within a unified and transparent processing framework, this package enables comprehensive evaluation of cool pavement performance across multiple thermal exposure pathways and supports reuse in future urban heat mitigation and climate resilience studies.

AIR TEMPERATURE↗
DOE OSTI2025

An Advanced Machine Learning and Artificial Intelligence System for Demonstrating Radiation Regulatory Compliance in DOE Accelerator Facilities

In this Phase II proposal, Applied Research LLC (ARLLC), Thomas Jefferson National Accelerator Facility (Jefferson Lab), and Old Dominion University (ODU) propose the combination of domain knowledge (beam characteristics, fixed structural shielding, earthen burden (the soil and foliage added to the dome of the experimental halls as additional shielding), etc.), machine learning (ML) and/or artificial intelligence (AI) to correlate a variety of multi-modal onsite signals and the radiation fields seen in accessible areas of the accelerator site and the site boundary. The ML/AI will consider the complex influence of environmental parameters affecting the radon contribution of the measurements, focusing on actual data obtained from Jefferson Lab. In Phase I, the coded beam and location data were fed into a deep learning model to predict doses at several designated locations in Jefferson Lab’s facility. Moreover, a dense radiation map was generated using only a sparse collection of the samples in a facility. In Phase II, we will develop a software prototype containing a radiation prediction algorithm, dense radiation map algorithms, and background noise prediction algorithms, with actual data used to evaluate the prototype. This work will provide a framework for evaluation of radiation measurement results around the site based on learned responses. In addition, the proposed approach allows more granular mapping of radiation levels. Better understanding and communication of these levels is related to the overall approach in keeping doses to personnel ALARA.

43 PARTICLE ACCELERATORS↗
DOE OSTI2025

Binder jet additive manufacturing of silicon carbide solar reactor

Achieving high powder packing density is critical in binder jet additive manufacturing (BJAM), as it directly influences the final part density, mechanical properties, and sintering behavior. Multi-modal powder blends, which combine particles of different sizes, have been explored as a strategy to optimize packing efficiency and minimize defects. In this study, bimodal and trimodal powder blends were obtained by mixing silicon carbide powder in three different sizes. These results show that increased powder density is achievable with bimodal powder blends but is reduced in trimodal blends, and it was found that a 13% increase in the powder tap density was achieved using a bimodal blend of powder. The powder size distribution of the bimodal blend was measured at various stages during binder jet additive manufacturing and, no measurable powder separation occurred even after eight prints. Overall, this study shows limited advantage to trimodal powder blends but good promise for trimodal blends for increasing printed density while maintaining reusability in the binder jet process.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Cell to Ecosystem: Understanding Methane and Associated Nutrient Cycling by Sediment Hosted Syntrophic Consortia and Their Viral Predators

The anaerobic oxidation of methane (AOM) is a significant worldwide microbial process in anoxic lake and ocean sediments, responsible for sequestering up to 80% of this greenhouse gas. Often considered a metabolism on the edge of thermodynamic probability, the impact of ANaerobic MEthane-oxidizing ‘ANME’ archaea on carbon and nutrient cycling in sediment ecosystems is far reaching. They not only serve as a sink for methane coupled to diverse electron acceptors, but also catalyze the transformation of many important nutrients including nitrogen, phosphate, and iron. While information about the potential mechanisms supporting metabolism in AOM is now available, remarkably little has been learned about their nutritional requirements, their dependencies on bacterial partners, and consequentially their ultimate impact on nutrient transformation and bioavailability within sedimentary ecosystems, and beyond. Further, the role of viruses within sediment ecosystems represents an essential but vastly understudied aspect of the transformation of carbon and nutrients by AOM. Viruses are now widely appreciated as central players in biogeochemical cycles across diverse ecosystems. These nanoscale predators have been shown to enhance the turnover of essential nutrients, thus stimulating microbial growth and environmental viruses themselves may constitute an important reservoir of nitrogen and phosphorous. Little is known about the role of viruses in methane-impacted sedimentary ecosystems, however prior genomic and microscopy evidence suggests that AOM consortia are susceptible to phage infection. The overarching scientific goal of this multi-disciplinary research proposal is to build on these recent discoveries and expand our understanding of interactions and fundamental activities involved in cycling of carbon and nutrients by syntrophic methanotrophic archaeal-bacterial consortia and associated viruses in anoxic sedimentary environments. Our three specific objectives are to 1) Quantify energy and nutrient exchange (e.g. N, P, Fe and vitamins) within AOM consortia and between ANME-bacterial partners; 2) Identify virus-host interactions associated with AOM and assess C and N transfer through viruses in methane-impacted sediment ecosystems; 3) Model energy and nutrient exchange in AOM consortia and viral-host interactions (i.e. viral activity), and their environmental distribution patterns. Our experimental emphasis cuts across scales that are important for understanding microbial and viral interactions and activities within their habitats, as well as community wide biogeochemical transformations. These research goals will be accomplished through the application of novel molecular techniques targeting DNA, RNA, proteins, and metabolites combined with a unique multi-modal analytical imaging pipeline. We will then model the ecophysiological capabilities of diverse sediment-hosted methanotrophic consortia to develop a more comprehensive understanding of the energetic and nutritional interactions between different AOM partner couplings that occur in sediments.

03 NATURAL GAS↗
DOE OSTI2025

Unveiling the Hidden Evolution of Crystal Defects and Disorder in Energy Materials

Control of point defects and disorder in functional thin films and 2D materials is critical to realizing their full potential in applications ranging from energy storage to advanced electronics. However, these phenomena are often poorly understood, difficult to characterize, and challenging to direct with precision. This presentation explores emerging multi-modal computer vision to decipher and predict order in materials across multiple length scales in the electron microscope, from the atomic to the nanoscale. By fusing data from diverse sources, these powerful models provide unprecedented insights into materials' lifecycles, enabling the control of defects and their associated properties at a fundamental level. This capability promises to transform materials design and accelerate the development of next-generation technologies.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2025

Illuminating the Night: A Survey of Super-Resolution Methods for Nighttime Light Images

Nighttime Light (NTL) images provide critical insights into urbanization, disaster response, and energy consumption. The VIIRS Day/Night Band (DNB) sensor offers high-quality NTL imagery with daily revisit rates, but the available spatial resolution hinders fine-grained accurate analysis. Super-resolution techniques aim to increase the resolution of NTL images, enabling more detailed assessments of infrastructure, light pollution, economic activity, and power outages. However, existing state-of-the-art super-resolution methods designed for natural images struggle with the unique characteristics of NTL data. This work provides a comprehensive review of super-resolution methods across multiple image modalities, evaluates their effectiveness on VI-IRS DNB data, and proposes a multi-modal super-resolution approach tailored to NTL imagery. The proposed approach integrates VIIRS DNB data with road networks and land use information to improve reconstruction accuracy and spatial detail. Code is available for this project athttps://code.ornl.gov/viirs-sr/sr-demos.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2025

Integration and Demonstration of Monitoring, Modeling, and Prediction of DV-1 Amendment Performance at the Bench Scale: DV-1 Amendment Demonstration

During fiscal years 2024 and 2025, the U.S. Department of Energy’s Hanford Field Office commissioned Pacific Northwest National Laboratory to conduct applied research aimed at reducing the cost, time, and uncertainty associated with in situ treatment of vadose zone contaminants at the Hanford Site. This report outlines the integration of three key research efforts into a meso-scale demonstration designed to advance field-scale solutions that aim to (1) optimize the delivery of chemical amendments to contaminated soils, (2) reduce uncertainty in amendment delivery performance assessment using advanced monitoring techniques, and (3) provide real-time insights into when and where amendment-induced precipitation reactions occur in the subsurface. To achieve these objectives, the tank-scale (~ 1 cubic meter) Geophysical Imaging of Flow and Transport (GIFT) system was developed. GIFT enables experimental testing of amendment delivery while incorporating automated multi-modal monitoring approaches, including pressure measurements, direct fluid sampling, and remote time-lapse geophysical imaging. The data generated from these monitoring techniques will serve as inputs for a generative artificial-intelligence-driven digital twin – a numerical simulation model designed to honor observed data while quantifying uncertainty in simulation accuracy. Using this simulator, researchers will refine an amendment injection strategy to maximize delivery efficiency within a low-permeability soil zone. Monitoring data will be interpreted through simulated outputs to enhance understanding of the injection process. The efficacy of this integrated approach will be evaluated through direct sampling at the conclusion of the experiment.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2025

Illuminating the Night: A Survey of Super-Resolution Methods for Nighttime Light Images

Nighttime Light (NTL) images provide critical insights into urbanization, disaster response, and energy consumption. The VIIRS Day/Night Band (DNB) sensor offers high-quality NTL imagery with daily revisit rates, but the available spatial resolution hinders fine-grained accurate analysis. Super-resolution techniques aim to increase the resolution of NTL images, enabling more detailed assessments of infrastructure, light pollution, economic activity, and power outages. However, existing state-of-the-art super-resolution methods designed for natural images struggle with the unique characteristics of NTL data. This work provides a comprehensive review of super-resolution methods across multiple image modalities, evaluates their effectiveness on VIIRS DNB data, and proposes a multi-modal super-resolution approach tailored to NTL imagery. The proposed approach integrates VIIRS DNB data with road networks and land use information to improve reconstruction accuracy and spatial detail. Code is available for this project at https://code.ornl.gov/viirs-sr/sr-demos.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2026

Quantum-Inspired Bayesian Sampling for Uncertainty Quantification and Machine Learning (Final Technical Report)

With increasing simulation and measurement data, machine learning and artificial intelligence have been widely used in computational decision-making of complex engineering systems. The resulting tools, such as uncertainty quantification solvers, reinforcement learning, and physics-informed machine learning, have achieved great success in critical DOE tasks such as material discovery and design, energy system modeling and control, and numerical weather and climate prediction. A core topic in scientific machine learning and artificial intelligence is Bayesian inference: given an observed data set, people want to estimate the posterior distribution of a (possibly large) number of hidden parameters. Due to the flexibility and weak assumptions, Bayesian sampling has been the mainstream Bayesian inference solvers despite the rapid progress of approximate Bayesian inference. Classical Bayesian sampling methods such as Markov-chain Monte Carlo suffer from a low-acceptance rate due to the random walk nature, therefore state-of-the-art techniques use Hamiltonian Monte Carlo and its variants to efficiently draw posterior samples in a high dimension. The key idea of Hamiltonian Monte Carlo and its variants is to simulate the Hamiltonian dynamics of a classical particle with a fixed mass, and their performance significantly degrades when the posterior distribution is highly spiky or has multiple modes. Leveraging the idea of quantum physics, this project has investigated new theory, algorithms and applications of Bayesian inference (especially Bayesian sampling). The main results include: (1) novel quantum-inspired Bayesian sampling methods that can lead to better accuracy for challenging multi-modal or spiky distributions, (2) more scalable machine learning framework leveraging tensor-compressed Bayesian inference, and (3) Bayesian and sampling approaches for verifying the robustness of continuous and binary neural networks.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Scalable foundation models for numerical simulations on HPC platforms

In recent years, foundation models (FMs) have begun to reshape numerical simulations on high-performance computing (HPC) platforms. These large, pre-trained AI models enable rapid predictions across a broad range of physical domains, including Earth system modeling, fluid dynamics, materials science, as well as complex multi-modal simulations in aerospace engineering and fusion research. By training on diverse datasets, FMs learn intricate relationships and underlying physical behavior while also enabling the quantification of uncertainty in their predictions. This capability allows simulations that once required days of numerical calculation to be completed in minutes (FM inference), supporting real-time design optimization, uncertainty-aware decision making, and more comprehensive exploration of complex scenarios.

AI↗
DOE OSTI2025

Characterization of the degradation of gamma-irradiated elastomers using Raman spectroscopy

This report presents key findings from Raman spectroscopic analysis of gamma-irradiated rubber samples extracted from a laminated lead-damped rubber (LDR) seismic isolation device. The samples were exposed to gamma radiation from a 60Co source in a Foss Therapy Services gamma irradiator, reaching absorbed doses up to 1600 kGy. A distinct threshold near 400 kGy was identified, beyond which significant spectral changes were observed. Two Raman peaks - at approximately 425 cm-1 and 2440 cm-1 - were tracked as a function of dose using Gaussian fitting. The 425 cm-1 peak, attributed to sulfur–sulfur (S–S) bond stretching (resulting from vulcanization of the rubber), exhibited a dose-dependent upshift, indicating radiation-induced crosslinking within the sulfur-based polymer network. Conversely, the 2440 cm-1 peak, likely associated with vibrational modes of additives or impurities, showed a downward shift with increasing dose, suggesting chain scission and degradation of non-rubber constituents. These results provide first-of-a-kind insights into the microstructural evolution of elastomers under high-dose gamma irradiation and establish a preliminary dose threshold for significant degradation. Future work will incorporate multi-modal characterization—including Fourier Transform Infrared (FTIR) spectroscopy, scanning electrom microscopy (SEM) of the rubber surface morphology, thermogravimetric analysis (TGA) to determine changes in thermal stability, and mechanical testing—to correlate molecular-level changes with macroscopic performance of these elastomers as damping media in seismic isolation devices. These findings are expected to provide regulatory guidance and design criteria for qualifying low-damping rubber seismic isolators in advanced nuclear reactor applications.

36 - MATERIALS SCIENCE↗
DOE OSTI2026

LAF-Net: A Deep Residual and Cross-Attention Framework for Day-Ahead Load Forecasting: Preprint

Accurate day-ahead load forecasting is essential for reliable power system operations and market efficiency. System operators such as the Midcontinent Independent System Operator (MISO) rely on forecasts from multiple vendors, yet combining them effectively remains a persistent challenge due to vendor-specific biases. This paper presents a novel LSTM-Attention Fusion Network with Error Representation (LAF-Net) that enhances day-ahead hourly load forecasting through deep residual learning and multi-modal cross-attention. The proposed model builds a historical error memory from past vendor performance and dynamically queries it with future hour context to generate adaptive, hour-specific trust weights for each vendor. A bounded residual correction further refines forecasts by mitigating systematic and temporally localized errors. Tested on real MISO LBA data with multi-vendor forecasts, LAF-Net consistently outperforms the best vendor baseline across all 38 LBAs, achieving more than a 40% reduction in system-level mean absolute error (MAE) during peak load hours relative to the best vendor baseline.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2026

Entropy-defect synergy for dual luminescence mechanism in spinel: Time-resolved anti-counterfeiting and fingerprint visualization

Multimodal luminescent materials, while promising for anti-counterfeiting, often lack dynamic time-dependent responses and controllable spatial distribution, limiting their encryption capabilities in the spatiotemporal dimension. Here, this work presents a coordinated control strategy based on entropy and defect engineering, and uses a backpropagation (BP) neural network for material screening to successfully prepare spinel Mg 0.8 (Fe 0.04 Co 0.04 Ni 0.04 Cu 0.04 Zn 0.04 )Cr 2 O 4 (MgA 5 CO) phosphors with time-dependent dynamic luminescence behavior. This phosphor simultaneously activated the d-d transition luminescence (∼618 nm) derived from Co 2+ /Cr 3+ and the defect luminescence (∼398 nm) related to zinc vacancies (V Zn ) in a single-phase solid solution. The phosphor exhibits a time-dependent color evolution from pink to purple under fixed-wavelength excitation, due to the different excited-state dynamics and decay lifetimes associated with the d-d transition and defect luminescence. Structural characterization and spectral analysis confirmed the existence of V Zn and its significant role in defect luminescence process. The fluorescent and dynamic luminescent properties of entropy-based spinel oxide enable its use in advanced anti-counterfeiting applications like fingerprint recognition and color-changing dedicated anti-counterfeiting mark, showing promise in high-end and time-dynamic anti-counterfeiting fields. This research not only developed a new type of fluorescent dynamic anti-counterfeiting material, but also provided a new idea for constructing advanced optical functional materials with multiple luminescence mechanisms.

Defect project↗
DOE OSTI2026

Ripening of Rh Nanoparticle Catalysts in Reverse Water–Gas Shift via a Data-Driven Model Combining Physics, Theory, and Experiment

Degradation via sintering is an ongoing challenge that impedes the broad commercial success of supported metallic nanoparticle catalysts. To mitigate degradation via informed catalyst design and process operations, here we aim to disambiguate the underlying mechanisms of sintering by combining theory and experiment in a quantitative framework. While mechanistic sintering models exist, they only model a single sintering pathway, even though multiple sintering mechanisms can occur simultaneously or dominate at different stages of the process. Data-driven machine learning models have emerged as a means to represent complex processes through data regression. However, machine learning models have very large data needs and lack mechanistic insights due to their black-box encoding. To develop an interpretive model of catalyst degradation via sintering, we constructed a hybrid model combining mechanistic “physics-based” models and data-driven methods to obtain both reliable predictions and mechanistic insights regarding experimentally observed sintering phenomena. Focusing on nanoparticle sintering in the Rh–TiO 2 catalyst for the reverse water–gas shift (RWGS) reaction, the hybrid model couples a mechanistic term for Ostwald ripening with energy values calculated via density functional theory (DFT) with a parametric, data-driven discrepancy function term for unmodeled mechanisms. The hybrid model is trained using Bayesian inference with data collected from small-angle X-ray scattering (SAXS) in situ experiments wherein average nanoparticle diameter versus time was measured at three relevant operating temperatures. The calibrated hybrid model results show that an Ostwald ripening-only model parameterized with fixed DFT energies does not fully capture the time and temperature dependence of the SAXS-observed sintering kinetics, and that an additional functional contribution, or DFT energy calibration, is required to reconcile simulation and experiment. Analysis of the hybrid-model error confirms that the hybrid model outperforms both the purely mechanistic and purely data-driven alternatives in terms of expected predictive accuracy for time-evolving average particle sizes. Furthermore, the results support the hypothesis that the Ostwald ripening mechanism is less important for explaining the sintering phenomena as operating temperature increases under an assumed fixed DFT parameterization. This could be explained in one of two ways: either latent, unmodeled sintering mechanisms dominate at higher temperatures, or the DFT uncertainty increases with temperature. The proposed modeling approach directly links theory to experiments and simulations via a statistical hybrid modeling framework and can be extended to other catalytic systems to improve predictive models and mechanistic understanding.

Bayesian hybrid modeling↗