Search NASA⌕ Search

SEARCH · Search NASA

Results for “Multimodal integration”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Achieving Multimodal and Multicolor Luminescence in LaAlO 3 :Pr 3+ , Gd 3+ via Trap Engineering and Energy Transfer

Achieving multimodal luminescence within a single phosphor is vital for multifunctional applications but remains challenging due to complex color tuning and trap engineering. In this study, we report Pr 3+ and Gd 3+ co‐doped LaAlO 3 (LAO:PG) phosphors, designed through careful modulation of multilevel traps and Pr 3+ → Gd 3+ energy transfer dynamics. These materials exhibit diverse luminescence modes, including down‐conversion luminescence (DCL), up‐conversion luminescence (UCL), persistent luminescence (PersL), optically stimulated luminescence (OSL), and thermally stimulated luminescence (TSL) across a wide spectral range. Unlike previously studied Pr 3+ ‐doped LAO, the co‐doped LAO:PG shows DCL in both UV‐visible and NIR regions and displays ultraviolet‐C UCL under visible excitation. Notably, we observe, for the first time, PersL lasting several minutes in these phosphors—an improvement over the non‐PersL behavior of Pr 3+ ‐only doped LAO. Additionally, the LAO:PG phosphors exhibit strong OSL response. TSL analysis reveals five distinct trap levels linked to these properties. Density functional theory calculations further correlate intrinsic defects to these traps, supporting a proposed mechanism for the observed multimodal luminescence. These findings highlight LAO:PG as a promising platform for developing advanced phosphors with integrated luminescence modes, paving the way for future applications in data storage, phototherapy, and anti‐counterfeiting technologies.

Chemistry↗
DOE OSTI2023

Data augmentation and multimodal learning for predicting drug response in patient-derived xenografts from gene expressions and histology images

Patient-derived xenografts (PDXs) are an appealing platform for preclinical drug studies. A primary challenge in modeling drug response prediction (DRP) with PDXs and neural networks (NNs) is the limited number of drug response samples. We investigate multimodal neural network (MM-Net) and data augmentation for DRP in PDXs. The MM-Net learns to predict response using drug descriptors, gene expressions (GE), and histology whole-slide images (WSIs). We explore whether combining WSIs with GE improves predictions as compared with models that use GE alone. We propose two data augmentation methods which allow us training multimodal and unimodal NNs without changing architectures with a single larger dataset: 1) combine single-drug and drug-pair treatments by homogenizing drug representations, and 2) augment drug-pairs which doubles the sample size of all drug-pair samples. Unimodal NNs which use GE are compared to assess the contribution of data augmentation. The NN that uses the original and the augmented drug-pair treatments as well as single-drug treatments outperforms NNs that ignore either the augmented drug-pairs or the single-drug treatments. In assessing the multimodal learning based on the MCC metric, MM-Net outperforms all the baselines. Our results show that data augmentation and integration of histology images with GE can improve prediction performance of drug response in PDXs.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2025

Using multimodal X-ray computed tomography to advance 3D petrography: A non-destructive investigation of olivine inside a carbonaceous chondrite

Rocks form in three dimensions through time and studying them provides information from inside dynamic systems we cannot otherwise observe. Yet how we typically access the interior of the rocks themselves to gain that information may limit our understanding and influence how we reconstruct the processes that formed them. Here, we demonstrate combined non-destructive 3D X-ray imaging techniques that produce quantitative densitometric and crystallographic maps of entire individual grains inside a rock. Olivine grains throughout a sample of the carbonaceous chondrite Northwest Africa (NWA) 11346 were each characterized by size, shape, composition, zoning intensity, and crystallographic orientation. The addition of 3D crystallographic mapping to calibrated 3D densitometric analysis—used to calculate chemical composition—demonstrates a fully non-destructive petrographic method and provides unique insight. For instance, in our case, using crystallographic data to delineate individual grains and then measuring the 3D size, shape, and composition of each distinguishes variably reset relict grains from those later crystallized after a melting event. Intersection in a 2D slice could not have led to this interpretation because the integration of three-dimensional size, rounding, composition, location, and crystallographic orientation measured from each grain forms the key patterns. Multimodal laboratory X-ray imaging has strong potential to advance 3D petrography.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Multimodal Atomic Force Microscopy for the Characterization of Metallic Particulates

This study investigates the utility of multimodal, or functional, atomic force microscopy (AFM) for the characterization of individual particles and particle ensembles. In single-particle analyses, AFM imaging modes provided orthogonal insights into mechanical and magnetic properties that are not accessible through conventional electron microscopy. Although the experiments were inherently delicate and time-intensive, with an observed sample loss rate of approximately 30%, these techniques enabled the qualitative differentiation of grain structures and magnetic domains, underscoring the challenges of experimental robustness. For particle ensembles, AFM enabled the extraction of reliable 2D and 3D particle size distributions. However, efforts to chemically differentiate particles based on mechanical property contrasts were limited by scaling effects and the qualitative nature of the data. Overall, multimodal AFM offers valuable complementary information, but its application requires careful consideration of methodological limitations, particularly for sample integrity, calibration, and scalability of mechanical and magnetic measurements. This report is organized to first address the application of AFM to single-particle analysis using various imaging modalities, followed by its potential role in ensemble-level particle screening and differentiation.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Synergistic Integration of Chemo-Resistive and SERS Sensing for Label-Free Multiplex Gas Detection

Practical sensing applications such as real-time safety alerts and clinical diagnoses require sensor devices to differentiate between various target molecules with high sensitivity and selectivity, yet conventional devices such as oxide-based chemo-resistive sensors and metal-based surface-enhanced Raman spectroscopy (SERS) sensors usually do not satisfy such requirements. In this report a label-free, chemo-resistive/SERS multimodal sensor based on a systematically assembled 3D cross-point multifunctional nanoarchitecture (3D-CMA), which has unusually strong enhancements in both “chemo-resistive” and “SERS” sensing characteristics is introduced. 3D-CMA combines several sensing mechanisms and sensing elements via 3D integration of semiconducting SnO 2 nanowire frameworks and dual-functioning Au metallic nanoparticles. It is shown that the multimodal sensor can successfully estimate mixed-gas compositions selectively and quantitatively at the sub-100 ppm level, even for mixtures of gaseous aromatic compounds (nitrobenzene and toluene) with very similar molecular structures. This is enabled by combined chemo-resistive and SERS multimodal sensing providing complementary information.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Building a Long-Lived 3D Multimode Quantum Processing Unit with TESLA Cavities

Superconducting radio-frequency (SRF) cavities, such as TESLA-shaped cavities, are excellent candidates for long-lived quantum memories. Integrating these cavities with nonlinear elements, such as transmons, enables universal quantum control; however, this integration can often introduce unwanted losses. In this talk, we present the successful integration of a long-lived 2-cell TESLA cavity with an ancillary qubit, forming a quantum processing unit (QPU) that allows for robust control while maintaining coherence. We demonstrate universal control of the QPU through various schemes, including ancilla-cavity sideband and echoed conditional displacement (ECD) methods, enabling fault-tolerant high-fidelity preparation of large Fock states and fast entanglement generation. These results illustrate the versatility and efficiency of our 3D quantum processing unit, paving the way for advanced quantum computing applications.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2026

4D Multimodal Co-attention Fusion Network with Latent Contrastive Alignment for Alzheimer’s Diagnosis

Multimodal neuroimaging provides complementary structural and functional insights into both human brain organization and disease-related dynamics. Recent studies demonstrate enhanced diagnostic sensitivity for Alzheimer’s disease (AD) through synergistic integration of neuroimaging data (e.g., sMRI, fMRI) with tabular data (e.g., behavioral and cognitive tests). However, the intrinsic heterogeneity across modalities (e.g., 4D spatiotemporal fMRI dynamics vs. 3D anatomical sMRI structure) presents critical challenges for discriminative feature fusion, often leading to information loss or biased fusion. To bridge this gap, we propose M2M-AlignNet: a multimodal co-attention network with latent alignment for early AD diagnosis using sMRI and fMRI. At the core of our approach is a multi-patch-to-multi-patch (M2M) contrastive loss function that quantifies and reduces representational discrepancies via weighted patch correspondence, explicitly aligning fMRI components across brain regions with their sMRI structural substrates without one-to-one constraints. Additionally, we propose a latent-as-query co-attention module to autonomously discover fusion patterns, circumventing modality prioritization biases while minimizing feature redundancy. We conduct extensive experiments to confirm the effectiveness of our method and highlight the correspondence between fMRI and sMRI as AD biomarkers.

Wei, Yuxiang [Georgia Institute of Technology]↗
DOE OSTI2023

Scaling Subspace-Driven Approaches Using Information Fusion

In this work, we seek to exploit the deep structure of multi-modal data to robustly exploit the group subspace distribution of the information using the Convolutional Neural Networks (CNNs) formalism. Upon unfolding the set of subspaces constituting each data modality, and learning their corresponding encoders, an optimized integration of the generated inherent information is carried out to yield a characterization of various classes. Referred to as deep Multimodal Robust Group Subspace Clustering (DRoGSuRe), this approach is compared against the independently developed state-of-the-art approach named Deep Multimodal Subspace Clustering (DMSC). Experiments on different multimodal datasets show that our approach is competitive and more robust in the presence of noise.

Ghanem, Sally↗
DOE OSTI2021

Direct Observation of Plasma-Stimulated Activation of Surface Species Using Multimodal In Situ/Operando Spectroscopy Combining Polarization-Modulation Infrared Reflection-Absorption Spectroscopy, Optical Emission Spectroscopy, and Mass Spectrometry

Nonthermal plasmas (NTPs) produce reactive chemical environments, including electrons, ions, radicals, and vibrationally excited molecules, that can drive chemistry at temperatures at which such species are thermally inaccessible. There has been growing interest in the integration of conventional catalysis with reactive NTPs to promote novel chemical transformations. Unveiling the full potential of plasma-catalytic processes requires a comprehensive understanding of plasma-catalytic synergies, including characterization of plasma-catalytic surface interactions. In this work, we report on a newly designed multimodal spectroscopic instrument combining polarization-modulation infrared reflection-absorption spectroscopy (PM-IRAS), mass spectrometry, and optical emission spectroscopy (OES) for the investigation of plasma–surface interactions such as those found in plasma catalysis. In particular, this tool has been utilized to correlate plasma-phase chemistry with both surface chemistry and gas-phase products in situ (1) during the deposition of carbonaceous surface species via NTP-promoted nonoxidative coupling of methane and (2) during subsequent activation of surface deposits with an atmospheric pressure and temperature argon plasma jet on both nickel (Ni) and silicon dioxide (SiO 2 ) surfaces. For the first time, the activation of carbonaceous surface species by a NTP on Ni and SiO 2 surfaces to form hydrogen gas and C 2 hydrocarbons was directly observed, where both PM-IRAS and OES measurements suggest that they may form through different pathways. Furthermore, this unique tool for studying plasma–surface interactions could enable more rational design of plasma-stimulated catalytic processes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2020

30 cm Drop Modeling

This report documents modeling and analysis of the 30 cm cask drop scenario for spent nuclear fuel (SNF) casks. The 30 cm drop is an important hypothetical dynamic loading scenario for SNF because 10 CFR 71.71 defines testing requirements for normal conditions of transport (NCT) of SNF packages, and free drop (of 30 cm for the heaviest packages) tests are required. Other NCT conditions specified in 10 CFR 71.71 include vibration normally incident to transport, and DOE’s multimodal transportation test (MMTT) and related analysis concluded that mechanical shock and vibration incident to transportation is negligible for SNF structural integrity because the loads are so small. The SNF cask 30 cm drop has a lot more potential to cause damage to SNF because the kinetic energy and momentum of the system is stopped abruptly during the cask impact event. Test data and model predictions both agree that the SNF assemblies are subjected to significantly higher loads in a cask drop event than normal transportation shock and vibration, but currently there is no reason to expect gross structural damage of the fuel assembly or widespread SNF cladding failure as a result of a 30 cm cask drop. The ultimate goal of this work is to close the knowledge gap of stress profiles on SNF rods and fuel assembly components during NCT, and this report describes the progress toward reaching that goal as well as a plan for finishing this work over the next year or two. Key remaining tasks include refining the fuel assembly model, calculating a selection of specific fuel assembly cases to populate the damage model, and finally running the damage model to predict the full general response range of 30 cm drop loads on SNF.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2022

Micromobility Integrated Transit and Infrastructure for Efficiency (MITIE)

Nearly omnipresent in many cities of all sizes across the United States, micromobility vehicles-e-scooters, manual bicycles, e-bicycles, and larger seated electric scooters-are notably missing from SMART Mobility research. This project aims to expand the spectrum of modes currently being researched within SMART Mobility by exploring micromobility as an important tool toward meeting energy-efficient mobility goals. It expands on findings from SMART Mobility 1.0 that revealed preferences to reduce transportation-related expenses through use of a network of mobility-as-a-service (MaaS) and other shared mobility options, and builds on findings from a 2019 Vehicle Technology Analysis Program (VTAP) funded micromobility project conducted by our team. We will explore multiple facets of micromobility, including behavior and decision-making, the integration of micromobility within transportation infrastructure, energy estimates, and operations. Guiding research questions include: (1) What are the potential energy savings from low, medium, and high market penetration of micromobility (in passenger, multimodal, and freight domains)? (2) Which scenarios for micromobility use and related enablement of increased public transit use should be modeled/considered in the SMART 2.0 Workflow? (3) To what degree can micromobility supplement/complement transit system operations? (4) What are people's preferences towards micromobility? How do preferences vary across various sociodemographic segments? How can this knowledge inform operations? (5) What are optimal strategies to attain high user adoption and shift users toward more energy-efficient mode choices in terms of micromobility operation? How do these strategies affect energy savings, person-miles traveled, lifecycle energy use, and adoption rates? These questions will be addressed through applied research in five project emphasis areas: (1) Energy estimates of micromobility for Workflow scenarios: Expand and refine previous micromobility work to augment the Workflow approaches to modeling urban travel. (2) Multimodal connection with transit: Utilizing Mobility-Energy Productivity (MEP) tools to evaluate multimodal travel patterns enabled by micromobility, including assessing how to reduce barriers of inequity of access to mobility options and destinations. (3) Mode choice, induced demand, and infrastructure: Understanding the mode shift induced through micromobility to inform energy impact analysis. (4) Energy optimization of micromobility operations: Identification of micromobility operations parameters and development of operations scenarios to better understand present-day micromobility operations for integration into the Workflow, in partnership with BEAM and POLARIS modeling teams. (5) Micro-freight: Characterize the current state of micro-freight activities, including energy effects and geospatial analyses, to inform Workflow.

ADVANCED PROPULSION SYSTEMS,POWER TRANSMISSION AND↗
DOE OSTI2023

Micromobility Integrated Transit and Infrastructure for Efficiency (MITIE)

Nearly omnipresent in many cities of all sizes across the United States, micromobility vehicles-e-scooters, manual bicycles, e-bicycles, and larger seated electric scooters-are notably missing from SMART Mobility research. This project aims to expand the spectrum of modes currently being researched within SMART Mobility by exploring micromobility as an important tool toward meeting energy-efficient mobility goals. It expands on findings from SMART Mobility 1.0 that revealed preferences to reduce transportation-related expenses through use of a network of mobility-as-a-service (MaaS) and other shared mobility options, and builds on findings from a 2019 Vehicle Technology Analysis Program (VTAP) funded micromobility project conducted by our team. We will explore multiple facets of micromobility, including behavior and decision-making, the integration of micromobility within transportation infrastructure, energy estimates, and operations. Guiding research questions include: 1) what are the potential energy savings from low, medium, and high market penetration of micromobility (in passenger, multimodal, and freight domains)? 2) which scenarios for micromobility use and related enablement of increased public transit use should be modeled/considered in the SMART 2.0 Workflow? 3) to what degree can micromobility supplement/complement transit system operations? 4) what are people's preferences towards micromobility? How do preferences vary across various sociodemographic segments? How can this knowledge inform operations? 5) what are optimal strategies to attain high user adoption and shift users toward more energy-efficient mode choices in terms of micromobility operation? How do these strategies affect energy savings, person-miles traveled, lifecycle energy use, and adoption rates? These questions will be addressed through applied research in five project emphasis areas: 1) energy estimates of micromobility for Workflow scenarios: Expand and refine previous micromobility work to augment the Workflow approaches to modeling urban travel; 2) multimodal connection with transit: Utilizing Mobility-Energy Productivity (MEP) tools to evaluate multimodal travel patterns enabled by micromobility, including assessing how to reduce barriers of inequity of access to mobility options and destinations; 3) mode choice, induced demand, and infrastructure: Understanding the mode shift induced through micromobility to inform energy impact analysis; 4) energy optimization of micromobility operations: Identification of micromobility operations parameters and development of operations scenarios to better understand present-day micromobility operations for integration into the Workflow, in partnership with BEAM and POLARIS modeling teams; 5) micro-freight: Characterize the current state of micro-freight activities, including energy effects and geospatial analyses, to inform Workflow.

ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2026

Thermal cycling-driven microstructural changes of eutectic Al–Si phase change materials in SS304 containers revealed by multi-modal imaging

Aluminum-based Al–Si alloys are widely used as phase change materials (PCMs) in thermal energy storage (TES) systems owing to their high volumetric latent heat and superior thermal conductivity. However, their long-term reliability is limited by degradation processes that remain insufficiently understood. In this work, we employ a multimodal, correlative characterization framework to systematically resolve the degradation behavior of eutectic Al–Si PCMs in contact with SS304 containers under repeated thermal cycling. By integrating high-resolution electron microscopy, three-dimensional X-ray fluorescence (3D XRF) imaging, and differential scanning calorimetry (DSC), we directly link spatially resolved compositional and microstructural evolution to changes in thermophysical properties. The correlative analysis reveals that elemental leaching of Fe, Cr, and Ni from the stainless-steel container into the PCM drives the formation of intermetallic compounds (IMCs) both at the interface and within the bulk PCM, leading to pronounced compositional heterogeneity. These interfacial reactions and diffusion-induced transformations progressively destabilize the Al–Si eutectic, reducing the effective phase-transforming fraction. Consistent with these observations, DSC measurements show a decrease in melting temperature and latent heat of fusion with thermal cycling. These results underscore the critical influence of interfacial reactions and material compatibility on the stability, durability, and overall performance of Al–Si-based TES systems.

25 ENERGY STORAGE↗
DOE OSTI2022

Computational Design of Alloys for Energy Technologies

Advanced materials that maintain their mechanical performance under elevated temperatures, corrosive environments, and a range of static and evolving stresses are needed to improve the efficiency and reduce the environmental impact of a wide spectrum of energy technologies. For instance, cost-efficient alloys that can withstand high temperatures (e.g., 700 °C) have a critical role in improving the efficiency and economics of power generation to support decarbonization of the energy sector; such is true of both the nuclear and fossil energy sectors. Considering both the threats of the energy crisis, namely soaring costs of greenhouse gas emission-producing energy and climate change, it is essential to increase the pace of material discovery and enable rapid paths for material qualification to advance clean energy technologies. Conventionally, alloy development has followed a slow Edisonian process that uses repeated cycles of making, characterizing, and modifying to arrive at optimum composition and processing conditions to achieve the desired component performance. This optimization is followed by the necessary stepwise materials qualification. Furthermore, the increasing adoption of sound data management and physics-informed machine learning represents the next step in the acceleration of materials design and development. In the integrated computational materials engineering (ICME) approach, computational modeling and simulation data from different length and time scales can be combined with complex microstructural details from multimodal experimental characterization and selective property testing to close the design loop for rapid alloy development.

Computational Design Of Materials↗
DOE OSTI2026

Multimodal Approaches for Leveraging Domain Knowledge with State-of-the-Art Machine Learning to Engineer Biocatalysts

This grant aimed to accelerate the development of specialized enzymes—biological catalysts essential for sustainable manufacturing and medicine—by integrating traditional laboratory evolution with cutting-edge artificial intelligence. To achieve this, we developed a suite of high-throughput sequencing tools and a centralized database to bridge the gap between a protein’s genetic "code" and its physical function. By training machine learning models on large datasets, we also demonstrated the ability to move beyond slow, trial-and-error testing to a "generative" approach, where AI can independently design new, versatile enzymes like tryptophan synthases. Ultimately, these findings demonstrate that combining laboratory data with computer-guided design enables the engineering of highly efficient biological tools with unprecedented speed and precision.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Folding at the Microscale: Enabling Multifunctional 3D Origami‐Architected Metamaterials

Abstract Mechanical metamaterials inspired by the Japanese art of paper folding have gained considerable attention because of their potential to yield deployable and highly tunable assemblies. The inherent foldability of origami structures enlarges the material design space with remarkable properties such as auxeticity and high deformation recoverability and deployability, the latter being key in applications where spatial constraints are pivotal. This work integrates the results of the design, 3D direct laser writing fabrication, and in situ scanning electron microscopic mechanical characterization of microscale origami metamaterials, based on the multimodal assembly of Miura‐Ori tubes. The origami‐architected metamaterials, achieved by means of microfabrication, display remarkable mechanical properties: stiffness and Poisson’s ratio tunable anisotropy, large degree of shape recoverability, multistability, and even reversible auxeticity whereby the metamaterial switches Poisson’s ratio sign during deformation. The findings here reported underscore the scalable and multifunctional nature of origami designs, and pave the way toward harnessing the power of origami engineering at small scales.

Lin, Zhaowen↗
DOE OSTI2024

Linewidth narrowing in self-injection locked lasers: Effects of quantum confinement

This paper explores the impact of gain medium on linewidth narrowing in integrated self-injection locked III–V/SiN lasers, theoretically and experimentally. We focus on the effects of carrier densities of states in zero- and two-dimensional structures due to quantum-dot and quantum-well confinement. The theoretical approach includes (a) multimode laser interaction to treat mode competition and wave mixing, (b) quantum-optical contributions from spontaneous emission, and (c) composite laser/free-space eigenmodes to describe outcoupling and coupling among components within an extended cavity. For single-cavity lasers, such as distributed feedback lasers, the model reproduces the experimentally observed better linewidth performance of quantum-dot active regions over quantum-well ones. When applied to integrated III–V/SiN lasers, our analysis indicates Hz-level linewidth performance for both quantum-dot and quantum-well gain media due to overcoming the difference in carrier-induced refractive index by incorporating a high-Q SiN passive resonator. Trade-offs are also explored between linewidth, output power, and threshold current.

Cavity quantum electrodynamics↗
DOE OSTI2024

CrossMP: Enabling Cross-Modality Translation between Single-Cell RNA-Seq and Single-Cell ATAC-Seq through Web-Based Portal

In recent years, there has been a growing interest in profiling multiomic modalities within individual cells simultaneously. One such example is integrating combined single-cell RNA sequencing (scRNA-seq) data and single-cell transposase-accessible chromatin sequencing (scATAC-seq) data. Integrated analysis of diverse modalities has helped researchers make more accurate predictions and gain a more comprehensive understanding than with single-modality analysis. However, generating such multimodal data is technically challenging and expensive, leading to limited availability of single-cell co-assay data. Here, we propose a model for cross-modal prediction between the transcriptome and chromatin profiles in single cells. Our model is based on a deep neural network architecture that learns the latent representations from the source modality and then predicts the target modality. It demonstrates reliable performance in accurately translating between these modalities across multiple paired human scATAC-seq and scRNA-seq datasets. Additionally, we developed CrossMP, a web-based portal allowing researchers to upload their single-cell modality data through an interactive web interface and predict the other type of modality data, using high-performance computing resources plugged at the backend.

59 BASIC BIOLOGICAL SCIENCES↗