Search NASA⌕ Search

SEARCH · Search NASA

Results for “Multimode”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6

Femtosecond multimodal imaging with a laser-driven X-ray source

Laser-plasma accelerators are compact linear accelerators based on the interaction of high-power lasers with plasma to form accelerating structures up to 1000 times smaller than standard radiofrequency cavities, and they come with an embedded X-ray source, namely betatron source, with unique properties: small source size and femtosecond pulse duration. A still unexplored possibility to exploit the betatron source comes from combining it with imaging methods able to encode multiple information like transmission and phase into a single-shot acquisition approach. In this work, we combine edge illumination-beam tracking (EI-BT) with a betatron X-ray source and present the demonstration of multimodal imaging (transmission, refraction, and scattering) with a compact light source down to the femtosecond timescale. The advantage of EI-BT is that it allows multimodal X-ray imaging technique, granting access to transmission, refraction and scattering signals from standard low-coherence laboratory X-ray sources in a single shot.

43 PARTICLE ACCELERATORS↗

A multimodal large language model for materials science

Understanding and predicting the properties of inorganic materials is crucial for accelerating advancements in materials science and driving applications in energy, electronics and beyond. Integrating material structure data with language-based information through multimodal large language models (LLMs) offers great potential to support these efforts by enhancing human–artificial intelligence interaction. However, a key challenge lies in integrating atomic structures at full resolution into LLMs. In this work, we introduce MatterChat, a versatile structure-aware multimodal LLM that unifies material structural data and textual inputs into a single cohesive model. MatterChat uses a bridging module to effectively align a pretrained universal machine learning interatomic potential with a pretrained LLM, reducing training costs and enhancing flexibility. Our results demonstrate that MatterChat greatly improves performance in material property prediction and human–artificial intelligence interaction, surpassing general-purpose LLMs such as GPT-4. We also demonstrate its usefulness in applications such as more advanced scientific reasoning and step-by-step material synthesis.

Tang, Yingheng [Lawrence Berkeley National Laborat↗

Importance of multimodal characterization and influence of residual Li 2 S impurity in amorphous Li 3 PS 4 inorganic electrolytes

Amorphous Li 3 PS 4 (LPS) solid-state electrolytes are promising for energy-dense lithium metal batteries. LPS glass, synthesized from a 3:1 mol ratio of Li 2 S and P 2 S 5 , has high ionic conductivity and can be synthesized by ball milling or solution processing. Ball milling has been attractive because it provides the easiest route to access amorphous LPS with a conductivity of 3.5 × 10 –4 S cm –1 (20 °C). However, achieving the complete reaction of precursors via ball milling can be difficult, and most literature reports use X-ray diffraction (XRD) or Raman spectroscopy to confirm sample purity, both of which have limitations. Furthermore, the effect of residual precursors on ionic conductivity and lithium metal cycling is unknown. In this work, we illustrate the importance of multimodal characterization to determine LPS phase and chemical purity. To determine the residual Li 2 S content in LPS, we show that (1) XRD and 31 P solid state nuclear magnetic resonance (ssNMR) are insufficient and (2) Raman loses sensitivity at concentrations below 12 mol% Li 2 S. Most importantly, we show that 7 Li ssNMR is highly sensitive. Using 7 Li ssNMR, we investigate the effect of ball milling parameters and develop a robust and highly reproducible procedure for pure LPS synthesis. We find that as the residual Li 2 S precursor content increases, LPS conductivity decreases and lithium metal batteries exhibit higher overpotentials and poor cycle life. Furthermore, our work reveals the importance of multimodal characterization techniques for amorphous solid-state electrolyte characterization and will enable better synthetic strategies for highly conductive electrolytes for efficient energy-dense solid-state lithium metal batteries.

25 ENERGY STORAGE↗

In situ spin coater for multimodal grazing incidence x-ray scattering studies

We present herein a custom-made, in situ, multimodal spin coater system with an integrated heating stage that can be programmed with spinning and heating recipes and that is coupled with synchrotron-based, grazing-incidence wide- and small-angle x-ray scattering. The spin coating system features an adaptable experimental chamber, with the ability to house multiple ancillary probes such as photoluminescence and visible optical cameras, to allow for true multimodal characterization and correlated data analysis. This system enables monitoring of structural evolutions such as perovskite crystallization and polymer self-assembly across a broad length scale (2 Å–150 nm) with millisecond temporal resolution throughout a complete thin film fabrication process. The use of this spin coating system allows scientists to gain a deeper understanding of temporal processes of a material system, to develop ideal conditions for thin film manufacturing.

47 OTHER INSTRUMENTATION↗

Multimodal correlative study of Hall transport and magnetic phases in Fe/Gd multilayer systems

The Fe/Gd multilayer system hosts a number of magnetic phases, such as stripe, mixed stripe and skyrmion, skyrmion lattice, and isolated skyrmions for a wide range of temperature and magnetic field. We report different Hall transport signals in a Fe/Gd system through multimodal correlative resonant soft x-ray scattering (RSXS), Hall effect, magneto-optic Kerr effect, and transmission x-ray microscopy measurements. The simultaneous nature of the RSXS and Hall transport measurements allowed us to accurately connect various features in the transport data with the specific magnetic phases. We found that the topological Hall effect (THE) shows peaks with opposite signs, which we attribute to two different mechanisms. Our multimodal correlative study indicates that the sign reversal in THE occurs when the system transforms to and from a skyrmion lattice and low density isolated skyrmion phases. We propose that the skyrmion lattice contributes to the THE through a Berry phase induced emergent magnetic field mechanism in one case, and a skew scattering mechanism corresponding to the isolated low density skyrmion state.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Shock tube simulations for the three-layer Richtmyer–Meshkov instability with single-mode and multimode perturbations

While the canonical two-component, single-mode Richtmyer–Meshkov instability (RMI) has been extensively studied, relatively less work has focused on the effects of an additional intermediate-density middle layer. This work investigates such three-material RMI configurations at two Atwood number scenarios using the ARES hydrodynamics code. After validation against previous experimental and computational studies, setups corresponding to recent three-layer shock tube experiments are simulated. Cases with both single-mode and multimode perturbations are studied to quantify mixing across the interface between the materials with highest and intermediate density. In particular, this work is able to comprehensibly examine differences between two- and three-dimensional setups for the single-mode and multimode problems. Observations from previous two-layer investigations still apply in the three-layer setup, but over the time horizons considered, there appears to be insufficient nonlinear mode coupling to create significant differences between two- and three-dimensional simulations following the first passage of a shock. Finally, additional reshock simulations have additional nonlinear growth that does result in expected differences between two- and three-dimensional cases in this three-layer setup, but significant differences do not manifest during the time horizon studied.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Pump depletion in Raman lasing in a graded index multimode fibre

We examine multimode diode laser pump depletion in a graded index multimode (MM) fibre Raman laser generating a high-quality Stokes beam. Spatial ‘hole burning’ in the transmitted pump beam is demonstrated. A balance model is constructed for interaction of the pump and Stokes waves in the MM Raman laser. Analytical formulas are derived and used in calculations demonstrating qualitative agreement with experimental data. The origin of the observed quantitative discrepancies is discussed. (paper)

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Multimodal, Multidimensional, and Multiscale X-ray Imaging at the National Synchrotron Light Source II

Over the last couple of decades, the synchrotron radiation research community has witnessed tremendous advancement in the field of x-ray imaging and microscopy. Continuing enhancement of the light sources’ brightness, advances in x-ray focusing optics, incorporation of precision instruments, and development of innovative imaging techniques are some of the leading contributors for the rapid progress. New imaging and microscopy beamlines, such as the ones at the National Synchrotron Light Source II (NSLS-II), a Department of Energy (DOE) Office of Science user facility located at DOE’s Brookhaven National Laboratory, are capable of performing more sophisticated and complicated measurements than ever before, either on their own or used together as a suite of tools. These sophisticated and complex measurements exhibit attributes for multimodal, multidimensional, and multiscale imaging. Recent popularity of these methods is strongly driven by the current trends in materials characterizations, where researchers desire to map out hierarchical materials structure over a large range of length scales, to understand structure-property correlation, to quantify materials structures in 3D, and/or to perform operando or in situ experiments. It is important to emphasize that “materials” under investigation are not only synthesized materials but also the natural materials. In this article, we describe multimodal, multidimensional and multiscale x-ray imaging capabilities of the NSLS-II beamlines and how these methods are used to tackle complex scientific problems.

47 OTHER INSTRUMENTATION↗

Multimodal representation learning for predicting molecule–disease relations

Motivation: Predicting molecule–disease indications and side effects is important for drug development and pharmacovigilance. Comprehensively mining molecule–molecule, molecule–disease and disease–disease semantic dependencies can potentially improve prediction performance. Methods: We introduce a Multi-Modal REpresentation Mapping Approach to Predicting molecular-disease relations (M2REMAP) by incorporating clinical semantics learned from electronic health records (EHR) of 12.6 million patients. Specifically, M2REMAP first learns a multimodal molecule representation that synthesizes chemical property and clinical semantic information by mapping molecule chemicals via a deep neural network onto the clinical semantic embedding space shared by drugs, diseases and other common clinical concepts. To infer molecule–disease relations, M2REMAP combines multimodal molecule representation and disease semantic embedding to jointly infer indications and side effects. Results: We extensively evaluate M2REMAP on molecule indications, side effects and interactions. Results show that incorporating EHR embeddings improves performance significantly, for example, attaining an improvement over the baseline models by 23.6% in PRC-AUC on indications and 23.9% on side effects. Further, M2REMAP overcomes the limitation of existing methods and effectively predicts drugs for novel diseases and emerging pathogens. Availability and implementation: The code is available at https://github.com/celehs/M2REMAP, and prediction results are provided at https://shiny.parse-health.org/drugs-diseases-dev/.

59 BASIC BIOLOGICAL SCIENCES↗

Multimodal X-ray nano-spectromicroscopy analysis of chemically heterogeneous systems

Abstract Understanding the nanoscale chemical speciation of heterogeneous systems in their native environment is critical for several disciplines such as life and environmental sciences, biogeochemistry, and materials science. Synchrotron-based X-ray spectromicroscopy tools are widely used to understand the chemistry and morphology of complex material systems owing to their high penetration depth and sensitivity. The multidimensional (4D+) structure of spectromicroscopy data poses visualization and data-reduction challenges. This paper reports the strategies for the visualization and analysis of spectromicroscopy data. We created a new graphical user interface and data analysis platform named XMIDAS (X-ray multimodal image data analysis software) to visualize spectromicroscopy data from both image and spectrum representations. The interactive data analysis toolkit combined conventional analysis methods with well-established machine learning classification algorithms (e.g. nonnegative matrix factorization) for data reduction. The data visualization and analysis methodologies were then defined and optimized using a model particle aggregate with known chemical composition. Nanoprobe-based X-ray fluorescence (nano-XRF) and X-ray absorption near edge structure (nano-XANES) spectromicroscopy techniques were used to probe elemental and chemical state information of the aggregate sample. We illustrated the complete chemical speciation methodology of the model particle by using XMIDAS. Next, we demonstrated the application of this approach in detecting and characterizing nanoparticles associated with alveolar macrophages. Our multimodal approach combining nano-XRF, nano-XANES, and differential phase-contrast imaging efficiently visualizes the chemistry of localized nanostructure with the morphology. We believe that the optimized data-reduction strategies and tool development will facilitate the analysis of complex biological and environmental samples using X-ray spectromicroscopy techniques.

36 MATERIALS SCIENCE↗

Coherent Pulse Echo in Hybrid Magnonics with Multimode Phonons

We report the hybridization of magnons and phonons is playing a critical role in the emerging field of hybrid magnonics because it combines the high tunability of magnetism with the long lifetime of mechanics for comprehensive coherent information processing. Recently there has been increasing interest in thin-film bulk acoustic waves because of their long lifetimes at high frequencies. However, the unique multimode nature of such phonon modes has not been exploited as an important resource for coherent information processing. In this Letter we study the simultaneous hybridization of multiple high-overtone bulk acoustic resonances with a magnon and a microwave mode. The demonstrated multimode hybridization allows us to observe coherent pulse echoes, opening opportunities for both fundamental studies and practical applications of hybrid magnonics.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Multimode Strong Coupling in Cavity Optomechanics

Optomechanical systems show great potential as quantum transducers and information storage devices for use in future hybrid quantum networks. In this context, optomechanical strong coupling can enable efficient, high-bandwidth, and deterministic transfer of quantum states. While optomechanical strong coupling has been realized at optical frequencies, it has proven difficult to identify a robust optomechanical system that features the low loss and high coupling rates required for more sophisticated control of mechanical motion. In this paper, we demonstrate strong coupling in a Brillouin-based bulk cavity optomechanical system in both the single-mode and the multimode strong-coupling regime, which leads to a useful device both for applications in quantum information and for investigating decoherence phenomena in bulk acoustic wave resonators. Using nontrivial mode hybridizations in the strong-coupling regime, we create hybridized photonic-phononic modes with lifetimes that are significantly longer than those of the uncoupled system. This surprising lifetime enhancement, which results from the interference of decay channels, showcases the use of multimode strong coupling as a general strategy to control extrinsic decoherence mechanisms. Moreover, phonons supported by such bulk-acoustic-wave resonators have a collection of properties, including high frequencies, long coherence times, and robustness against thermal decoherence, that make this optomechanical system particularly enticing for applications such as quantum transduction and memories. Hence, this system provides access to phenomena in a previously unexplored regime of optomechanical interactions and could serve as an important building block for future quantum devices.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Identifying Light-Duty Vehicle Travel from Large-Scale Multimodal Wearable GPS Data with Novelty Detection Algorithms

Identifying travel mode within travel survey data sets, especially light-duty vehicle (LDV) travel, is foundational, though nontrivial, to travel behavior analysis and fuel consumption estimation. Current travel mode detection approaches require well-sampled and balanced data sets with ground truth travel mode labels. They are rarely applied and validated on large-scale, real-world data sets, which may not satisfy the data requirements. This paper proposes an LDV travel mode detection model as a supplement to current travel mode detection methods, for the case when the training set is highly (and/or completely) unbalanced, to the extent that classical machine-learning approaches become difficult or impossible to deploy. The proposed model uses a novelty detection technique-one-class support vector machines (OCSVMs)-and a novel exhaustive feature extraction (EFE) technique on continuous time series data (i.e., Global Positioning System [GPS] speed profiles) for single-mode trip trajectories. Training and validation of the model are conducted on a large-scale, real-world data set. The proposed method accurately identifies LDV trips from a broad set of multimodal trips by leveraging a wealth of preexisting in-vehicle GPS travel data. Additional sensitivity analysis sheds light on the optimal training size, which will benefit applications limited by highly imbalanced data. The paper also discusses performance comparison with regular machine-learning approaches, the model's robustness, and the potential to extend the proposed model to multimodal prediction.

47 OTHER INSTRUMENTATION↗

Rolling Root Mean Square Based Multimodal Anomaly Detection for Real Time Monitoring of Smart Grid

Reliable real-time monitoring is valuable for maintaining the operational integrity of modern electrical smart grids. Deployment of heterogeneous sensing technologies in substations has enabled high-resolution, multichannel waveform monitoring, but also introduces challenges for anomaly detection due to noise, baseline drift, and modality-dependent signal characteristics. In this work, we present a computationally efficient unsupervised method for multimodal event detection based on Rolling Root Mean Square based Event Detection (RRMSED). The method is developed using in-house, field deployed sensors collecting data at a utility substation. The sensing system comprises voltage and current sensors, triaxial accelerometers, and magnetometers, collectively capturing electrical, vibrational, and magnetic waveform measurements at high temporal resolution. RRMSED operates by extracting rolling RMS energy features and their first-order temporal differences from consecutive waveform segments for each channel and then applying channel-specific statistical thresholds learned from historical data. A persistence-based exceedance logic is employed to robustly identify transient events while suppressing impulsive noise, and to provide precise temporal localization with high resolution. The framework is designed for continuous server-side operation and can be deployed in real time without requiring complex models. Experiments on simulated waveform data with known ground truth demonstrate low false positive (FP) and false negative (FN) rates. Application to real substation data shows RRMSED to identify events that are not captured by conventional monitoring indicators including fast transient detection algorithm currently deployed in the system. These results indicate that rolling RMS based features provide an effective and practical basis for real-time multimodal event detection in smart-grid substations.

Mukherjee, Subrata [ORNL] (ORCID:0000000309930338)↗

Iterative Reconstruction for Multimodal Neutron Tomography

Here, we describe a unified framework for model-based iterative 3-D reconstruction of multimodal neutron transmission, hydrogen-scatter, and induced-fission images from low resolution data recorded using 14.1-MeV neutrons and the associated-particle imaging (API) technique. The framework, which was developed to facilitate use in challenging field-deployment scenarios, is centered around physics-based system models and a total variation (TV) constrained implementation of the simultaneous iterative reconstruction technique (SIRT). Modified to solve a statistically weighted least squares (WLS) problem, the SIRT algorithm is accelerated using ordered subsets and Nesterov’s momentum for which we derive a near-optimal value of the governing Lipschitz constant. The approach enables the reconstruction of images that are high resolution compared to the acquired data and is robust to both limited statistics and a limited number of projection angles. Moreover, the framework is fast enough to be practical. Example images are provided that demonstrate both the ability to perform fast-neutron imaging of high-atomic-number materials with low radiation dose and the benefit of multimodal neutron imaging to identify key materials.

Hydrogen scatter↗

4D Multimodal Co-attention Fusion Network with Latent Contrastive Alignment for Alzheimer’s Diagnosis

Multimodal neuroimaging provides complementary structural and functional insights into both human brain organization and disease-related dynamics. Recent studies demonstrate enhanced diagnostic sensitivity for Alzheimer’s disease (AD) through synergistic integration of neuroimaging data (e.g., sMRI, fMRI) with tabular data (e.g., behavioral and cognitive tests). However, the intrinsic heterogeneity across modalities (e.g., 4D spatiotemporal fMRI dynamics vs. 3D anatomical sMRI structure) presents critical challenges for discriminative feature fusion, often leading to information loss or biased fusion. To bridge this gap, we propose M2M-AlignNet: a multimodal co-attention network with latent alignment for early AD diagnosis using sMRI and fMRI. At the core of our approach is a multi-patch-to-multi-patch (M2M) contrastive loss function that quantifies and reduces representational discrepancies via weighted patch correspondence, explicitly aligning fMRI components across brain regions with their sMRI structural substrates without one-to-one constraints. Additionally, we propose a latent-as-query co-attention module to autonomously discover fusion patterns, circumventing modality prioritization biases while minimizing feature redundancy. We conduct extensive experiments to confirm the effectiveness of our method and highlight the correspondence between fMRI and sMRI as AD biomarkers.

Wei, Yuxiang [Georgia Institute of Technology]↗

Emerging Flexible Designs for Geospatial Multimodal Foundation Models

Foundation models are rapidly transforming Earth observation by enabling scalable pretraining across diverse unlabeled geospatial modalities. However, their architectural diversity—ranging from encoder-only to encoder-decoder and masked autoencoding paradigms—makes it challenging to assess performance trade-offs in a consistent manner. In this work, we present an apples-to-apples comparison of leading FM architectures designed for geospatial multimodal reasoning, with a particular focus on flexibility across varied spectral band configurations. We standardize pretraining using identical self-supervised learning objectives and training datasets, and evaluate all models under consistent parameterization on the GEOBench benchmark across classification and segmentation tasks. Our results offer new insights into the design trade-offs between model flexibility, modality alignment, and downstream task performance. By highlighting architectural strengths and limitations under controlled conditions, this study provides practical guidance for building next-generation geospatial foundation models capable of robust multimodal reasoning.

Ambrozio Dias, Philipe [ORNL] (ORCID:0000000194277↗