Search NASA⌕ Search

SEARCH · Search NASA

Results for “multimode”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Probing corrosion using a simple and versatile in situ multimodal corrosion measurement system

In this work, we have developed a unique in situ multimodal corrosion system that is capable of acquiring electrochemical data, sample imaging/visualization and hydrogen collection, simultaneously. Each of these modalities yield valuable information pertaining to the ongoing corrosion process. Combining them can yield holistic information on the role of microstructure, processing history, presence of coatings, etc., on the sequence of steps occurring during the corrosion process, and how they correlate with the acquired electrochemical data. Four materials systems, namely AA6061-T6 aluminum alloy, AZ91 magnesium alloy, galvanized DP590 steel, and pure Zn, were investigated under open circuit potential and under potentiodynamic polarization. The multimodal corrosion system was utilized to observe processes such as surface passivation and dissolution, pit and filiform corrosion initiation and propagation, and was correlated with location and magnitude of hydrogen evolution. This approach is shown to yield a truly multimodal understanding of the ongoing corrosion processes.

36 MATERIALS SCIENCE↗

A Representation Fusion Framework for Decoupling Diagnostic Information in Multimodal Learning

Modern medicine increasingly relies on multimodal data, ranging from clinical notes to imaging and genomics, to guide diagnosis and treatment. However, integrating these heterogeneous data sources in a principled and interpretable manner remains a major challenge. We present MODES (Multi-mOdal Disentangled Embedding Space), a representation fusion framework that explicitly separates shared and modality-specific factors of variation, offering a structured latent space for multimodal information that improves both prediction and interpretability. By leveraging pre-trained unimodal foundation models, MODES mitigates the dependency on extensive paired datasets, crucial in data-scarce clinical settings. We introduce a masking strategy that optimizes representation dimensionality by eliminating low-information dimensions, to achieve compact, information-rich representations. Our framework demonstrates superior performance in predicting diagnoses and phenotypes compared to unimodal and conventional fusion models. MODES also enables robust diagnostic inference in missing data scenarios, offering an opportunity toward interpretable and efficient multimodal diagnostics in personalized healthcare.

60 APPLIED LIFE SCIENCES↗

Automated electrosynthesis reaction mining with multimodal large language models (MLLMs)

Leveraging the chemical data available in legacy formats such as publications and patents is a significant challenge for the community. Automated reaction mining offers a promising solution to unleash this knowledge into a learnable digital form and therefore help expedite materials and reaction discovery. However, existing reaction mining toolkits are limited to single input modalities (text or images) and cannot effectively integrate heterogeneous data that is scattered across text, tables, and figures. In this work, we go beyond single input modalities and explore multimodal large language models (MLLMs) for the analysis of diverse data inputs for automated electrosynthesis reaction mining. We compiled a test dataset of 65 articles (MERMES-T24 set) and employed it to benchmark five prominent MLLMs against two critical tasks: (i) reaction diagram parsing and (ii) resolving cross-modality data interdependencies. The frontrunner MLLM achieved ≥96% accuracy in both tasks, with the strategic integration of single-shot visual prompts and image pre-processing techniques. We integrate this capability into a toolkit named MERMES (multimodal reaction mining pipeline for electrosynthesis). Our toolkit functions as an end-to-end MLLM-powered pipeline that integrates article retrieval, information extraction and multimodal analysis for streamlining and automating knowledge extraction. This work lays the groundwork for the increased utilization of MLLMs to accelerate the digitization of chemistry knowledge for data-driven research.

Leong, Shi Xuan↗

Arbitrary-ratio power splitter based on nonlinear multimode interference coupler

We propose an ultra-compact multimode interference (MMI) power splitter based on nonlinear effects from simulations using nonlinear modal propagation analysis (NMPA) cooperation with finite difference Method (FDM) to access free choice of splitting ratio. Conventional multimode interference power splitter could only obtain a few discrete ratios. The power splitting ratio may be adjusted continuously while the input set power is varying by a tunable laser. In fact, using an ultra- compact MMI with a simple structure that is launched by a tunable nonlinear input fulfills the problem of arbitrary-ratio in integrated photonics circuits. Silicon on insulator (SOI) is used as the offered material due to the high contrast refractive index and Centro symmetric properties. The high-resolution images at the end of the multimode waveguide in the simulated power splitter have a high power balance, whereas access to a free choice of splitting ratio is not possible under the linear regime in the proposed length range except changes in the dimension for any ratio. The compact dimensions and ideal performance of the device are established according to optimized parameters. The proposed regime can be extended to the design of M×N arbitrary power splitters ratio for programmable logic devices in all optical digital signal processing. The results of this study indicate that nonlinear modal propagation analysis solves the miniaturization problem for all-optical devices based on MMI couplers to achieve multiple functions in a compact planar integrated circuit and also overcomes the limitations of previously proposed methods for nonlinear MMI.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Nonlinear bubble competition of the multimode ablative Rayleigh–Taylor instability and applications to inertial confinement fusion

The self-similar nonlinear evolution of the multimode ablative Rayleigh–Taylor instability (RTI) and the ablation-generated vorticity effect are studied for a range of initial conditions. We show that, unlike classical RTI, the nonlinear multimode bubble-front evolution remains in the bubble competition regime due to ablation-generated vorticity, which accelerates the bubbles, thereby preventing a transition into the bubble-merger regime. We develop an analytical bubble competition model to describe the linear and nonlinear stages of ablative RTI. Here, we show that vorticity inside the multimode bubbles is most significant at small scales with large initial perturbation. Since these small scales persist in the bubble competition regime, the self-similar growth coefficient ab can be enhanced by up to 30% relative to ablative bubble competition without vorticity effects. We use the ablative bubble competition model to explain the hydrodynamic stability boundary observed in OMEGA low-adiabat implosion experiments.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

ADAPTIVE ANNEALED IMPORTANCE SAMPLING FOR MULTIMODAL POSTERIOR EXPLORATION AND MODEL SELECTION WITH APPLICATION TO EXTRASOLAR PLANET DETECTION

We describe an algorithm that can adaptively provide mixture summaries of multimodal posterior distributions. The parameter space of the involved posteriors ranges in size from a few dimensions to dozens of dimensions. This work was motivated by an astrophysical problem called extrasolar planet (exoplanet) detection, wherein the computation of stochastic integrals that are required for Bayesian model comparison is challenging. The difficulty comes from the highly nonlinear models that lead to multimodal posterior distributions. We resort to importance sampling (IS) to estimate the integrals, and thus translate the problem to be how to find a parametric approximation of the posterior. To capture the multimodal structure in the posterior, we initialize a mixture proposal distribution and then tailor its parameters elaborately to make it resemble the posterior to the greatest extent possible. We use the effective sample size (ESS) calculated based on the IS draws to measure the degree of approximation. The bigger the ESS is, the better the proposal resembles the posterior. A difficulty within this tailoring operation lies in the adjustment of the number of mixing components in the mixture proposal. Brute force methods just preset it as a large constant, which leads to an increase in the required computational resources. We provide an iterative delete/merge/add process, which works in tandem with an expectation-maximization step to tailor such a number online. The efficiency of our proposed method is tested via both simulation studies and real exoplanet data analysis.

79 ASTRONOMY AND ASTROPHYSICS↗

Identification of Blue Horizontal Branch Stars with Multimodal Fusion

Blue Horizontal Branch stars (BHBs) are ideal tracers to probe the global structure of the milky Way (MW), and the increased size of the BHB star sample could be helpful to accurately calculate the MW's enclosed mass and kinematics. Large survey telescopes have produced an increasing number of astronomical images and spectra. However, traditional methods of identifying BHBs are limited in dealing with the large scale of astronomical data. A fast and efficient way of identifying BHBs can provide a more significant sample for further analysis and research. Therefore, in order to fully use the various data observed and further improve the identification accuracy of BHBs, we have innovatively proposed and implemented a Bi-level attention mechanism-based Transformer multimodal fusion model, called Bi-level Attention in the Transformer with Multimodality (BATMM). The model consists of a spectrum encoder, an image encoder, and a Transformer multimodal fusion module. The Transformer enables the effective fusion of data from two modalities, namely image and spectrum, by using the proposed Bi-level attention mechanism, including cross-attention and self-attention. As a result, the information from the different modalities complements each other, thus improving the accuracy of the identification of BHBs. The experimental results show that the F1 score of the proposed BATMM is 94.78%, which is 21.77% and 2.76% higher than the image and spectral unimodality, respectively. It is therefore demonstrated that higher identification accuracy of BHBs can be achieved by means of using data from multiple modalities and employing an efficient data fusion strategy.

79 ASTRONOMY AND ASTROPHYSICS↗

Testing nonclassicality in multimode fields: A unified derivation of classical inequalities

We consider a way to generate operational inequalities to test nonclassicality (or quantumness) of multimode bosonic fields (or multiparty bosonic systems) that unifies the derivation of many known inequalities and allows to propose new ones. The nonclassicality criteria are based on Vogel's criterion corresponding to analyzing the positivity of multimode P functions or, equivalently, the positivity of matrices of expectation values of, e.g., creation and annihilation operators. We analyze not only monomials but also polynomial functions of such moments, which can sometimes enable simpler derivations of physically relevant inequalities. As an example, we derive various classical inequalities which can be violated only by nonclassical fields. In particular, we show how the criteria introduced here easily reduce to the well-known inequalities describing (a) multimode quadrature squeezing and its generalizations, including sum, difference, and principal squeezing; (b) two-mode one-time photon-number correlations, including sub-Poisson photon-number correlations and effects corresponding to violations of the Cauchy-Schwarz and Muirhead inequalities; (c) two-time single-mode photon-number correlations, including photon antibunching and hyperbunching; and (d) two- and three-mode quantum entanglement. Other simple inequalities for testing nonclassicality are also proposed. We have found some general relations between the nonclassicality and entanglement criteria, in particular those resulting from the Cauchy-Schwarz inequality. It is shown that some known entanglement inequalities can be derived as nonclassicality inequalities within our formalism, while some other known entanglement inequalities can be seen as sums of more than one inequality derived from the nonclassicality criterion. This approach enables a deeper analysis of the entanglement for a given nonclassicality.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Seamless High-Q Microwave Cavities for Multimode Circuit Quantum Electrodynamics

Multimode cavity quantum electrodynamics ---where a two-level system interacts simultaneously with many cavity modes---provides a versatile framework for quantum information processing and quantum optics. Due to the combination of long coherence times and large interaction strengths, one of the leading experimental platforms for cavity QED involves coupling a superconducting circuit to a 3D microwave cavity. In this work, we realize a 3D multimode circuit QED system with single photon lifetimes of $2$ ms and cooperativities of $0.5-1.5\times10^9$ across 9 modes of a novel seamless cavity. We demonstrate a variety of protocols for universal single-mode quantum control applicable across all cavity modes, using only a single drive line. We achieve this by developing a straightforward flute method for creating monolithic superconducting microwave cavities that reduces loss while simultaneously allowing control of the mode spectrum and mode-qubit interaction. We highlight the flexibility and ease of implementation of this technique by using it to fabricate a variety of 3D cavity geometries, providing a template for engineering multimode quantum systems with exceptionally low dissipation. This work is an important step towards realizing hardware efficient random access quantum memories and processors, and for exploring quantum many-body physics with photons.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Multimodal Approach Reveals the Symmetry-Breaking Pathway to the Broken Helix in EuIn 2 ⁢As 2

Understanding and manipulating emergent phases, which are themes at the forefront of quantum-materials research, rely on identifying their underlying symmetries. This general principle has been particularly prominent in materials with coupled electronic and magnetic degrees of freedom, in which magnetic order influences the electronic band structure and can lead to exotic topological effects. However, identifying symmetry of a magnetically ordered phase can pose a challenge, particularly in the presence of small domains. Here we introduce a multimodal approach for determining magnetic structures, which combines symmetry-sensitive optical probes, scattering, and group-theoretical analysis. We apply it to EuIn 2 ⁢As 2 , a material that has received attention as a candidate axion insulator. While first-principles calculations predict this state on the assumption of a simple collinear antiferromagnetic structure, subsequent neutron-scattering measurements reveal a much more intricate magnetic ground state characterized by two coexisting magnetic wave vectors reached by successive thermal phase transitions. The proposed high- and low-temperature phases are a spin helix and a state with interpenetrating helical and Néel antiferromagnetic order termed a “broken helix,” respectively. Employing a multimodal approach, we identify the magnetic structure associated with these two phases of EuIn 2 ⁢As 2 . We find that the higher-temperature phase is characterized by a variation of the magnetic moment amplitude from layer to layer, with the moment vanishing entirely in every third Eu layer. The lower-temperature structure is similar to the broken helix, with one important difference: Because of local strain, the relative orientation of the magnetic structure and the lattice is not fixed. Consequently, the symmetry required to protect the axion phase is not generically protected in EuIn 2 ⁢As 2 , but we show that it can be restored if the magnetic structure is tuned with uniaxial strain. Finally, we present a spin Hamiltonian that identifies the spin interactions that account for the complex magnetic order in EuIn 2 ⁢As 2 . Our work highlights the importance of a multimodal approach in determining the symmetry of complex order parameters.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Highly cascaded first-order fiber Bragg gratings in highly multimode optical fibers for distributed temperature sensing under harsh environment conditions

This study presents a pioneering technique for fabricating highly cascaded first-order fiber Bragg gratings (FBGs) using a femtosecond laser-assisted point-by-point inscription method in highly multimode optical fibers, specifically Sapphire crystalline fiber, and pure silica coreless fiber. Notably, it marks the first successful demonstration of a distributed array comprising 10 FBGs within highly multimode fibers. This achievement is facilitated by a high-power laser technique that yields larger reflectors characterized by a Gaussian intensity profile. These first-order FBGs offer various advantages, including enhanced reflectivity, reduced fabrication time, and simplified spectral characteristics, enhancing their accessibility for interpretation when contrasted with higher-order FBGs. In addition to that it encompasses a comprehensive analysis of the robustness and efficacy of these FBGs, with particular emphasis on their ability to endure extreme temperatures. These FBGs demonstrate an advantageous capability for localized multi-point temperature monitoring, reaching temperatures up to 1500°C with sapphire crystalline fiber and 1100°C with pure silica coreless fiber. This resilience makes them suitable for deployment in harsh environmental conditions. This innovative approach substantially broadens the potential applications of highly multimode optical fibers, particularly in the arena of sensing and communication, where challenges related to thermal gradients and harsh environments prevail. Furthermore, these groundbreaking first-order FBGs signify a substantial advancement in the realm of distributed temperature sensing, offering supreme capabilities for temperature monitoring and signal stability. As such, our work holds the promise of a substantial impact on industries and applications that demand unwavering reliability under extreme conditions.

47 OTHER INSTRUMENTATION↗

MO-DE-202-03: Image-Guided Surgery and Interventions in the Advanced Multimodality Image-Guided Operating (AMIGO) Suite

At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504 Disclosure and CoI: IGI Technologies, small-business partner on the grants.

60 APPLIED LIFE SCIENCES↗

MO-DE-202-04: Multimodality Image-Guided Surgery and Intervention: For the Rest of Us

At least three major trends in surgical intervention have emerged over the last decade: a move toward more minimally invasive (or non-invasive) approach to the surgical target; the development of high-precision treatment delivery techniques; and the increasing role of multi-modality intraoperative imaging in support of such procedures. This symposium includes invited presentations on recent advances in each of these areas and the emerging role for medical physics research in the development and translation of high-precision interventional techniques. The four speakers are: Keyvan Farahani, “Image-guided focused ultrasound surgery and therapy” Jeffrey H. Siewerdsen, “Advances in image registration and reconstruction for image-guided neurosurgery” Tina Kapur, “Image-guided surgery and interventions in the advanced multimodality image-guided operating (AMIGO) suite” Raj Shekhar, “Multimodality image-guided interventions: Multimodality for the rest of us” Learning Objectives: Understand the principles and applications of HIFU in surgical ablation. Learn about recent advances in 3D–2D and 3D deformable image registration in support of surgical safety and precision. Learn about recent advances in model-based 3D image reconstruction in application to intraoperative 3D imaging. Understand the multi-modality imaging technologies and clinical applications investigated in the AMIGO suite. Understand the emerging need and techniques to implement multi-modality image guidance in surgical applications such as neurosurgery, orthopaedic surgery, vascular surgery, and interventional radiology. Research supported by the NIH and Siemens Healthcare.; J. Siewerdsen; Grant Support - National Institutes of Health; Grant Support - Siemens Healthcare; Grant Support - Carestream Health; Advisory Board - Carestream Health; Licensing Agreement - Carestream Health; Licensing Agreement - Elekta Oncology.; T. Kapur, P41EB015898; R. Shekhar, Funding: R42CA137886 and R41CA192504 Disclosure and CoI: IGI Technologies, small-business partner on the grants.

60 APPLIED LIFE SCIENCES↗

Mechanisms of murine cerebral malaria: Multimodal imaging of altered cerebral metabolism and protein oxidation at hemorrhage sites

Using a multimodal biospectroscopic approach, we settle several long-standing controversies over the molecular mechanisms that lead to brain damage in cerebral malaria, which is a major health concern in developing countries because of high levels of mortality and permanent brain damage. Our results provide the first conclusive evidence that important components of the pathology of cerebral malaria include peroxidative stress and protein oxidation within cerebellar gray matter, which are colocalized with elevated nonheme iron at the site of microhemorrhage. Such information could not be obtained previously from routine imaging methods, such as electron microscopy, fluorescence, and optical microscopy in combination with immunocytochemistry, or from bulk assays, where the level of spatial information is restricted to the minimum size of tissue that can be dissected. We describe the novel combination of chemical probe–free, multimodal imaging to quantify molecular markers of disturbed energy metabolism and peroxidative stress, which were used to provide new insights into understanding the pathogenesis of cerebral malaria. In addition to these mechanistic insights, the approach described acts as a template for the future use of multimodal biospectroscopy for understanding the molecular processes involved in a range of clinically important acute and chronic (neurodegenerative) brain diseases to improve treatment strategies.

60 APPLIED LIFE SCIENCES↗

Machine Learning in Multimodal Medical Imaging

Machine learning techniques have been increasingly applied in the medical imaging field for developing computer-aided diagnosis and prognosis models. Multimodal medical imaging can provide us with separate yet complementary structure and function information of a patient study and hence has transformed the way we study living bodies. Therefore, using machine learning techniques to deal with multimodal medical images is much more challenging due to the diversity of biophysical-biochemical mechanisms. In these years, researchers mainly adapt modern machine learning and pattern recognition techniques such as supervised, unsupervised, semi-supervised, and deep learning to solve multimodal medical imaging related problems.

60 APPLIED LIFE SCIENCES↗

In planta single-molecule imaging and holographic force spectroscopy to study real-time, multimodal turnover dynamics of polysaccharides and associated carbohydrate metabolites

Cellular production of polysaccharides from simple sugar molecules serves critical roles in a variety of metabolic processes essential to the survival of every living organism. In the context of photosynthetically fixed carbon, cell wall polysaccharides synthesis is particularly of interest for increased biomass accumulation for human food, animal feed, and bioenergy related applications. Despite a long history of research in plant cell biology, our understanding of in planta cell wall biosynthesis and its regulation is far from complete due to lack of a comprehensive microscopy toolkit that encompass the multiple spatial and temporal scales in which cell wall polysaccharides fibrils are synthesized and assembled into intricate cell wall networks. In this project, a multidisciplinary team of scientists from Rutgers University, Vanderbilt University, and Oak Ridge National Laboratory carried out innovative multimodal, multiscale microscopy studies of cell wall synthesis using single-molecule force-spectroscopy, super-resolution fluorescence microscopy, and in vivo live cell imaging. Our novel multimodal and holistic imaging approach revealed plant cell wall polysaccharides synthesis processes in unprecedented detail across multiple spatiotemporal scales, from a single-molecule to a single-cell. Besides, the team has made technical and scientific innovations across multiple research fields—microscopy, bioengineering, single-molecule biophysics, and plant biology, etc.—to accomplish the goals. The results from this project will greatly advance the mechanistic and holistic understanding of in planta cell wall synthesis, which will accelerate the development of better transgenic crops for bioenergy applications. Moreover, the new toolbox, combining powerful advanced microscopy assays with cell/protein engineering, will have broader impacts on molecular and cellular biology fields by paving the way for studying cellular processes occurring across multiple physical scales with multimodal microscopy methodologies.

59 BASIC BIOLOGICAL SCIENCES↗

Multimodality in the Search for New Physics in Pulsar Timing Data and the Case of Kination-amplified Gravitational-wave Background from Inflation

We investigate the kination-amplified inflationary gravitational-wave background (GWB) interpretation of the signal recently reported by various pulsar timing array (PTA) experiments. Kination is a post-inflationary phase in the expansion history dominated by the kinetic energy of some scalar field, characterized by a stiff equation of state w = 1. Within the inflationary GWB model, we identify two modes that can fit the current data sets (NANOGrav and EPTA) with equal likelihood: the kination-amplification (KA) mode and the ordinary, no-kination-amplification (no-KA) mode. The multimodality of the likelihood motivates a Bayesian analysis with nested sampling. We analyze the free spectra of current PTA data and mock free spectra constructed with higher signal-to-noise ratios using nested sampling. The analysis of the mock spectrum designed to be consistent with the best fit to the NANOGrav 15 yr (NG15) data successfully reveals the expected bimodal posterior for the first time while excluding the reheating mode that appears in the fit to the current NG15 data, making a case for our correct and comprehensive treatment of potential multimodal posteriors arising from future PTA data sets. The resultant Bayes factor is $\mathcal{B}$ $\equiv$ Z no–KA /Z KA = 2.9 ± 1.9, indicating comparable statistical significance between the two modes. Given the theoretical model-building challenges of producing highly blue-tilted primordial tensor spectra, the KA mode has the advantage of requiring less blue primordial spectra, compared with the no-KA mode. The synergy between future cosmic microwave background polarization, pulsar timing, and laser interferometer measurements of gravitational waves will help resolve the ambiguity implied by the multimodal posterior in PTA-only searches.

Cosmology↗

Multimodal agile robots

Examples and implementations of various robotic mechanisms, devices, components, systems and techniques are provided, including multimodal robotic devices and systems. For example, a multimodal robot can be configured to autonomously reconfigure between two or more primary modes of operation. Such robots may be used in a wide range of applications, including reconnaissance, exploration, search and rescue, military, sports, personal assistance, education, and entertainment and toys. Described examples of multimodal robots can be wheeled robots that use two or more drive wheels to perform various motions and operations.

Bewley, Thomas R.↗