Search NASA⌕ Search

SEARCH · Search NASA

Results for “multimodal processing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2023

In planta single-molecule imaging and holographic force spectroscopy to study real-time, multimodal turnover dynamics of polysaccharides and associated carbohydrate metabolites

Cellular production of polysaccharides from simple sugar molecules serves critical roles in a variety of metabolic processes essential to the survival of every living organism. In the context of photosynthetically fixed carbon, cell wall polysaccharides synthesis is particularly of interest for increased biomass accumulation for human food, animal feed, and bioenergy related applications. Despite a long history of research in plant cell biology, our understanding of in planta cell wall biosynthesis and its regulation is far from complete due to lack of a comprehensive microscopy toolkit that encompass the multiple spatial and temporal scales in which cell wall polysaccharides fibrils are synthesized and assembled into intricate cell wall networks. In this project, a multidisciplinary team of scientists from Rutgers University, Vanderbilt University, and Oak Ridge National Laboratory carried out innovative multimodal, multiscale microscopy studies of cell wall synthesis using single-molecule force-spectroscopy, super-resolution fluorescence microscopy, and in vivo live cell imaging. Our novel multimodal and holistic imaging approach revealed plant cell wall polysaccharides synthesis processes in unprecedented detail across multiple spatiotemporal scales, from a single-molecule to a single-cell. Besides, the team has made technical and scientific innovations across multiple research fields—microscopy, bioengineering, single-molecule biophysics, and plant biology, etc.—to accomplish the goals. The results from this project will greatly advance the mechanistic and holistic understanding of in planta cell wall synthesis, which will accelerate the development of better transgenic crops for bioenergy applications. Moreover, the new toolbox, combining powerful advanced microscopy assays with cell/protein engineering, will have broader impacts on molecular and cellular biology fields by paving the way for studying cellular processes occurring across multiple physical scales with multimodal microscopy methodologies.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2023

Probing corrosion using a simple and versatile in situ multimodal corrosion measurement system

In this work, we have developed a unique in situ multimodal corrosion system that is capable of acquiring electrochemical data, sample imaging/visualization and hydrogen collection, simultaneously. Each of these modalities yield valuable information pertaining to the ongoing corrosion process. Combining them can yield holistic information on the role of microstructure, processing history, presence of coatings, etc., on the sequence of steps occurring during the corrosion process, and how they correlate with the acquired electrochemical data. Four materials systems, namely AA6061-T6 aluminum alloy, AZ91 magnesium alloy, galvanized DP590 steel, and pure Zn, were investigated under open circuit potential and under potentiodynamic polarization. The multimodal corrosion system was utilized to observe processes such as surface passivation and dissolution, pit and filiform corrosion initiation and propagation, and was correlated with location and magnitude of hydrogen evolution. This approach is shown to yield a truly multimodal understanding of the ongoing corrosion processes.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Discriminative analysis of schizophrenia patients using graph convolutional networks: A combined multimodal MRI and connectomics analysis

Introduction Recent studies in human brain connectomics with multimodal magnetic resonance imaging (MRI) data have widely reported abnormalities in brain structure, function and connectivity associated with schizophrenia (SZ). However, most previous discriminative studies of SZ patients were based on MRI features of brain regions, ignoring the complex relationships within brain networks. Methods We applied a graph convolutional network (GCN) to discriminating SZ patients using the features of brain region and connectivity derived from a combined multimodal MRI and connectomics analysis. Structural magnetic resonance imaging (sMRI) and resting-state functional magnetic resonance imaging (rs-fMRI) data were acquired from 140 SZ patients and 205 normal controls. Eighteen types of brain graphs were constructed for each subject using 3 types of node features, 3 types of edge features, and 2 brain atlases. We investigated the performance of 18 brain graphs and used the TopK pooling layers to highlight salient brain regions (nodes in the graph). Results The GCN model, which used functional connectivity as edge features and multimodal features (sMRI + fMRI) of brain regions as node features, obtained the highest average accuracy of 95.8%, and outperformed other existing classification studies in SZ patients. In the explainability analysis, we reported that the top 10 salient brain regions, predominantly distributed in the prefrontal and occipital cortices, were mainly involved in the systems of emotion and visual processing. Discussion Our findings demonstrated that GCN with a combined multimodal MRI and connectomics analysis can effectively improve the classification of SZ at an individual level, indicating a promising direction for the diagnosis of SZ patients. The code is available at https://github.com/CXY-scut/GCN-SZ.git .

Chen, Xiaoyi↗
DOE OSTI2023

Sputter-Deposited Mo Thin Films: Multimodal Characterization of Structure, Surface Morphology, Density, Residual Stress, Electrical Resistivity, and Mechanical Response

Multimodal datasets of materials are rich sources of information which can be leveraged for expedited discovery of process–structure–property relationships and for designing materials with targeted structures and/or properties. For this data descriptor article, we provide a multimodal dataset of magnetron sputter-deposited molybdenum (Mo) thin films, which are used in a variety of industries including high temperature coatings, photovoltaics, and microelectronics. In this dataset we explored a process space consisting of 27 unique combinations of sputter power and Ar deposition pressure. Here, the phase, structure, surface morphology, and composition of the Mo thin films were characterized by x-ray diffraction, scanning electron microscopy, atomic force microscopy, and Rutherford backscattering spectrometry. Physical properties—namely, thickness, film stress and sheet resistance—were also measured to provide additional film characteristics and behaviors. Additionally, nanoindentation was utilized to obtain mechanical load-displacement data. The entire dataset consists of 2072 measurements including scalar values (e.g., film stress values), 2D linescans (e.g., x-ray diffractograms), and 3D imagery (e.g., atomic force microscopy images). An additional 1889 quantities, including film hardness, modulus, electrical resistivity, density, and surface roughness, were derived from the experimental datasets using traditional methods. Minimal analysis and discussion of the results are provided in this data descriptor article to limit the authors’ preconceived interpretations of the data. Overall, the data modalities are consistent with previous reports of refractory metal thin films, ensuring that a high-quality dataset was generated. The entirety of this data is committed to a public repository in the Materials Data Facility.

36 MATERIALS SCIENCE↗
DOE OSTI2023

In situ Stress Monitoring Reveals Tension and Wrinkling Evolutions during Halide Perovskite Film Formation

Metal halide perovskites (MHPs) are promising candidates for next-generation thin film photovoltaics and high-performance tandems. Solution-processed MHP films are susceptible to residual stress that can induce undesirable surface wrinkles. However, the origins and evolution of stress during solution processing remain elusive. Here, in this work, we utilize multimodal in situ characterizations, including substrate curvature, reflectance, absorbance, and photoluminescence, to monitor stress and morphology evolution during MHP film formation. A film formation model emerges, consisting of a perovskite top crust on a semirigid sol with the ability to transfer mechanical forces. The phase transformation induces tension in the MHP crust, while shrinkage of the sol causes additional compression and surface wrinkles. Wrinkle-free films are formed through dynamically balancing forces between the crust and the sol. This study provides a powerful toolkit for the fast-growing area of stress engineering in MHP photovoltaics to achieve dynamic control of film stress and surface morphology.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Heterogeneous multiphase flow properties of volcanic rocks and implications for noble gas transport from underground nuclear explosions

Of interest to the Underground Nuclear Explosion Signatures Experiment are patterns and timing of explosion-generated noble gases that reach the land surface. The impact of potentially simultaneous flow of water and gas on noble gas transport in heterogeneous fractured rock is a current scientific knowledge gap. This article presents field and laboratory data to constrain and justify a triple continua conceptual model with multimodal multiphase fluid flow constitutive equations that represents host rock matrix, natural fractures, and induced fractures from past underground nuclear explosions (UNEs) at Aqueduct and Pahute Mesas, Nevada National Security Site, Nevada, USA. Capillary pressure from mercury intrusion and direct air–water measurements on volcanic tuff core samples exhibit extreme spatial heterogeneity (i.e., variation over multiple orders of magnitude). Petrographic observations indicate that heterogeneity derives from multimodal pore structures in ash-flow tuff components and post-depositional alteration processes. Comparisons of pre- and post-UNE samples reveal different pore size distributions that are due in part to microfractures. Capillary pressure relationships require a multimodal van Genuchten (VG) constitutive model to best fit the data. Relative permeability estimations based on unimodal VG fits to capillary pressure can be different from those based on bimodal VG fits, implying the choice of unimodal vs. bimodal fits may greatly affect flow and transport predictions of noble gas signatures. The range in measured capillary pressure and predicted relative permeability curves for a given lithology and between lithologies highlights the need for future modeling to consider spatially distributed properties.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2023

Coordination-Dependent Chemical Reactivity of TFSI Anions at a Mg Metal Interface

Charge transfer across the electrode–electrolyte interface is a highly complex and convoluted process involving diverse solvated species with varying structures and compositions. Despite recent advances in in situ and operando interfacial analysis, molecular specific reactivity of solvated species is inaccessible due to a lack of precise control over the interfacial constituents and/or an unclear understanding of their spectroscopic fingerprints. However, such molecular-specific understanding is critical to the rational design of energy-efficient solid–electrolyte interphase layers. We have employed ion soft landing, a versatile and highly controlled method, to prepare well-defined interfaces assembled with selected ions, either as solvated species or as bare ions, with distinguishing molecular precision. Equipped with precise control over interfacial composition, we employed in situ multimodal spectroscopic characterization to unravel the molecular specific reactivity of Mg solvated species comprising (i.e., bis(trifluoromethanesulfonyl)imide, TFSI – ) anions and solvent molecules (i.e., dimethoxyethane, DME/G1) on a Mg metal surface relevant to multivalent Mg batteries. In situ multimodal spectroscopic characterization revealed higher reactivity of the undercoordinated solvated species [Mg-TFSI-G1] + compared to the fully coordinated [Mg-TFSI-(G1) 2 ] + species or even the bare TFSI – . These results were corroborated by the computed reaction pathways and energy barriers for decomposition of the TFSI – within Mg solvated species relative to bare TFSI – . Finally, we evaluated the TFSI reactivity under electrochemical conditions using Mg(TFSI) 2 –DME-based phase-separated electrolytes representing different solvated constituents. Based on our multimodal study, we report a detailed understanding of TFSI – decomposition processes as part of coordinated solvated species at a Mg-metal anode that will aid the rational design of improved sustainable electrochemical energy technologies.

25 ENERGY STORAGE↗
DOE OSTI2022

Direct Multimodal Nanoscale Visualization of Early Phosphorus-Based Antiwear Tribofilm Formation

Understanding the mechanism of antiwear (AW) tribofilm formation and how to tune surface chemistry to control functionality is essential for the development of the next generation of oil lubricants. In particular, understanding and optimizing early AW tribofilm formation can increase the energy efficiency of mechanical systems. However, the mechanism for how these films form is not well understood. The majority of prior work has focused on analyzing only end-of-test surfaces long after the film has formed. In this work, we develop an in situ multimodal chemical imaging methodology to directly visualize the early formation of AW films on steel surfaces. We investigate an oil formulation containing a phosphorus-based additive commonly used to protect surfaces from wear and fatigue processes in machine elements, such as gears, bearings, and sliding contacts. Using nanoscale multimodal chemical imaging on combined platforms of atomic force microscopy (AFM) coupled directly with in situ nano-infrared (nano-IR) spectroscopy, and further combined ex situ with time-of-flight secondary ion mass spectrometry (ToF-SIMS), we demonstrate a direct correlation between changes in friction and local surface chemistry. In these experiments, the AFM probe acts as a single asperity contact to generate the tribofilm as well as a tool to analyze it in situ as it is forming. To verify our in situ measurements, we compare these results to the ex situ ToF-SIMS of macroscale block-on-ring tribometer-formed samples. We report the understanding gained here on how AW films form and how film properties can be modified by tuning the chemistry of the additives will facilitate developing transmission fluids to meet increasing demands for vehicle performance and efficiency.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Automated electrosynthesis reaction mining with multimodal large language models (MLLMs)

Leveraging the chemical data available in legacy formats such as publications and patents is a significant challenge for the community. Automated reaction mining offers a promising solution to unleash this knowledge into a learnable digital form and therefore help expedite materials and reaction discovery. However, existing reaction mining toolkits are limited to single input modalities (text or images) and cannot effectively integrate heterogeneous data that is scattered across text, tables, and figures. In this work, we go beyond single input modalities and explore multimodal large language models (MLLMs) for the analysis of diverse data inputs for automated electrosynthesis reaction mining. We compiled a test dataset of 65 articles (MERMES-T24 set) and employed it to benchmark five prominent MLLMs against two critical tasks: (i) reaction diagram parsing and (ii) resolving cross-modality data interdependencies. The frontrunner MLLM achieved ≥96% accuracy in both tasks, with the strategic integration of single-shot visual prompts and image pre-processing techniques. We integrate this capability into a toolkit named MERMES (multimodal reaction mining pipeline for electrosynthesis). Our toolkit functions as an end-to-end MLLM-powered pipeline that integrates article retrieval, information extraction and multimodal analysis for streamlining and automating knowledge extraction. This work lays the groundwork for the increased utilization of MLLMs to accelerate the digitization of chemistry knowledge for data-driven research.

Leong, Shi Xuan↗
DOE OSTI2025

Fast Sideband Control of a Weakly Coupled Multimode Bosonic Memory

Circuit quantum electrodynamics (cQED) with superconducting cavities coupled to nonlinear circuits like transmons offers a promising platform for hardware-efficient quantum information processing. We address critical challenges in realizing this architecture by weakening the dispersive coupling while also demonstrating fast, high-fidelity multimode control by dynamically amplifying gate speeds through transmon-mediated sideband interactions. This approach enables transmon-cavity SWAP gates, for which we achieve speeds up to 30 times larger than the bare dispersive coupling. Combined with transmon rotations, this allows for efficient, universal state preparation in a single cavity mode, though achieving unitary gates and extending control to multiple modes remains a challenge. In this work, we overcome this by introducing two sideband control strategies: (1) a shelving technique that prevents unwanted transitions by temporarily storing populations in sideband-transparent transmon states and (2) a method that exploits the dispersive shift to synchronize sideband transition rates across chosen photon-number pairs to implement transmon-cavity SWAP gates that are selective on photon number. We leverage these protocols to prepare Fock and binomial code states across any of ten modes of a multimode cavity with millisecond cavity coherence times. We demonstrate the encoding of a qubit from a transmon into arbitrary vacuum and Fock state superpositions, as well as entangled NOON states of cavity mode pairs— a scheme extendable to arbitrary multimode Fock encodings. Furthermore, we implement a new binomial encoding gate that converts arbitrary transmon superpositions into binomial code states in $\qty{4}{\micro\second}$ (less than $1/\chi$), achieving an average post-selected final state fidelity of $\qty{96.3}{\percent}$ across different fiducial input states.

Huang, Jordan [Rutgers U., Piscataway]↗
DOE OSTI2022

A robust and interpretable machine learning approach using multimodal biological data to predict future pathological tau accumulation

The early stages of Alzheimer’s disease (AD) involve interactions between multiple pathophysiological processes. Although these processes are well studied, we still lack robust tools to predict individualised trajectories of disease progression. Here, we employ a robust and interpretable machine learning approach to combine multimodal biological data and predict future pathological tau accumulation. In particular, we use machine learning to quantify interactions between key pathological markers (β-amyloid, medial temporal lobe atrophy, tau and APOE 4) at mildly impaired and asymptomatic stages of AD. Using baseline non-tau markers we derive a prognostic index that: (a) stratifies patients based on future pathological tau accumulation, (b) predicts individualised regional future rate of tau accumulation, and (c) translates predictions from deep phenotyping patient cohorts to cognitively normal individuals. Our results propose a robust approach for fine scale stratification and prognostication with translation impact for clinical trial design targeting the earliest stages of AD.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Coherent Pulse Echo in Hybrid Magnonics with Multimode Phonons

We report the hybridization of magnons and phonons is playing a critical role in the emerging field of hybrid magnonics because it combines the high tunability of magnetism with the long lifetime of mechanics for comprehensive coherent information processing. Recently there has been increasing interest in thin-film bulk acoustic waves because of their long lifetimes at high frequencies. However, the unique multimode nature of such phonon modes has not been exploited as an important resource for coherent information processing. In this Letter we study the simultaneous hybridization of multiple high-overtone bulk acoustic resonances with a magnon and a microwave mode. The demonstrated multimode hybridization allows us to observe coherent pulse echoes, opening opportunities for both fundamental studies and practical applications of hybrid magnonics.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2023

Revealing the Sodium Storage Mechanisms in Hard Carbon Pores

Abstract Hard carbon (HC) is the most promising anode for the commercialization of sodium‐ion batteries (NIBs); however, a general mechanism for sodium storage in HC remains unclear, obstructing the development of highly efficient anodes for NIBs. To elucidate the mechanism of sodium storage in the pores, operando synchrotron small‐angle X‐ray scattering, wide‐angle X‐ray scattering, X‐ray absorption near edge structure, Raman spectroscopy, and galvanostatic measurements are combined. The multimodal approach provides mechanistic insights into the sodium pore‐filling process for different HC microstructures including the pore sizes that are preferentially filled, the extent to which different pore sizes are filled, and how the defect concentration influences pore filling. It is observed that sodium in the larger pores has an increased pseudo‐metallic sodium character consistent with larger sodium clusters. Furthermore, it is shown that the HCs prepared at higher pyrolysis temperatures have a larger capacity from sodium stored in the pores and that sodium intercalation between graphene layers occurs simultaneously with the pore filling in the plateau region. Opportunities are outlined to improve the performance of HC anodes by fully utilizing the pores for sodium storage, helping to pave the way for the commercialization of sodium ion batteries.

Kitsu Iglesias, Luis↗
DOE OSTI2024

Artificial intelligence to unlock real-world evidence in clinical oncology: A primer on recent advances

Purpose: Real world evidence is crucial to understanding the diffusion of new oncologic therapies, monitoring cancer outcomes, and detecting unexpected toxicities. In practice, real world evidence is challenging to collect rapidly and comprehensively, often requiring expensive and time-consuming manual case-finding and annotation of clinical text. In this Review, we summarise recent developments in the use of artificial intelligence to collect and analyze real world evidence in oncology. Methods: We performed a narrative review of the major current trends and recent literature in artificial intelligence applications in oncology. Results: Artificial intelligence (AI) approaches are increasingly used to efficiently phenotype patients and tumors at large scale. These tools also may provide novel biological insights and improve risk prediction through multimodal integration of radiographic, pathological, and genomic datasets. Custom language processing pipelines and large language models hold great promise for clinical prediction and phenotyping. Conclusions: Despite rapid advances, continued progress in computation, generalizability, interpretability, and reliability as well as prospective validation are needed to integrate AI approaches into routine clinical care and real-time monitoring of novel therapies.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2022

Development of Multimodal Few-Shot Analytics for Electron Micrographs

Recent advances in materials data analytics have provided new avenues for determining process-structure-property (PSP) linkages in a variety of materials. Machine learning techniques including few-shot learning have increased the efficiency of classifying microscopy images for the purposes of material characterization. Attempts at creating a multimodal approach can provide further improvements to current models and help extract more salient features from data. In this vein, raw spectrum data was taken to provide an additional modality to our current pyCHIP classifier. Modifications in segmentation also show potential in improving the accuracy of the pyCHIP classifier. Classifier output was analyzed using network graphs and unsupervised clustering algorithms such as spectral clustering to detect better segmentation methods than the current “chipping” approach. We suggest that the chip selection process can be automated in the future using a combination of these techniques to enable high-throughput analyses.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Droplet breakup by multimodal nonlinear Rayleigh Taylor instability

A droplet impacted by a shock wave will undergo a process of fragmentation due to the development of interfacial hydrodynamic instabilities. The interface experiences variable acceleration and shear that result in the development of both inertial (Rayleigh–Taylor) and shear (Kelvin–Helmholtz) instabilities. These perturbations grow in time and drive the fragmentation and breakup of the deformed droplet. Experiments are performed on nominally 0.86 mm water droplet subjected to a Mach 7.6 detonation wave, resulting in a high Weber number (~36,000) breakup event. Perturbation growth is measured from a series of high-speed (> MHz) shadowgraph images. It is proposed that, given the size of the large-scale perturbations observed in experiments, these instabilities are growing in the non-linear regime and can be described by bubble-merger models for nonlinear mixing. Calculations are performed for the growth rates and size of these instabilities using deformation and external flow models to establish the time-dependent boundary conditions. The concurrence of the measured perturbation widths and the predictions of the simple model lend credence to the theory. This novel approach serves to open a new avenue in the characterization of droplet breakup via hydrodynamic instabilities.

Droplet breakup↗
DOE OSTI2026

Thermal cycling-driven microstructural changes of eutectic Al–Si phase change materials in SS304 containers revealed by multi-modal imaging

Aluminum-based Al–Si alloys are widely used as phase change materials (PCMs) in thermal energy storage (TES) systems owing to their high volumetric latent heat and superior thermal conductivity. However, their long-term reliability is limited by degradation processes that remain insufficiently understood. In this work, we employ a multimodal, correlative characterization framework to systematically resolve the degradation behavior of eutectic Al–Si PCMs in contact with SS304 containers under repeated thermal cycling. By integrating high-resolution electron microscopy, three-dimensional X-ray fluorescence (3D XRF) imaging, and differential scanning calorimetry (DSC), we directly link spatially resolved compositional and microstructural evolution to changes in thermophysical properties. The correlative analysis reveals that elemental leaching of Fe, Cr, and Ni from the stainless-steel container into the PCM drives the formation of intermetallic compounds (IMCs) both at the interface and within the bulk PCM, leading to pronounced compositional heterogeneity. These interfacial reactions and diffusion-induced transformations progressively destabilize the Al–Si eutectic, reducing the effective phase-transforming fraction. Consistent with these observations, DSC measurements show a decrease in melting temperature and latent heat of fusion with thermal cycling. These results underscore the critical influence of interfacial reactions and material compatibility on the stability, durability, and overall performance of Al–Si-based TES systems.

25 ENERGY STORAGE↗
DOE OSTI2025

Kelvin probe force microscopy under ambient conditions

Kelvin probe force microscopy (KPFM) is a technique derived from atomic force microscopy that provides maps of surface potential or work function differences across material systems, with nanometre-scale resolution. KPFM is a useful tool for investigating electrical phenomena such as dipole orientation, interfacial charge transfer, charge accumulation, band bending and doping levels. This Primer aims to provide an overview of typical ambient-condition KPFM measurements, covering their underlying principles, experimental implementations and wide-ranging applications. Key KPFM variants, including amplitude and frequency modulation, heterodyne detection schemes and innovative open loop and pulsed force techniques, are discussed, with practical guidance on optimizing signal acquisition and reducing errors. Specialized approaches, such as time-resolved KPFM and multimodal KPFM, are discussed for their ability to capture dynamic charge processes and chemical information, respectively. Here, we highlight recent advances in KPFM applications, spanning metal alloys, soft matter, ferroelectrics, photovoltaics and 2D materials, showcasing its versatility across research domains. By addressing current limitations and identifying future opportunities, this Primer underscores the transformative potential of KPFM in advancing the understanding of nanoscale electrical phenomena.

Zahmatkeshsaredorahi, Amirhossein [Lehigh Univ., B↗