Search NASA⌕ Search

SEARCH · Search NASA

Results for “multimodal”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

Multimodal MSI in Conjunction with Broad Coverage Spatially Resolved MS2 Increases Confidence in Both Molecular Identification and Localization

One critical aspect of mass spectrometry imaging (MSI) is the need to con?dently identify detected analytes. While orthogonal tandem MS (e.g., LC-MS2) experiments from sample extracts can assist in annotating ions, the spatial information about these molecules is lost. Accordingly, this could cause mislead conclusions, especially in cases where isobaric species exhibit di?erent distributions within a sample. In this Technical Note, we employed a multimodal imaging approach, using matrix assisted laser desorption/ionization (MALDI)-MSI and liquid extraction surface analysis (LESA)-MS2I, to con?dently annotate and One critical aspect of mass spectrometry imaging (MSI) is the need to con?dently identify detected analytes. While orthogonal tandem MS (e.g., LC-MS2) experiments from sample extracts can assist in annotating ions, the spatial information about these molecules is lost. Accordingly, this could cause mislead conclusions, especially in cases where isobaric species exhibit di?erent distributions within a sample. In this Technical Note, we employed a multimodal imaging approach, using matrix assisted laser desorption/ionization (MALDI)-MSI and liquid extraction surface analysis (LESA)-MS2I, to con?dently annotate and localize a broad range of metabolites involved in a tripartite symbiosis system of moss, cyanobacteria, and fungus. We found that the combination of these two imaging modalities generated very congruent ion images, providing the link between highly accurate structural information onfered by LESA and high spatial resolution attainable by MALDI. These results demonstrate how this combined methodology could be very useful in di?erentiating metabolite routes in complex systems.

Velickovic, Dusan↗
DOE OSTI2024

Potential Adoption and Benefits of Co-Optimized Multimode Engines and Fuels for U.S. Light-Duty Vehicles

Exploring a diverse portfolio of technologies for decarbonization is crucial to understanding the potential impacts of different technological solutions and their associated environmental implications. Using high-octane, high-sensitivity biofuel blends in co-optimized multimode engines can increase engine efficiency and reduce vehicle emissions. Here, the multimode engine research focuses on the benefits of light-duty vehicle engines, which can operate in multiple modes depending on the vehicle's load. Low-temperature combustion can improve efficiency and reduce emissions (such as those from oxides of nitrogen and particulate matter) during low-load operation, while spark ignition performance is maintained in high-load operation. These advanced engines can be optimized to run on blends of biobased fuels. This analysis models scenarios for potential market adoption of co-optimized multimode vehicles fueled by three different bioblendstocks: ethanol, isopropanol, and isobutanol. An integrated modeling approach is used to forecast the energy and environmental impacts of the deployment of co-optimized multimode vehicles and fuels in the light-duty sector over the 2020-to-2050 time horizon. The multidisciplinary approach combines vehicle sales modeling, system dynamics modeling of the biorefining industry, and life cycle assessment to estimate the emissions and energy benefits. The models consider market forces such as consumer preferences for vehicle attributes, biofuel supply and demand dynamics subject to biorefinery capacity build-out and bioresource constraints, and forecasted changes to the U.S. bulk energy system over time. Market adoption of co-optimized vehicles is evaluated across a wide parameter space for incremental vehicle cost and engine efficiency improvement. This analysis reveals that the deployment of co-optimized multimode fuels and vehicles results in up to a 5% reduction in annual sector-wide life cycle greenhouse gas (GHG) emissions by 2050, relative to a business-as-usual scenario, but is also indicates environmental trade-offs, such as higher life cycle water-use. Emission benefits could potentially increase beyond 2050, as the new technologies penetrate the market and gain a foothold. Results also show that, under certain circumstances, vehicles with engines co-optimized for use with high-octane, high-sensitivity biofuel blends can be cost-competitive with conventional gasoline, while reducing GHG emissions. Our modeling results indicate that co-optimized multimode fuels and engines can be strategically leveraged in tandem with electrification to decarbonize the light-duty sector. Co-optimized vehicles could play a role in the early years of the time horizon, while electric vehicles (EVs) could become more competitive in the later years, highlighting the complementary benefits of these technologies for GHG reductions.

Oke, Doris↗
DOE OSTI2018

An Iterative Local Updating Ensemble Smoother for Estimation and Uncertainty Assessment of Hydrologic Model Parameters With Multimodal Distributions

Abstract Ensemble smoother (ES) has been widely used in inverse modeling of hydrologic systems. However, for problems where the distribution of model parameters is multimodal, using ES directly would be problematic. One popular solution is to use a clustering algorithm to identify each mode and update the clusters with ES separately. However, this strategy may not be very efficient when the dimension of parameter space is high or the number of modes is large. Alternatively, we propose in this paper a very simple and efficient algorithm, i.e., the iterative local updating ensemble smoother (ILUES), to explore multimodal distributions of model parameters in nonlinear hydrologic systems. The ILUES algorithm works by updating local ensembles of each sample with ES to explore possible multimodal distributions. To achieve satisfactory data matches in nonlinear problems, we adopt an iterative form of ES to assimilate the measurements multiple times. Numerical cases involving nonlinearity and multimodality are tested to illustrate the performance of the proposed method. It is shown that overall the ILUES algorithm can well quantify the parametric uncertainties of complex hydrologic models, no matter whether the multimodal distribution exists.

Zhang, Jiangjiang↗
DOE OSTI2013

Novel multimodality segmentation using level sets and Jensen-Rényi divergence

Purpose: Positron emission tomography (PET) is playing an increasing role in radiotherapy treatment planning. However, despite progress, robust algorithms for PET and multimodal image segmentation are still lacking, especially if the algorithm were extended to image-guided and adaptive radiotherapy (IGART). This work presents a novel multimodality segmentation algorithm using the Jensen-Rényi divergence (JRD) to evolve the geometric level set contour. The algorithm offers improved noise tolerance which is particularly applicable to segmentation of regions found in PET and cone-beam computed tomography. Methods: A steepest gradient ascent optimization method is used in conjunction with the JRD and a level set active contour to iteratively evolve a contour to partition an image based on statistical divergence of the intensity histograms. The algorithm is evaluated using PET scans of pharyngolaryngeal squamous cell carcinoma with the corresponding histological reference. The multimodality extension of the algorithm is evaluated using 22 PET/CT scans of patients with lung carcinoma and a physical phantom scanned under varying image quality conditions. Results: The average concordance index (CI) of the JRD segmentation of the PET images was 0.56 with an average classification error of 65%. The segmentation of the lung carcinoma images had a maximum diameter relative error of 63%, 19.5%, and 14.8% when using CT, PET, and combined PET/CT images, respectively. The estimated maximal diameters of the gross tumor volume (GTV) showed a high correlation with the macroscopically determined maximal diameters, with aR{sup 2} value of 0.85 and 0.88 using the PET and PET/CT images, respectively. Results from the physical phantom show that the JRD is more robust to image noise compared to mutual information and region growing. Conclusions: The JRD has shown improved noise tolerance compared to mutual information for the purpose of PET image segmentation. Presented is a flexible framework for multimodal image segmentation that can incorporate a large number of inputs efficiently for IGART.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2026

MOSAIC-CONUS: A Multimodal, Multi-Temporally Paired Dataset for Earth Sciences

Earth embeddings—vector representations of geographic locations indexed in space and time—are emerging as a unifying interface for geospatial AI. However, their quality depends not only on model design, but on how multimodal Earth observation (EO) data are spatially indexed, temporally aligned, and cross-modally associated during pretraining. We introduce MOSAIC-CONUS (Multimodal Observations with Spatially Aligned Imagery, Urban Points of Interest, In-Situ Measurements and Text Captions), a large-scale EO dataset over the contiguous United States, organized around 250,000 stratified point indices that serve as stable spatial keys across seven modalities: active radar, passive optical imagery, lidar-derived elevation, land cover, functional context, hydrometeorological measurements, and textual summaries. Unlike existing EO datasets, MOSAIC-CONUS introduces four contributions not jointly addressed in prior work: 1. an open-source, large-scale multimodal EO corpus structured around point-indexed data designed to support Earth embedding learning; 2. explicit radar-optical pairing tables spanning twelve temporal alignment regimes, formalizing cross-sensor alignment as a controllable variable for analyzing how temporal mismatch across modalities influences learned embeddings quality; 3. a benchmark suite spanning cross-modal retrieval, annual nightlights regression, and basin-held-out streamflow prediction, positioning MOSAIC-CONUS as a benchmark-ready resource for multimodal AI systems; and 4. a language-based embedding layer through co-registered textual summaries, enabling Earth embeddings to function as a queryable interface for agentic AI systems. The dataset and pairing protocols are publicly released.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

An adaptive importance sampling algorithm for Bayesian inversion with multimodal distributions

Parametric uncertainties are encountered in the simulations of many physical systems, and may be reduced by an inverse modeling procedure that calibrates the simulation results to observations on the real system being simulated. Following Bayes' rule, a general approach for inverse modeling problems is to sample from the posterior distribution of the uncertain model parameters given the observations. However, the large number of repetitive forward simulations required in the sampling process could pose a prohibitive computational burden. This difficulty is particularly challenging when the posterior is multimodal. We present in this paper an adaptive importance sampling algorithm to tackle these challenges. Two essential ingredients of the algorithm are: 1) a Gaussian mixture (GM) model adaptively constructed as the proposal distribution to approximate the possibly multimodal target posterior, and 2) a mixture of polynomial chaos (PC) expansions, built according to the GM proposal, as a surrogate model to alleviate the computational burden caused by computational-demanding forward model evaluations. In three illustrative examples, the proposed adaptive importance sampling algorithm demonstrates its capabilities of automatically finding a GM proposal with an appropriate number of modes for the specific problem under study, and obtaining a sample accurately and efficiently representing the posterior with limited number of forward simulations.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2023

Plasmonic nanorod probes’ journey inside plant cells for in vivo SERS sensing and multimodal imaging

Nanoparticle-based platforms are gaining strong interest in plant biology and bioenergy research to monitor and control biological processes in whole plants. However, in vivo monitoring of biomolecules using nanoparticles inside plant cells remains challenging due to the impenetrability of the plant cell wall to nanoparticles beyond the exclusion limits (5-20 nm). To overcome this physical barrier, we have designed unique bimetallic silver-coated gold nanorods (AuNR@Ag) capable of entering plant cells, while conserving key plasmonic properties in the near-infrared (NIR). To demonstrate cellular internalization and tracking of the nanorods inside plant tissue, we used a comprehensive multimodal imaging approach that included transmission electron microscopy (TEM), confocal fluorescence microscopy, two-photon luminescence (TPL), X-ray fluorescence microscopy (XRF), and photoacoustics imaging (PAI). We successfully acquired SERS signals of nanorods in vivo inside plant cells of tobacco leaves. On the same leaf samples, we applied orthogonal imaging methods, TPL and PAI techniques for in vivo imaging of the nanorods. This study first demonstrates the intracellular internalization of AuNR@Ag inside whole plant systems for in vivo SERS analysis in tobacco cells. This work demonstrates the potential of this nanoplatform as a new nanotool for intracellular in vivo biosensing for plant biology.

Cupil-Garcia, Vanessa↗
DOE OSTI2024

Statistical mechanics and pressure of composite multimoded weakly nonlinear optical systems

Statistical mechanics can provide a versatile theoretical framework for investigating the collective dynamics of weakly nonlinear-wave settings that can be utterly complex to describe otherwise. In optics, composite systems arise due to interactions between different frequencies and polarizations. The purpose of this work is to develop a thermodynamic theory that takes into account the synergistic action of multiple components. We find that the type of the nonlinearity involved can have important implications in the thermalization process and, hence, can lead to different thermal equilibrium conditions. Importantly, we derive closed-form expressions for the actual optomechanical pressure that is exerted on the system. In particular, the total optomechanical pressure is the sum of the partial pressures due to each component. Our results can be applied to a variety of weakly nonlinear optical settings such as multimode fibers, bulk waveguides, photonic lattices, and coupled microresonators. We present two specific examples, where two colors interact in a one-waveguide array with either a cubic or quadratic nonlinearity.

Efremidis, Nikolaos K. (ORCID:0000000298300268)↗
DOE OSTI2016

Integrated Proteomics and Metabolomics Suggests Symbiotic Metabolism and Multimodal Regulation in a Fungal-Endobacterial System: Symbiotic Metabolism and Multimodal Regulation

Many plant-associated fungi host endosymbiotic endobacteria with reduced genomes. While endobacteria play important roles in these tri-partite plant-fungal-endobacterial systems, the active physiology of fungal endobacteria has not been characterized extensively by systems biology approaches. Here in this paper, we use integrated proteomics and metabolomics to characterize the relationship between the endobacterium Mycoavidus sp. and the root-associated fungus Mortierella elongata . In nitrogen-poor media, M. elongata had decreased growth but hosted a large and growing endobacterial population. The active endobacterium likely extracted malate from the fungal host as the primary carbon substrate for energy production and biosynthesis of phospho-sugars, nucleobases, peptidoglycan, and some amino acids. The endobacterium obtained nitrogen by importing a variety of nitrogen-containing compounds. Further, nitrogen limitation significantly perturbed the carbon and nitrogen flows in the fungal metabolic network. M. elongata regulated many pathways by concordant changes on enzyme abundances, post-translational modifications, reactant concentrations, and allosteric effectors. Lastly, such multimodal regulations may be a general mechanism for metabolic modulation.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Multimodal Analysis of Spatially Heterogeneous Microstructural Refinement and Softening Mechanisms in Three-Pass Friction Stir Processed Al4Si Alloy

Multiple thermally and thermomechanically induced microstructural refinement mechanisms can be activated in metallic alloys when subjected to solid phase processing methods such as friction stir processing (FSP). In this work, we provide detailed descriptions of the relationship between region-specific microstructural refinement mechanisms and the variation in microhardness, through a systematic and multimodal microstructural characterization of an FSP-processed 75% cold-rolled Al-4 at.% Si model binary alloy. Spatially resolved high-energy synchrotron X-ray diffraction, electron backscattered diffraction, and scanning transmission electron microscopy were used to understand the spatially heterogeneous microstructural evolution due to FSP. Results provide insights into how mechanisms such as static recovery, static recrystallization, dynamic recovery and recrystallization, geometric and continuous dynamic recrystallization, and particle-stimulated static or dynamic grain nucleation may occur heterogeneously in the microstructure as a function of the distance from the stir zone in processed alloys, directly influencing the degree of softening. The systematic analysis of microstructures and hardness in the FSP-processed model binary alloy given in this work highlights the rich microstructural domains that can be uniquely harnessed through solid phase processing of metallic alloys.

Al4Si, Friction Stir Processing, Geometric Dynamic↗
DOE OSTI2022

Porous Colloidal Nanoparticles as Injectable Multimodal Contrast Agents for Enhanced Geophysical Sensing

Injecting fluids into underground geologic structures is crucial for the development of long-term strategies for managing captured carbon and facilitating sustainable energy extraction operations. Here, we have previously reported that the injection of metal–organic frameworks (MOFs) into the subsurface can enhance seismic monitoring tools to track fluids and map complex structures, reduce risk, and verify containment in carbon storage reservoirs because of their absorption capacity of low-frequency seismic waves. Here, we demonstrate that water-based Cr/Zn/Zr MOF colloidal suspensions (nanofluids) are multimodal geophysical contrast agents that enhance near-wellbore logging tools. Based on experimental fluid-only measurements, MIL-101(Cr), ZIF-8, and UiO-66 nanofluids have distinct complex conductivity and/or low-field nuclear magnetic resonance (NMR) signatures that are relevant to field-deployed technologies, implying the potential to enhance near-wellbore monitoring of CO 2 injection and associated processes with downhole logging tools. Small- and wide-angle X-ray scattering characterization of ~0.5 wt % MIL-101(Cr) suspensions confirmed phase stability and provided insight into the fractal nature of colloidal nanoparticles. Finally, low-field (2 MHz) NMR measurements of MIL-101(Cr) nanofluid injection into a prototypical Berea sandstone demonstrate how paramagnetic high-surface area MOFs may dominate the relaxation times of hydrogen-bearing fluids in porous geologic matrices, enhancing the mapping of near-surface and near-wellbore transport pathways and advancing sustainable subsurface energy technologies.

NMR↗