Search NASA⌕ Search

SEARCH · Search NASA

Results for “Multimode”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2024

Redesigning large-scale multimodal transit networks with shared autonomous mobility services

Here, this study addresses a large-scale multimodal transit network design problem, with Shared Autonomous Mobility Services (SAMS) as both transit feeders and an origin-to-destination mode. The framework captures spatial demand and modal characteristics, considers intermodal transfers and express services, determines transit infrastructure investment and path flows, and generates transit routes. A system-optimal multimodal transit network is designed with minimum total door-to-door generalized costs of users and operators, satisfying transit origin-destination demand within a pre-set infrastructure budget. Firstly, the geography, demand, and modes in each zone are characterized with continuous approximation. The decisions of network link investment and multimodal path flows in zonal connection optimization are formulated as a minimum-cost multi-commodity network flow (MCNF) problem and solved efficiently with a mixed-integer linear programming (MILP) solver. Subsequently, the route generation problem is solved by expanding the MCNF formulation to minimize intramodal transfers. The model is illustrated through a set of experiments with the Chicago network comprised of 50 zones and seven modes, under three scenarios. The computational results present savings in traveler journey time and operator cost demonstrating the potential benefits of collaboration between multimodal transit systems and SAMS.

Autonomous vehicles↗
DOE OSTI2022

Integrating multimodal data through interpretable heterogeneous ensembles

Motivation: Integrating multimodal data represents an effective approach to predicting biomedical characteristics, such as protein functions and disease outcomes. However, existing data integration approaches do not sufficiently address the heterogeneous semantics of multimodal data. In particular, early and intermediate approaches that rely on a uniform integrated representation reinforce the consensus among the modalities but may lose exclusive local information. The alternative late integration approach that can address this challenge has not been systematically studied for biomedical problems. Results: We propose Ensemble Integration (EI) as a novel systematic implementation of the late integration approach. EI infers local predictive models from the individual data modalities using appropriate algorithms and uses heterogeneous ensemble algorithms to integrate these local models into a global predictive model. We also propose a novel interpretation method for EI models. We tested EI on the problems of predicting protein function from multimodal STRING data and mortality due to coronavirus disease 2019 (COVID-19) from multimodal data in electronic health records. We found that EI accomplished its goal of producing significantly more accurate predictions than each individual modality. It also performed better than several established early integration methods for each of these problems. The interpretation of a representative EI model for COVID-19 mortality prediction identified several disease-relevant features, such as laboratory test (blood urea nitrogen and calcium) and vital sign measurements (minimum oxygen saturation) and demographics (age). These results demonstrated the effectiveness of the EI framework for biomedical data integration and predictive modeling.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2026

Joint Optimization of Multimodal Transit Frequency and Shared Autonomous Vehicle Fleet Size with Hybrid Metaheuristic and Nonlinear Programming

Shared autonomous vehicles (SAVs) bring competition to traditional transit services but redesigning multimodal transit network can utilize SAVs as feeders to enhance service efficiency and coverage. This paper presents an optimization framework for the joint multimodal transit frequency and SAV fleet size problem, a variant of the transit network frequency setting problem. The objective is to maximize total transit ridership (including SAV-fed trips and subtracting boarding rejections) across multiple time periods under budget constraints, considering endogenous mode choice (transit, point-to-point SAVs, driving) and route selection, while allowing for strategic route removal by setting frequencies to zero. Due to the problem’s non-linear, non-convex nature and the computational challenges of large-scale networks, we develop a hybrid solution approach that combines a metaheuristic approach (particle swarm optimization) with nonlinear programming for local solution refinement. To ensure computational tractability, the framework integrates analytical approximation models for SAV waiting times based on fleet utilization, multimodal network assignment for route choice, and multinomial logit mode choice behavior, bypassing the need for computationally intensive simulations within the main optimization loop. Applied to the Chicago metropolitan area’s multimodal network, our method illustrates a 33.3% increase in transit ridership through optimized transit route frequencies and SAV integration, particularly enhancing off-peak service accessibility and strategically reallocating resources.

Ng, Max↗
DOE OSTI2021

Factors associated with emerging multimodal transportation behavior in the San Francisco Bay Area

Abstract This paper identifies the influence of demographic, local transportation environment, and individual preferences for transportation attributes on multimodal transportation behavior in an urban environment with emergent transportation mode availability. Multimodality is the use of more than one mode of transportation during a given timeframe. Multimodality has been considered a key component of sustainable and efficient transportation systems, as this travel behavior can represent a shift away from personal vehicle use to more sustainable transportation modes, especially in urban environments with diverse transportation systems and emergent shared transportation alternatives (e.g., carsharing, ridehailing, bike sharing). However, it is unclear what factors contribute towards people being more likely to exhibit multimodal transportation behavior in modern urban environments. We assessed commuting behavior based on a survey administered in the San Francisco Bay Area according to whether residents commuted (i) exclusively by vehicle, (ii) by a mix of vehicle and non-vehicle modes, or (iii) exclusively by non-vehicle modes. A classification tree approach identified correlations between commuting classes and demographic variables, preferences for transportation attributes, and location-based information. The characterization of commuting styles could inform regional transportation policy and design that aims to reduce vehicle use by identifying the demographic, preference, and location-based considerations correlated with each commuting style.

McAuliffe Wells, Emily↗
DOE OSTI2023

Discriminative analysis of schizophrenia patients using graph convolutional networks: A combined multimodal MRI and connectomics analysis

Introduction Recent studies in human brain connectomics with multimodal magnetic resonance imaging (MRI) data have widely reported abnormalities in brain structure, function and connectivity associated with schizophrenia (SZ). However, most previous discriminative studies of SZ patients were based on MRI features of brain regions, ignoring the complex relationships within brain networks. Methods We applied a graph convolutional network (GCN) to discriminating SZ patients using the features of brain region and connectivity derived from a combined multimodal MRI and connectomics analysis. Structural magnetic resonance imaging (sMRI) and resting-state functional magnetic resonance imaging (rs-fMRI) data were acquired from 140 SZ patients and 205 normal controls. Eighteen types of brain graphs were constructed for each subject using 3 types of node features, 3 types of edge features, and 2 brain atlases. We investigated the performance of 18 brain graphs and used the TopK pooling layers to highlight salient brain regions (nodes in the graph). Results The GCN model, which used functional connectivity as edge features and multimodal features (sMRI + fMRI) of brain regions as node features, obtained the highest average accuracy of 95.8%, and outperformed other existing classification studies in SZ patients. In the explainability analysis, we reported that the top 10 salient brain regions, predominantly distributed in the prefrontal and occipital cortices, were mainly involved in the systems of emotion and visual processing. Discussion Our findings demonstrated that GCN with a combined multimodal MRI and connectomics analysis can effectively improve the classification of SZ at an individual level, indicating a promising direction for the diagnosis of SZ patients. The code is available at https://github.com/CXY-scut/GCN-SZ.git .

Chen, Xiaoyi↗
DOE OSTI2020

Impact of multimode range and location on urban fuel economy on a light-duty spark-ignition based powertrain using vehicle system simulations

Multimode engine operation uses two or more combustion modes to maximize engine efficiency across the operational range of a vehicle to achieve higher overall vehicle fuel economy than is possible with a single combustion mode. More specifically for this study, multimode solutions are explored that make use of boosted SI under high load operation and other advanced combustion modes such as advanced compression ignition (ACI) under part-load conditions to enable additional engine efficiency improvements across a broader range of the engine operating map. ACI combustion has well-documented potential to improve efficiency and emissions under part-load operation but poses challenges that limit full engine speed-load range. This study investigates the potential impact of ACI operational range on simulated fuel economy to help focus research on areas with the most opportunity for improving fuel economy. These simulations make use of a vehicle model, discretized engine data, and employ a systematic exploration of ACI operational range to estimate multimode fuel economy for a mid-size passenger vehicle over U.S. Environmental Protection Agency’s Urban Dynamometer Driving Schedule. The results of this study highlight operational ranges with the highest potential fuel economy and correspondingly areas of focus for multimode research and ACI engine operation1.

Curran, Scott↗
NASA NTRS2003

Parallel Information Processing (Image Transmission Via Fiber Bundle and Multimode Fiber

Growing demand for visual, user-friendly representation of information inspires search for the new methods of image transmission. Currently used in-series (sequential) methods of information processing are inherently slow and are designed mainly for transmission of one or two dimensional arrays of data. Conventional transmission of data by fibers requires many fibers with array of laser diodes and photodetectors. In practice, fiber bundles are also used for transmission of images. Image is formed on the fiber-optic bundle entrance surface and each fiber transmits the incident image to the exit surface. Since the fibers do not preserve phase, only 2D intensity distribution can be transmitted in this way. Each single mode fiber transmit only one pixel of an image. Multimode fibers may be also used, so that each mode represent different pixel element. Direct transmission of image through multimode fiber is hindered by the mode scrambling and phase randomization. To overcome these obstacles wavelength and time-division multiplexing have been used, with each pixel transmitted on a separate wavelength or time interval. Phase-conjugate techniques also was tested in, but only in the unpractical scheme when reconstructed image return back to the fiber input end. Another method of three-dimensional imaging over single mode fibers was demonstrated in, using laser light of reduced spatial coherence. Coherence encoding, needed for a transmission of images by this methods, was realized with grating interferometer or with the help of an acousto-optic deflector. We suggest simple practical holographic method of image transmission over single multimode fiber or over fiber bundle with coherent light using filtering by holographic optical elements. Originally this method was successfully tested for the single multimode fiber. In this research we have modified holographic method for transmission of laser illuminated images over commercially available fiber bundle (fiber endoscope, or fiberscope).

Kukhtarev, Nicholai↗
NASA NTRS2014

Angular and Polarization Response of Multimode Sensors with Resistive-Grid Absorbers

High sensitivity receiver systems with near ideal polarization sensitivity are highly desirable for development of millimeter and sub-millimeter radio astronomy. Multimoded bolometers provide a unique solution to achieve such sensitivity, for which hundreds of single-mode sensors would otherwise be required. The primary concern in employing such multimoded sensors for polarimetery is the control of the polarization systematics. In this paper, we examine the angular- and polarization- dependent absorption pattern of a thin resistive grid or membrane, which models an absorber used for a multimoded bolometer. The result shows that a freestanding thin resistive absorber with a surface resistivity of eta/2, where eta is the impedance of free space, attains a beam pattern with equal E- and H-plane responses, leading to zero cross polarization. For a resistive-grid absorber, the condition is met when a pair of grids is positioned orthogonal to each other and both have a resistivity of eta/2. When a reflective backshort termination is employed to improve absorption efficiency, the cross-polar level can be suppressed below −30 dB if acceptance angle of the sensor is limited to < or approx. 60deg. The small cross-polar systematics have even-parity patterns and do not contaminate the measurements of odd-parity polarization patterns, for which many of recent instruments for cosmic microwave background are designed. Underlying symmetry that suppresses these cross-polar systematics is discussed in detail. The estimates and formalism provided in this paper offer key tools in the design consideration of the instruments using the multimoded polarimeters.

High sensitivity receiver systems↗
DOE OSTI2026

FIRM: federated image reconstruction using multimodal tomographic data

Here, we propose a federated algorithm for reconstructing images using multimodal tomographic data sourced from dispersed locations, addressing the challenges of traditional unimodal approaches that are prone to noise and reduced image quality, as well as the limitations of centralized multimodal approaches that require extensive data transfer, leading to significant communication overhead, storage demands, and potential data privacy concerns. Our approach formulates a joint inverse optimization problem incorporating multimodality constraints and solves it in a federated framework through local gradient computations complemented by lightweight central operations, thereby ensuring data decentralization. Leveraging the connection between our federated algorithm and the quadratic penalty method, we introduce an adaptive step-size rule with guaranteed sublinear convergence. Numerical results demonstrate superior computational efficiency and improved image reconstruction quality compared to existing approaches.

federated algorithm↗
DOE OSTI2024

Unsupervised multimodal fusion of in-process sensor data for advanced manufacturing process monitoring

Effective monitoring of manufacturing processes is crucial for maintaining product quality and operational efficiency. Modern manufacturing environments often generate vast amounts of complementary multimodal data, including visual imagery from various perspectives and resolutions, hyperspectral data, and machine health monitoring information such as actuator positions, accelerometer readings, and temperature measurements. However, fusing and interpreting this complex, high-dimensional data presents significant challenges, particularly when labeled datasets are unavailable or impractical to obtain. This paper presents a novel approach to multimodal sensor data fusion in manufacturing processes, inspired by the Contrastive Language-Image Pre-training (CLIP) model. We leverage contrastive learning techniques to correlate different data modalities without the need for labeled data, overcoming limitations of traditional supervised machine learning methods in manufacturing contexts. Our proposed method demonstrates the ability to handle and learn encoders for five distinct modalities: visual imagery, audio signals, laser position (x and y coordinates), and laser power measurements. By compressing these high-dimensional datasets into low-dimensional representational spaces, our approach facilitates downstream tasks such as process control, anomaly detection, and quality assurance. The unsupervised nature of our method makes it broadly applicable across various manufacturing domains, where large volumes of unlabeled sensor data are common. We evaluate the effectiveness of our approach through a series of experiments, demonstrating its potential to enhance process monitoring capabilities in advanced manufacturing systems. This research contributes to the field of smart manufacturing by providing a flexible, scalable framework for multimodal data fusion that can adapt to diverse manufacturing environments and sensor configurations. The proposed method paves the way for more robust, data-driven decision-making in complex manufacturing processes.

Contrastive Learning↗
DOE OSTI2023

Large-scale cascading of first-order FBG array in a highly multimode coreless fiber using femtosecond laser for distributed thermal sensing

This research focuses on the performance analysis and characterization of a fiber Bragg gratings (FBGs) array, consisting of 10 first-order FBGs inscribed by a femtosecond (FS) laser in a highly multimode coreless fiber. The study evaluates the FBG array's ability to function as a distributed thermal sensing (DTS) platform, with the coreless fiber chosen as the sensing element due to its immunity to dopant migration at high temperatures. The design of a large cascaded first-order FBG array effectively eliminates unwanted harmonic peaks across a wide spectrum range. In contrast, higher-order FBGs introduce limitations due to the overlapping of Bragg peaks with harmonics. The FBG array's performance is evaluated by measuring the reflection spectrum of each grating at different temperatures, showing a high temperature sensitivity of 15.05 pm/°C at a Bragg wavelength of 1606.3 nm, with a linear response in the temperature range of 24 - 1100 °C. The FBG array was designed for a spatial resolution of 5 mm. A mode scrambler in the sensing network is employed, which suppresses multimodal interference, characterizes FBG peak visibility, and stabilizes the interference spectrum. The stability of the FBG array is also assessed over 24 hrs at 1100 °C, and it is observed to be stable during thermal treatment. Heat treatment at 1100°C improves the signal to noise ratio of the FBG array, demonstrating the robustness and suitability of the proposed FBG array on highly multimode coreless fiber as a potential sensing platform for DTS applications in harsh environmental conditions, overcoming the issues of dopant migration presented by dopes silica optical fibers at high temperatures.

47 OTHER INSTRUMENTATION↗
DOE OSTI2023

Data augmentation and multimodal learning for predicting drug response in patient-derived xenografts from gene expressions and histology images

Patient-derived xenografts (PDXs) are an appealing platform for preclinical drug studies. A primary challenge in modeling drug response prediction (DRP) with PDXs and neural networks (NNs) is the limited number of drug response samples. We investigate multimodal neural network (MM-Net) and data augmentation for DRP in PDXs. The MM-Net learns to predict response using drug descriptors, gene expressions (GE), and histology whole-slide images (WSIs). We explore whether combining WSIs with GE improves predictions as compared with models that use GE alone. We propose two data augmentation methods which allow us training multimodal and unimodal NNs without changing architectures with a single larger dataset: 1) combine single-drug and drug-pair treatments by homogenizing drug representations, and 2) augment drug-pairs which doubles the sample size of all drug-pair samples. Unimodal NNs which use GE are compared to assess the contribution of data augmentation. The NN that uses the original and the augmented drug-pair treatments as well as single-drug treatments outperforms NNs that ignore either the augmented drug-pairs or the single-drug treatments. In assessing the multimodal learning based on the MCC metric, MM-Net outperforms all the baselines. Our results show that data augmentation and integration of histology images with GE can improve prediction performance of drug response in PDXs.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Unsupervised physics-informed disentanglement of multimodal data

Here, we introduce physics-informed multimodal autoencoders (PIMA) - a variational inference framework for discovering shared information in multimodal datasets. Individual modalities are embedded into a shared latent space and fused through a product-of-experts formulation, enabling a Gaussian mixture prior to identify shared features. Sampling from clusters allows cross-modal generative modeling, with a mixture-of-experts decoder that imposes inductive biases from prior scientific knowledge and thereby imparts structured disentanglement of the latent space. This approach enables cross-modal inference and the discovery of features in high-dimensional heterogeneous datasets. Consequently, this approach provides a means to discover fingerprints in multimodal scientific datasets and to avoid traditional bottlenecks related to high-fidelity measurement and characterization of scientific datasets.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2023

Microstructure Evolution of a Multimodal Gamma-Prime Ni-Based Superalloy Characterized by In Situ Diffraction

The relationship between the evolution of microstructure, deformation micromechanisms and mechanical properties is difficult to establish in multimodal size distribution $_γ$$'$ superalloys, as the microstructure evolves with both temperature and time, and multiple strengthening mechanisms across each size distribution contribute to mechanical performance. In situ X-ray scattering can offer unparalleled insight regarding microstructure evolution at the temperatures and stresses of importance to gas-turbine applications; however, in situ X-ray diffraction has not been applied to the study of multimodal $_γ$$'$ distribution superalloys. Herein, lattice parameter evolution of secondary and tertiary $_γ$$'$ precipitates in a representative superalloy, Nimonic 115, is determined between 750 °C and 950 °C and correlated to room-temperature SEM and microhardness values. A large positive lattice parameter misfit of secondary $_γ$$'$ induces precipitate splitting, and the tertiary $_γ$$'$ goes into dissolution at ~ 800 °C, but with little apparent change in hardness values. The volume fraction of $_γ$$'$ decreases above 900 °C and precipitate-matrix coherency is lost, and there is a corresponding decrease in microhardness values. Importantly, the diffraction analysis demonstrates the capability to determine critical microstructural parameters of both precipitate size distributions in situ, representing an additional tool for determining microstructure-mechanical property relationships of multimodal superalloys.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Evaluation of UAV-derived multimodal remote sensing data for biomass prediction and drought tolerance assessment in bioenergy sorghum

Screening for drought tolerance is critical to ensure high biomass production of bioenergy sorghum in arid or semi-arid environments. The bottleneck in drought tolerance selection is the challenge of accurately predicting biomass for a large number of genotypes. Although biomass prediction by low-altitude remote sensing has been widely investigated on various crops, the performance of the predictions are not consistent, especially when applied in a breeding context with hundreds of genotypes. In some cases, biomass prediction of a large group of genotypes benefited from multimodal remote sensing data; while in other cases, the benefits were not obvious. In this study, we evaluated the performance of single and multimodal data (thermal, RGB, and multispectral) derived from an unmanned aerial vehicle (UAV) for biomass prediction for drought tolerance assessments within a context of bioenergy sorghum breeding. The biomass of 360 sorghum genotypes grown under well-watered and water-stressed regimes was predicted with a series of UAV-derived canopy features, including canopy structure, spectral reflectance, and thermal radiation features. Biomass predictions using canopy features derived from the multimodal data showed comparable performance with the best results obtained with the single modal data with coefficients of determination (R 2 ) ranging from 0.40 to 0.53 under water-stressed environment and 0.11 to 0.35 under well-watered environment. The significance in biomass prediction was highest with multispectral followed by RGB and lowest with the thermal sensor. Finally, two well-recognized yield-based drought tolerance indices were calculated from ground truth biomass data and UAV predicted biomass, respectively. Results showed that the geometric mean productivity index outperformed the yield stability index in terms of the potential for reliable predictions by the remotely sensed data. Collectively, this study demonstrated a promising strategy for the use of different UAV-based imaging sensors to quantify yield-based drought tolerance.

09 BIOMASS FUELS↗
DOE OSTI2020

The Role of Ligand–Ligand Interactions in Multimodal Ligand Conformational Equilibria and Surface Pattern Formation

Multimodal chromatography uses multiple modes of interaction such as charge, hydrophobic, or hydrogen bonding to separate proteins. Recently, we used molecular dynamics (MD) simulations to show that ligands immobilized on surfaces can interact and associate with neighboring ligands to form hydrophobic and charge patches, which may have important implications for the nature of protein–surface interactions. Here, we study interfacial systems of increasing complexity—from a single immobilized multimodal ligand to high density surfaces—to better understand how ligand behavior is affected by the presence of a surface and the presence of other ligands in the vicinity, and how this behavior scales to larger systems. Furthermore, we find that tethering a ligand to a surface restricts its conformations to a subset of those observed in free solution, yet the ligand maintains flexibility in the plane of the surface and can form contacts with neighboring ligands. We find that although the formation of a contact between two neighboring ligands is slightly unfavorable, three neighboring ligands exhibit a preference for the formation of a fully connected cluster. To explore how these trends in ligand association extend to a larger surface with high density of ligands, we performed coarse-grained Monte Carlo (MC) simulations of a 132-ligand surface using ligand interactions parametrized based on free energies obtained from the three-ligand MD simulations. Despite their simplicity, the coarse-grained simulations qualitatively capture the cluster size distribution of ligands observed in detailed MD simulations. Quantitative differences between the two suggest opportunities for improvements in the coarse-grained energy function for efficient predictions of cluster and pattern formations. Our approach presents a promising route to the engineering of multimodal patterns for future chromatographic resin design.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Probing corrosion using a simple and versatile in situ multimodal corrosion measurement system

In this work, we have developed a unique in situ multimodal corrosion system that is capable of acquiring electrochemical data, sample imaging/visualization and hydrogen collection, simultaneously. Each of these modalities yield valuable information pertaining to the ongoing corrosion process. Combining them can yield holistic information on the role of microstructure, processing history, presence of coatings, etc., on the sequence of steps occurring during the corrosion process, and how they correlate with the acquired electrochemical data. Four materials systems, namely AA6061-T6 aluminum alloy, AZ91 magnesium alloy, galvanized DP590 steel, and pure Zn, were investigated under open circuit potential and under potentiodynamic polarization. The multimodal corrosion system was utilized to observe processes such as surface passivation and dissolution, pit and filiform corrosion initiation and propagation, and was correlated with location and magnitude of hydrogen evolution. This approach is shown to yield a truly multimodal understanding of the ongoing corrosion processes.

36 MATERIALS SCIENCE↗
DOE OSTI2025

A Representation Fusion Framework for Decoupling Diagnostic Information in Multimodal Learning

Modern medicine increasingly relies on multimodal data, ranging from clinical notes to imaging and genomics, to guide diagnosis and treatment. However, integrating these heterogeneous data sources in a principled and interpretable manner remains a major challenge. We present MODES (Multi-mOdal Disentangled Embedding Space), a representation fusion framework that explicitly separates shared and modality-specific factors of variation, offering a structured latent space for multimodal information that improves both prediction and interpretability. By leveraging pre-trained unimodal foundation models, MODES mitigates the dependency on extensive paired datasets, crucial in data-scarce clinical settings. We introduce a masking strategy that optimizes representation dimensionality by eliminating low-information dimensions, to achieve compact, information-rich representations. Our framework demonstrates superior performance in predicting diagnoses and phenotypes compared to unimodal and conventional fusion models. MODES also enables robust diagnostic inference in missing data scenarios, offering an opportunity toward interpretable and efficient multimodal diagnostics in personalized healthcare.

60 APPLIED LIFE SCIENCES↗