Search NASA⌕ Search

SEARCH · Search NASA

Results for “multimode”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3

Multimodal hard x-ray imaging with resolution approaching 10 nm for studies in material science

We report multimodal scanning hard x-ray imaging with spatial resolution approaching 10 nm and its application to contemporary studies in the field of material science. The high spatial resolution is achieved by focusing hard x-rays with two crossed multilayer Laue lenses and raster-scanning a sample with respect to the nanofocusing optics. Various techniques are used to characterize and verify the achieved focus size and imaging resolution. Here, the multimodal imaging is realized by utilizing simultaneously absorption-, phase-, and fluorescence-contrast mechanisms. The combination of high spatial resolution and multimodal imaging enables a comprehensive study of a sample on a very fine length scale. In this work, the unique multimodal imaging capability was used to investigate a mixed ionic-electronic conducting ceramic-based membrane material employed in solid oxide fuel cells and membrane separations (compound of Ce 0.8 Gd 0.2 O 2–x and CoFe 2 O 4 ) which revealed the existence of an emergent material phase and quantified the chemical complexity at the nanoscale.

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Integrating multimodal data through interpretable heterogeneous ensembles

Motivation: Integrating multimodal data represents an effective approach to predicting biomedical characteristics, such as protein functions and disease outcomes. However, existing data integration approaches do not sufficiently address the heterogeneous semantics of multimodal data. In particular, early and intermediate approaches that rely on a uniform integrated representation reinforce the consensus among the modalities but may lose exclusive local information. The alternative late integration approach that can address this challenge has not been systematically studied for biomedical problems. Results: We propose Ensemble Integration (EI) as a novel systematic implementation of the late integration approach. EI infers local predictive models from the individual data modalities using appropriate algorithms and uses heterogeneous ensemble algorithms to integrate these local models into a global predictive model. We also propose a novel interpretation method for EI models. We tested EI on the problems of predicting protein function from multimodal STRING data and mortality due to coronavirus disease 2019 (COVID-19) from multimodal data in electronic health records. We found that EI accomplished its goal of producing significantly more accurate predictions than each individual modality. It also performed better than several established early integration methods for each of these problems. The interpretation of a representative EI model for COVID-19 mortality prediction identified several disease-relevant features, such as laboratory test (blood urea nitrogen and calcium) and vital sign measurements (minimum oxygen saturation) and demographics (age). These results demonstrated the effectiveness of the EI framework for biomedical data integration and predictive modeling.

59 BASIC BIOLOGICAL SCIENCES↗

Joint Optimization of Multimodal Transit Frequency and Shared Autonomous Vehicle Fleet Size with Hybrid Metaheuristic and Nonlinear Programming

Shared autonomous vehicles (SAVs) bring competition to traditional transit services but redesigning multimodal transit network can utilize SAVs as feeders to enhance service efficiency and coverage. This paper presents an optimization framework for the joint multimodal transit frequency and SAV fleet size problem, a variant of the transit network frequency setting problem. The objective is to maximize total transit ridership (including SAV-fed trips and subtracting boarding rejections) across multiple time periods under budget constraints, considering endogenous mode choice (transit, point-to-point SAVs, driving) and route selection, while allowing for strategic route removal by setting frequencies to zero. Due to the problem’s non-linear, non-convex nature and the computational challenges of large-scale networks, we develop a hybrid solution approach that combines a metaheuristic approach (particle swarm optimization) with nonlinear programming for local solution refinement. To ensure computational tractability, the framework integrates analytical approximation models for SAV waiting times based on fleet utilization, multimodal network assignment for route choice, and multinomial logit mode choice behavior, bypassing the need for computationally intensive simulations within the main optimization loop. Applied to the Chicago metropolitan area’s multimodal network, our method illustrates a 33.3% increase in transit ridership through optimized transit route frequencies and SAV integration, particularly enhancing off-peak service accessibility and strategically reallocating resources.

Ng, Max↗

Conformational Equilibria of Multimodal Chromatography Ligands in Water and Bound to Protein Surfaces

Multimodal chromatography uses small ligands with multiple modes of interaction, e.g., charged, hydrophobic or hydrogen bonding, to separate proteins from complex mixtures. The mechanism by which multimodal ligands interact with proteins is expected to be affected by ligand conformations, among other factors. In this report, we determine conformational equilibria of two commercially used multimodal cation exchange ligands, Capto MMC and Nuvia cPrime, in a range of solvents, a Lennard-Jones (LJ) liquid, ethanol, and water, using molecular dynamics (MD) simulations. By mapping ligand conformations onto two key torsion angles, ω and φ, in these solvents and in low and high dielectric media, we quantify the relative importance of intramolecular and solvent-mediated interactions. In a high dielectric medium, Capto MMC preferentially samples three conformations, which are stabilized by a combination of an intramolecular torsion potential (on ω) and LJ interactions. In an LJ liquid, solvent molecules compete with intramolecular interactions while simultaneously providing an osmotic force, stabilizing both closer and farther distances between ligand sites. This has the overall result of “flattening out” the conformational landscape. Interestingly, in ethanol and water, hydrogen bonding among the amide hydrogen and solvent molecules stabilizes two additional conformations of Capto MMC in which ω takes on less favorable cis-like configurations. MD simulations of ligands in free solution with three therapeutic antibody fragments show that ligand conformational equilibria remain effectively unchanged upon binding to proteins. Although, there is 20–30% dehydration of the overall ligand upon binding, the hydrogen-bonding sites are dehydrated to a much smaller extent, particularly in cis-like configurations. Conformational preferences of Nuvia cPrime are similar to that of Capto MMC, except for the effect of symmetry arising from the absence of an alkyl thiol tail. Characterizing the conformational equilibria of these two ligands in free solution and bound to a protein provides a foundation for developing a mechanistic understanding of protein–multimodal ligand interactions.

59 BASIC BIOLOGICAL SCIENCES↗

Factors associated with emerging multimodal transportation behavior in the San Francisco Bay Area

Abstract This paper identifies the influence of demographic, local transportation environment, and individual preferences for transportation attributes on multimodal transportation behavior in an urban environment with emergent transportation mode availability. Multimodality is the use of more than one mode of transportation during a given timeframe. Multimodality has been considered a key component of sustainable and efficient transportation systems, as this travel behavior can represent a shift away from personal vehicle use to more sustainable transportation modes, especially in urban environments with diverse transportation systems and emergent shared transportation alternatives (e.g., carsharing, ridehailing, bike sharing). However, it is unclear what factors contribute towards people being more likely to exhibit multimodal transportation behavior in modern urban environments. We assessed commuting behavior based on a survey administered in the San Francisco Bay Area according to whether residents commuted (i) exclusively by vehicle, (ii) by a mix of vehicle and non-vehicle modes, or (iii) exclusively by non-vehicle modes. A classification tree approach identified correlations between commuting classes and demographic variables, preferences for transportation attributes, and location-based information. The characterization of commuting styles could inform regional transportation policy and design that aims to reduce vehicle use by identifying the demographic, preference, and location-based considerations correlated with each commuting style.

McAuliffe Wells, Emily↗

Modal interactions between a large-wavelength inclined interface and small-wavelength multimode perturbations in a Richtmyer-Meshkov instability

The interaction of a small-wavelength multimodal perturbation with a large-wavelength inclined interface perturbation is investigated for the reshocked Richtmyer-Meshkov instability using three-dimensional simulations. The ares code, developed at Lawrence Livermore National Laboratory, was used for these simulations and a detailed comparison of simulation results and experiments performed at the Georgia Tech Shock Tube facility is presented first for code validation. Simulation results are presented for four cases that vary in large-wavelength perturbation amplitude and the presence of secondary small-wavelength multimode perturbations. Previously developed measures of mixing and turbulence quantities are presented that highlight the large variation in perturbation length scales created by the inclined interface and the multimode complex perturbation. Measures are developed for entrainment, and turbulence anisotropy that help to identify the effects of and competition between each perturbations type. It is shown through multiple measures that before reshock the flow processes a distinct memory of the initial conditions that is present in both large-scale-driven entrainment measures and small-scale-driven mixing measures. After reshock the flow develops to a turbulentlike state that retains a memory of high-amplitude but not low-amplitude large-wavelength perturbations. As a result, it is also shown that the high-amplitude large-wavelength perturbation is capable of producing small-scale mixing and turbulent features similar to the small-wavelength multimode perturbations.

42 ENGINEERING↗

PBX 9502 Multimode Damage Accumulation Cycles-to-Failure Study

In FY13, we performed a detailed cycles-to-failure study of PBX 9502 using 3- point bend specimens. In that study we examined the effect of temperature and cyclic frequency on the failure behavior of PBX 9502. We identified cycles-to-failure curves for samples tested at -20°C, ~19°C and 50°C and at cyclic frequencies of 0.0001 up to 1-Hz. We also did cyclic conditioning of parts in an effort to establish damage accumulation criteria that could then be used in predictive models. As follow-on to that work, in FY14 we have added multimode cycles-to-failure to our test suite. Work this year re-established the baseline cycles-to-failure behavior of the PBX 9502 material tested round ~19°C at 1-Hz and also looked at damage accumulation under a multimode loading environment. This fresh baseline development was performed to remove any time related or test rig related variables. The multimode loading was done because real-world applications are not mono-modal and we desire for our predictive capability to be robust and include more complex, realistic scenarios. In the following sections we briefly describe the test setup, we provide a summary of the new baseline results and we show the multimode cycles-to-failure data and how it compares to the mono-modal test data.

42 ENGINEERING↗

Preliminary Results on Applying Nonparametric Clustering and Bayesian Consensus Clustering Methods to Multimodal Data

In this report, we present preliminary research into nonparametric clustering methods for multi-source imagery data and quantifying the performance of these models. In many domain areas, data sets do not necessarily follow well-defined and well-known probability distributions, such as the normal, gamma, and exponential. This is especially true when combining data from multiple sources describing a common set of objects (which we call multimodal analysis), where the data in each source can follow different distributions and need to be analyzed in conjunction with one another. This necessitates nonparametric density estimation methods, which allow the data to better dictate the distribution of the data. One prominent example of multimodal analysis is multimodal image analysis, when we analyze multiple images taken using different radar systems of the same scene of interest. We develop uncertainty analysis methods, which are inherent in the use of probabilistic models but often not taken advance of, to assess the performance of probabilistic clustering methods used for analyzing multimodal images. This added information helps assess model performance and how much trust decision-makers should have in the obtained analysis results. The developed methods illustrate some ways in which uncertainty can inform decisions that arise when designing and using machine learning models.

42 ENGINEERING↗

Discriminative analysis of schizophrenia patients using graph convolutional networks: A combined multimodal MRI and connectomics analysis

Introduction Recent studies in human brain connectomics with multimodal magnetic resonance imaging (MRI) data have widely reported abnormalities in brain structure, function and connectivity associated with schizophrenia (SZ). However, most previous discriminative studies of SZ patients were based on MRI features of brain regions, ignoring the complex relationships within brain networks. Methods We applied a graph convolutional network (GCN) to discriminating SZ patients using the features of brain region and connectivity derived from a combined multimodal MRI and connectomics analysis. Structural magnetic resonance imaging (sMRI) and resting-state functional magnetic resonance imaging (rs-fMRI) data were acquired from 140 SZ patients and 205 normal controls. Eighteen types of brain graphs were constructed for each subject using 3 types of node features, 3 types of edge features, and 2 brain atlases. We investigated the performance of 18 brain graphs and used the TopK pooling layers to highlight salient brain regions (nodes in the graph). Results The GCN model, which used functional connectivity as edge features and multimodal features (sMRI + fMRI) of brain regions as node features, obtained the highest average accuracy of 95.8%, and outperformed other existing classification studies in SZ patients. In the explainability analysis, we reported that the top 10 salient brain regions, predominantly distributed in the prefrontal and occipital cortices, were mainly involved in the systems of emotion and visual processing. Discussion Our findings demonstrated that GCN with a combined multimodal MRI and connectomics analysis can effectively improve the classification of SZ at an individual level, indicating a promising direction for the diagnosis of SZ patients. The code is available at https://github.com/CXY-scut/GCN-SZ.git .

Chen, Xiaoyi↗

Impact of multimode range and location on urban fuel economy on a light-duty spark-ignition based powertrain using vehicle system simulations

Multimode engine operation uses two or more combustion modes to maximize engine efficiency across the operational range of a vehicle to achieve higher overall vehicle fuel economy than is possible with a single combustion mode. More specifically for this study, multimode solutions are explored that make use of boosted SI under high load operation and other advanced combustion modes such as advanced compression ignition (ACI) under part-load conditions to enable additional engine efficiency improvements across a broader range of the engine operating map. ACI combustion has well-documented potential to improve efficiency and emissions under part-load operation but poses challenges that limit full engine speed-load range. This study investigates the potential impact of ACI operational range on simulated fuel economy to help focus research on areas with the most opportunity for improving fuel economy. These simulations make use of a vehicle model, discretized engine data, and employ a systematic exploration of ACI operational range to estimate multimode fuel economy for a mid-size passenger vehicle over U.S. Environmental Protection Agency’s Urban Dynamometer Driving Schedule. The results of this study highlight operational ranges with the highest potential fuel economy and correspondingly areas of focus for multimode research and ACI engine operation1.

Curran, Scott↗

Parallel Information Processing (Image Transmission Via Fiber Bundle and Multimode Fiber

Growing demand for visual, user-friendly representation of information inspires search for the new methods of image transmission. Currently used in-series (sequential) methods of information processing are inherently slow and are designed mainly for transmission of one or two dimensional arrays of data. Conventional transmission of data by fibers requires many fibers with array of laser diodes and photodetectors. In practice, fiber bundles are also used for transmission of images. Image is formed on the fiber-optic bundle entrance surface and each fiber transmits the incident image to the exit surface. Since the fibers do not preserve phase, only 2D intensity distribution can be transmitted in this way. Each single mode fiber transmit only one pixel of an image. Multimode fibers may be also used, so that each mode represent different pixel element. Direct transmission of image through multimode fiber is hindered by the mode scrambling and phase randomization. To overcome these obstacles wavelength and time-division multiplexing have been used, with each pixel transmitted on a separate wavelength or time interval. Phase-conjugate techniques also was tested in, but only in the unpractical scheme when reconstructed image return back to the fiber input end. Another method of three-dimensional imaging over single mode fibers was demonstrated in, using laser light of reduced spatial coherence. Coherence encoding, needed for a transmission of images by this methods, was realized with grating interferometer or with the help of an acousto-optic deflector. We suggest simple practical holographic method of image transmission over single multimode fiber or over fiber bundle with coherent light using filtering by holographic optical elements. Originally this method was successfully tested for the single multimode fiber. In this research we have modified holographic method for transmission of laser illuminated images over commercially available fiber bundle (fiber endoscope, or fiberscope).

Kukhtarev, Nicholai↗

Angular and Polarization Response of Multimode Sensors with Resistive-Grid Absorbers

High sensitivity receiver systems with near ideal polarization sensitivity are highly desirable for development of millimeter and sub-millimeter radio astronomy. Multimoded bolometers provide a unique solution to achieve such sensitivity, for which hundreds of single-mode sensors would otherwise be required. The primary concern in employing such multimoded sensors for polarimetery is the control of the polarization systematics. In this paper, we examine the angular- and polarization- dependent absorption pattern of a thin resistive grid or membrane, which models an absorber used for a multimoded bolometer. The result shows that a freestanding thin resistive absorber with a surface resistivity of eta/2, where eta is the impedance of free space, attains a beam pattern with equal E- and H-plane responses, leading to zero cross polarization. For a resistive-grid absorber, the condition is met when a pair of grids is positioned orthogonal to each other and both have a resistivity of eta/2. When a reflective backshort termination is employed to improve absorption efficiency, the cross-polar level can be suppressed below −30 dB if acceptance angle of the sensor is limited to < or approx. 60deg. The small cross-polar systematics have even-parity patterns and do not contaminate the measurements of odd-parity polarization patterns, for which many of recent instruments for cosmic microwave background are designed. Underlying symmetry that suppresses these cross-polar systematics is discussed in detail. The estimates and formalism provided in this paper offer key tools in the design consideration of the instruments using the multimoded polarimeters.

High sensitivity receiver systems↗

Toward a Multimodal-Deep Learning Retrieval System for Monitoring Nuclear Proliferation Activities

As the amount of available data increases, the human ability to locate, process, and analyze it is strained and eventually overwhelmed. To address this challenge for nonproliferation analysts, the authors have been creating a large-scale multimodal retrieval system to help analysts triage and search open source science, technology, and news data for indicators of nuclear proliferation capabilities and activities. The system relies on a set of deep neural networks (DNNs) trained to evaluate conceptual similarities across data modalities, such as text, image, and video. These DNNs can be used to search and prioritize data, according to a nuclear fuel cycle (NFC) process template, that are conceptually closest to the seed query items regardless of data modality. The DNNs have been trained to map conceptually related words, sentences, and images to nearby points in a multimodal feature space, enabling intra- and intermodal retrieval via nearest-neighbor calculations to seed query points. The authors evaluate the system’s ability to retrieve NFC-related data that have been purposely hidden in collections of unrelated background data. They demonstrate quantitative and qualitative results for text-to-image, image-to-image, and image-to-video retrievals. This paper discusses data challenges confronting nonproliferation analysts, describes the DNNs designed to retrieve multimodal data that are proximal in the semantic space, and demonstrates their effectiveness by applying the DNNs to nonproliferation-specific multimodal data sets.

97 MATHEMATICS AND COMPUTING↗

Automatic Synthesis of Multimodal Polymers

An automatic molecular weight controller is used in semi-batch reactions to produce final polymers that contain distinct subpopulations with different molecular weight distributions (MWD). While blending polymers with different MWD is frequently used to make multimodal polymer products, a method is introduced here allowing the multimodal product to be made in successive, automatically controlled stages in the same reactor. The method is demonstrated using free radical polymerization of acrylamide to produce widely separated multimodal MWD. Automatic Continuous Online Monitoring of Polymerization reactions with a Control Interface (ACOMP/CI) was used. Weight average molecular weight (M w ) in the ACOMP/CI was continuously measured with multi-angle light scattering and ultra-violet absorption. The controller used two principles: both polymerization rate and instantaneous molecular weight are proportional to monomer concentration. By controlling monomer flow rate into the reactor, the controller produced a targeted amount of polymer with a desired first M w and then automatically introduced chain transfer agent (CTA) into the reactor to produce a second population of polymers with much lower M w . Subsequently, reactions were performed to produce trimodal populations. Finally, this approach is kindred to multi-stage synthesis of polymers where distinctly different processes are carried out in succeeding stages to produce polymers with highly specific properties.

42 ENGINEERING↗

FIRM: federated image reconstruction using multimodal tomographic data

Here, we propose a federated algorithm for reconstructing images using multimodal tomographic data sourced from dispersed locations, addressing the challenges of traditional unimodal approaches that are prone to noise and reduced image quality, as well as the limitations of centralized multimodal approaches that require extensive data transfer, leading to significant communication overhead, storage demands, and potential data privacy concerns. Our approach formulates a joint inverse optimization problem incorporating multimodality constraints and solves it in a federated framework through local gradient computations complemented by lightweight central operations, thereby ensuring data decentralization. Leveraging the connection between our federated algorithm and the quadratic penalty method, we introduce an adaptive step-size rule with guaranteed sublinear convergence. Numerical results demonstrate superior computational efficiency and improved image reconstruction quality compared to existing approaches.

federated algorithm↗

Unsupervised multimodal fusion of in-process sensor data for advanced manufacturing process monitoring

Effective monitoring of manufacturing processes is crucial for maintaining product quality and operational efficiency. Modern manufacturing environments often generate vast amounts of complementary multimodal data, including visual imagery from various perspectives and resolutions, hyperspectral data, and machine health monitoring information such as actuator positions, accelerometer readings, and temperature measurements. However, fusing and interpreting this complex, high-dimensional data presents significant challenges, particularly when labeled datasets are unavailable or impractical to obtain. This paper presents a novel approach to multimodal sensor data fusion in manufacturing processes, inspired by the Contrastive Language-Image Pre-training (CLIP) model. We leverage contrastive learning techniques to correlate different data modalities without the need for labeled data, overcoming limitations of traditional supervised machine learning methods in manufacturing contexts. Our proposed method demonstrates the ability to handle and learn encoders for five distinct modalities: visual imagery, audio signals, laser position (x and y coordinates), and laser power measurements. By compressing these high-dimensional datasets into low-dimensional representational spaces, our approach facilitates downstream tasks such as process control, anomaly detection, and quality assurance. The unsupervised nature of our method makes it broadly applicable across various manufacturing domains, where large volumes of unlabeled sensor data are common. We evaluate the effectiveness of our approach through a series of experiments, demonstrating its potential to enhance process monitoring capabilities in advanced manufacturing systems. This research contributes to the field of smart manufacturing by providing a flexible, scalable framework for multimodal data fusion that can adapt to diverse manufacturing environments and sensor configurations. The proposed method paves the way for more robust, data-driven decision-making in complex manufacturing processes.

Contrastive Learning↗

Large-scale cascading of first-order FBG array in a highly multimode coreless fiber using femtosecond laser for distributed thermal sensing

This research focuses on the performance analysis and characterization of a fiber Bragg gratings (FBGs) array, consisting of 10 first-order FBGs inscribed by a femtosecond (FS) laser in a highly multimode coreless fiber. The study evaluates the FBG array's ability to function as a distributed thermal sensing (DTS) platform, with the coreless fiber chosen as the sensing element due to its immunity to dopant migration at high temperatures. The design of a large cascaded first-order FBG array effectively eliminates unwanted harmonic peaks across a wide spectrum range. In contrast, higher-order FBGs introduce limitations due to the overlapping of Bragg peaks with harmonics. The FBG array's performance is evaluated by measuring the reflection spectrum of each grating at different temperatures, showing a high temperature sensitivity of 15.05 pm/°C at a Bragg wavelength of 1606.3 nm, with a linear response in the temperature range of 24 - 1100 °C. The FBG array was designed for a spatial resolution of 5 mm. A mode scrambler in the sensing network is employed, which suppresses multimodal interference, characterizes FBG peak visibility, and stabilizes the interference spectrum. The stability of the FBG array is also assessed over 24 hrs at 1100 °C, and it is observed to be stable during thermal treatment. Heat treatment at 1100°C improves the signal to noise ratio of the FBG array, demonstrating the robustness and suitability of the proposed FBG array on highly multimode coreless fiber as a potential sensing platform for DTS applications in harsh environmental conditions, overcoming the issues of dopant migration presented by dopes silica optical fibers at high temperatures.

47 OTHER INSTRUMENTATION↗

Data augmentation and multimodal learning for predicting drug response in patient-derived xenografts from gene expressions and histology images

Patient-derived xenografts (PDXs) are an appealing platform for preclinical drug studies. A primary challenge in modeling drug response prediction (DRP) with PDXs and neural networks (NNs) is the limited number of drug response samples. We investigate multimodal neural network (MM-Net) and data augmentation for DRP in PDXs. The MM-Net learns to predict response using drug descriptors, gene expressions (GE), and histology whole-slide images (WSIs). We explore whether combining WSIs with GE improves predictions as compared with models that use GE alone. We propose two data augmentation methods which allow us training multimodal and unimodal NNs without changing architectures with a single larger dataset: 1) combine single-drug and drug-pair treatments by homogenizing drug representations, and 2) augment drug-pairs which doubles the sample size of all drug-pair samples. Unimodal NNs which use GE are compared to assess the contribution of data augmentation. The NN that uses the original and the augmented drug-pair treatments as well as single-drug treatments outperforms NNs that ignore either the augmented drug-pairs or the single-drug treatments. In assessing the multimodal learning based on the MCC metric, MM-Net outperforms all the baselines. Our results show that data augmentation and integration of histology images with GE can improve prediction performance of drug response in PDXs.

60 APPLIED LIFE SCIENCES↗