SEARCH · Search NASA
Results for “multimodal”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Laser assisted crystallization of ferromagnetic amorphous ribbons: A multimodal characterization and thermal model study
This paper focuses on laser-based de-vitrification of amorphous soft magnetic Fe-Si-B ribbons and its consequent influence on the magnetic properties. Laser processing resulted in a finer scale of crystallites due to rapid heating and cooling during laser annealing compared to conventional furnace annealing process. A significant increase in saturation magnetization is observed for laser-annealed ribbons compared to both as-received and furnace annealed samples coupled with an increase in coercivity compared to the as received samples. The combined effect of thermal histories and stresses developed during laser annealing results in the formation of nano-crystalline phase along the laser track. The phase evolution is studied by micro-XRD and TEM analysis. Solute partitioning and compositional variation within the phases are obtained by Local Electrode Atom probe analysis. The evolution of microstructure is rationalized using a Finite Element based heat transfer multi-physics model.
Numerical simulations of the two-dimensional multimode Richtmyer-Meshkov instability
We show the two-dimensional Richtmyer-Meshkov instability occurs as shock waves pass through a perturbed material interface, triggering transition to an inhomogeneous turbulence variable density flow. This paper presents a series of large-eddy-simulations of the two dimensional turbulent RM instability and compares the results to the fully three dimensional simulations. There are two aims for this paper, the first is to explore what numerical resolution is required for a statistically converged solution for a two dimensional inhomogeneous flow field. The second aim is to elucidate the key differences in flow physics between the two dimensional and three dimensional Richtmyer-Meshkov instabilities, particularly their asymptotic self-similar regime. Convergence is achieved using 64 independent realisations and grid resolutions up to 4096 2 in the plane. It is shown that for narrowband cases the growth rate θ = 0.48 which is substantially higher than the three-dimensional equivalent. Mix measures are consistently lower compared to three-dimensional, and the kinetic energy distribution is homogeneous at late time. The broadband case has a similar initial growth rate as the three-dimensional case, with a marginally lower θ = 0.63. Mix is similar in magnitude, but is reducing at late time. The spectra in both cases exhibit the dual-cascade expected from two-dimensional turbulence.
Piezoelectrically Tuned, Multimode Cavity Search for Axion Dark Matter
The eV axion is a well-motivated extension to the standard model. The Axion Dark Matter 27 eXperiment (ADMX) collaboration seeks to discover this particle by looking for the resonant con28 version of dark-matter axions to microwave photons in a strong magnetic eld. In this paper we 29 report results from an ADMX pathnder experiment, the ADMX \Sidecar", which is designed to 30 pave the way for future, higher mass, searches. The Sidecar experiment excludes masses in three 31 widely spaced frequency ranges (4202-4249 MHz, 5086-5799 MHz and 7173-7203 MHz), correspond32 ing to masses favored by some cosmic string simulations. In addition, Sidecar demonstrates the 33 successful use of piezoelectric actuators for both cavity tuning and antenna coupling. Finally, this publication is the rst to report data taken on both the TM010 and TM020 modes.
Fiducial marker application method for position alignment of in situ multimodal X-ray experiments and reconstructions
An evolving suite of X-ray characterization methods are presently available to the materials community, providing a great opportunity to gain new insight into material behavior and provide critical validation data for materials models. Two critical and related issues are sample repositioning during an in situ experiment and registration of multiple data sets after the experiment. To address these issues, a method is described which utilizes a focused ion-beam scanning electron microscope equipped with a micromanipulator to apply gold fiducial markers to samples for X-ray measurements. The method is demonstrated with a synchrotron X-ray experiment involving in situ loading of a titanium alloy tensile specimen.
Identification of preferred multimodal ligand‐binding regions on IgG1 F C using nuclear magnetic resonance and molecular dynamics simulations
Abstract In this study, the binding of multimodal chromatographic ligands to the IgG1 F C domain were studied using nuclear magnetic resonance and molecular dynamics simulations. Nuclear magnetic resonance experiments carried out with chromatographic ligands and a perdeuterated 15 N‐labeled F C domain indicated that while single‐mode ion exchange ligands interacted very weakly throughout the F C surface, multimodal ligands containing negatively charged and aromatic moieties interacted with specific clusters of residues with relatively high affinity, forming distinct binding regions on the F C . The multimodal ligand‐binding sites on the F C were concentrated in the hinge region and near the interface of the C H 2 and C H 3 domains. Furthermore, the multimodal binding sites were primarily composed of positively charged, polar, and aliphatic residues in these regions, with histidine residues exhibiting some of the strongest binding affinities with the multimodal ligand. Interestingly, comparison of protein surface property data with ligand interaction sites indicated that the patch analysis on F C corroborated molecular‐level binding information obtained from the nuclear magnetic resonance experiments. Finally, molecular dynamics simulation results were shown to be qualitatively consistent with the nuclear magnetic resonance results and to provide further insights into the binding mechanisms. An important contribution to multimodal ligand‐F C binding in these preferred regions was shown to be electrostatic interactions and π–π stacking of surface‐exposed histidines with the ligands. This combined biophysical and simulation approach has provided a deeper molecular‐level understanding of multimodal ligand–F C interactions and sets the stage for future analyses of even more complex biotherapeutics.
A kernel machine method for detecting higher order interactions in multimodal datasets: Application to schizophrenia
Technological advances are enabling us to collect multimodal datasets at an increasing depth and resolution while with decreasing labors. Understanding complex interactions among multimodal datasets, however, is challenging. Here in this study, we tested the interaction effect of multimodal datasets using a novel method called the kernel machine for detecting higher order interactions among biologically relevant multimodal data. Using a semiparametric method on a reproducing kernel Hilbert space, we formulated the proposed method as a standard mixed-effects linear model and derived a score-based variance component statistic to test higher order interactions between multimodal datasets. The method was evaluated using extensive numerical simulation and real data from the Mind Clinical Imaging Consortium with both schizophrenia patients and healthy controls. Our method identified 13-triplets that included 6 gene-derived SNPs, 10 ROIs, and 6 gene-specific DNA methylations that are correlated with the changes in hippocampal volume, suggesting that these triplets may be important for explaining schizophrenia-related neurodegeneration. The performance of the proposed method is compared with the following methods: test based on only first and first few principal components followed by multiple regression, and full principal component analysis regression, and the sequence kernel association test. With strong evidence (p-value ≤0.000001), the triplet (MAGI2, CRBLCrus1.L, FBXO28) is a significant biomarker for schizophrenia patients. This novel method can be applicable to the study of other disease processes, where multimodal data analysis is a common task.
Advanced Multimodal Solutions for Information Presentation
High-workload, fast-paced, and degraded sensory environments are the likeliest candidates to benefit from multimodal information presentation. For example, during EVA (Extra-Vehicular Activity) and telerobotic operations, the sensory restrictions associated with a space environment provide a major challenge to maintaining the situation awareness (SA) required for safe operations. Multimodal displays hold promise to enhance situation awareness and task performance by utilizing different sensory modalities and maximizing their effectiveness based on appropriate interaction between modalities. During EVA, the visual and auditory channels are likely to be the most utilized with tasks such as monitoring the visual environment, attending visual and auditory displays, and maintaining multichannel auditory communications. Previous studies have shown that compared to unimodal displays (spatial auditory or 2D visual), bimodal presentation of information can improve operator performance during simulated extravehicular activity on planetary surfaces for tasks as diverse as orientation, localization or docking, particularly when the visual environment is degraded or workload is increased. Tactile displays offer a third sensory channel that may both offload information processing effort and provide a means to capture attention when urgently required. For example, recent studies suggest that including tactile cues may result in increased orientation and alerting accuracy, improved task response time and decreased workload, as well as provide self-orientation cues in microgravity on the ISS (International Space Station). An important overall issue is that context-dependent factors like task complexity, sensory degradation, peripersonal vs. extrapersonal space operations, workload, experience level, and operator fatigue tend to vary greatly in complex real-world environments and it will be difficult to design a multimodal interface that performs well under all conditions. As a possible solution, adaptive systems have been proposed in which the information presented to the user changes as a function of taskcontext-dependent factors. However, this presupposes that adequate methods for detecting andor predicting such factors are developed. Further, research in adaptive systems for aviation suggests that they can sometimes serve to increase workload and reduce situational awareness. It will be critical to develop multimodal display guidelines that include consideration of smart systems that can select the best display method for a particular contextsituation.The scope of the current work is an analysis of potential multimodal display technologies for long duration missions and, in particular, will focus on their potential role in EVA activities. The review will address multimodal (combined visual, auditory andor tactile) displays investigated by NASA, industry, and DoD (Dept. of Defense). It also considers the need for adaptive information systems to accommodate a variety of operational contexts such as crew status (e.g., fatigue, workload level) and task environment (e.g., EVA, habitat, rover, spacecraft). Current approaches to guidelines and best practices for combining modalities for the most effective information displays are also reviewed. Potential issues in developing interface guidelines for the Exploration Information System (EIS) are briefly considered.
Advanced Multimodal Solutions for Information Presentation
High-workload, fast-paced, and degraded sensory environments are the likeliest candidates to benefit from multimodal information presentation. For example, during extra-vehicular activity (EVA) and telerobotic operations, the sensory restrictions associated with such a hostile environment provide a major challenge to maintaining the situation awareness (SA) required for safe operations. In particular, orientation, navigation, and collision avoidance are critical aspects of EVA tasks that need to be addressed to ensure the safety of the crew and the success of the mission. Multimodal displays hold promise to enhance situation awareness and task performance by utilizing different sensory modalities and maximizing their effectiveness based on appropriate interaction between modalities. Multimodal displays will also play an important role for long-duration information systems and will likely begin to be developed in the early phases of cislunar Gateway, and later lunar or Mars transit missions. Information systems are envisioned for LDEMs that require spacecraft with greater crew autonomy and increased dependence on computer-provided information needed to perform routine tasks, as well as time- and safety critical tasks. Such a system will require a single, common interface that is easy to learn and use and accesses key information from all relevant vehicle/habitat systems to enable task performance in both nominal and emergency conditions. Understanding of multimodal display technologies and their interactions will help to inform interface guidelines for LDEMs. The scope of the current report is an analysis of potential multimodal display technologies for long duration missions and, in particular, will focus on their potential role in EVA activities. The review will address multimodal (combined visual, auditory and/or tactile) displays investigated by the National Aeronautics and Space Administration (NASA), industry, and Department of Defense (DoD). It also considers the need for adaptive information systems to accommodate a variety of operational contexts such as crew status (e.g., fatigue, workload level) and task environment (e.g., EVA, habitat, rover, spacecraft). Current approaches to guidelines and best practices for combining modalities for the most effective information displays are also reviewed. Potential issues in developing interface guidelines for LDEMs are briefly considered.
Fast Sideband Control of a Multimode Cavity Memory with Weak Dispersive Coupling to a Transmon
Mitigating ancilla-mediated error channels is a critical challenge in controlling high-quality superconducting cavities using circuit quantum electrodynamics (cQED). We address this by weakening the dispersive coupling while demonstrating fast, high-fidelity multimode control through transmon-mediated sideband interactions. We implement transmon-cavity SWAP gates with speeds up to 30 times larger than the bare dispersive coupling. Combined with transmon rotations, this enables universal state preparation in a single mode, though achieving unitary gates and extending control to multiple modes remains a challenge. In this work, we overcome this limitation by introducing two control strategies: (i) a shelving technique that stores populations in sideband-transparent states, and (ii) a method that exploits the dispersive shift to implement photon-number-selective transmon-cavity SWAP gates. We use these protocols to prepare Fock and binomial code states across any of the ten modes of a multimode cavity with millisecond coherence times—serving as a multimode quantum memory. We demonstrate unitaries that encode and decode an arbitrary qubit state from the transmon into corresponding vacuum and Fock state superpositions, as well as entangled NOON states of cavity mode pairs—a scheme extendable to arbitrary multimode Fock encodings in the cavity modes. Furthermore, we implement a new binomial encoding gate that converts arbitrary transmon superpositions into binomial code states in any cavity mode at a rate exceeding the dispersive shifts in our system, achieving an average post-selected state fidelity of 96.3% in a 4 μs gate time. By using precalibrated transmon and sideband pulses, our work demonstrates multimode control with significantly reduced calibration overhead, enabling efficient unitary operations using sideband interactions in multimode cQED systems.
Data Fusion for the Development of a Multimodal Freight Transload Facilities Dataset in the U.S.
To withstand the growing demand of commodity volume and its strain on the transportation infrastructure, it is necessary to identify the flow of commodities by route and mode. However, a national multimodal freight routing model does not exist for the U.S. The development of such model requires multiple building blocks, such as virtual representations of roadway, railway, and waterway networks, transload facilities (TFs), and access/egress links. Most of these blocks have a robust database in the U.S., except for the TFs. Here, this paper presents the fusion of dispersed and heterogeneous representations of multimodal TFs into a single, comprehensive, geospatial freight TF dataset. The TF dataset is derived from several sources, including the U.S. Army Corps of Engineers Master Docks Plus, the National Transportation Atlas Database, the Intermodal Association of North America, industry publications, and other public information. First, individual datasets were queried and reconciled. A geocoding/reverse geocoding process was applied to get the best street address and latitude/longitude location for each terminal. Then, duplicate terminals were identified by a fuzzy match algorithm based on terminal name and location, and removed. Validation was performed by visual inspection of random facilities. The main contributions of this work are: a publicly available version of the TF dataset, including facility location and multimodal transfer capability of 9,003 facilities, and an enterprise-version with the same facilities but including commodity handling capabilities. The main purpose of developing the TF dataset is to inform multimodal routing algorithms. The proposed TF dataset allows for credibly modeling the multimodal transfer of commodities within shipment routes.
Multimodal Freight Energy Model for Emerging Freight Technology Analysis
While freight movement represents a small portion of the volume in the transportation sector, they are a critical contributor for energy consumed in that sector. To reduce logistics costs, energy consumption and negative environmental impact, emerging technologies, such as digitalization of logistics and alternative powertrain, have been developed and extended applications in freight. These trends are expected to grow and provide opportunities for greater efficiencies in freight movement and corresponding energy use. Still, the complexity of freight systems present challenges in evaluating these benefits, especially in the multimodal inter-city freight. Addressing the research need, this paper develops a multimodal freight energy modeling framework for the analysis of emerging freight technology scenarios. The framework is a bi-level optimization problem: network cost minimization problem (lower-level) and energy minimization problem (upper-level). The lower-level problem is a mode-path assignment problem in multimodal inter-city freight networks, where commodity-specific congestion effects on trans-shipment links are considered. For this model, an inverse modeling approach is applied to infer parameters of the lower-level model. The upper-level problem is designed to search for an optimal scenario that has the lowest energy consumption among different levels of technology applications. The proposed model is empirically tested to analyze truck load-pooling and multimodal load-pooling scenarios through stand-alone and mixed applications using freight shipments originating from or destined to the Chicago region. This framework can be used to explore the impact of emerging freight technologies on mode-path freight flow and energy consumption in the national multimodal freight network.
Formation of Ligand Clusters on Multimodal Chromatographic Surfaces
Multimodal chromatography is a powerful tool which uses multiple modes of interaction, such as charge and hydrophobicity, to purify protein-based therapeutics. In this work, we performed molecular dynamics simulations of a series of multimodal cation-exchange ligands immobilized on a hydrophilic self-assembled monolayer surface at the commercially relevant surface density (1 ligand/nm2). We found that ligands that were flexible and terminated in a hydrophobic group had a propensity to aggregate on the surface, while less flexible ligands containing a hydrophobic group closer to the surface did not aggregate. For aggregating ligands, we report this resulted in the formation of a surface pattern that contained relatively large patches of hydrophobicity and charge whose sizes exceeded the length scale of the individual ligands. On the other hand, lowering the surface density to 1 ligand/3 nm 2 reduced or eliminated this aggregation behavior. In addition, the introduction of a flexible linker (corresponding to the commercially available ligand) enhanced cluster formation and allowed aggregation to occur at lower surface densities. Further, the use of flexible linkers enabled hydrophobic groups to collapse to the surface, reducing their accessibility. Finally, we developed an approach for quantifying differences in the observed surface patterns by calculating distributions of the patch size and patch length. This clustering phenomenon is likely to play a key role in governing protein–surface interactions in multimodal chromatography. This new understanding of multimodal surfaces has important implications for developing improved predictive models and designing new classes of multimodal separation materials.
Investigation of the bandwidth of multimode optical fibers used with 1550-nm LED and laser sources
Multimode optical fibers are not intended to be used with 1550-nm sources; however, it is desirable to utilize 1300/1550-nm wavelength division multiplexing (WDM) on some multimode fibers at Kennedy Space Center (KSC). No information from fiber vendors nor from the literature is available to support this use. Preliminary studies at KSC have suggested that these fibers might be usable at 1550-nm if the fibers possessed enough bandwidth when sourced by LEDs. Detailed bandwidth studies were made on 12 multimode fibers using 1300- and 1550-nm lasers and LEDs. The results showed that the modal bandwidth at 1550-nm was about 50 percent of the 1300-nm value and that the chromatic dispersion could be predicted by extrapolating the vendor's specifications for wavelengths outside the 1550-nm region. Utilizing these data, predictions of the fiber's optical bandwidth were accurately made. Problems with launch conditions and possible differential attenuation at connectors was noted at 1300-nm but was less significant at 1550-nm. It appears that the multimode fibers studied will offer adequate performance in the 1550-nm region for a number of current KSC needs. Studies of additional fibers are encouraged to gain more confidence and better understanding of the 1550-nm bandwidth of KSC's multimode optical fibers before committing to 1300/1550-nm WDM.
Generalist multimodal AI: A review of architectures, challenges and opportunities
Multimodal models are expected to be a critical component to future advances in artificial intelligence. Here, this field is starting to grow rapidly with a surge of new design elements motivated by the success of foundation models in natural language processing (NLP) and vision. It is widely hoped that further extending the foundation models to multiple modalities (e.g., text, image, video, sensor, time series, graph, etc.) will ultimately lead to generalist multimodal models, i.e. one model across different data modalities and tasks. However, there is little research that systematically analyzes recent multimodal models (particularly the ones that work beyond text and vision) with respect to the underling architecture proposed. Therefore, this work provides a fresh perspective on generalist multimodal models (GMMs) via a novel architecture and training configuration specific taxonomy. This includes factors such as Unifiability, Modularity, and Adaptability that are pertinent and essential to the wide adoption and application of GMMs. The review further highlights key challenges and prospects for the field and guide the researchers into the new advancements.
Redesigning large-scale multimodal transit networks with shared autonomous mobility services
Here, this study addresses a large-scale multimodal transit network design problem, with Shared Autonomous Mobility Services (SAMS) as both transit feeders and an origin-to-destination mode. The framework captures spatial demand and modal characteristics, considers intermodal transfers and express services, determines transit infrastructure investment and path flows, and generates transit routes. A system-optimal multimodal transit network is designed with minimum total door-to-door generalized costs of users and operators, satisfying transit origin-destination demand within a pre-set infrastructure budget. Firstly, the geography, demand, and modes in each zone are characterized with continuous approximation. The decisions of network link investment and multimodal path flows in zonal connection optimization are formulated as a minimum-cost multi-commodity network flow (MCNF) problem and solved efficiently with a mixed-integer linear programming (MILP) solver. Subsequently, the route generation problem is solved by expanding the MCNF formulation to minimize intramodal transfers. The model is illustrated through a set of experiments with the Chicago network comprised of 50 zones and seven modes, under three scenarios. The computational results present savings in traveler journey time and operator cost demonstrating the potential benefits of collaboration between multimodal transit systems and SAMS.
Multimodal hard x-ray imaging with resolution approaching 10 nm for studies in material science
We report multimodal scanning hard x-ray imaging with spatial resolution approaching 10 nm and its application to contemporary studies in the field of material science. The high spatial resolution is achieved by focusing hard x-rays with two crossed multilayer Laue lenses and raster-scanning a sample with respect to the nanofocusing optics. Various techniques are used to characterize and verify the achieved focus size and imaging resolution. Here, the multimodal imaging is realized by utilizing simultaneously absorption-, phase-, and fluorescence-contrast mechanisms. The combination of high spatial resolution and multimodal imaging enables a comprehensive study of a sample on a very fine length scale. In this work, the unique multimodal imaging capability was used to investigate a mixed ionic-electronic conducting ceramic-based membrane material employed in solid oxide fuel cells and membrane separations (compound of Ce 0.8 Gd 0.2 O 2–x and CoFe 2 O 4 ) which revealed the existence of an emergent material phase and quantified the chemical complexity at the nanoscale.