SEARCH · Search NASA

Results for “Multimode”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

NASA NTRS2013

Multimode Directional Coupler for Utilization of Harmonic Frequencies from TWTAs

A novel waveguide multimode directional coupler (MDC) intended for the measurement and potential utilization of the second and higher order harmonic frequencies from high-power traveling wave tube amplifiers (TWTAs) has been successfully designed, fabricated, and tested. The design is based on the characteristic multiple propagation modes of the electrical and magnetic field components of electromagnetic waves in a rectangular waveguide. The purpose was to create a rugged, easily constructed, more efficient waveguide- based MDC for extraction and exploitation of the second harmonic signal from the RF output of high-power TWTs used for space communications. The application would be a satellitebased beacon source needed for Qband and V/W-band atmospheric propagation studies. The MDC could function as a CW narrow-band source or as a wideband source for study of atmospheric group delay effects on highdata- rate links. The MDC is fabricated from two sections of waveguide - a primary one for the fundamental frequency and a secondary waveguide for the second harmonic - that are joined together such that the second harmonic higher order modes are selectively coupled via precision- machined slots for propagation in the secondary waveguide. In the TWTA output waveguide port, both the fundamental and the second harmonic signals are present. These signals propagate in the output waveguide as the dominant and higher order modes, respectively. By including an appropriate mode selective waveguide directional coupler, such as the MDC presented here at the output of the TWTA, the power at the second harmonic can be sampled and amplified to the power level needed for atmospheric propagation studies. The important conclusions from the preliminary test results for the multimode directional coupler are: (1) the second harmonic (Ka-band) can be measured and effectively separated from the fundamental (Ku-band) with no coupling of the latter, (2) power losses in the fundamental frequency are negligible, and (3) the power level of the extracted second harmonic is sufficient for further amplification to power levels needed for practical applications. It was also demonstrated that third order and potentially higher order harmonics are measurable with this device. The design is frequency agnostic, and with the appropriate choice of waveguides, is easily scaled to higher frequency TWTs. The MDC has the same function but with a number of important advantages over the conventional diplexer.

Simmons, Rainee N.↗

NASA NTRS2017

Natural Language Based Multimodal Interface for UAV Mission Planning

As the number of viable applications for unmanned aerial vehicle (UAV) systems increases at an exponential rate, interfaces that reduce the reliance on highly skilled engineers and pilots must be developed. Recent work aims to make use of common human communication modalities such as speech and gesture. This paper explores a multimodal natural language interface that uses a combination of speech and gesture input modalities to build complex UAV flight paths by defining trajectory segment primitives. Gesture inputs are used to define the general shape of a segment while speech inputs provide additional geometric information needed to fully characterize a trajectory segment. A user study is conducted in order to evaluate the efficacy of the multimodal interface.

Chandarana, Meghan↗

NASA NTRSDate not supplied

Exploring Multimodal Interactions in Human-Autonomy Teaming Using a Natural User Interface

The creation of a multimodal, natural user interface to facilitate multi-agent interaction is essential to establishing trust among human and machine teammates in multi-agent systems. Trust is being researched, along with trustworthiness, as a path to certification of autonomous systems by the Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR) project at NASA. The Autonomous Mission Experimental Logistics Interactive Assistant (AMELIA) is a natural user interface that enables multimodal interaction and is designed for rapid mission planning. AMELIA is an intelligent system that considers the user’s preferred communication strategies, as well as the time-critical aspect of the multi-agent system decision-making process. Twenty-four participants planned a multi-agent search and rescue mission, with the aid of an intelligent assistant. The results show that while the combined use of touch and speech was faster than speech alone, the single modality, touch, was still the most efficient. Future research should investigate additional input technologies.

Lisa R Le Vie↗

NASA NTRSDate not supplied

Exploring Multimodal Interactions in Human-Autonomy Teaming Using a Natural User Interface

Lisa Renee Le Vie↗

DOE OSTI2025

CAMFeND: Credibility-Aware Multimodal Fake News Detection with Rotational Attention

In the evolving digital landscape, fake news is a significant challenge, influencing public perception and decision-making. Traditional detection approaches focus on single-modal data or simple multimodal fusion, often overlooking deeper interactions and news credibility. We propose a novel model addressing these limitations by introducing rotational attention and news domain information as a feature. Unlike static attention mechanisms, our rotational attention dynamically shifts query, key, and value roles across text and image inputs, enabling richer cross-modal interaction. Incorporating news domain information further enhances the model’s reliability by associating news posts with top domains extracted from Google search results, reducing false detections. This approach assesses both the content and the broader web context in which the news is discussed. Our model outperforms existing state-of-the-art methods by providing deeper, layered multimodal integration and domain information analysis, resulting in a more robust and adaptive fake news detection system.

Gupta, Nidhi↗

DOE OSTI2025

A Dynamic Hierarchical Attention Framework for Multimodal Malware Detection

The increasing use of Android in the worldwide mobile ecosystem has come along with a significant increase in advanced malware, highlighting the critical necessity for efficient, scalable, and adaptable detection systems. Despite recent advancements in machine learning improving malware detection, the majority of current solutions are limited to one, two, or three data modalities, hence neglecting the comprehensive behavioral spectrum of contemporary multi-vector threats. This thesis presents the first comprehensive multimodal framework for Android malware detection, which combines textual, time-series (temporal), graph-based (structural), and visual information using an innovative hierarchical attention mechanism and Dynamic Fusion Controller (DFC). Our methodology consistently classifies and processes modalities as either sequential or structural, facilitating content-adaptive weighting and resilient cross-modal representation learning. We advance the implementation of cutting-edge time series techniques, such as MiniRocket, for malware detection, hence creating new opportunities for temporal analysis in cybersecurity. Comprehensive experimental assessment shows that our framework performs exceptionally well, with 99.46% classification accuracy and 97.15% detection accuracy, significantly outperforming existing approaches through effective multimodal integration and hierarchical attention mechanisms.

Nazmin, Tamanna↗

DOE OSTI2026

Quantifying Operational Drivers of Multimodal Biometric Verification in Aerial Surveillance

Multimodal biometric verification is increasingly applied across operational contexts ranging from close-range security cameras and building-mounted surveillance to long-range ground sensors and unmanned aerial system (UAS) imagery. Variations in acquisition conditions—such as image resolution, viewing geometry, and motion artifacts—pose significant challenges for cross-domain algorithmic generalization. This study evaluates two independent multimodal biometric verification systems developed under the Intelligence Advanced Research Projects Activity (IARPA) Biometric Recognition and Identification at Altitude and Range (BRIAR) program, comparing performance on close-range and aerial datasets. Close-range video served as a baseline to quantify the decline in verification performance on aerial footage. The dataset included six UAS platforms, spanning small quadcopters at 10m altitude to medium-sized fixed-wing aircraft at 360m. Mixed-effects logistic regression identified image resolution (head and body pixel counts), head height, sensor characteristics, and algorithm selection as primary determinants of verification success, whereas demographic attributes and mission gait were not significant predictors. Activity type and collection site influenced performance in close-range data but had negligible impact on UAS imagery. These results clarify modality-specific strengths and limitations and highlight opportunities to enhance cross-domain biometric verification.

Peluso, Alina [ORNL] (ORCID:0000000328950406)↗

DOE OSTI2020

Multimodal Nanoscale Tomographic Imaging for Battery Electrodes

Accurate representations of the 3D structure within a lithium-ion battery are key to understanding performance limitations. However, obtaining exact reconstructions of electrodes, where the active particles, the carbon black and polymeric binder domain, and the pore space are visualized is challenging. In this work, it is shown that multimodal imaging can be used to overcome this challenge. High-resolution ptychographic X-ray computed tomography are combined with lower resolution but higher contrast transmission X-ray tomographic microscopy to obtain 3D reconstructions of pristine and cycled graphite-silicon composite electrodes. This cross-correlation enables quantitative analysis of the surface of active particles, including the heterogeneity of carbon-black and binder domain and solid-electrolyte interphase coverage. Capturing the active particles as well as the carbon black-binder domain allows using these segmented structures for electrochemical simulations to highlight the influence of the particle embedding on local state of charge heterogeneities.

25 ENERGY STORAGE↗

DOE OSTI2021

The Value of Watching How Materials Grow: A Multimodal Case Study on Halide Perovskites

Material synthesis is one of the most important aspects in humankinds’ endeavor to discover and create new materials for energy applications. One strategy to tailor materials with desired functions in a rational way is by knowing how functions relate to structure, synthetic variables, arrangement of atoms and molecules, and how functions evolve during synthesis. In order to accelerate materials synthesis, discovery, and optimization by 10 times it is the right time now to integrate computational tools, synthesis, and characterization. One particular barrier to realizing this concept is the understanding of when and how phases form in real time during synthesis, which is challenging to asses by existing theoretical frameworks. In addition, transient or metastable phases with positive free energy above the lowest-free energy ground state can be revealed by such real time (in situ) measurements. Metastable materials are ubiquitous in condensed matter and can show superior properties compared to their equilibrium form. This work discusses the value of emerging multimodal in situ characterizations exemplified on hybrid halide perovskites. Finally, the ways in which the implementation of in situ measurements can advance the materials science synthesis field as well as their role to enable close-loop feedback control and autonomous synthesis are discussed.

36 MATERIALS SCIENCE↗

DOE OSTI2020

Multimodal Imaging of Autofluorescent Sites Reveals Varied Chemical Speciation in SSZ-13 Crystals

Here, a multimodal imaging study of chabazite is used to show the distribution of and discriminate between different emissive deposits arising as a result of the detemplation process. 3D confocal imaging, fluorescence lifetime imaging, spectral imaging, and Raman mapping are used to show three different types of emissive behaviours each characterised by different spatial distributions, trends in lifetime, spectral signals, and Raman signatures. A notable difference is seen in the morphology of agglomerated surface deposits and larger subsurface deposits, which experience lifetime augmentation due to spatial confinement. The distribution of organic residue throughout the crystal volume is comparable to XRF mapping that shows Si enrichment on the outer edges and higher Al content through the centre, demonstrating that a fluorescence-based technique can also be used to indirectly comment on the compositional chemistry of the inorganic framework.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

DOE OSTI2024

Agent-based modeling for multimodal transportation of CO 2 for carbon capture, utilization, and storage: CCUS-agent

Here, to understand the system-level interactions between the entities in Carbon Capture, Utilization, and Storage (CCUS), an agent-based foundational modeling tool, CCUS-Agent, is developed for a large-scale study of transportation flows and infrastructure in the United States. Key features of the tool include (i) modular design, (ii) multiple transportation modes, (iii) capabilities for extension, and (iv) testing against various system components and networks of small and large sizes. Five matching algorithms for CO 2 supply agents (e.g., powerplants and industrial facilities) and demand agents (e.g., storage and utilization sites) are explored: Most Profitable First Year (MPFY), Most Profitable All Years (MPAY), Shortest Total Distance First Year (SDFY), Shortest Total Distance All Years (SDAY), and Shortest distance to long-haul transport All Years (ACAY). Before matching, the supply agent, demand agent, and route must be available, and the connection must be profitable. A profitable connection means the supply agent portion of revenue from the 45Q tax credit must cover the supply agent costs and all transportation costs, while the demand agent revenue portion must cover all demand agent costs. A case study employing over 5500 supply and demand agents and multimodal CCUS transportation infrastructure in the contiguous United States is conducted. The results suggest that it is possible to capture over 9 billion tonnes (GT) of CO 2 from 2025 to 2043, which will increase significantly to 22 GT if the capture costs are reduced by 40 %. The MPFY and SDFY algorithms capture more CO 2 earlier in the time horizon, while the MPAY and SDAY algorithms capture more later in the time horizon.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2022

Photochemical micromotor of eccentric core in isotropic hollow shell exhibiting multimodal motion behavior

Adaptive motion behavior in response to different environmental stimuli is ubiquitous in biology and enables creatures to achieve a diversity of complex tasks, but not typically observed in synthetic systems. In this report we propose a design of chemically-powered micromotors actively performing multimodal motion behaviors with the external stimulus changing. They have isotropic outer surfaces but inherent inner mass asymmetry, such as eccentric core-in-hollow shell TiO 2 (E-TiO 2 ) microspheres. Their motion behavior can be spontaneously transformed among random Brownian propulsion (stochastic walk), negative phototaxis (moving against incident light), and negative photogravitaxis (moving against gravity) when the light intensity, illumination direction, or fuel concentration change. At a low light intensity and/or low H 2 O 2 fuel concentration, the E-TiO 2 micromotors perform directional movement away from light based on the dominated diffusiophoresis by the photocatalytic reaction over the isotropic shell. With the increase of light intensity or fuel concentration, there are more and more photons or fuels to reach the eccentric core and the contribution of the photocatalytic reaction over it to the diffusiophoresis gradually becomes dominant. In this case, the E-TiO 2 micromotors perform stochastic walks near the substrate due to their Brownian random rotational reorientations. The micromotors are single component, have low density, and can be synthesized in a large scale and at a low cost. This work will facilitate the development of multifunctional micro/nanomotors with varying behaviors and functions depending on environmental cues, e.g., enabling efficient search and delivery operations.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Energy-efficient multimodal mobility networks in transportation digital twins: Strategies and optimization

The study proposes a comprehensive Transportation Mobility (TransitMo) framework covering conceptual design, model formulation, optimization, simulation, and impact analysis of the transportation mobility system. TransitMo is composed of a transportation digital twin developed in Simulation of Urban MObility (SUMO) and an Intelligent Traffic Management and Control Center (ITMCC) that identifies the best ways to improve the movement of people within urban areas using various modes of transportation. This study encompasses advanced modeling techniques, algorithms, and strategic testing to optimize energy efficiency and mobility in a multimodal shared mobility network. TransitMo’s practical applications are exemplified through a city-scaled simulation network in Chattanooga, TN, employing demographic data to analyze historical traffic patterns and forecast future demands. Central to this methodology are three models: the User Preference Model (UP), the Energy Consumption Model (EC), and the System Optimization Model (SO). These models work in concert to iteratively devise the optimal travel incentives and minimize the total system cost in a real-time manner. In conclusion, test results verified that the proposed adaptive incentive program and optimized bus scheduling can improve network performance by increasing public transit ridership.

42 ENGINEERING↗

DOE OSTI2021

Direct Observation of Plasma-Stimulated Activation of Surface Species Using Multimodal In Situ/Operando Spectroscopy Combining Polarization-Modulation Infrared Reflection-Absorption Spectroscopy, Optical Emission Spectroscopy, and Mass Spectrometry

Nonthermal plasmas (NTPs) produce reactive chemical environments, including electrons, ions, radicals, and vibrationally excited molecules, that can drive chemistry at temperatures at which such species are thermally inaccessible. There has been growing interest in the integration of conventional catalysis with reactive NTPs to promote novel chemical transformations. Unveiling the full potential of plasma-catalytic processes requires a comprehensive understanding of plasma-catalytic synergies, including characterization of plasma-catalytic surface interactions. In this work, we report on a newly designed multimodal spectroscopic instrument combining polarization-modulation infrared reflection-absorption spectroscopy (PM-IRAS), mass spectrometry, and optical emission spectroscopy (OES) for the investigation of plasma–surface interactions such as those found in plasma catalysis. In particular, this tool has been utilized to correlate plasma-phase chemistry with both surface chemistry and gas-phase products in situ (1) during the deposition of carbonaceous surface species via NTP-promoted nonoxidative coupling of methane and (2) during subsequent activation of surface deposits with an atmospheric pressure and temperature argon plasma jet on both nickel (Ni) and silicon dioxide (SiO 2 ) surfaces. For the first time, the activation of carbonaceous surface species by a NTP on Ni and SiO 2 surfaces to form hydrogen gas and C 2 hydrocarbons was directly observed, where both PM-IRAS and OES measurements suggest that they may form through different pathways. Furthermore, this unique tool for studying plasma–surface interactions could enable more rational design of plasma-stimulated catalytic processes.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

AC Magnetometry Using Nano-ferrofluid Cladded Multimode Interferometric Fiber Optic Sensors for Power Grid Monitoring Applications

The AC magnetic field response of the superparamagnetic nano-ferrofluid is an interplay between the Neel and Brownian relaxation processes and is generally quantified via the susceptibility measurements at high frequencies. The high frequency limit is dictated by these relaxation times which need to be shorter than the time scale of the time varying magnetic field for the nano-ferrofluid to be considered in an equilibrium state at each time instant. Even though the high frequency response of ferrofluid has been extensively investigated for frequencies up to GHz range by non-optical methods, harnessing dynamic response by optical means for AC magnetic field sensing in fiber-optic-based sensors-field remains unexplored. Instead, the incorporation of nano-ferrofluid as sensing materials has been only limited to DC magnetic field sensing, often citing their long response time as a limiting factor to AC field sensing. This work reports the finding of high frequency (up to 15 kHz) AC magnetic field sensing capability of nanomagnetic fluid as the cladding material of a fiber-optic multimode interferometry (MMI) structure optimized for the fourth self-imaging spectral response. The key parameter enabling high frequency response is the short response time (<1 ms) achieved by optimizing both the sensing structure and nano-ferrofluid solution. Focus has been imparted on 60 Hz line-frequency profiles of various current/magnetic fields to test the efficacy of these sensors in metering and monitoring current and current-induced magnetic fields in the electrical power grid systems. The magnetic field sensitivity of 240 mV/Gauss per dBm of transmitted power was achieved for 60 Hz field applied via Helmholtz coil, whereas the 60 Hz AC current sensitivity of 2.83 mV/A was measured due to magnetic field induced by current in a straight conducting wire.

42 ENGINEERING↗

DOE OSTI2025

Multimodal Ambient Pressure Sample Environment for the HIPPIE Solid-Gas Endstation at MAX IV Laboratory

The HIPPIE APXPS instruments have undergone several major upgrades, such as developing a dedicated solid gas endstation to specialize in multimodal ambient pressure sample environments centered around X-ray photoelectron spectroscopy. Herein, the technical specifications of the HIPPIE solid gas endstation are detailed; upgrades to the laser heating and gas systems, as well as the addition of an offline 1 bar reactor, are introduced. To demonstrate how the endstation is currently being utilized, scientific examples of all upgrades are presented, as well as science cases using infrared reflection-adsorption spectroscopy. The HIPPIE solid gas endstation is maturing into an instrument offering bespoke sample environments aimed at pushing experimental capabilities, especially in the time-resolved domain.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2023

Multimodal microscopy of extended defects in β-Ga 2 O 3 (010) EFG crystals

Beta-phase gallium oxide (β-Ga 2 O 3 ) has attracted attention in recent years as a potentially low cost, large area substrate and active layer material for high power, high temperature power electronics and sensing devices. However, growth of β-Ga 2 O 3 crystals is complicated by easily activated (100) and (001) cleavage planes, the presence of low angle grain boundaries (LAGBs) and twins, and the potential formation of polycrystalline grains. In this study, β-Ga 2 O 3 crystals were grown by the edge-defined film-fed growth technique with an (010) principal face. Two crystals with apparently randomly formed high angle grain boundaries (HAGBs) were selected and analyzed by electron backscatter diffraction, electron channeling contrast imaging, and cathodoluminescence to investigate the nature of the LAGBs and the source of the HAGB formation. It was discovered that planar LAGBs lying parallel to the (010) plane exist in the region immediately preceding the start of an HAGB. Increased misorientation across the LAGB was observed, approaching the initiation of a new grain. We present multimodal microscopy characterization, correlating misorientation and variation in optoelectronic properties with LAGBs and the associated dislocations.

14 SOLAR ENERGY↗

DOE OSTI2023

Multimodal Prediction of Tearing Instabilities in a Tokamak

Tokamak is a torus-shaped nuclear fusion device that uses magnetic fields to confine fusion fuel in the form of plasma. Tearing instability in plasma is a major issue in which the magnetic field breaks and recombines in tokamak. Here, this instability can lead to plasma disruption that terminates the fusion power generation and damages the plasma-facing wall materials. For a successful steady operation of a large-scale tokamak without disruption, it is required to predict and alarm the tearing instabilities well in advance to avoid them. In this work, we develop and validate a deep neural network-based multimodal prediction system that estimates the future tearing instability likelihood from multi-diagnostics signals in the DIII-D tokamak.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗