Search NASA⌕ Search

SEARCH · Search NASA

Results for “multimodal”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

CRCNS21 Computational Models of Multisensory Integration by Upper Limb in Humanoids and Amputees

This international collaborative research project between Johns Hopkins University (JHU) and the Technical University of Munich (TUM) investigated how the human brain processes and integrates multiple types of sensory information, such as touch and force, with the goal of improving prosthetic limbs for amputees and advancing sensory capabilities in humanoid robots. The research advanced our understanding of how the brain responds to sensory feedback in upper-limb amputees. Through experiments in which amputees received electrical stimulation while performing phantom hand movements, we demonstrated that sensory feedback activates the cortical sensorimotor and multisensory regions, and that these regions communicate dynamically during stimulation. Experiments with intact-limb participants explored the integration of visual, haptic, and force feedback, as well as in virtual reality motor training, further showing how the brain processes multimodal sensory information. In addition, this research inspired work on examining the reliability of where amputees perceive sensations over time, which contributed to a successful doctoral fellowship for continued investigation. Our collaborators at TUM improved multimodal sensor technology combining tactile and thermal feedback for humanoid robots, demonstrating the feasibility of integrating multiple sensor types into a unified system for detecting and responding to environmental stimuli. The experimental methods and analysis techniques developed across both teams, including functional network analysis and multimodal sensor integration, provide a foundation for future research in prosthetics and robotics. This research benefits the public by generating knowledge about how amputees process restored sensory information. Advances in humanoid sensing contribute to safer human-robot interaction. The project also fostered international collaboration and cross-disciplinary training: one TUM doctoral student spent a summer at JHU working on multimodal sensor integration, while two JHU students traveled to TUM to host workshops on neuromorphic sensory encoding and sensory integration.

42 ENGINEERING↗

Multi-mode horn antenna simulation

Radiation patterns were computed for a circular multimode horn antenna using waveguide electric field radiation expressions. The circular multimode horn was considered as a possible reflector feed antenna for the Large Antenna Multifrequency Microwave Radiometer (LAMMR). This horn antenna uses a summation of the TE sub 11 deg and TM sub 11 deg modes to generate far field primary radiation patterns with equal E and H plane beamwidths and low sidelobes. A computer program for the radiation field expressions using the summation of waveguide radiation modes is described. The sensitivity of the multimode horn antenna radiation patterns to phase variations between the two modes is given. Sample radiation pattern calculations for a reflector feed horn for LAMMR are shown. The multimode horn antenna provides a low noise feed suitable for radiometric applications.

Dod, L. R.↗

Thermal Stability and Ion Irradiation Response of Refined Grained V – 4Cr – 4Ti

Since the 1960’s, there has been interest in V-4Cr-4Ti and similar alloys as candidates for low activation structural materials for advanced nuclear reactors. V-4Cr-4Ti was produced using arc melting and subsequently subjected to large strain extrusion machining to produce a multimodal microstructure largely composed of nanocrystalline and ultrafine grain sizes. In-situ thermal stability of the multimodal V-4Cr-4Ti to 800 °C shows the formation of vanadium carbides with negligible grain growth. In-situ dual-beam 16 KeV He+ and 1 MeV Kr2+ ion irradiation performed at 700 °C to a final dose of ~5 displacements per atom show the formation of small He cavities well distributed throughout the system, with preferential clustering at grain boundaries. This work provides insight into how the increased fraction of grain boundaries affect the simultaneous dual beam ion irradiation response of multimodal V – 4 wt.% Cr – 4 wt.% Ti at elevated temperatures. Analysis of the cavities reveal an areal density of 0.024±0.007 cavities/nm2 and swelling of 0.236% after the dual-beam ion irradiation. Nanoindentation shows a ~50% increase in hardening after the ion irradiation at 700 °C.

TEM↗

Diverse Manifestations of Electron-Phonon Coupling in a Kagome Superconductor

Recent angle-resolved photoemission spectroscopy (ARPES) experiments on the kagome metal CsV_{3}Sb_{5} revealed distinct multimodal dispersion kinks and nodeless superconducting gaps across multiple electron bands. The prominent photoemission kinks suggest a definitive coupling between electrons and certain collective modes, yet the precise nature of this interaction and its connection to superconductivity remain to be established. Here, employing the state-of-the-art ab initio many-body perturbation theory computation, we present direct evidence that electron-phonon (e-ph) coupling induces the multimodal photoemission kinks in CsV_{3}Sb_{5}, and profoundly, drives the nodeless s-wave superconductivity, showcasing the diverse manifestations of the e-ph coupling. Our calculations well capture the experimentally measured kinks and their fine structures, and reveal that vibrations from different atomic species dictate the multimodal behavior. Results from anisotropic GW-Eliashberg equations predict a phonon-mediated superconductivity with nodeless s-wave gaps, in excellent agreement with various ARPES and scanning tunneling spectroscopy measurements. Despite the universal origin of the e-ph coupling, the contributions of several characteristic phonon vibrations vary in different phenomena, highlighting a versatile role of e-ph coupling in shaping the low-energy excitations of kagome metals.

Electron-phonon coupling↗

Optical fiber characteristics and standards; Proceedings of the Meeting, Cannes, France, November 25-27, 1985

Papers are presented on outside vapor deposition, the plasma activated CVD process for large scale production of telecommunication fibers, axial lateral plasma deposition technology from plastic clad silica, coatings for optical fibers, primary coating characterization, and radiation-induced time dependent attenuation in a fiber. Topics discussed include fibers with high tensile strength, the characteristics and specifications of airborne fiber optic components, the baseband frequency response of multimode fibers, and fibers for local and broadband networks. Consideration is given to industrial measurements for single mode and multimode fibers, the characterization of source power distribution in a multimode fiber by a splice offset technique, the measurement of chromatic dispersion in a single mode optical, and the effect of temperature on the refracted near-field optical fiber profiling technique.

Bouillie, Remy↗

Multiple-mode reconfigurable electro-optic switching network for optical fiber sensor array

This paper reports the first switching network compatible with multimode fibers. A one-to-many cascaded reconfigurable interconnection was built. A thin glass substrate was used as the guiding medium which provides not only higher coupling efficiency from multimode fiber to waveguide but also better tolerance of phase-matching conditions. Involvement of a total-internal-reflection hologram and multimode waveguide eliminates interface problems between fibers and waveguides. The DCG polymer graft has proven to be reliable from -180 C to +200 C. Survivability of such an electrooptic system in harsh environments is further ensured. LiNbO3 was chosen as the E-O material because of its stability at high temperatures (phase-transition temperature of more than 1000 C) and maturity of E-O device technology. Further theoretical calculation was conducted to provide the optimal interaction length and device capacitance.

Chen, Ray T.↗

Numerical Analysis of the Sea State Bias for Satellite Altimetry

Theoretical understanding of the dependence of sea state bias (SSB) on wind wave conditions has been achieved only for the case of a unidirectional wind-driven sea. Recent analysis of Geosat and TOPEX altimeter data showed that additional factors, such as swell, ocean currents, and complex directional properties of realistic wave fields, may influence SSB behavior. Here we investigate effects of two-dimensional multimodal wave spectra using a numerical model of radar reflection from a random, non-Gaussian surface. A recently proposed ocean wave spectrum is employed to describe sea surface statistics. The following findings appear to be of particular interest: (1) Sea swell has an appreciable effect in reducing the SSB coefficient compared with the pure wind sea case but has less effect on the actual SSB owing to the corresponding increase in significant wave height. (2) Hidden multimodal structure (the two-dimensional wavenumber spectrum contains separate peaks, for swell and wind seas, while the frequency spectrum looks unimodal) results in an appreciable change of SSB. (3) For unimodal, purely wind-driven seas, the influence of the angular spectral width is relatively unimportant; that is, a unidirectional sea provides a good qualitative model for SSB if the swell is absent. (4) The pseudo wave age is generally much better fo parametrization the SSB coefficient than the actual wave age (which is ill-defined for a multimodal sea) or wind speed. (5) SSB can be as high as 5% of the significant wave height, which is significantly greater than predicted by present empirical model functions tuned on global data sets. (6) Parameterization of SSB in terms of wind speed is likely to lead to errors due to the dependence on the (in practice, unknown) fetch.

Glazman, R. E.↗

A least-squares parameter estimation algorithm for switched hammerstein systems with applications to the VOR

A "Multimode" or "switched" system is one that switches between various modes of operation. When a switch occurs from one mode to another, a discontinuity may result followed by a smooth evolution under the new regime. Characterizing the switching behavior of these systems is not well understood and, therefore, identification of multimode systems typically requires a preprocessing step to classify the observed data according to a mode of operation. A further consequence of the switched nature of these systems is that data available for parameter estimation of any subsystem may be inadequate. As such, identification and parameter estimation of multimode systems remains an unresolved problem. In this paper, we 1) show that the NARMAX model structure can be used to describe the impulsive-smooth behavior of switched systems, 2) propose a modified extended least squares (MELS) algorithm to estimate the coefficients of such models, and 3) demonstrate its applicability to simulated and real data from the Vestibulo-Ocular Reflex (VOR). The approach will also allow the identification of other nonlinear bio-systems, suspected of containing "hard" nonlinearities.

Evaluation Studies↗

Optical Measurement of Mass Flow of a Two-Phase Fluid

An optoelectronic system utilizes wavelength-dependent scattering of light for measuring the density and mass flow of a two-phase fluid in a pipe. The apparatus was invented for original use in measuring the mass flow of a two-phase cryogenic fluid (e.g., liquid hydrogen containing bubbles of hydrogen gas), but underlying principles of operation can readily be adapted to non-cryogenic two-phase fluids. The system (see figure) includes a laser module, which contains two or more laser diodes, each operating at a different wavelength. The laser module also contains beam splitters that combine the beams at the various wavelengths so as to produce two output beams, each containing all of the wavelengths. One of the multiwavelength output beams is sent, via a multimode fiberoptic cable, to a transmitting optical coupler. The other multiwavelength output beam is sent, via another multimode fiber-optic cable, to a reference detector module, wherein fiber-optic splitters split the light into several multiwavelength beams, each going to a photodiode having a spectral response that is known and that differs from the spectral responses of the other photodiodes. The outputs of these photodiodes are digitized and fed to a processor, which executes an algorithm that utilizes the known spectral responses to convert the photodiode outputs to obtain reference laser-power levels for the various wavelengths. The transmitting optical coupler is mounted in (and sealed to) a hole in the pipe and is oriented at a slant with respect to the axis of the pipe. The transmitting optical coupler contains a collimating lens and a cylindrical lens that form the light emerging from the end of the fiber-optic cable into a fan-shaped beam in a meridional plane of the pipe. Receiving optical couplers similar to the transmitting optical couplers are mounted in the same meridional plane at various longitudinal positions on the opposite side of the pipe, approximately facing the transmitting optical coupler along the same slant. Light collected by each receiving optical coupler is sent, via a multimode fiber-optic cable, to a detector module similar to the reference detector module. The outputs of the photodiodes in each detector module are digitized and processed, similarly to those of the reference detector module, to obtain indications of the amounts of light of each wavelength scattered to the corresponding receiving position. The value for each wavelength at each position is also normalized to the reference laser-power level for that wavelength. From these normalized values, the density and the mass flow rate of the fluid are estimated.

Wiley, John↗

Spatial Combining of Laser-Diode Beams for Pumping an NPRO

A free-space optical beam combiner now undergoing development makes it possible to use the outputs of multiple multimode laser diodes to pump a neodymium-doped yttrium aluminum garnet (Nd:YAG) non-planar ring oscillator (NPRO) laser while ensuring that the laser operates at only a single desired frequency. Heretofore, a Nd:YAG NPRO like the present one has been pumped by a single multimode laser-diode beam delivered via an optical fiber. It would be desirable to use multiple pump laser diodes to increase reliability beyond that obtainable from a single pump laser diode. However, as explained in this article, simplistically coupling multiple multimode laser-diode beams through a fiber-optic combiner would entail a significant reduction in coupling efficiency, and lasing would occur at one or more other frequencies in addition to the single desired frequency. To minimize coupling loss, one must ensure that the NA (approximately equal to 0.3) of the combined laser-diode beams is less than the NA of the fiber. The A(Omega) of the laser-diode beam in the slow-axis plane is 1/1.3 as large as that of the fiber. This A(Omega) is small enough to enable efficient coupling of light into the optical fiber, but too large for combining of beams in the slow-axis plane. Therefore, a pair of cylindrical lenses is used to cancel the slow-axis plane magnification introduced by the on-cylindrical lenses used to effect magnification in the fast-axis plane.

Gelsinger, Paul↗

Polarization/Spatial Combining of Laser-Diode Pump Beams

A breadboard version of an optical beam combiner is depicted which make it possible to use the outputs of any or all of four multimode laser diodes to pump a non-planar ring oscillator (NPRO) laser. The output of each laser diode has a single-mode profile in the meridional plane containing an axis denoted the 'fast' axis and a narrower multimode profile in the orthogonal meridional plane, which contains an axis denoted the 'slow' axis and a narrower multimode profile in the orthogonal meridional plane, which contains an axis denoted the 'slow' axis. One of the purposes served by the beam-combining optics is to reduce the fast-axis numerical aperture (NA) of the laser-diode output to match the NA of the optical fiber. Along the slow axis, the unmodified laser-diode NA is already well matched to the fiber optic NA, so no further slow-axis beam shaping is needed. In this beam combiner, the laser-diode outputs are collimated by aspherical lenses, then half-wave plates and polarizing beam splitters are used to combine the four collimated beams into two beams. Spatial combination of the two beams and coupling into the optical fiber is effected by use of anamorphic prisms, mirrors, and a focusing lens. The anamorphic prisms are critical elements in the NA-matching scheme, in that they reduce the fast-axis beam width to 1/6 of its original values. Inasmuch as no slow-axis beam shaping is needed, the collimating and focusing lenses are matched for 1:1 iumaging. Because these lenses are well corrected for infinite conjugates the combiner offers diffraction-limited performance along both the fast and slow axes.

Gelsinger, Paul↗

Mixture-Tuned, Clutter Matched Filter for Remote Detection of Subpixel Spectral Signals

Mapping localized spectral features in large images demands sensitive and robust detection algorithms. Two aspects of large images that can harm matched-filter detection performance are addressed simultaneously. First, multimodal backgrounds may thwart the typical Gaussian model. Second, outlier features can trigger false detections from large projections onto the target vector. Two state-of-the-art approaches are combined that independently address outlier false positives and multimodal backgrounds. The background clustering models multimodal backgrounds, and the mixture tuned matched filter (MT-MF) addresses outliers. Combining the two methods captures significant additional performance benefits. The resulting mixture tuned clutter matched filter (MT-CMF) shows effective performance on simulated and airborne datasets. The classical MNF transform was applied, followed by k-means clustering. Then, each cluster s mean, covariance, and the corresponding eigenvalues were estimated. This yields a cluster-specific matched filter estimate as well as a cluster- specific feasibility score to flag outlier false positives. The technology described is a proof of concept that may be employed in future target detection and mapping applications for remote imaging spectrometers. It is of most direct relevance to JPL proposals for airborne and orbital hyperspectral instruments. Applications include subpixel target detection in hyperspectral scenes for military surveillance. Earth science applications include mineralogical mapping, species discrimination for ecosystem health monitoring, and land use classification.

Thompson, David R.↗

Alternative Vegetation States in Tropical Forests and Savannas: The Search for Consistent Signals in Diverse Remote Sensing Data

Globally, the spatial distribution of vegetation is governed primarily by climatological factors (rainfall and temperature, seasonality, and inter-annual variability). The local distribution of vegetation, however, depends on local edaphic conditions (soils and topography) and disturbances (fire, herbivory, and anthropogenic activities). Abrupt spatial or temporal changes in vegetation distribution can occur if there are positive (i.e., amplifying) feedbacks favoring certain vegetation states under otherwise similar climatic and edaphic conditions. Previous studies in the tropical savannas of Africa and other continents using the MODerate Resolution Imaging Spectroradiometer (MODIS) vegetation continuous fields (VCF) satellite data product have focused on discontinuities in the distribution of tree cover at different rainfall levels, with bimodal distributions (e.g., concentrations of high and low tree cover) interpreted as alternative vegetation states. Such observed bimodalities over large spatial extents may not be evidence for alternate states, as they may include regions that have different edaphic conditions and disturbance histories. In this study, we conduct a systematic multi-scale analysis of diverse MODIS data streams to quantify the presence and spatial consistency of alternative vegetation states in Sub-Saharan Africa. The analysis is based on the premise that major discontinuities in vegetation structure should also manifest as consistent spatial patterns in a range of remote sensing data streams, including, for example, albedo and land surface temperature (LST). Our results confirm previous observations of bimodal and multimodal distributions of estimated tree cover in the MODIS VCF. However, strong disagreements in the location of multimodality between VCF and other data streams were observed at 1 km scale. Results suggest that the observed distribution of VCF over vast spatial extents are multimodal, not because of local-scale feedbacks and emergent bifurcations (the definition of alternative states), but likely because of other factors including regional scale differences in woody dynamics associated with edaphic, disturbance, and/or anthropogenic processes. These results suggest the need for more in-depth consideration of bifurcation mechanisms and thus the likely spatial and temporal scales at which alternative states driven by different positive feedback processes should manifest.

Savanna↗

Microstructurally informed synchrotron x-ray analysis revealing helium defect transitions in ultrafine grained tungsten

The formation of insoluble gaseous defects in materials due to nuclear transmutation or ion implantation involves the diffusion of impurity atoms to form atomic defect clusters that coalesce into bubbles or cavities and ultimately degrade the material properties. Transmission electron microscopy (TEM) is limited in its ability to resolve sub-nanometer gas clusters whereas X-ray diffraction (XRD) provides information pertaining to local atomic changes. Here, in this study, helium (He) implanted ultrafine grained tungsten is explored through a multimodal defect characterization campaign combining TEM-informed Small Angle X-ray Scattering (SAXS) analysis, XRD lattice parameter measurements, and nanoscale He cluster quantification from a region of reciprocal space accessible via Wide Angle X-ray Scattering (WAXS). Moderate elevated temperature implantations are shown to produce high concentrations of sub-nanoscale He clusters and small, homogeneously distributed cavities, which collectively are linked to lattice expansion and further substantiated through complementary atomistic simulations. Increased implantation temperatures encourage the diffusion of these defects to the grain boundaries (GBs), leading to lattice relaxation and the growth of large GB cavities manifesting as bimodal size distributions in the SAXS analysis. Overall, our results demonstrate the utility of multimodal synchrotron X-ray analysis in bridging the gap between microscale He cavity quantification and atomic-scale defect analysis.

36 MATERIALS SCIENCE↗

Heterogeneous Multi-Domain Dataset Synthesis to Facilitate Privacy and Risk Assessments in Smart City IoT

The emergence of the Smart Cities paradigm and the rapid expansion and integration of Internet of Things (IoT) technologies within this context have created unprecedented opportunities for high-resolution behavioral analytics, urban optimization, and context-aware services. However, this same proliferation intensifies privacy risks, particularly those arising from cross-modal data linkage across heterogeneous sensing platforms. To address these challenges, this paper introduces a comprehensive, statistically grounded framework for generating synthetic, multimodal IoT datasets tailored to Smart City research. The framework produces behaviorally plausible synthetic data suitable for preliminary privacy risk assessment and as a benchmark for future re-identification studies, as well as for evaluating algorithms in mobility modeling, urban informatics, and privacy-enhancing technologies. As part of our approach, we formalize probabilistic methods for synthesizing three heterogeneous and operationally relevant data streams—cellular mobility traces, payment terminal transaction logs, and Smart Retail nutrition records—capturing the behaviors of a large number of synthetically generated urban residents over a 12-week period. The framework integrates spatially explicit merchant selection using K-Dimensional (KD)-tree nearest-neighbor algorithms, temporally correlated anchor-based mobility simulation reflective of daily urban rhythms, and dietary-constraint filtering to preserve ecological validity in consumption patterns. In total, the system generates approximately 116 million mobility pings, 5.4 million transactions, and 1.9 million itemized purchases, yielding a reproducible benchmark for evaluating multimodal analytics, privacy-preserving computation, and secure IoT data-sharing protocols. To show the validity of this dataset, the underlying distributions of these residents were successfully validated against reported distributions in published research. We present preliminary uniqueness and cross-modal linkage indicators; comprehensive re-identification benchmarking against specific attack algorithms is planned as future work. This framework can be easily adapted to various scenarios of interest in Smart Cities and other IoT applications. By aligning methodological rigor with the operational needs of Smart City ecosystems, this work fills critical gaps in synthetic data generation for privacy-sensitive domains, including intelligent transportation systems, urban health informatics, and next-generation digital commerce infrastructures.

IoT↗