Search NASA⌕ Search

SEARCH · Search NASA

Results for “multimode”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Iterative Reconstruction for Multimodal Neutron Tomography

Here, we describe a unified framework for model-based iterative 3-D reconstruction of multimodal neutron transmission, hydrogen-scatter, and induced-fission images from low resolution data recorded using 14.1-MeV neutrons and the associated-particle imaging (API) technique. The framework, which was developed to facilitate use in challenging field-deployment scenarios, is centered around physics-based system models and a total variation (TV) constrained implementation of the simultaneous iterative reconstruction technique (SIRT). Modified to solve a statistically weighted least squares (WLS) problem, the SIRT algorithm is accelerated using ordered subsets and Nesterov’s momentum for which we derive a near-optimal value of the governing Lipschitz constant. The approach enables the reconstruction of images that are high resolution compared to the acquired data and is robust to both limited statistics and a limited number of projection angles. Moreover, the framework is fast enough to be practical. Example images are provided that demonstrate both the ability to perform fast-neutron imaging of high-atomic-number materials with low radiation dose and the benefit of multimodal neutron imaging to identify key materials.

Hydrogen scatter↗

4D Multimodal Co-attention Fusion Network with Latent Contrastive Alignment for Alzheimer’s Diagnosis

Multimodal neuroimaging provides complementary structural and functional insights into both human brain organization and disease-related dynamics. Recent studies demonstrate enhanced diagnostic sensitivity for Alzheimer’s disease (AD) through synergistic integration of neuroimaging data (e.g., sMRI, fMRI) with tabular data (e.g., behavioral and cognitive tests). However, the intrinsic heterogeneity across modalities (e.g., 4D spatiotemporal fMRI dynamics vs. 3D anatomical sMRI structure) presents critical challenges for discriminative feature fusion, often leading to information loss or biased fusion. To bridge this gap, we propose M2M-AlignNet: a multimodal co-attention network with latent alignment for early AD diagnosis using sMRI and fMRI. At the core of our approach is a multi-patch-to-multi-patch (M2M) contrastive loss function that quantifies and reduces representational discrepancies via weighted patch correspondence, explicitly aligning fMRI components across brain regions with their sMRI structural substrates without one-to-one constraints. Additionally, we propose a latent-as-query co-attention module to autonomously discover fusion patterns, circumventing modality prioritization biases while minimizing feature redundancy. We conduct extensive experiments to confirm the effectiveness of our method and highlight the correspondence between fMRI and sMRI as AD biomarkers.

Wei, Yuxiang [Georgia Institute of Technology]↗

Comparative imaging study in ultrasound, MRI, CT, and DSA using a multimodality renal artery phantom

Purpose: A range of anatomically realistic multimodality renal artery phantoms consisting of vessels with varying degrees of stenosis was developed and evaluated using four imaging techniques currently used to detect renal artery stenosis (RAS). The spatial resolution required to visualize vascular geometry and the velocity detection performance required to adequately characterize blood flow in patients suffering from RAS are currently ill-defined, with the result that no one imaging modality has emerged as a gold standard technique for screening for this disease. Methods: The phantoms, which contained a range of stenosis values (0%, 30%, 50%, 70%, and 85%), were designed for use with ultrasound, magnetic resonance imaging, x-ray computed tomography, and x-ray digital subtraction angiography. The construction materials used were optimized with respect to their ultrasonic speed of sound and attenuation coefficient, MR relaxometry (T{sub 1},T{sub 2}) properties, and Hounsfield number/x-ray attenuation coefficient, with a design capable of tolerating high-pressure pulsatile flow. Fiducial targets, incorporated into the phantoms to allow for registration of images among modalities, were chosen to minimize geometric distortions. Results: High quality distortion-free images of the phantoms with good contrast between vessel lumen, fiducial markers, and background tissue to visualize all stenoses were obtained with each modality. Quantitative assessments of the grade of stenosis revealed significant discrepancies between modalities, with each underestimating the stenosis severity for the higher-stenosed phantoms (70% and 85%) by up to 14%, with the greatest discrepancy attributable to DSA. Conclusions: The design and construction of a range of anatomically realistic renal artery phantoms containing varying degrees of stenosis is described. Images obtained using the main four diagnostic techniques used to detect RAS were free from artifacts and exhibited adequate contrast to allow for quantitative measurements of the degree of stenosis in each phantom. Such multimodality phantoms may prove useful in evaluating current and emerging US, MRI, CT, and DSA technology.

60 APPLIED LIFE SCIENCES↗

A system to detect cerebral aneurysms in multimodality angiographic data sets

Purpose: The early detection of cerebral aneurysms plays a major role in preventing subarachnoid hemorrhage. The authors present a system to automatically detect cerebral aneurysms in multimodal 3D angiographic data sets. The authors’ system is parametrizable for contrast-enhanced magnetic resonance angiography (CE-MRA), time-of-flight magnetic resonance angiography (TOF-MRA), and computed tomography angiography (CTA). Methods: Initial volumes of interest are found by applying a multiscale sphere-enhancing filter. Several features are combined in a linear discriminant function (LDF) to distinguish between true aneurysms and false positives. The features include shape information, spatial information, and probability information. The LDF can either be parametrized by domain experts or automatically by training. Vessel segmentation is avoided as it could heavily influence the detection algorithm. Results: The authors tested their method with 151 clinical angiographic data sets containing 112 aneurysms. The authors reach a sensitivity of 95% with CE-MRA data sets at an average false positive rate per data set (FP{sub DS}) of 8.2. For TOF-MRA, we achieve 95% sensitivity at 11.3 FP{sub DS}. For CTA, we reach a sensitivity of 95% at 22.8 FP{sub DS}. For all modalities, the expert parametrization led to similar or better results than the trained parametrization eliminating the need for training. 93% of aneurysms that were smaller than 5 mm were found. The authors also showed that their algorithm is capable of detecting aneurysms that were previously overlooked by radiologists. Conclusions: The authors present an automatic system to detect cerebral aneurysms in multimodal angiographic data sets. The system proved as a suitable computer-aided detection tool to help radiologists find cerebral aneurysms.

60 APPLIED LIFE SCIENCES↗

Robust electromagnetically guided endoscopic procedure using enhanced particle swarm optimization for multimodal information fusion

Purpose: Electromagnetically guided endoscopic procedure, which aims at accurately and robustly localizing the endoscope, involves multimodal sensory information during interventions. However, it still remains challenging in how to integrate these information for precise and stable endoscopic guidance. To tackle such a challenge, this paper proposes a new framework on the basis of an enhanced particle swarm optimization method to effectively fuse these information for accurate and continuous endoscope localization. Methods: The authors use the particle swarm optimization method, which is one of stochastic evolutionary computation algorithms, to effectively fuse the multimodal information including preoperative information (i.e., computed tomography images) as a frame of reference, endoscopic camera videos, and positional sensor measurements (i.e., electromagnetic sensor outputs). Since the evolutionary computation method usually limits its possible premature convergence and evolutionary factors, the authors introduce the current (endoscopic camera and electromagnetic sensor’s) observation to boost the particle swarm optimization and also adaptively update evolutionary parameters in accordance with spatial constraints and the current observation, resulting in advantageous performance in the enhanced algorithm. Results: The experimental results demonstrate that the authors’ proposed method provides a more accurate and robust endoscopic guidance framework than state-of-the-art methods. The average guidance accuracy of the authors’ framework was about 3.0 mm and 5.6° while the previous methods show at least 3.9 mm and 7.0°. The average position and orientation smoothness of their method was 1.0 mm and 1.6°, which is significantly better than the other methods at least with (2.0 mm and 2.6°). Additionally, the average visual quality of the endoscopic guidance was improved to 0.29. Conclusions: A robust electromagnetically guided endoscopy framework was proposed on the basis of an enhanced particle swarm optimization method with using the current observation information and adaptive evolutionary factors. The authors proposed framework greatly reduced the guidance errors from (4.3, 7.8) to (3.0 mm, 5.6°), compared to state-of-the-art methods.

60 APPLIED LIFE SCIENCES↗

Technical Note: Radiological properties of tissue surrogates used in a multimodality deformable pelvic phantom for MR-guided radiotherapy

Purpose: Phantom surrogates were developed to allow multimodal [computed tomography (CT), magnetic resonance imaging (MRI), and teletherapy] and anthropomorphic tissue simulation as well as materials and methods to construct deformable organ shapes and anthropomorphic bone models. Methods: Agarose gels of variable concentrations and loadings were investigated to simulate various soft tissue types. Oils, fats, and Vaseline were investigated as surrogates for adipose tissue and bone marrow. Anthropomorphic shapes of bone and organs were realized using 3D-printing techniques based on segmentations of patient CT-scans. All materials were characterized in dual energy CT and MRI to adapt CT numbers, electron density, effective atomic number, as well as T1- and T2-relaxation times to patient and literature values. Results: Soft tissue simulation could be achieved with agarose gels in combination with a gadolinium-based contrast agent and NaF to simulate muscle, prostate, and tumor tissues. Vegetable oils were shown to be a good representation for adipose tissue in all modalities. Inner bone was realized using a mixture of Vaseline and K{sub 2}HPO{sub 4}, resulting in both a fatty bone marrow signal in MRI and inhomogeneous areas of low and high attenuation in CT. The high attenuation of outer bone was additionally adapted by applying gypsum bandages to the 3D-printed hollow bone case with values up to 1200 HU. Deformable hollow organs were manufactured using silicone. Signal loss in the MR images based on the conductivity of the gels needs to be further investigated. Conclusions: The presented surrogates and techniques allow the customized construction of multimodality, anthropomorphic, and deformable phantoms as exemplarily shown for a pelvic phantom, which is intended to study adaptive treatment scenarios in MR-guided radiation therapy.

61 RADIATION PROTECTION AND DOSIMETRY↗

Emerging Flexible Designs for Geospatial Multimodal Foundation Models

Foundation models are rapidly transforming Earth observation by enabling scalable pretraining across diverse unlabeled geospatial modalities. However, their architectural diversity—ranging from encoder-only to encoder-decoder and masked autoencoding paradigms—makes it challenging to assess performance trade-offs in a consistent manner. In this work, we present an apples-to-apples comparison of leading FM architectures designed for geospatial multimodal reasoning, with a particular focus on flexibility across varied spectral band configurations. We standardize pretraining using identical self-supervised learning objectives and training datasets, and evaluate all models under consistent parameterization on the GEOBench benchmark across classification and segmentation tasks. Our results offer new insights into the design trade-offs between model flexibility, modality alignment, and downstream task performance. By highlighting architectural strengths and limitations under controlled conditions, this study provides practical guidance for building next-generation geospatial foundation models capable of robust multimodal reasoning.

Ambrozio Dias, Philipe [ORNL] (ORCID:0000000194277↗

Point-by-point inscribed sapphire parallel fiber Bragg gratings in a fully multimode system for multiplexed high-temperature sensing

In this work, we study the point-by-point inscription of sapphire parallel fiber Bragg gratings (sapphire pFBGs) in a fully multimode system. A parallel FBG is shown to be critical in enabling detectable and reliable high-order grating signals. The impacts of modal volume, spatial coherence, and grating location on reflectivity are examined. Three cascaded seventh-order pFBGs are fabricated in one sapphire fiber for wavelength multiplexed temperature sensing. Using a low-cost, fully multimode 850-nm interrogator, reliable measurement up to 1500°C is demonstrated.

42 ENGINEERING↗

MIDA: A Multimodal Imaging-Based Detailed Anatomical Model of the Human Head and Neck

Computational modeling and simulations are increasingly being used to complement experimental testing for analysis of safety and efficacy of medical devices. Multiple voxel- and surface-based whole- and partial-body models have been proposed in the literature, typically with spatial resolution in the range of 1–2 mm and with 10–50 different tissue types resolved. We have developed a multimodal imaging-based detailed anatomical model of the human head and neck, named “MIDA”. The model was obtained by integrating three different magnetic resonance imaging (MRI) modalities, the parameters of which were tailored to enhance the signals of specific tissues: i) structural T1- and T2-weighted MRIs; a specific heavily T2-weighted MRI slab with high nerve contrast optimized to enhance the structures of the ear and eye; ii) magnetic resonance angiography (MRA) data to image the vasculature, and iii) diffusion tensor imaging (DTI) to obtain information on anisotropy and fiber orientation. The unique multimodal high-resolution approach allowed resolving 153 structures, including several distinct muscles, bones and skull layers, arteries and veins, nerves, as well as salivary glands. The model offers also a detailed characterization of eyes, ears, and deep brain structures. A special automatic atlas-based segmentation procedure was adopted to include a detailed map of the nuclei of the thalamus and midbrain into the head model. The suitability of the model to simulations involving different numerical methods, discretization approaches, as well as DTI-based tensorial electrical conductivity, was examined in a case-study, in which the electric field was generated by transcranial alternating current stimulation. The voxel- and the surface-based versions of the models are freely available to the scientific community.

59 BASIC BIOLOGICAL SCIENCES↗

A Multimodal Event Catalog and Waveform Data Set That Supports Explosion Monitoring from Nevada, U.S.A.

Multimodal, curated data sets and nuisance event catalogs remain rare in the explosion monitoring community relative to curated seismic data sets. The source of this relative absence is the difficultly in deploying multimodal receivers that sense the seismic, acoustic, and other modalities from multiphysics sources. We provide such a data set in this study that delivers seismic, infrasound, and electromagnetic (magnetometer) sensor records collected over a two–week period, within 255 km of a 10 ton buried chemical explosion called DAG–4 that was located at 37.1146°, –116.0693° on 22 June 2019 21:06:19.88 UTC. This catalog includes 485 seismic, seismoacoustic, and infrasound–only events that an expert analyst manually built by reviewing waveforms from 29 seismic and infrasound sensors. Our data release includes waveforms from these 29 seismic, infrasound, and seismoacoustic stations and two magnetometer stations and their station metadata. We deliver these waveforms in NNSA KB Core CSS.w format (i4) with a corresponding wfdisc table that provides the header information. Here, we expect that this data set will provide a valuable, benchmark resource to develop signal processing algorithms and explosion monitoring methods against manual, human observations.

58 GEOSCIENCES↗

Multimodal Nanomaterials for PET/MRI/optical imaging

This research aimed to develop new, simple, high yield synthetic strategies for producing multimodal nanoparticles that were not based on traditional conjugation methods. This new method incorporated radioisotopes as an integral part of nanoparticle structure and was developed for two nanoparticle systems: superparamagnetic iron oxide nanoparticles and luminescent silicon quantum dots, to generate biocompatible imaging agents for combined positron emission tomography, magnetic resonance and optical imaging. In conjunction with the chemistry of probe synthesis, our team developed appropriate software to reconstruct and interpret multimodal data sets.

Louie, Angelique↗

Quantum Super-resolution Bioimaging using Massively Entangled Multimode Squeezed Light

This report presents a new method for realizing a super-resolution quantum imaging using massively entangled multimode squeezed light (MEMSL). Each branch of the entangled multimode light interacts with the sample and bears the spatially varying optical phase delay. When imaging optics with finite pupil sizes are used, information is lost. Thanks to the analyticity in the Fourier plane, a noiseless measurement would recover the lost information and accomplish super resolution imaging beating the Rayleigh diffraction limit. I proved rigorously in a fully quantum formalism and presented that (1) such information recovery is possible and (2) the information recovery can be accomplished with much less resources when MEMSL is used than those needed in any non-entangled or non-squeezed classical imaging method. Furthermore, the action of the optical loss in the imaging system that degrades the imaging performance is also rigorously analyzed and presented. Several bioimaging applications that can benefit tremendously from the proposed quantum imaging scheme are also suggested.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Using Neural Architecture Search for Improving Software Flaw Detection in Multimodal Deep Learning Models

Software flaw detection using multimodal deep learning models has been demonstrated as a very competitive approach on benchmark problems. In this work, we demonstrate that even better performance can be achieved using neural architecture search (NAS) combined with multimodal learning models. We adapt a NAS framework aimed at investigating image classification to the problem of software flaw detection and demonstrate improved results on the Juliet Test Suite, a popular benchmarking data set for measuring performance of machine learning models in this problem domain.

97 MATHEMATICS AND COMPUTING↗

Fuel Effects on Multimode Engine Operation (Sandia National Laboratories) (DOE VTO Annual Progress Report for FY21)

In total, light-duty vehicles in the United States travel on the order of 3 trillion miles annually, providing tremendous societal and personal benefits. However, the environmental burden is excessive, prompting Co-Optimization of Fuel and Engines (Co-Optima) program efforts to provide the science needed to increase engine efficiency and produce non-fossil fuels with reduced greenhouse gas emissions. Boosted spark-ignition (SI) engines provide high power density by offering high loads and engine speeds, making them light-weight and attractive for light-duty vehicles. Unfortunately, the engine efficiency drops off at lower loads and speeds, where the engine spends most time during typical driving. Multimode SI engines can use a more efficient advanced lean combustion mode at lower loads and speeds, while reverting to boosted SI under high-load conditions. Within Co-Optima, multiple advanced lean combustion modes have been explored; these include stratified-charge SI, pre-chamber lean SI, and advanced compression ignition (ACI) techniques such as spark-assisted compression ignition (SACI). For these combustion modes, focus has been on determining fuel properties that enable higher engine efficiency, clean and stable combustion, and effective exhaust aftertreatment. This report highlights recent efforts funded by the Vehicle Technologies Office at multiple National Laboratories that supported the multimode project in Co-Optima. It also includes a brief summary of biofuel production research funded by the Bioenergy Technologies Office.

33 ADVANCED PROPULSION SYSTEMS↗

Crosstalk-Robust Quantum Control in Multimode Bosonic Systems

Universal control of multimode bosonic modes typically relies on a dispersively coupled transmon ancilla. However, its frequency undergoes a Stark shift that depends on the state of each coupled bosonic mode, leading to a frequency mismatch in the ancilla drive and ultimately reducing the fidelity of multimode gates

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Multimodal Atomic Force Microscopy for the Characterization of Metallic Particulates

This study investigates the utility of multimodal, or functional, atomic force microscopy (AFM) for the characterization of individual particles and particle ensembles. In single-particle analyses, AFM imaging modes provided orthogonal insights into mechanical and magnetic properties that are not accessible through conventional electron microscopy. Although the experiments were inherently delicate and time-intensive, with an observed sample loss rate of approximately 30%, these techniques enabled the qualitative differentiation of grain structures and magnetic domains, underscoring the challenges of experimental robustness. For particle ensembles, AFM enabled the extraction of reliable 2D and 3D particle size distributions. However, efforts to chemically differentiate particles based on mechanical property contrasts were limited by scaling effects and the qualitative nature of the data. Overall, multimodal AFM offers valuable complementary information, but its application requires careful consideration of methodological limitations, particularly for sample integrity, calibration, and scalability of mechanical and magnetic measurements. This report is organized to first address the application of AFM to single-particle analysis using various imaging modalities, followed by its potential role in ensemble-level particle screening and differentiation.

36 MATERIALS SCIENCE↗

Advancing Industry 4.0: Multimodal Sensor Fusion for AI-Based Fault Detection in 3D Printing

Additive manufacturing, particularly fused deposition modeling, is transforming modern production by enabling rapid prototyping and complex part fabrication. However, its layer-by-layer process remains vulnerable to faults such as nozzle clogging, filament runout, and layer misalignment, which compromise print quality and reliability. Traditional inspection methods are costly, time-intensive, and often limited to post-process analysis, making them unsuitable for real-time intervention. In this current study, the authors developed a novel, low-cost, and portable faultdetection system that leverages multimodal sensor fusion and artificial intelligence for real-time monitoring in FDM-based 3D printing. The system integrates acoustic, vibration, and thermal sensing into a non-intrusive architecture, capturing complementary data streams that reflect both mechanical and process-related anomalies. Acoustic and thermal sensors operate in a fully contactless manner, while the vibration sensor requires minimal attachment such that it will not interfere with printer hardware, thereby preserving portability and ease of deployment. The multimodal signals are processed into spectrograms and time-frequency features, which are classified using convolutional neural networks for intelligent fault detection. The proposed system advances Industry 4.0 objectives by offering an affordable, scalable, and practical monitoring solution that improves faultdetection accuracy, reduces waste, and supports sustainable, adaptive manufacturing.

42 ENGINEERING↗

CAMFeND: Credibility-Aware Multimodal Fake News Detection with Rotational Attention

In the evolving digital landscape, fake news is a significant challenge, influencing public perception and decision-making. Traditional detection approaches focus on single-modal data or simple multimodal fusion, often overlooking deeper interactions and news credibility. We propose a novel model addressing these limitations by introducing rotational attention and news domain information as a feature. Unlike static attention mechanisms, our rotational attention dynamically shifts query, key, and value roles across text and image inputs, enabling richer cross-modal interaction. Incorporating news domain information further enhances the model’s reliability by associating news posts with top domains extracted from Google search results, reducing false detections. This approach assesses both the content and the broader web context in which the news is discussed. Our model outperforms existing state-of-the-art methods by providing deeper, layered multimodal integration and domain information analysis, resulting in a more robust and adaptive fake news detection system.

Gupta, Nidhi↗