Search NASA⌕ Search

SEARCH · Search NASA

Results for “Multimodal analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
DOE OSTI2021

Identifying Light-Duty Vehicle Travel from Large-Scale Multimodal Wearable GPS Data with Novelty Detection Algorithms

Identifying travel mode within travel survey data sets, especially light-duty vehicle (LDV) travel, is foundational, though nontrivial, to travel behavior analysis and fuel consumption estimation. Current travel mode detection approaches require well-sampled and balanced data sets with ground truth travel mode labels. They are rarely applied and validated on large-scale, real-world data sets, which may not satisfy the data requirements. This paper proposes an LDV travel mode detection model as a supplement to current travel mode detection methods, for the case when the training set is highly (and/or completely) unbalanced, to the extent that classical machine-learning approaches become difficult or impossible to deploy. The proposed model uses a novelty detection technique-one-class support vector machines (OCSVMs)-and a novel exhaustive feature extraction (EFE) technique on continuous time series data (i.e., Global Positioning System [GPS] speed profiles) for single-mode trip trajectories. Training and validation of the model are conducted on a large-scale, real-world data set. The proposed method accurately identifies LDV trips from a broad set of multimodal trips by leveraging a wealth of preexisting in-vehicle GPS travel data. Additional sensitivity analysis sheds light on the optimal training size, which will benefit applications limited by highly imbalanced data. The paper also discusses performance comparison with regular machine-learning approaches, the model's robustness, and the potential to extend the proposed model to multimodal prediction.

47 OTHER INSTRUMENTATION↗
DOE OSTI2025

Multimodal hard X-ray nanoprobe techniques for operando investigations of photovoltaic devices

Compared with conventional laboratory-scale X-ray techniques, synchrotron based X-rays with higher brilliance and higher coherence allow for the investigation of various material properties with high spatial resolution. The microscopic behaviours of materials can be examined using the Hard X-ray Nanoprobe beamline (I14) at Diamond Light Source, which provides a 50 nm focused beam and has been successfully employed to identify nanoscale optoelectronic features in energy-harvesting materials such as halide perovskites that exhibit local heterogeneity. We have developed X-ray beam-induced current (XBIC) measurement capability at I14 to address the growing demand for operando analysis in energy-harvesting research. Here, we demonstrate that X-ray fluorescence (XRF)/XBIC multimodal measurements are feasible at I14 and apply these newly implemented techniques to study perovskite solar cells with various additive concentrations to understand the effect of the additive on nanoscale optoelectronic performance. This expanded operando characterization capability offers the possibility of monitoring nanometre-scale compositional variations and corresponding optoelectronic features of actual solar cell configurations.

73 NUCLEAR PHYSICS AND RADIATION PHYSICS↗
DOE OSTI2023

Localized keyhole pore prediction during laser powder bed fusion via multimodal process monitoring and X-ray radiography

Systematic fault detection and control during laser powder bed fusion (L-PBF) has been a long-standing objective for system manufacturers and researchers in the additive manufacturing (AM) industry. This manuscript investigates a data fusion approach for detection of keyhole porosity formation during laser irradiation of Ti-6Al-4V substrates by concurrent recording of thermally induced optical emission measured using both off-axis and coaxial photodiode sensors, and acoustic emission. Subsurface defect formation was monitored via high-speed synchrotron X-ray imaging at 20,000 frames per second, enabling temporal registration of keyhole pore formation events to the monitoring signals at a resolution of 50 µs. We developed data fusion machine learning (ML) models for localized prediction of keyhole pore formation at various time scales ranging from 0.5 ms to 2 ms. The signal segments were featurized using two independent approaches: (1) power spectral density (PSD) and (2) highly comparative time series analysis (HCTSA) framework. The extracted features from different sensor modalities were fused together to construct a multimodal feature space and sequential feature selection was used to determine the most informative features for training the ML models. The predictive performance was evaluated for three classifying algorithms: Support Vector Machine (SVM), K-Nearest Neighbor (KNN), and Gaussian Naive Bayes (GNB). As a result, pore formation events were predicted with up to 0.95 F1-score, 1.0 recall and 0.94 accuracy. The most heavily weighted features indicate that model performance is chiefly governed by the acoustic monitoring signal, with a secondary contribution from the optical emission sensors.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Light-Duty Vehicle Trip Classification Using One-Class Novelty Detection and Exhaustive Feature Extraction

Travel mode classification within travel survey data sets, especially light-duty vehicle (LDV) trips, is foundational, though nontrivial, to emerging mobility systems, travel behavior analysis, and fuel consumption estimation. Current travel mode detection approaches require well-sampled and balanced data sets with ground truth travel mode labels. The detection approaches are rarely applied and validated on large-scale, real-world data sets, which may not satisfy the dataset requirements. This work proposes an LDV trip detection model as a supplement to current travel mode detection methods, for the case when the training set is highly (and/or completely) unbalanced, to the extent that classical machine-learning approaches become difficult or impossible to deploy. The proposed model uses a novelty detection technique - one-class support vector machines (OCSVMs) - and a novel exhaustive feature extraction (EFE) technique on continuous time series data (i.e., Global Positioning System [GPS] speed profiles) for single-mode trip trajectories. Training and validation of the model are conducted on a large-scale, real-world data set. The proposed method accurately identifies LDV trips from a broad set of multimodal trips by leveraging a wealth of preexisting in-vehicle GPS travel data. Additional sensitivity analysis sheds light on the optimal training size and feature selection, which will benefit applications limited by highly imbalanced data. The paper also discusses performance comparison with regular machine-learning approaches, the model's robustness, and the potential to extend the proposed model to multi-modal trip prediction.

33 ADVANCED PROPULSION SYSTEMS↗
DOE OSTI2020

Inferring thermal ion temperature and residual kinetic energy from nuclear measurements in inertial confinement fusion implosions

In inertial con finement fusion implosion experiments, the presence of residual anisotropic fluid motion within the stagnating hot spot leads to signifi cant variations in ion-temperature measurements using neutron time- of-flight detectors along different lines of sight. The minimum ion-temperature measurement is typically used as representative of the thermal temperature. In the presence of isotropic flows, however, even the minimum DT neutron-inferred ion temperature can be well above the plasma thermal temperature. Using both DD and DT neutron-inferred ion-temperature measurements, we show that it is possible to determine the contribution of isotropic flows and infer the DT burn-averaged thermal ion temperature. The contribution of large isotropic flows on driving the ratio of DD to DT neutron-inferred ion temperatures well below unity and approaching the lower bound of 0.8 is demonstrated in multimode simulations. The minimum DD neutron- inferred ion temperature is determined from the velocity variance analysis, accounting for the presence of isotropic flows. Being close to the DT burn-averaged thermal ion temperature, the inferred DD minimum ion temperatures demonstrate a strong correlation with the experimental yields in the OMEGA implosion database. An analytical expression is also derived to explain the effect of mode ℓ = 1 ion-temperature measurement asymmetry on yield degradations caused by the anisotropic flows.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Multimodal Approach Reveals the Symmetry-Breaking Pathway to the Broken Helix in EuIn 2 ⁢As 2

Understanding and manipulating emergent phases, which are themes at the forefront of quantum-materials research, rely on identifying their underlying symmetries. This general principle has been particularly prominent in materials with coupled electronic and magnetic degrees of freedom, in which magnetic order influences the electronic band structure and can lead to exotic topological effects. However, identifying symmetry of a magnetically ordered phase can pose a challenge, particularly in the presence of small domains. Here we introduce a multimodal approach for determining magnetic structures, which combines symmetry-sensitive optical probes, scattering, and group-theoretical analysis. We apply it to EuIn 2 ⁢As 2 , a material that has received attention as a candidate axion insulator. While first-principles calculations predict this state on the assumption of a simple collinear antiferromagnetic structure, subsequent neutron-scattering measurements reveal a much more intricate magnetic ground state characterized by two coexisting magnetic wave vectors reached by successive thermal phase transitions. The proposed high- and low-temperature phases are a spin helix and a state with interpenetrating helical and Néel antiferromagnetic order termed a “broken helix,” respectively. Employing a multimodal approach, we identify the magnetic structure associated with these two phases of EuIn 2 ⁢As 2 . We find that the higher-temperature phase is characterized by a variation of the magnetic moment amplitude from layer to layer, with the moment vanishing entirely in every third Eu layer. The lower-temperature structure is similar to the broken helix, with one important difference: Because of local strain, the relative orientation of the magnetic structure and the lattice is not fixed. Consequently, the symmetry required to protect the axion phase is not generically protected in EuIn 2 ⁢As 2 , but we show that it can be restored if the magnetic structure is tuned with uniaxial strain. Finally, we present a spin Hamiltonian that identifies the spin interactions that account for the complex magnetic order in EuIn 2 ⁢As 2 . Our work highlights the importance of a multimodal approach in determining the symmetry of complex order parameters.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2025

Energy-efficient multimodal mobility networks in transportation digital twins: Strategies and optimization

The study proposes a comprehensive Transportation Mobility (TransitMo) framework covering conceptual design, model formulation, optimization, simulation, and impact analysis of the transportation mobility system. TransitMo is composed of a transportation digital twin developed in Simulation of Urban MObility (SUMO) and an Intelligent Traffic Management and Control Center (ITMCC) that identifies the best ways to improve the movement of people within urban areas using various modes of transportation. This study encompasses advanced modeling techniques, algorithms, and strategic testing to optimize energy efficiency and mobility in a multimodal shared mobility network. TransitMo’s practical applications are exemplified through a city-scaled simulation network in Chattanooga, TN, employing demographic data to analyze historical traffic patterns and forecast future demands. Central to this methodology are three models: the User Preference Model (UP), the Energy Consumption Model (EC), and the System Optimization Model (SO). These models work in concert to iteratively devise the optimal travel incentives and minimize the total system cost in a real-time manner. In conclusion, test results verified that the proposed adaptive incentive program and optimized bus scheduling can improve network performance by increasing public transit ridership.

42 ENGINEERING↗
DOE OSTI2023

Microscale Electrochemical Corrosion of Uranium Oxide Particles

Understanding the corrosion of spent nuclear fuel is important for the development of long-term storage solutions. However, the risk of radiation contamination presents challenges for experimental analysis. Adapted from the system for analysis at the liquid–vacuum interface (SALVI), we developed a miniaturized uranium oxide (UO 2 )-attached working electrode (WE) to reduce contamination risk. To protect UO 2 particles in a miniatured electrochemical cell, a thin layer of Nafion was formed on the surface. Atomic force microscopy (AFM) shows a dense layer of UO 2 particles and indicates their participation in electrochemical reactions. Particles remain intact on the electrode surface with slight redistribution. X-ray photoelectron spectroscopy (XPS) reveals a difference in the distribution of U(IV), U(V), and U(VI) between pristine and corroded UO 2 electrodes. The presence of U(V)/U(VI) on the corroded electrode surface demonstrates that electrochemically driven UO 2 oxidation can be studied using these cells. Our observations of U(V) in the micro-electrode due to the selective semi-permeability of Nafion suggest that interfacial water plays a key role, potentially simulating a water-lean scenario in fuel storage conditions. This novel approach offers analytical reproducibility, design flexibility, a small footprint, and a low irradiation dose, while separating the α-effect. This approach provides a valuable microscale electrochemical platform for spent fuel corrosion studies with minimal radiological materials and the potential for diverse configurations.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗
DOE OSTI2021

Helium Ion Microscopy with Secondary Ion Mass Spectrometry for Nanoscale Chemical Imaging and Analysis of Polyolefins

To date, chemical imaging of polymers and polymer blends has been primarily accomplished using time-of-flight secondary ion mass spectrometry (ToF-SIMS) to directly visualize the distribution of components in a complex material with spatial resolution ranging from 100 nm to 5 μm. However, in many cases, this resolution falls far short of visualizing interfaces directly. To overcome these limitations, recent work has focused on developing a SIMS detection system based on a helium ion microscope (HIM) enabling chemical imaging with a demonstrated ~14 nm spatial resolution. Here, we utilize HIM-SIMS for differentiation between the olefin-based polymers of polyethylene (PE) and polypropylene (PP). We illustrate both analyses for separating PE and PP using specific mass fragment ratios as well as demonstrate spatially resolved imaging of phase-separated domains within PE. Altogether, we demonstrate the abilities of HIM-SIMS as a multimodal chemical technique for imaging and quantification of polyolefin interfaces, which could be more broadly applied to the analysis of more complex polymeric systems.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2025

Predicting High‐Resolution Spatial and Spectral Features in Mass Spectrometry Imaging with Machine Learning and Multimodal Data Fusion

Recent advancements in molecular Mass Spectrometry Imaging have sparked interest in integrating high spatial resolution methods with molecular mass-spectrometry-based chemical imaging. Fusion-based algorithms have proven effective in generating high spatial-resolution molecular mass spectra. However, a significant challenge stems from the differing physical mechanisms underlying image generation and data upsampling techniques, potentially leading to discrepancies in integrated information channels. Integrating physical constraints into data processing workflows is essential to tackle this issue. In this study, we propose an innovative approach that merges data from Fourier transform ion cyclotron resonance (FTICR), time-of-flight matrix-assisted laser desorption/ionization, and time-of-flight secondary ion mass spectrometry imaging techniques. By leveraging FT-ICR's unparalleled spectral resolution and ToF-SIMS's exceptional spatial resolution, we achieve submicron spatial resolution, enabling the observation of intact molecular species with remarkable spectral precision. Canonical correlation analysis is employed to incorporate physical constraints. Through sophisticated image processing and machine learning techniques, the results of this fusion hold significant promise for advancing our comprehension of complex systems and unveiling concealed molecular intricacies.

canonical correlation analysis↗
DOE OSTI2021

Exploring Causal Physical Mechanisms via Non-Gaussian Linear Models and Deep Kernel Learning: Applications for Ferroelectric Domain Structures

Rapid emergence of multimodal imaging in scanning probe, electron, and optical microscopies has brought forth the challenge of understanding the information contained in these complex data sets, targeting the intrinsic correlations between different channels, and further exploring the underpinning causal physical mechanisms. Here, we develop such an analysis framework for Piezoresponse Force Microscopy. We argue that under certain conditions, we can bootstrap experimental observations with the prior knowledge of materials structure to get information on certain nonobserved properties, and demonstrate linear causal analysis for PFM observables. We further demonstrate that the strength of individual causal links between complex descriptors can be ascertained using the deep kernel learning (DKL) model. In this DKL analysis, we use the prior information on domain structure within the image to predict the physical properties. This analysis demonstrates the correlative relationships between morphology, piezoresponse, elastic property, etc., at nanoscale. The prediction of morphology and other physical parameters illustrates a mutual interaction between surface condition and physical properties in ferroelectric materials. Overall, this analysis is universal and can be extended to explore the correlative relationships of other multichannel data sets, and allow for high-fidelity reconstruction of underpinning functionalities and physical mechanisms.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2024

Unveiling the nanoscale architectures and dynamics of protein assembly with in situ atomic force microscopy

Proteins play a vital role in different biological processes by forming complexes through precise folding with exclusive inter- and intra-molecular interactions. Understanding the structural and regulatory mechanisms underlying protein complex formation provides insights into biophysical processes. Furthermore, the principle of protein assembly gives guidelines for new biomimetic materials with potential applications in medicine, energy, and nanotechnology. Atomic force microscopy (AFM) is a powerful tool for investigating protein assembly and interactions across spatial scales (single molecules to cells) and temporal scales (milliseconds to days). It has significantly contributed to understanding nanoscale architectures, inter- and intra-molecular interactions, and regulatory elements that determine protein structures, assemblies, and functions. This review describes recent advancements in elucidating protein assemblies with in situ AFM. We discuss the structures, diffusions, interactions, and assembly dynamics of proteins captured by conventional and high-speed AFM in near-native environments and recent AFM developments in the multimodal high-resolution imaging, bimodal imaging, live cell imaging, and machine-learning-enhanced data analysis. These approaches show the significance of broadening the horizons of AFM and enable unprecedented explorations of protein assembly for biomaterial design and biomedical research.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Novel High Resolution High Temperature In-Line Sensors for Steel Manufacturing

To support efficiency, productivity, yield improvements, and future industry 4.0 and SMART manufacturing objectives for a competitive and prosperous steel industry, this program has embarked on an effort to develop, demonstrate and deploy several novel sensing technologies based on fiber optics for use in production steel facilities. Over the duration of this program, our team has successfully demonstrated three of these technologies: (1) near continuous Rayliegh Scattering optical frequency domain reflectometry (OFDR) sensing with single mode silica fibers for temperature sensing to 700 C, (2) semi-distributed fiber Bragg grating (FBG) sensing with multimode sapphire fibers for temperature sensing to >1600 C, and (3) remote in-situ Raman analysis for slag and flux chemistry analysis at steelmaking temperatures >1550 C. Each of these sensor and interrogation systems was developed, refined, and tested in our labs at Missouri S&T and then successfully deployed at SSAB’s production facilities at two sites, one in Montpelier, IA and one in Mobile, AL.

36 MATERIALS SCIENCE↗
DOE OSTI2025

Bolide Infrasound Signal Morphology and Yield Estimates: A Case Study of Two Events Detected by a Dense Acoustic Sensor Network

Two bolides (2016 June 2 and 2019 April 4) were detected at multiple regional infrasound stations, with many of the locations receiving multiple detections. Analysis of the received signals was used to estimate the yield, location, and trajectory, as well as the type of shock that produced the received signal. The results from the infrasound analysis were compared with ground-truth information that was collected through other sensing modalities. This multimodal framework offers an expanded perspective on the processes governing bolide shock generation and propagation. The majority of signal features showed reasonable agreement between the infrasound-based interpretation and the other observational modalities, though the yield estimate from the 2019 bolide was significantly lower using the infrasound detections. There was also evidence suggesting that one of the detections was from a cylindrical shock that was initially propagating upward, which is unusual though not impossible.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2026

Advancing Industry 4.0: Multimodal Sensor Fusion for AI-Based Fault Detection in 3D Printing

Additive manufacturing, particularly fused deposition modeling, is transforming modern production by enabling rapid prototyping and complex part fabrication. However, its layer-by-layer process remains vulnerable to faults such as nozzle clogging, filament runout, and layer misalignment, which compromise print quality and reliability. Traditional inspection methods are costly, time-intensive, and often limited to post-process analysis, making them unsuitable for real-time intervention. In this current study, the authors developed a novel, low-cost, and portable faultdetection system that leverages multimodal sensor fusion and artificial intelligence for real-time monitoring in FDM-based 3D printing. The system integrates acoustic, vibration, and thermal sensing into a non-intrusive architecture, capturing complementary data streams that reflect both mechanical and process-related anomalies. Acoustic and thermal sensors operate in a fully contactless manner, while the vibration sensor requires minimal attachment such that it will not interfere with printer hardware, thereby preserving portability and ease of deployment. The multimodal signals are processed into spectrograms and time-frequency features, which are classified using convolutional neural networks for intelligent fault detection. The proposed system advances Industry 4.0 objectives by offering an affordable, scalable, and practical monitoring solution that improves faultdetection accuracy, reduces waste, and supports sustainable, adaptive manufacturing.

42 ENGINEERING↗
DOE OSTI2024

Multimodal, microspectroscopic speciation of legacy phosphorus in two US mid-Atlantic agricultural soils

To understand phosphorus (P) mobility in agricultural soils and its potential environmental risk, it is essential to directly measure solid phase P speciation. Often, bulk P K-edge X-ray absorption near edge structure (XANES) spectroscopy followed by linear combination fitting (LCF) is utilized to determine the solid P phases in soil. However, this method may limit results to only a few major phases. Additionally, XANES spectra for different P species may have very similar features, leading to an over- or underestimate of their contribution to LCF. Here, an improved P speciation by pairing multimodal microbeam-X-ray fluorescence (µ-XRF) mapping coupled with µ-XANES (microbeam-X-ray absorption near edge structure) analysis to directly speciate major and minor P phases on the micron scale is provided. We combined maps of both tender (P, sulfur, aluminum, and silicon) and hard energy (calcium, iron [Fe], and manganese) elements to evaluate the elemental co-locations with P. To better account for uncertainty assigning XANES peaks to individual compounds, a more quantitative fingerprinting by “spectral feature analysis” was completed. With this analysis, an R-factor is reported for the fit. These results were compared to traditional LCF. Pre-edge fitting results revealed the presence of a two-component pre-edge feature for phosphate adsorbed to ferrihydrite. Additionally, phytate co-precipitated with ferrihydrite (Phytate-Fe-Cop) had a pre-edge feature, indicating direct association with Fe. Lastly, a unique P species associated with manganese oxide was identified in the soil via multimodal mapping and µ-XANES. These results allow for better prediction of P dissolution and mobility.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Tailoring Fibre Structure Enabled by X-ray Analytics for Targeted Biomedical Applications

The rising interest in designing fibres via spinning techniques combining the properties of various polymeric materials into advanced functionalised materials is directed towards targeted biomedical applications such as drug delivery, wearable sensors or tissue engineering. Understanding how these functional polymers exhibit multiscale structures ranging from the molecular level to nano-, micro-and millimetre scale is a key prerequisite for their challenging applications that can be addressed by a non-destructive X-ray based analytical approach. X-ray multimodalities combining X-ray imaging, scattering and diffraction allow the study of morphology, molecular structure, and the analysis of nano-domain size and shape, crystallinity and preferential orientation in 3D arrangements. The incorporation of X-ray analytics in the design process of polymeric fibers via their nanostructure under non-ambient conditions (i.e. temperature, mechanical load, humidity…) allows for efficient optimization of the fabrication process as well as quality control along the product lifetime under operating environmental conditions. Here, we demonstrate the successful collaboration between the laboratory of Biomimetic Textiles and Membranes and the Center of X-ray Analytics at Empa for the design, characterisation and optimisation of advanced functionalised polymeric fibrous material systems.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Multimodal Tip-Enhanced Nonlinear Optical Nanoimaging of Plasmonic Silver Nanocubes

Optical field localization at plasmonic tip-sample nanojunctions has enabled high spatial resolution chemical analysis through tip-enhanced linear optical spectroscopies, including Raman scattering and photoluminescence. In this work, we illustrate that nonlinear optical processes, including parametric four-wave mixing (4WM), second harmonic/sum-frequency generation (SHG and SFG), and two-photon photoluminescence (TPPL), can be enhanced at plasmonic junctions and spatio-spectrally resolved simultaneously with few-nm spatial resolution under ambient conditions. More importantly, through a detailed analysis of our spectral nano-images, we find that the efficiencies of the local nonlinear signals are determined by sharp tip-sample junction resonances that vary over the few-nanometer length scale because of the corrugated nature of the probe. Namely, plasmon resonances centered at or around the different nonlinear signals are tracked through TPPL, and they are found to selectively enhance nonlinear signals with closely matched optical resonances.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗