Search NASA⌕ Search

SEARCH · Search NASA

Results for “Multimode”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 289 records · Page 16
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Predicting High‐Resolution Spatial and Spectral Features in Mass Spectrometry Imaging with Machine Learning and Multimodal Data Fusion

Recent advancements in molecular Mass Spectrometry Imaging have sparked interest in integrating high spatial resolution methods with molecular mass-spectrometry-based chemical imaging. Fusion-based algorithms have proven effective in generating high spatial-resolution molecular mass spectra. However, a significant challenge stems from the differing physical mechanisms underlying image generation and data upsampling techniques, potentially leading to discrepancies in integrated information channels. Integrating physical constraints into data processing workflows is essential to tackle this issue. In this study, we propose an innovative approach that merges data from Fourier transform ion cyclotron resonance (FTICR), time-of-flight matrix-assisted laser desorption/ionization, and time-of-flight secondary ion mass spectrometry imaging techniques. By leveraging FT-ICR's unparalleled spectral resolution and ToF-SIMS's exceptional spatial resolution, we achieve submicron spatial resolution, enabling the observation of intact molecular species with remarkable spectral precision. Canonical correlation analysis is employed to incorporate physical constraints. Through sophisticated image processing and machine learning techniques, the results of this fusion hold significant promise for advancing our comprehension of complex systems and unveiling concealed molecular intricacies.

canonical correlation analysis↗
DOE OSTI2022

Multimodal sensor fusion framework for residential building occupancy detection

For several years now, smart building energy systems have been a research area of intensive activity. In light of the increasing need for sustainable buildings and energy systems, this trend motivates an increasing need for a solution to reduce carbon dioxide emissions and improve energy efficiency. This work proposes a high-performing and transferable occupancy detection framework that combines sensor data from different data modalities, including time series environmental data (temperature, humidity, and illuminance), image data, and acoustic energy data using ensemble method. To draw out the best prediction performance in each modality, the proposed framework was developed, including various models that were designed to learn the occupancy patterns reflected in the physical data streams. To tackle the time series environmental data, we designed two variants of an occupancy detection spatiotemporal pattern network (Occ-STPN) that performs both feature level and decision level fusion, respectively. We also propose a new metric; the fading memory mean square error (FMMSE), that provides a fair evaluation and penalization of delayed occupancy predictions. Multiple open-sourced datasets, including the Electricity Consumption and Occupancy and the University of California, Irvine's (UCI) building occupancy detection dataset, along with our own real data collected from six different houses, were used to validate the algorithms' performance. The experimental results presented herein break down the performance for each sensing modality, and a detailed analysis of the performance is also discussed.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2022

A photosensitive sustainable lignin nanoplatform for multimodal image-guided mitochondria-targeted photodynamic and photothermal therapy

Photoactivated nanocarriers exhibit significant potential for anticancer therapy, but complex design strategies, unsustainable substrates, and short wavelengths limit their practical application. Here, we designed a new lignin-derived photoactivated nanomaterial that exploits the sensitivity of the β-O-4 bond of lignin to singlet oxygen. This sustainable product was loaded with mitochondria-targeting chlorin e6 and black phosphorus quantum dots (BPQDs) to produce BPQDs@N-LgC NPs, which were used for mitochondria-targeted fluorescence/photoacoustic-guided photothermal and photodynamic therapy. When irradiated at 808 nm, the BPQDs in BPQDs@N-LgC NPs exhibited good photothermal conversion, which allowed photoacoustic imaging and inhibited tumor growth. When irradiated at 660 nm, the BPQDs@N-LgC NPs generated fluorescence and reactive oxygen species, which allowed photoluminescence imaging and further inhibited tumor growth. Cleavage of the β-O-4 bond of lignin by photo-triggered reactive oxygen species degraded the NPs and released the BPQDs, facilitating rapid excretion of the therapeutic nanomaterials. Our rationally designed BPQDs@N-LgC NPs exhibited good therapeutic efficacy, both in vitro and in vivo.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2026

A comparative study of multimodal data fusion strategies for planetary spectroscopy

Integrating heterogeneous data sources can improve scientific inference when different modalities capture complementary information, but doing so is challenging in high-dimensional, small-sample settings. In spectroscopy for planetary exploration, Laser-Induced Breakdown Spectroscopy (LIBS), Raman Spectroscopy (Raman), Visible Infrared Spectroscopy (VISIR), and Mid-Infrared Spectroscopy (MIR) each examine different aspects of composition and mineralogy, raising fundamental questions about when and how data fusion improves predictive performance. Using a Mars-relevant set of geologic standards with measurements from all four modalities, we present a rigorous systematic evaluation of four data fusion strategies: low-level (data) fusion, mid-level (feature) fusion, high-level (decision) fusion, and residual-boosting (sequential) fusion. We assess performance in predicting oxide composition via nested cross-validation and corrected significance testing to evaluate whether data fusion improves upon single-modality baselines. We show that data fusion does not uniformly improve accuracy, and that observed gains are modest, oxide-dependent, and sensitive to modality and model structure. To move beyond aggregate accuracy metrics, we use model coefficients, permutation importance, and residual gain analysis to examine how the fusion models weight individual modalities and to identify patterns of apparent complementarity or redundancy. Though focused on spectroscopy for planetary exploration, our framework for data fusion evaluation and interpretation extends to other scientific domains with heterogeneous and scarce data and provides a principled approach evaluating data fusion strategies, interpreting modality contributions, and understanding tradeoffs among data fusion strategies.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2024

Community Charging: Emerging Multifamily, Curbside, and Multimodal Practices

Approximately 44 million households—31% of the United States total—are in multifamily housing. This encompasses both rented and owned homes in apartment buildings, condominiums, townhouses, and mixed-use developments. Regardless of where they live, nearly one-third of Americans do not drive. As U.S. transportation is electrified, it will be imperative to support car-free or car-light households, as well as residents living in multifamily and rental housing, with tailored solutions.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗
DOE OSTI2023

Continuous multimodal technologies in industrial microbiology: potential for achieving high process performance and agility

The field of industrial microbiology has great potential to tackle the most pressing challenges facing society, but today, this entails much more than classical fermentation technology followed by product upgrading. Methods are needed to confer unit-operation-level functionality and whole-system-level robustness, as well as flexibility. As examples of this concept, we focus here on methodologies often deployed at industrial scale as discrete processes—such as biological, chemical, and electrochemical unit operations—that are also capable of substantial complementarity when combined sequentially and operated continuously. A key and relatively new type of conversion step is made possible by catalyst immobilization methods at both the enzymatic and cellular level. Cases drawn from electro-fermentation for acetoin production and syngas-mediated microbial electrosynthesis of ethanol exemplify the synergy of combined operational approaches. Because modular processes can be treated as a series of reactor elements, considerable flexibility is possible. As discussed, however, not all processes are amenable to this intensification.

09 BIOMASS FUELS↗
DOE OSTI2025

Bridging multimodal microscopy for advanced characterization on nuclear fuel using machine learning

Uranium dioxide (UO 2 ), widely used as driver fuel in light water reactors, experiences microstructure and property change by nuclear fission reactions. This paper bridges the characterization of fresh UO 2 fuel at different length scales, serving as a baseline for future post irradiation examination of irradiated UO 2 fuel. To characterize the microstructural change of nuclear fuel, modern approaches cover a wide range of length scales through different characterization techniques, such as mm scale for Synchrotron-based X-ray computed tomography (SXCT) and microscale for focused ion beam (FIB) and scanning electron microscopy (SEM). It is challenging to bridge the data and knowledge of the same sample in different length scales. This paper proposed a deep learning framework leveraging transfer learning to detect microstructural defects, trained from a sparse FIB, SEM, and SXCT images. The proposed model achieved superior performance in defect segmentation on multiscale microscopic data compared to four of the latest deep learning models.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Machine Learning-Enabled Correlation and Modeling of Multimodal Response of Thin Film to Environment on Macro and Nanoscale Using “Lab-on-a-Crystal”

To close the feedback loop between artificial intellegence-controlled materials synthesis and characterization, material functionality must be rapidly tested. A platform for high-throughput multifunctional materials characterization is developed using a quartz crystal microbalance with auxiliary in-plane electrodes and a custom gas/vapor flow cell, enabling simultaneous scanning probe microscopy and electrical, optical, gravimetric, and viscoelastic characterization on the same film under controlled environment. The lab-on-a-crystal in situ multifunctional output allows direct correlations between the gravimetric/viscoelastic, electrical, and optical responses of polymer film in response to environment. Finally, when multiple film properties are used to augment the training set for machine learning regression, prediction of material response to the environment improves by a factor of 13 when <5% of the total dataset is used for model training.

36 MATERIALS SCIENCE↗
DOE OSTI2020

Multiscale and Multimodal Characterization of 2D Titanium Carbonitride MXene

Here, a comprehensive study on the prototype solid solution phase carbonitride MXene Ti 3 CN is conducted using nuclear magnetic resonance, electron spin resonance, total and quasi-elastic neutron scattering, combined with density functional theory-based electronic structure and molecular dynamic calculations. The combination of experiment and theory lead toward rational atomic structural models of Ti 3 CN. The remnant Al ions from the etching process significantly tune the interlayer spacing, distinct from the more typical MXene, Ti 3 C 2 , prepared similarly. Neutron scattering indicates the surface terminations of Ti 3 CN display high oxygen and fluorine concentrations and rather low hydroxyl and hydrogen concentrations. Calculations show that the structure including both the residual Al ions and mixed surface terminations give the best agreement with the measurements. The water molecules in Ti 3 CN are highly immobile, in strong contrast to those in Ti 3 C 2 . The analysis of the electronic structure suggests that the nitride MXene displays higher conductivity than the carbides. Finally, the absence of hydroxyl groups in terminations, the solid-solution in the anion sites, the remnants within layers, and immobile water altogether make the carbonitrides a unique series in the MXene family, implying a further exploration of their exotic properties and applications in energy storage.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Direct Visualization of Charge Migration in Bilayer Tantalum Oxide Films by Multimodal Imaging

Inspired by biological neuromorphic computing, artificial neural networks based on crossbar arrays of bilayer tantalum oxide memristors have shown to be promising alternatives to conventional complementary metal-oxide-semiconductor (CMOS) architectures. In order to understand the driving mechanism in these oxide systems, tantalum oxide films are resistively switched by conductive atomic force microscopy (C-AFM), and subsequently imaged by kelvin probe force microscopy (KPFM) and spatially resolved time-of-flight secondary ion mass spectrometry (ToF-SIMS). These workflows enable induction and analysis of the resistive switching mechanism as well as control over the resistively switched region of the film. In this work it is shown that the resistive switching mechanism is driven by both current and electric field effects. Reversible oxygen motion is enabled by applying low (<1 V) electric fields, while high electric fields generate irreversible breakdown of the material (>1 V). Fully understanding oxygen motion and electrical effects in bilayer oxide memristor systems is a fundamental step toward the adoption of memristors as a neuromorphic computing technology.

36 MATERIALS SCIENCE↗
DOE OSTI2021

Multimodal 3D characterization of voids in shock-loaded tantalum: Implications for ductile spallation mechanisms

Predicting the failure of crystalline materials at high strain rates requires knowledge of the underlying failure mechanisms and their dependence on microstructure. However, little experimental consensus exists on the underlying micromechanics of spallation. In this study, a 3D-EBSD characterization experiment is performed on tantalum prior to and after partial spallation by plate impact, which allowed for the statistical assessment of the microstructural neighborhoods surrounding incipient voids. In analyzing the resulting dataset containing 5884 grains and 467 voids, it is observed that the voids were roughly spherical and consistent in size throughout the spalled material. The voids mostly resided at quadruple points, at triple junctions, at grain boundaries, and within grains, in decreasing order of prevalence. Moreover, voids tended to form at grain boundaries with high degrees of plastic incompatibility, growing into the plastically soft grain but orienting primarily with or perpendicular to the loading direction. Here, the statistics from these analyses of 3D microstructural data support dynamic cavitation models for ductile spallation.

36 MATERIALS SCIENCE↗
DOE OSTI2024

Multimodal 3D quantification of particle stimulated nucleation in industrially manufactured aluminium AA5182 sheet

Particle stimulated nucleation is a dominant recrystallisation mechanism observed in many industrially relevant aluminium alloys during thermomechanical processing. Here, in this work, we quantify particle stimulated nucleation in 3D in an aluminium AA5182 alloy sheet cold-rolled to 75% thickness reduction. Second phase particles and nuclei are mapped in the same sample volume by conventional laboratory absorption X-ray tomography and synchrotron X-ray Laue micro-diffraction. The large second phase particles are classified as Fe- and Mg-rich phases. It is found that 84% of the nuclei are particle stimulated and 40% of the particles stimulate nucleation. The critical particle diameter is found to be 4 μm. Deviatoric elastic strains are derived from micro-diffraction data and it is found that elastic strains are present in the recrystallised nuclei. The effects of the different particle types, particle clustering, particle size and aspect ratio as well as strain inheritance are discussed. This work provides a full 3D quantification of particle stimulated nucleation behaviour in AA5182 alloy sheet deformed to high strain.

Deviatoric strain↗
DOE OSTI2020

Multimodal imaging and machine learning to enhance microscope images of shale

A machine learning based image processing workflow is presented to enhance shale source rock microscopic images obtained using diverse imaging platforms. Images were acquired from a 30 μm diameter cylindrical Vaca Muerta shale sample using both nondestructive Transmission X-Ray Microscopy (TXM, alternately referred to as nano computed tomography) and destructive Focused Ion Beam-Scanning Electron Microscopy (FIB-SEM). Output cross-sectional images from each modality were aligned using a combination of manual and automated registration techniques to create a registered image dataset. We then apply this dataset for two image processing tasks: prediction of image cross sections with SEM-like resolution from nondestructive TXM data and repair of charged region artifacts (localized accumulation of electrons) within SEM images. The image processing algorithms for both tasks use deep learning models, specifically image-to-image Convolutional Neural Networks (CNNs) and conditional Generative Adversarial Networks (cGANs). In the image enhancement tasks, we are able to achieve significant qualitative and quantitative improvement in TXM images. Here, the best model reaches an average Peak Signal to Noise Ratio (PSNR) of 15.8 dB. Conditioning on TXM data is also shown to reduce artifacts from SEM charging, achieving an average PSNR of 25.8 dB. Furthermore, our results suggest that properly trained and validated networks are capable of significant enhancement of images obtained using nondestructive techniques, thereby improving interpretation of two- and three-dimensional images while preserving samples for future use.

58 GEOSCIENCES↗
DOE OSTI2021

Multimodal Bayesian registration of noisy functions using Hamiltonian Monte Carlo

Functional data registration is a necessary processing step for many applications. The observed data can be inherently noisy, often due to measurement error or natural process uncertainty; which most functional alignment methods cannot handle. A pair of functions can also have multiple optimal alignment solutions, which is not addressed in current literature. In this paper, a flexible Bayesian approach to functional alignment is presented, which appropriately accounts for noise in the data without any pre-smoothing required. Additionally, by running parallel MCMC chains, the method can account for multiple optimal alignments via the multi-modal posterior distribution of the warping functions. To most efficiently sample the warping functions, the approach relies on a modification of the standard Hamiltonian Monte Carlo to be well-defined on the infinite-dimensional Hilbert space. In this work, this flexible Bayesian alignment method is applied to both simulated data and real data sets to show its efficiency in handling noisy functions and successfully accounting for multiple optimal alignments in the posterior; characterizing the uncertainty surrounding the warping functions.

97 MATHEMATICS AND COMPUTING↗