Search NASA⌕ Search

SEARCH · Search NASA

Results for “multimodal data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 469 records · Page 26

Using Doppler spectra to separate hydrometeor populations and analyze ice precipitation in multilayered mixed-phase clouds

Multimodality of cloud radar Doppler spectra is used to partition cloud particle phases and to separate distinct ice populations in the radar sample volume, thereby facilitating analysis of individual ice showers in multilayered mixed-phase clouds. A 35-GHz cloud radar located at Barrow, Alaska, during the Mixed-Phase Arctic Cloud Experiment collected the Doppler spectra. Data from a pair of collocated depolarization lidars confirmed the presence of two liquid cloud layers reported in this study. Surprisingly, both of these cloud layers were embedded in ice precipitation yet maintained their liquid. Our spectral separation of the ice precipitation yielded two distinct ice populations: ice initiated within the two liquid cloud layers and ice precipitation formed in higher cloud layers. Comparisons of ice fall velocity versus radar reflectivity relationships derived for distinct showers reveal that a single relationship might not properly represent the ice showers during this period.

54 ENVIRONMENTAL SCIENCES↗

Bridging multimodal microscopy for advanced characterization on nuclear fuel using machine learning

Uranium dioxide (UO 2 ), widely used as driver fuel in light water reactors, experiences microstructure and property change by nuclear fission reactions. This paper bridges the characterization of fresh UO 2 fuel at different length scales, serving as a baseline for future post irradiation examination of irradiated UO 2 fuel. To characterize the microstructural change of nuclear fuel, modern approaches cover a wide range of length scales through different characterization techniques, such as mm scale for Synchrotron-based X-ray computed tomography (SXCT) and microscale for focused ion beam (FIB) and scanning electron microscopy (SEM). It is challenging to bridge the data and knowledge of the same sample in different length scales. This paper proposed a deep learning framework leveraging transfer learning to detect microstructural defects, trained from a sparse FIB, SEM, and SXCT images. The proposed model achieved superior performance in defect segmentation on multiscale microscopic data compared to four of the latest deep learning models.

36 MATERIALS SCIENCE↗

Disentangling the chemistry of Australian plant exudates from a unique historical collection

For thousands of years, the unique physicochemical properties of plant exudates have defined uses in material culture and practical applications. Native Australian plant exudates, including resins, kinos, and gums, have been used and continue to be used by Aboriginal Australians for numerous technical and cultural purposes. A historic collection of well-preserved native Australian plant exudates, assembled a century ago by plant naturalists, gives a rare window into the history and chemical composition of these materials. Here we report the full hierarchical characterization of four genera from this collection, Xanthorrhoea, Callitris, Eucalyptus, and Acacia, from the local elemental speciation, to functional groups and main molecular markers. We use high-resolution X-ray Raman spectroscopy (XRS) to achieve bulk-sensitive chemical speciation of these plant exudates, including insoluble, amorphous, and cross-linked fractions, without the limitation of invasive and/or surface specific methods. Combinatorial testing of the XRS data allows direct classification of these complex natural species as terpenoid, aromatic, phenolic, and polysaccharide materials. Differences in intragenera chemistry was evidenced by detailed interpretation of the XRS spectral features. We complement XRS with Fourier-transform infrared (FT-IR) spectroscopy, gas chromatography–mass spectrometry (GC-MS), and pyrolysis–GC-MS (Py-GC-MS). This multimodal approach provides a fundamental understanding of the chemistry of these natural materials long used by Aboriginal Australian peoples.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

A light intensity function suitable for multimode fiber-optic sensors

Intensity distribution functions on the image plane are derived under the assumption that a multimode optic fiber is illuminated by a light source which can be approximated by infinite uniangular beams carrying equal power. The application of the theory to a Lambertian source is discussed. Experimental results, based on the observation of the light intensity distribution imaged on an opaque screen and collected by a digital camera, are presented. The theoretical and experimental data are compared to verify that the intensity function is an accurate model for describing the realistic approach to sensor design. The limitations of the uniangular and uniform intensity distribution models are discussed on the basis of theoretical and experimental results.

He, Gang↗

Vision 20/20: Simultaneous CT-MRI — Next chapter of multimodality imaging

Multimodality imaging systems such as positron emission tomography-computed tomography (PET-CT) and MRI-PET are widely available, but a simultaneous CT-MRI instrument has not been developed. Synergies between independent modalities, e.g., CT, MRI, and PET/SPECT can be realized with image registration, but such postprocessing suffers from registration errors that can be avoided with synchronized data acquisition. The clinical potential of simultaneous CT-MRI is significant, especially in cardiovascular and oncologic applications where studies of the vulnerable plaque, response to cancer therapy, and kinetic and dynamic mechanisms of targeted agents are limited by current imaging technologies. The rationale, feasibility, and realization of simultaneous CT-MRI are described in this perspective paper. The enabling technologies include interior tomography, unique gantry designs, open magnet and RF sequences, and source and detector adaptation. Based on the experience with PET-CT, PET-MRI, and MRI-LINAC instrumentation where hardware innovation and performance optimization were instrumental to construct commercial systems, the authors provide top-level concepts for simultaneous CT-MRI to meet clinical requirements and new challenges. Simultaneous CT-MRI fills a major gap of modality coupling and represents a key step toward the so-called “omnitomography” defined as the integration of all relevant imaging modalities for systems biology and precision medicine.

60 APPLIED LIFE SCIENCES↗

Seeing is Believing: Autonomous Microscopy and the Data Revolution in Materials Science

This presentation explores the transformative potential of autonomous electron microscopy and artificial intelligence (AI) in accelerating materials science discovery, particularly for energy applications and materials operating in extreme environments. We discuss pioneering self-driving laboratories at NREL designed to intelligently probe material synthesis and degradation across multiple scales, aiming to rapidly bridge the gap between atomic-level understanding and the development of high-performance, reliable materials. Utilizing advanced machine learning techniques, such as few-shot learning and multimodal analysis integrating imaging and spectroscopy, we demonstrate methods to extract actionable descriptors for material behavior, quantify complex microstructural evolution, and statistically link synthesis parameters to defect populations. This AI-driven approach promises to accelerate the creation of predictive materials tailored for specific missions, enabling faster development cycles and enhanced material assurance.

36 MATERIALS SCIENCE↗

Seeing is Believing: Autonomous Microscopy and the Data Revolution in Materials Science

This presentation explores the transformative potential of autonomous electron microscopy and artificial intelligence (AI) in accelerating materials science discovery, particularly for energy applications and materials operating in extreme environments. We discuss pioneering self-driving laboratories at NREL designed to intelligently probe material synthesis and degradation across multiple scales, aiming to rapidly bridge the gap between atomic-level understanding and the development of high-performance, reliable materials. Utilizing advanced machine learning techniques, such as few-shot learning and multimodal analysis integrating imaging and spectroscopy, we demonstrate methods to extract actionable descriptors for material behavior, quantify complex microstructural evolution, and statistically link synthesis parameters to defect populations. This AI-driven approach promises to accelerate the creation of predictive materials tailored for specific missions, enabling faster development cycles and enhanced material assurance.

97 MATHEMATICS AND COMPUTING↗

Accelerating Markov Chain Monte Carlo sampling with diffusion models

Global fits of physics models require efficient methods for exploring high-dimensional and/or multimodal posterior functions. We introduce a novel method for accelerating Markov Chain Monte Carlo (MCMC) sampling by pairing a Metropolis-Hastings algorithm with a diffusion model that can draw global samples with the aim of approximating the posterior. We briefly review diffusion models in the context of image synthesis before providing a streamlined diffusion model tailored towards low-dimensional data arrays. We then present our adapted Metropolis-Hastings algorithm which combines local proposals with global proposals taken from a diffusion model that is regularly trained on the samples produced during the MCMC run. Our approach leads to a significant reduction in the number of likelihood evaluations required to obtain an accurate representation of the Bayesian posterior across several analytic functions, as well as for a physical example based on a global fit of parton distribution functions. Our method is extensible to other MCMC techniques, and we briefly compare our method to similar approaches based on normalising flows. A code implementation can be found at https://github.com/NickHunt-Smith/MCMC-diffusion.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Silica-core photonic bandgap fibres: Properties and a criterion for single-mode operation

We have studied the properties of silica-core photonic bandgap fibres with a small diameter to pitch ratio (no greater than 0.4) of high-index rods and small refractive-index difference (no greater than 0.03) in the cladding. Theoretical analysis and experimental data demonstrate that the number of core modes depends only on the number of pure-silica elements that form the core and is independent of cladding parameters. If there is one such element, only one dispersion curve of a core mode falls in the fundamental bandgap and the fibre is single-mode. The fibres having seven such elements are multimode. (fibre optics)

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

30 cm Drop Modeling

This report documents modeling and analysis of the 30 cm cask drop scenario for spent nuclear fuel (SNF) casks. The 30 cm drop is an important hypothetical dynamic loading scenario for SNF because 10 CFR 71.71 defines testing requirements for normal conditions of transport (NCT) of SNF packages, and free drop (of 30 cm for the heaviest packages) tests are required. Other NCT conditions specified in 10 CFR 71.71 include vibration normally incident to transport, and DOE’s multimodal transportation test (MMTT) and related analysis concluded that mechanical shock and vibration incident to transportation is negligible for SNF structural integrity because the loads are so small. The SNF cask 30 cm drop has a lot more potential to cause damage to SNF because the kinetic energy and momentum of the system is stopped abruptly during the cask impact event. Test data and model predictions both agree that the SNF assemblies are subjected to significantly higher loads in a cask drop event than normal transportation shock and vibration, but currently there is no reason to expect gross structural damage of the fuel assembly or widespread SNF cladding failure as a result of a 30 cm cask drop. The ultimate goal of this work is to close the knowledge gap of stress profiles on SNF rods and fuel assembly components during NCT, and this report describes the progress toward reaching that goal as well as a plan for finishing this work over the next year or two. Key remaining tasks include refining the fuel assembly model, calculating a selection of specific fuel assembly cases to populate the damage model, and finally running the damage model to predict the full general response range of 30 cm drop loads on SNF.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Predicting and Controlling Corrosion (Abbreviated Final Report)

Corrosion accumulates significant replacement costs in the transportation, utility, manufacturing, and infrastructure sectors. It also underpins several of LLNL’s core missions in stockpile stewardship, defense, and energy security. Whereas most corrosion and aging models are empirically parameterized to describe well-defined conditions late in the reaction, the factors that determine the early stages of corrosion—during which mitigation could be most impactful— are poorly understood. This project addressed the critical need for new approaches to predict the kinetics of corrosion initiation based on firm physical and chemical understanding. The activities encompassed degradation of relevant metals in both hydrogen-rich and environmental corrosion scenarios. The team integrated state-of-the-art multiscale simulation, in situ characterization, and data science within three technical thrusts: hydriding of Ti alloys; aqueous corrosion of Al and Ni-Cr alloys; and degradation of additively manufactured 316L stainless steel. In each case, novel capabilities were developed to identify and track the impacts of key atomistic, compositional, and microstructural features on the metal systems. For hydriding, protocols were developed to tightly integrate multiscale models, advanced multimodal characterization, and machine learning to determine how hydrogen interacts with native passivating surface oxides and nucleates new undesired phases, shedding new light on the critical role of grain boundaries, interfaces, and atomically disordered regions. For aqueous corrosion, the project demonstrated methods to predict dissolution rates of metal surfaces in corrosive solutions, to measure and understand microstructural and grain orientation effects on corrosion susceptibility, and to investigate competing growth and dissolution kinetics of surface oxides. For additively manufactured metals, analysis using state-of-the-art microscopy techniques revealed the role of specific heterogeneities invoked during laser processing, including cellular structure, dislocations, and precipitates, on corrosion susceptibility. In addition to new capabilities and understanding, the project provided an avenue for workforce development, as well as key partnerships with stakeholders in corrosion science.

08 HYDROGEN↗

Multimodality stereotactic brain tissue identification: the NASA smart probe project

Real-time tissue identification can benefit procedures such as stereotactic brain biopsy, functional neurosurgery and brain tumor excision. Optical scattering spectroscopy has been shown to be effective at discriminating cancer from noncancerous conditions in the colon, bladder and breast. The NASA Smart Probe extends the concept of 'optical biopsy' by using neural network techniques to combine the output from 3 microsensors contained within a cannula 2. 7 mm in diameter (i.e. the diameter of a stereotactic brain biopsy needle). Experimental data from 5 rats show the clear differentiation between tissues such as brain, nerve, fat, artery and muscle that can be achieved with optical scattering spectroscopy alone. These data and previous findings with other modalities such as (1) analysis of the image from a fiberoptic neuroendoscope and (2) the output from a microstrain gauge suggest the Smart Probe multiple microsensor technique shows promise for real-time tissue identification in neurosurgical procedures. Copyright 2000 S. Karger AG, Basel.

Non-programmatic↗

Co-registered Topographical, Band Excitation Nanomechanical, and Mass Spectral Imaging Using a Combined Atomic Force Microscopy/Mass Spectrometry Platform

The advancement of a hybrid atomic force microscopy/mass spectrometry imaging platform demonstrating for the first time co-registered topographical, band excitation nanomechanical, and mass spectral imaging of a surface using a single instrument is reported. The mass spectrometry-based chemical imaging component of the system utilized nanothermal analysis probes for pyrolytic surface sampling followed by atmospheric pressure chemical ionization of the gas phase species produced with subsequent mass analysis. We discuss the basic instrumental setup and operation and the multimodal imaging capability and utility are demonstrated using a phase separated polystyrene/poly(2-vinylpyridine) polymer blend thin film. The topography and band excitation images showed that the valley and plateau regions of the thin film surface were comprised primarily of one of the two polymers in the blend with the mass spectral chemical image used to definitively identify the polymers at the different locations. Data point pixel size for the topography (390 nm x 390 nm), band excitation (781 nm x 781 nm), mass spectrometry (690 nm x 500 nm) images was comparable and submicrometer in all three cases, but the data voxel size for each of the three images was dramatically different. The topography image was uniquely a surface measurement, whereas the band excitation image included information from an estimated 10 nm deep into the sample and the mass spectral image from 110-140 nm in depth. Moreover, because of this dramatic sampling depth variance, some differences in the band excitation and mass spectrometry chemical images were observed and were interpreted to indicate the presence of a buried interface in the sample. The spatial resolution of the mass spectral image was estimated to be between 1.5 m 2.6 m, based on the ability to distinguish surface features in that image that were also observed in the other images.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Test–retest repeatability of myocardial oxidative metabolism and efficiency using standalone dynamic {sup 11}C-acetate PET and multimodality approaches in healthy controls

Background: Myocardial efficiency measured by {sup 11}C-acetate positron emission tomography (PET) has successfully been used in clinical research to quantify mechanoenergetic coupling. The objective of this study was to establish the repeatability of myocardial external efficiency (MEE) and work metabolic index (WMI) by non-invasive concepts. Methods and Results: Ten healthy volunteers (63 ± 4 years) were examined twice, one week apart, using {sup 11}C-acetate PET, cardiovascular magnetic resonance (CMR), and echocardiography. Myocardial oxygen consumption from PET was combined with stroke work data from CMR, echocardiography, or PET to obtain MEE and WMI for each modality. Repeatability was estimated as the coefficient of variation (CV) between test and retest. MEE{sub CMR}, MEE{sub Echo}, and MEE{sub PET} values were 21.9 ± 2.7%, 16.4 ± 3.7%, and 23.8 ± 4.9%, respectively, P < .001. WMI{sub CMR}, WMI{sub Echo}, and WMI{sub PET} values were 4.42 ± 0.90, 4.07 ± 0.63, and 4.58 ± 1.13 mmHg × mL/m{sup 2} × 10{sup 6}, respectively, P = .45. Repeatability for MEE{sub CMR} was superior compared with MEE{sub Echo} but did not differ significantly compared with MEE{sub PET} (6.3% vs 12.9% and 9.4%, P = .04 and .25). CV values for WMI{sub CMR}, WMI{sub Echo}, and WMI{sub PET} were 10.0%, 14.8%, and 12.0%, respectively, (P = .53). Conclusions: Non-invasive measurements of MEE using {sup 11}C-acetate PET are highly repeatable. A PET-only approach did not differ significantly from CMR/PET and might facilitate further clinical research due to lower costs and broader applicability.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Elucidating a dissolution–deposition reaction mechanism by multimodal synchrotron X-ray characterization in aqueous Zn/MnO 2 batteries

Aqueous Zn/MnO 2 batteries with their environmental sustainability and competitive cost, are becoming a promising, safe alternative for grid-scale electrochemical energy storage. Here, presented as a promising design principle to deliver a higher theoretical capacity, this work offers fundamental understanding of the dissolution–deposition mechanism of Zn/β-MnO 2 . A multimodal synchrotron characterization approach including three operando X-ray techniques (powder diffraction, absorption spectroscopy, and fluorescence microscopy) is coupled with elementally resolved synchrotron X-ray nano-tomography. Together they provide a direct correlation between structural evolution, reaction chemistry, and 3D morphological changes. Operando synchrotron X-ray diffraction and spectroscopy show a crystalline-to-amorphous phase transition. Quantitative modeling of the operando data by Rietveld refinement for X-ray diffraction and multivariate curve resolution (MCR) for X-ray absorption spectroscopy are used in a complementary fashion to track the structural and chemical transitions of both the long-range (crystalline phases) and short-range (including amorphous phases) ordering upon cycling. Scanning X-ray microscopy and full-field nano-tomography visualizes the morphology of electrodes at different electrochemical states with elemental sensitivity to spatially resolve the formation of the Zn- and Mn-containing phases. Overall, this work critically indicates that for Zn/MnO 2 aqueous batteries, the reaction pathways involving Zn–Mn complex formation upon cycling become independent of the polymorphs of the initial electrode and sheds light on the interplay among structural, chemical, and morphological evolution for electrochemically driven phase transitions.

36 MATERIALS SCIENCE↗

Capturing dynamics on multiple timescales: a hybrid approach for cluttered electromagnetic data

Many problems in electromagnetic signal analysis exhibit dynamics on a wide range of time scales against nonstationary clutter and noise. We consider a problem in which the relevant time scales can range from nanoseconds to hours or days (12 or 13 orders of magnitude). We present a hybrid algorithm currently designed to capture the dynamic behavior at scales from nanoseconds to milliseconds (6 orders of magnitude) while remaining robust to clutter and noise. We draw from techniques of adaptive feature extraction, statistical machine learning, and discrete process modeling and present results on a simulated multimode problem. Our goals are to find a representation of the signal that allows us to identify which pulses were produced by a target emitter and to determine the operational mode of the target.

97 MATHEMATICS AND COMPUTING↗

Resilient information and inference networks under mixed-trust sensing

With ubiquitous digitization, sensing, and computational intelligence deployed in increasingly more and broader domains, including critical infrastructure, potentially misleading and destabilizing effects of multimodal anomalies and adversarial behavior are growing in importance. Here, we develop randomized and reinforcement learning-based strategies for strategically recruiting and utilizing deployed (and, thus, vulnerable and potentially faulty and/or compromised) nodes from information and inference networks, while defending against adversaries that attempt to misguide assessments of inferred variables. Recognizing that, besides communication and other costs, sampling from any observable node can either provide true data or dangerously expose our inference to misinformation (without being easily distinguishable what actually happens), the proposed strategies proceed by progressively recruiting nodes and cautiously scaling their information contribution based on assumed, or, in our reinforcement learning approach, intelligently weighed trustworthiness, with the learning approach also considering network-wide, threat-inclusive risk/value tradeoffs. While avoiding the hardware, communication, analytical and computational burden of explicit redundancy, the proposed defensive schemes enable on-the-fly assessments of underlying processes, and system-wide situational awareness with demonstrable resilience against adversarial activities.

97 - MATHEMATICS AND COMPUTING↗

Augmented cognition tool for rapid military decision making.

This report describes the laboratory directed research and development work to model relevant areas of the brain that associate multi-modal information for long-term storage for the purpose of creating a more effective, and more automated, association mechanism to support rapid decision making. Using the biology and functionality of the hippocampus as an analogy or inspiration, we have developed an artificial neural network architecture to associate k-tuples (paired associates) of multimodal input records. The architecture is composed of coupled unimodal self-organizing neural modules that learn generalizations of unimodal components of the input record. Cross modal associations, stored as a higher-order tensor, are learned incrementally as these generalizations form. Graph algorithms are then applied to the tensor to extract multi-modal association networks formed during learning. Doing so yields a novel approach to data mining for knowledge discovery. This report describes the neurobiological inspiration, architecture, and operational characteristics of our model, and also provides a real world terrorist network example to illustrate the model's functionality.

99 GENERAL AND MISCELLANEOUS↗