Search NASA⌕ Search

SEARCH · Search NASA

Results for “Multimodal analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

A Dynamic Hierarchical Attention Framework for Multimodal Malware Detection

The increasing use of Android in the worldwide mobile ecosystem has come along with a significant increase in advanced malware, highlighting the critical necessity for efficient, scalable, and adaptable detection systems. Despite recent advancements in machine learning improving malware detection, the majority of current solutions are limited to one, two, or three data modalities, hence neglecting the comprehensive behavioral spectrum of contemporary multi-vector threats. This thesis presents the first comprehensive multimodal framework for Android malware detection, which combines textual, time-series (temporal), graph-based (structural), and visual information using an innovative hierarchical attention mechanism and Dynamic Fusion Controller (DFC). Our methodology consistently classifies and processes modalities as either sequential or structural, facilitating content-adaptive weighting and resilient cross-modal representation learning. We advance the implementation of cutting-edge time series techniques, such as MiniRocket, for malware detection, hence creating new opportunities for temporal analysis in cybersecurity. Comprehensive experimental assessment shows that our framework performs exceptionally well, with 99.46% classification accuracy and 97.15% detection accuracy, significantly outperforming existing approaches through effective multimodal integration and hierarchical attention mechanisms.

Nazmin, Tamanna↗

Molecular Imaging of Microbially Induced Corrosion of Synthetic Archeological Glasses by a Rhizosphere Bacterium

Microbially induced corrosion (MIC) focuses on the degradation of solid materials, such as glass or metal. Soil microbes are often associated with the corrosion of foreign objects in the rhizosphere. Paenibacillus polymyxa SCE2, a facultative anaerobic bacterium in soil, is of the same genus as bacteria found near nuclear waste disposal sites. Time-of-flight secondary ion mass spectrometry (ToF-SIMS) was used for imaging surface changes induced by P. polymyxa SCE2 cultured on two synthetic glass coupons to represent natural analogs of materials that were studied in relation to the vitrification of nuclear waste. Multimodal imaging was used to verify bacterial coverage across the glass surface after long-term growth. ToF-SIMS spectral analysis showed detection of glass component ions, such as silicon oxide (m/z – 59.96 SiO 2 – ) and aluminum oxide (m/z – 101.95 Al 2 O 3 – ), and biofilm’s extracellular polymeric substance (EPS) components, such as pentadecanoic acid (m/z – 241.22 C 15 H 29 O 2 – ) and sterol lipids (m/z – 311.16 C 20 H 23 O 3 – ). ToF-SIMS spectral, imaging, and depth profiling analyses showed that the glass rich in silica and other light elements (“granite glass”) had more “corrosion related” peaks than the glass that was less silica-rich and contained more iron (“dike glass”). Furthermore, these surface and interface compositional and spatial differences observed in the mass spectra and imaging were attributed to bacterial metabolism and an electron transfer mechanism influenced by morphological and compositional differences between the two types of glasses. ToF-SIMS is effective in studying microbial effects, bringing new molecular insights into MIC in a broader context of materials degradation.

Amorphous materials↗

The cardiac molecular setting of metabolic syndrome in pigs reveals disease susceptibility and suggests mechanisms that exacerbate COVID-19 outcomes in patients

Abstract Although metabolic syndrome (MetS) is linked to an elevated risk of cardiovascular disease (CVD), the cardiac-specific risk mechanism is unknown. Obesity, hypertension, and diabetes (all MetS components) are the most common form of CVD and represent risk factors for worse COVID-19 outcomes compared to their non MetS peers. Here, we use obese Yorkshire pigs as a highly relevant animal model of human MetS, where pigs develop the hallmarks of human MetS and reproducibly mimics the myocardial pathophysiology in patients. Myocardium-specific mass spectroscopy-derived metabolomics, proteomics, and transcriptomics enabled the identity and quality of proteins and metabolites to be investigated in the myocardium to greater depth. Myocardium-specific deregulation of pro-inflammatory markers, propensity for arterial thrombosis, and platelet aggregation was revealed by computational analysis of differentially enriched pathways between MetS and control animals. While key components of the complement pathway and the immune response to viruses are under expressed, key N6-methyladenosin RNA methylation enzymes are largely overexpressed in MetS. Blood tests do not capture the entirety of metabolic changes that the myocardium undergoes, making this analysis of greater value than blood component analysis alone. Our findings create data associations to further characterize the MetS myocardium and disease vulnerability, emphasize the need for a multimodal therapeutic approach, and suggests a mechanism for observed worse outcomes in MetS patients with COVID-19 comorbidity.

60 APPLIED LIFE SCIENCES↗

Microstructure Evolution of a Multimodal Gamma-Prime Ni-Based Superalloy Characterized by In Situ Diffraction

The relationship between the evolution of microstructure, deformation micromechanisms and mechanical properties is difficult to establish in multimodal size distribution $_γ$$'$ superalloys, as the microstructure evolves with both temperature and time, and multiple strengthening mechanisms across each size distribution contribute to mechanical performance. In situ X-ray scattering can offer unparalleled insight regarding microstructure evolution at the temperatures and stresses of importance to gas-turbine applications; however, in situ X-ray diffraction has not been applied to the study of multimodal $_γ$$'$ distribution superalloys. Herein, lattice parameter evolution of secondary and tertiary $_γ$$'$ precipitates in a representative superalloy, Nimonic 115, is determined between 750 °C and 950 °C and correlated to room-temperature SEM and microhardness values. A large positive lattice parameter misfit of secondary $_γ$$'$ induces precipitate splitting, and the tertiary $_γ$$'$ goes into dissolution at ~ 800 °C, but with little apparent change in hardness values. The volume fraction of $_γ$$'$ decreases above 900 °C and precipitate-matrix coherency is lost, and there is a corresponding decrease in microhardness values. Importantly, the diffraction analysis demonstrates the capability to determine critical microstructural parameters of both precipitate size distributions in situ, representing an additional tool for determining microstructure-mechanical property relationships of multimodal superalloys.

36 MATERIALS SCIENCE↗

Real time quantitative imaging for semiconductor crystal growth, control and characterization

A quantitative real time image processing system has been developed which can be software-reconfigured for semiconductor processing and characterization tasks. In thermal imager mode, 2D temperature distributions of semiconductor melt surfaces (900-1600 C) can be obtained with temperature and spatial resolutions better than 0.5 C and 0.5 mm, respectively, as demonstrated by analysis of melt surface thermal distributions. Temporal and spatial image processing techniques and multitasking computational capabilities convert such thermal imaging into a multimode sensor for crystal growth control. A second configuration of the image processing engine in conjunction with bright and dark field transmission optics is used to nonintrusively determine the microdistribution of free charge carriers and submicron sized crystalline defects in semiconductors. The IR absorption characteristics of wafers are determined with 10-micron spatial resolution and, after calibration, are converted into charge carrier density.

Wargo, Michael J.↗

Dynamic Anomaly Response and Integrated Analysis (DARIA): A Fault Investigation Toolset Supporting Earth-Independent Operations in Future Crewed Mars Missions

NASA's Moon to Mars Objectives outline a strategic vision for human spaceflight culminating in crewed missions to Mars. A critical component of this objective is the development of systems that are capable of being Earth-Independent Operated (EIO). A key aspect of EIO is the ability to rapidly detect, diagnose, and respond to anomalies in crew-supporting habitat and connected systems. To address this, the Dynamic Anomaly Response and Integrated Analysis (DARIA) architecture has been developed. DARIA incorporates a network of compact, wireless sensing devices called the System for Telemetry Amalgamation of Multimodal PrognosticS (STAMPS) for increased state awareness of EIO habitats. Able to perform on-the-fly data acquisition, STAMPS are connected to integrated anomaly data dashboards for crew visualization. DARIA is designed to seamlessly integrate into various off-world environments, including the International Space Station, Lunar Gateway, Artemis Base Camp, and future Mars habitats. By leveraging Commercial Off-The-Shelf (COTS) hardware, the NASA Internet of Things (NASA IoT) framework, and EIO fault detection methods, DARIA provides a cost-effective and adaptable solution for anomaly detection and response in EIO habitats.

Diagnostics↗

Multimodal CO2 Transportation Cost Model

This model provides a cost estimate for transporting CO2 via truck or rail in the United States using commercially available equipment and technologies. The model includes an analysis of direct and indirect CO2 emissions to determine costs per net tonne of CO2 transported. Publicly available data and methods published in the peer-reviewed literature are used to the extent possible; references are available at the bottom of the "Calculations" sheet. Upstream (i.e., liquefaction, buffer storage) and downstream (i.e., buffer storage, reconditioning) activities are included in the model of emissions and costs. All capital and operating expenditures are estimated in the "Calculations" sheet. The cost of financing the project is determined in the "FINEX" sheet. All user inputs are done via drop down menus in on the "User Interface" sheet. Summary results are also provided on the "User Interface" sheet.

Myers, CoreyA↗

Identification of Blue Horizontal Branch Stars with Multimodal Fusion

Blue Horizontal Branch stars (BHBs) are ideal tracers to probe the global structure of the milky Way (MW), and the increased size of the BHB star sample could be helpful to accurately calculate the MW's enclosed mass and kinematics. Large survey telescopes have produced an increasing number of astronomical images and spectra. However, traditional methods of identifying BHBs are limited in dealing with the large scale of astronomical data. A fast and efficient way of identifying BHBs can provide a more significant sample for further analysis and research. Therefore, in order to fully use the various data observed and further improve the identification accuracy of BHBs, we have innovatively proposed and implemented a Bi-level attention mechanism-based Transformer multimodal fusion model, called Bi-level Attention in the Transformer with Multimodality (BATMM). The model consists of a spectrum encoder, an image encoder, and a Transformer multimodal fusion module. The Transformer enables the effective fusion of data from two modalities, namely image and spectrum, by using the proposed Bi-level attention mechanism, including cross-attention and self-attention. As a result, the information from the different modalities complements each other, thus improving the accuracy of the identification of BHBs. The experimental results show that the F1 score of the proposed BATMM is 94.78%, which is 21.77% and 2.76% higher than the image and spectral unimodality, respectively. It is therefore demonstrated that higher identification accuracy of BHBs can be achieved by means of using data from multiple modalities and employing an efficient data fusion strategy.

79 ASTRONOMY AND ASTROPHYSICS↗

Micromobility Integrated Transit and Infrastructure for Efficiency (MITIE)

Nearly omnipresent in many cities of all sizes across the United States, micromobility vehicles-e-scooters, manual bicycles, e-bicycles, and larger seated electric scooters-are notably missing from SMART Mobility research. This project aims to expand the spectrum of modes currently being researched within SMART Mobility by exploring micromobility as an important tool toward meeting energy-efficient mobility goals. It expands on findings from SMART Mobility 1.0 that revealed preferences to reduce transportation-related expenses through use of a network of mobility-as-a-service (MaaS) and other shared mobility options, and builds on findings from a 2019 Vehicle Technology Analysis Program (VTAP) funded micromobility project conducted by our team. We will explore multiple facets of micromobility, including behavior and decision-making, the integration of micromobility within transportation infrastructure, energy estimates, and operations. Guiding research questions include: (1) What are the potential energy savings from low, medium, and high market penetration of micromobility (in passenger, multimodal, and freight domains)? (2) Which scenarios for micromobility use and related enablement of increased public transit use should be modeled/considered in the SMART 2.0 Workflow? (3) To what degree can micromobility supplement/complement transit system operations? (4) What are people's preferences towards micromobility? How do preferences vary across various sociodemographic segments? How can this knowledge inform operations? (5) What are optimal strategies to attain high user adoption and shift users toward more energy-efficient mode choices in terms of micromobility operation? How do these strategies affect energy savings, person-miles traveled, lifecycle energy use, and adoption rates? These questions will be addressed through applied research in five project emphasis areas: (1) Energy estimates of micromobility for Workflow scenarios: Expand and refine previous micromobility work to augment the Workflow approaches to modeling urban travel. (2) Multimodal connection with transit: Utilizing Mobility-Energy Productivity (MEP) tools to evaluate multimodal travel patterns enabled by micromobility, including assessing how to reduce barriers of inequity of access to mobility options and destinations. (3) Mode choice, induced demand, and infrastructure: Understanding the mode shift induced through micromobility to inform energy impact analysis. (4) Energy optimization of micromobility operations: Identification of micromobility operations parameters and development of operations scenarios to better understand present-day micromobility operations for integration into the Workflow, in partnership with BEAM and POLARIS modeling teams. (5) Micro-freight: Characterize the current state of micro-freight activities, including energy effects and geospatial analyses, to inform Workflow.

ADVANCED PROPULSION SYSTEMS,POWER TRANSMISSION AND↗

Micromobility Integrated Transit and Infrastructure for Efficiency (MITIE)

Nearly omnipresent in many cities of all sizes across the United States, micromobility vehicles-e-scooters, manual bicycles, e-bicycles, and larger seated electric scooters-are notably missing from SMART Mobility research. This project aims to expand the spectrum of modes currently being researched within SMART Mobility by exploring micromobility as an important tool toward meeting energy-efficient mobility goals. It expands on findings from SMART Mobility 1.0 that revealed preferences to reduce transportation-related expenses through use of a network of mobility-as-a-service (MaaS) and other shared mobility options, and builds on findings from a 2019 Vehicle Technology Analysis Program (VTAP) funded micromobility project conducted by our team. We will explore multiple facets of micromobility, including behavior and decision-making, the integration of micromobility within transportation infrastructure, energy estimates, and operations. Guiding research questions include: 1) what are the potential energy savings from low, medium, and high market penetration of micromobility (in passenger, multimodal, and freight domains)? 2) which scenarios for micromobility use and related enablement of increased public transit use should be modeled/considered in the SMART 2.0 Workflow? 3) to what degree can micromobility supplement/complement transit system operations? 4) what are people's preferences towards micromobility? How do preferences vary across various sociodemographic segments? How can this knowledge inform operations? 5) what are optimal strategies to attain high user adoption and shift users toward more energy-efficient mode choices in terms of micromobility operation? How do these strategies affect energy savings, person-miles traveled, lifecycle energy use, and adoption rates? These questions will be addressed through applied research in five project emphasis areas: 1) energy estimates of micromobility for Workflow scenarios: Expand and refine previous micromobility work to augment the Workflow approaches to modeling urban travel; 2) multimodal connection with transit: Utilizing Mobility-Energy Productivity (MEP) tools to evaluate multimodal travel patterns enabled by micromobility, including assessing how to reduce barriers of inequity of access to mobility options and destinations; 3) mode choice, induced demand, and infrastructure: Understanding the mode shift induced through micromobility to inform energy impact analysis; 4) energy optimization of micromobility operations: Identification of micromobility operations parameters and development of operations scenarios to better understand present-day micromobility operations for integration into the Workflow, in partnership with BEAM and POLARIS modeling teams; 5) micro-freight: Characterize the current state of micro-freight activities, including energy effects and geospatial analyses, to inform Workflow.

ADVANCED PROPULSION SYSTEMS↗

Accelerated Stress Testing of Perovskite Photovoltaic Modules: Differentiating Degradation Modes with Electroluminescence Imaging

Herein, electroluminescence (EL) and thermal imaging are used to examine p–i–n metal halide perovskite (MHP) photovoltaic (PV) mini-modules (MA0.6FA0.4PbI3, 20 cells, 78 cm2) before and after indoor-accelerated stress testing or outdoor deployment. Distinct spatial patterns in the EL images emerge, which depend on the external stress conditions experienced by the mini-module. Imaging results highlight a distribution of dark speckle features that dominate after UV stress, attributed to widespread interfacial contact degradation. Lateral intensity gradients across cells dominate after thermal cycling (TC) stress, attributed to current crowding near scribe defects. While current–voltage analysis alone does not give full insight on the degradation process, this study shows that distinct degradation modes can be further defined by multimodal electro-optical imaging (i.e., EL combined with photoluminescence and dark lock-in thermography). Neither UV exposure nor TC-accelerated stress testing alone replicates the same degradation signatures observed after outdoor deployment, suggesting that multiple degradation modes occur under concurrent stressors outdoors. Finally, spatial characterization of degradation modes in MHP PV mini-modules before and after accelerated stress testing lays the groundwork for developing targeted accelerated stress testing procedures through comparison with outdoor aging.

14 SOLAR ENERGY↗

Achieving Multimodal and Multicolor Luminescence in LaAlO 3 :Pr 3+ , Gd 3+ via Trap Engineering and Energy Transfer

Achieving multimodal luminescence within a single phosphor is vital for multifunctional applications but remains challenging due to complex color tuning and trap engineering. In this study, we report Pr 3+ and Gd 3+ co‐doped LaAlO 3 (LAO:PG) phosphors, designed through careful modulation of multilevel traps and Pr 3+ → Gd 3+ energy transfer dynamics. These materials exhibit diverse luminescence modes, including down‐conversion luminescence (DCL), up‐conversion luminescence (UCL), persistent luminescence (PersL), optically stimulated luminescence (OSL), and thermally stimulated luminescence (TSL) across a wide spectral range. Unlike previously studied Pr 3+ ‐doped LAO, the co‐doped LAO:PG shows DCL in both UV‐visible and NIR regions and displays ultraviolet‐C UCL under visible excitation. Notably, we observe, for the first time, PersL lasting several minutes in these phosphors—an improvement over the non‐PersL behavior of Pr 3+ ‐only doped LAO. Additionally, the LAO:PG phosphors exhibit strong OSL response. TSL analysis reveals five distinct trap levels linked to these properties. Density functional theory calculations further correlate intrinsic defects to these traps, supporting a proposed mechanism for the observed multimodal luminescence. These findings highlight LAO:PG as a promising platform for developing advanced phosphors with integrated luminescence modes, paving the way for future applications in data storage, phototherapy, and anti‐counterfeiting technologies.

Chemistry↗

Surface Nanostructure Control and Thermodynamic Stability Analysis of Femtosecond Laser-Ablated CuCoMn 1.75 NiFe 0.25 Nanoparticles

Surface nanostructure control is the key to functionalizing nanomaterials. This paper presents a characterization with thermodynamic stability analysis of CuCoMn 1.75 NiFe 0.25 high-entropy alloy (HEA) nanoparticles synthesized by femtosecond laser ablation in ethanol and liquid nitrogen (LN2). Using multimodal electron microscopy and spectroscopy, we examine phase, particle size, defect structure, chemical distribution, and surface composition and relate them to HEA stability. Elemental distributions are uniform in both media, but LN2 produces smaller particles with a narrower size distribution and mainly single- or few-domain interiors, whereas ethanol yields larger particles built from 2–4 nm crystallites with domain aggregation. Edge defects appear in both but energy-dispersive X-ray spectroscopy (EDS) is broadly uniform with local fluctuations in ethanol. X-ray photoelectron spectroscopy (XPS), supported by an attenuation model, indicates an ∼1 nm oxide overlayer that suppresses Mn 2p intensity; correcting for it returns Mn toward the bulk value. UV–NIR and photoluminescent spectra independently support a thin oxide shell. Composition-based thermodynamic descriptors place LN2 closer to bulk mixing parameters, while ethanol raises ΔH_mix and lowers Ω. Cooling simulations are consistent (LN2 ∼ 0.1 μs quench, ethanol ∼1 μs). In conclusion, these results connect solvent-controlled kinetics and thermodynamics to crystalline state and surface chemistry, informing surface control of HEA nanoparticles.

Femtosecond Laser Ablation↗

Asteroseismology of White Dwarf Stars

The primary purpose of this investigation has been to study various aspects of multimode pulsations in variable white dwarfs. In particular, nonlinear interactions among pulsation modes in white dwarfs (and, to some extent, in other variable stars), analysis of recent observations where such interactions are important, and preliminary work on the effects of crystallization in cool white dwarfs are reported.

Hansen, Carl J.↗

Heterogeneous microstructure of yttrium hydride and its relation to mechanical properties

Here, the goal of this study is to investigate the properties of yttrium hydride materials in relation to the microstructure, especially its homogeneity. High-throughput nanoindentation mapping was used to evaluate hardness distribution. Raman spectral imaging demonstrated its sensitivity to the presence of YH2 and impurities. Raman peak position maps were correlated with residual stress in the specimens. Electron backscatter diffraction mapping provided phase distributions with correlation to high-energy X-ray diffraction analysis. The experimental mapping data were combined and analyzed using unsupervised machine learning cluster procedures. The machine learning analysis revealed that yttrium hydride specimens contained a major δ-YH2 – x phase component and minor α-Y and δ-YH2 – x components with significant residual stress. The minor phase fraction decreased with increasing nominal H/Y ratio, which affected the nanoindentation and Vickers hardness. The multimodal mapping procedures described herein affect developing important microstructure–property relationships, as well as correlations in heterogeneity and mechanical properties.

36 MATERIALS SCIENCE↗

Aerosol Composition, Mixing State, and Phase State of Free Tropospheric Particles and Their Role in Ice Cloud Formation

The prediction of ice cloud formation in the atmosphere remains challenging. Free tropospheric aerosols can act as ice nucleating particles (INPs), affecting cloud properties and precipitation. The physicochemical properties of free tropospheric particles are modified upon long-range transport by different atmospheric processes. These modifications affect the ice formation potential of individual particles. We investigated free tropospheric particles collected at the remote Pico Mountain Observatory at 2225m a.s.l. in the North Atlantic Ocean using multimodal microspectroscopy and chemical imaging techniques. We probed their ice nucleation activity using an ice nucleation stage interfaced with an environmental scanning electron microscope. Retroplume analysis, chemical imaging, and micro-spectroscopy analysis indicated that the size-resolved chemical composition, mixing state, and phase state of the articles with similar aging times but different transport patterns were substantially different. Relative humidity-dependent glass transition temperatures estimated from meteorological conditions were consistent with the observed organic component of the particles' phase. More viscous (solid and semi-solid-like) particles are more ice active in deposition mode at temperature ranging from 205-220 K than those less viscous particles. Finally, this study provides a better understanding of the phase and mixing state of long range transported free tropospheric aerosols and their role in ice cloud formation.

54 ENVIRONMENTAL SCIENCES↗

Vehicle Automation Benefits and Challenges for Passenger Transport System Beyond Automated Driving

The National Renewable Energy Laboratory has been researching the implementation of fully automated passenger transport systems to be operated within dense urban settings, referred to as Automated Mobility Districts, based on roadway vehicle automation as opposed to track or train-based automation. This research, now in its third phase, is presently addressing the full spectrum of benefits and challenges of full automation of passenger transport systems with respect to fleet electrification and the associated multimodal, large fleet operational management, benefits beyond simply automating the driving tasks. The focal points summarized in the paper and presentation address the benefit-analysis of fleet automation to address added complexities imposed on the multi-fleet operational management when there is a simultaneous implementation of an on-demand service mode that connects with and optimizes the effectiveness of legacy transit systems and new sub-regional autonomous vehicle fleets, with specific emphasis on enhanced ability to better meet peak ridership demand. The research also begins to address challenges in operations arising from lack of personnel present to handle unexpected customer and system needs. Combined, this research articulates vehicle automation benefits and challenges beyond simply automating the driving tasks, addressing additional operational benefits automation provides to address the added complexities imposed by electrification and on-demand modes of operation.

33 ADVANCED PROPULSION SYSTEMS↗

Pan-cancer evaluation of clinical value of mitotic network activity index (MNAI) and its predictive value for immunotherapy

Increased mitotic activity is associated with the genesis and aggressiveness of many cancers. To assess the clinical value of mitotic activity as prognostic biomarker, we performed a pan-cancer study on the mitotic network activity index (MNAI) constructed based on 54-gene mitotic apparatus network. Our pan-cancer assessment on TCGA (33 tumor types, 10,061 patients) and validation on other publicly available cohorts (23 tumor types, 9,209 patients) confirmed the significant association of MNAI with overall survival, progression-free survival, and other prognostic endpoints in multiple cancer types, including lower-grade gliomas (LGG), breast invasive carcinoma (BRCA), as well as many others. We also showed significant association between MNAI and genetic instability, which provides a biological explanation of its prognostic impact at pan-cancer landscape. Our association analysis revealed that patients with high MNAI benefitted more from anti-PD-1 and Anti-CTLA-4 treatment. In addition, we demonstrated that multimodal integration of MNAI and the AI-empowered Cellular Morphometric Subtypes (CMS) significantly improved the predictive power of prognosis compared to using MNAI and CMS alone. Our results suggest that MNAI can be used as a potential prognostic biomarker for different tumor types toward different clinical endpoints, and multimodal integration of MNAI and CMS exceeds individual biomarker for precision prognosis.

60 APPLIED LIFE SCIENCES↗