SEARCH · Search NASA

Results for “visualization techniques”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

All sources NASA NTRS DOE OSTI

DOE OSTI2026

Precision Polishing of Spheres Via In-Situ Process Monitoring and Machine-Learning-Based Optimization

In inertial confinement fusion (ICF) experiments seeking output gains of unity and beyond, the quality of the ablator capsule is paramount for minimizing hydrodynamic mix that quenches the central hot spot. Defects in the form of foreign particles or missing mass on the surface and within the wall of the capsule are primary offenders. High density carbon capsules made for ICF experiments on the National Ignition Facility (NIF) are precision polished to achieve the surface smoothness in the order of a few nm as well as to minimize isolated defects in the form of pits. Given the critical role of this process, we are developing smart manufacturing techniques with goal of elevating the efficiency of this process. Our approach is to use MEMS-based sensors to capture the fine vibrational signals generated during the polishing process and combine it with synchronized visual feedback as needed. Beyond using these sensors for process monitoring, we use specific deep learning methods to analyze the data and extract correlations with both the process parameters and the final performance of the polishing run. Here, we describe the multiple fronts that we have explored in this regard and the results we have gotten so far. This approach promises to have the potential to ultimately provide real-time feedback that can be used for ensuring the progress of the run as well as a means for faster optimization.

36 MATERIALS SCIENCE↗

DOE OSTI2025

Unimodal Imaging of Monovalent Metal-Chelator Complexes and Lipids by MALDI Imaging Mass Spectrometry

Careful regulation of monovalent metal ions (M + ) is necessary to maintain a functional cellular system. Of these ions, appropriate sodium (Na + ) and potassium (K + ) concentrations are particularly integral for electrochemical signaling, as well as the secondary transport of nutrients and waste. Dysregulation of M + homeostasis can disrupt these mechanisms, potentially influencing the metabolism of downstream biomolecules such as lipids. Thus, the relationship between M + abundances and related biomolecular distributions must be elucidated to better understand the physiology of healthy and disordered tissues. Traditional techniques for imaging biological metal distributions include SIMS, LA-ICP-MS, and XRF; however, these capabilities are limited to elemental analysis or the analysis of molecular fragments and must be paired with other modalities to visualize distributions of more complex biomolecules within the same or similar samples. Conversely, matrix-assisted laser desorption/ionization imaging mass spectrometry (MALDI IMS) is a powerful tool often used for mapping such biomolecular distributions, but current methods are unable to detect metals within tissue. This study illustrates a novel methodology that adds metal detection to the MALDI IMS repertoire through which the simultaneous detection of M + metals and lipids is achievable. Using a robotic sprayer for homogeneous application, on-tissue deposition of the chelator deferiprone (DEF) enables subsequent detection of the ionizable metal-chelator complex by MALDI without hindering lipid detection. Our work provides proof-of-concept data for the simultaneous detection of K + , Na + , and intact lipids using MALDI IMS.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2024

Quantification of the Crack Evolution Process by Extracting Relevant Signal Components from Wave Propagation and Diffusive Transport Front Measurements

Wave propagation and diffusive transport phenomena in a geological rock sample undergoing crack evolution process are expected to interact with the mechanical discontinuities in the medium. The measurements of the signals associated with these phenomena can be used to assess and monitor the crack-driven micromechanical alterations in the rock. Different wave/diffusion phenomena, such as sonic propagation, pressure diffusion, and acoustic emission (AE), are sensitive to different elements of the mechanical discontinuities generated during the evolution of the crack clusters from initiation to coalescence. Sonic propagation, AE, and pressure diffusion monitoring have the potential to map the crack evolution because the transmitter-receiver arrays can be designed, arranged and tuned to (1) achieve maximum recovery of the scattered waveforms and travel times, (2) capture the later arrivals and multiple reflections, and (3) illuminate large rock volume. However, the structural/topological complexities of the mechanical discontinuities, complex distribution of the stress fields, complex mechanical alterations in media, and fluid redistribution in the crack system pose serious challenges for the detection and modeling of the crack evolution process (from here on, we will use the term ‘crack evolution process’ to mean that the crack evolution occurred under shallow crustal conditions). For purposes of accurately accounting such complexities and heterogeneities in the absence of reliable physical laws, simulation methods, and signal processing techniques, my early-career research proposal will develop and apply novel data-driven machine learning methods to: (1) extract signal components relevant to the various phases of crack evolution and (2) generate a 2D visual map of the crack evolution process.

58 GEOSCIENCES↗

DOE OSTI2024

Pre-Transient Characterization of Historic EBR-II Pins for Transient Testing

Current interest in sodium-cooled fast reactor (SFR) designs, such as TerraPower’s Natrium Reactor, has highlighted the need for advanced reactor fuel technology development. Modern U-Zr and U- Pu-Zr pin designs are primary candidates to fuel SFRs and boast high fuel utilization capacity, increased fuel-cladding compatibility, and improved safety through inherent feedback mechanisms. Despite over 60 years of metallic fuel irradiation, uncertainties exist in the performance of the fuel system, particularly under transient overpower (TOP) and loss of flow (LOF) scenarios. Throughout historical testing within the Experimental Breeder Reactor II (EBR-II) and the Fast Flux Test Facility (FFTF), fuel behavior has demonstrated benign response to transient reactor conditions; however, accurate predictions of failure thresholds to inform operational limitations rely heavily on fuel composition, burnup, and irradiation history. In expanding TOP and LOF testing, the Transient Heat sink Overpower Response (THOR) Capsule will be used to test modern fuel technologies in a static sodium environment in the Transient Reactor Test (TREAT) Facility. The THOR capsule is highly instrumented and will provide time-dependent thermal behavior of SFR fuel pins subjected to accident conditions within TREAT. The THOR-Metallic (THOR- M) campaign aims to validate and expand historical TOP and LOF testing on high burnup U-Zr and U-Pu- Zr fuel alloys previously irradiated in EBR-II by running the rods to failure. This contribution focuses primarily on the pre-transient engineering-scale destructive and non- destructive characterization that has been conducted on both the test and sibling pins used for the TOP and LOF tests. All pins underwent visual examination, neutron radiography, element contact profilometry, and precise gamma scan. The sibling pins used for each test were further analyzed using gas assay, sampling, and recharge analysis (GASR), and optical microscopy. The results from each technique confirmed that the fuel pins were intact and devoid of any atypical developments when compared to historical data. Additionally, the analyzed measurements establish a baseline for comparison to post-transient analysis. Key fuel behaviors quanitifed include axial elongation of the fuel column, diametral strain of the pin, patterns in fluff structure geometry, changes in axial isotope distribution, evolution of constituent redistribution, porosity, and fission gas release. The pre-transient measurements and changes attributed to transient behavior from post-transient measurement will be compared to historical data to capture the behavioral dependence on composition, burnup, and irradiation history. Results from this work advance the initiatives of the THOR-M campaign, which aid in informing fuel performance models and establishing safety criteria for SFR operational limits. The novel combination of test environment, in-situ instrumentation, and comprehensive suite of characterization methods provides greater understanding of transient fuel behavior. Overall, information on the time and condition of pin failure for high burnup U-Pu-Zr will greatly expand the limited existing TOP and LOF test data.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2024

Pre-Transient Characterization of Historic EBR-II Pins for Transient Testing

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

DOE OSTI2024

Pore-scale visualization of natural hydrate-bearing sediments

Accurate modeling of gas hydrate reservoir productivity and geomechanical risks associated with subsurface dissociation of natural gas hydrates (NGH) requires the determination of model parameters through physical testing on natural hydrate-bearing sediments (HBS). This involves investigating the hydro-mechanical behavior of undisturbed hydrate samples from nature under in situ conditions using pressure core characterization and analysis, which provides a unique opportunity for research. By employing state-of-the-art micro computed tomography imagery on cryogenically preserved, hydrate-bearing sediment samples, we can determine hydrate saturation as well as permeability with and without the presence of hydrates in the sediment. Furthermore, utilizing a machine learning based image segmentation technique, it is possible to extract pore space and grain information. Subsections of the entire image volume were used to determine anisotropic permeabilities using a finite-difference method Stokes solver (FDMSS). Additionally, permeability measurements on whole pressure and temperature preserved hydrate-bearing core were analyzed by utilizing the National Energy Technology Laboratory’s (NETL) Pressure Core Characterization and X-ray CT Visualization Tool (PCXT) to manipulate, cut, and analyze pressure preserved sediment. Permeabilities were measured under a broad range of vertical stress states to simulate expected pressure changes during production scenarios, and the results show that permeabilities derived from images are in agreement with those from traditional core derived experiments. The collected stress-dependent permeability, permeability anisotropy, and corresponding gas hydrate saturations provide valuable input into numerical simulations of reservoir productivity. These properties have been proven to be key parameters determining a long-term reservoir response under depressurization.

Liu, Mengwei [Oak Ridge Institute for Science and ↗

DOE OSTI2024

Advanced Functional Membranes for Noble Gas Management: Fabrication and Testing of Membranes on Porous Support

We selected several porous materials including PNW-24, CC3, SAPO-34, SAPO-56 and PNW-6, as the basis for fabricating membranes for Kr/Xe separation. Initially, we synthesized powder samples of the candidates and confirmed their crystallinity and morphology with X-ray diffraction and microscopy. In the case of PNW-24 and PNW-6, we further confirmed its Xe selectivity through Xe and Kr adsorption experiments, while we relied on literature reports for CC3, SAPO-34 and SAPO-56. We subsequently proceeded to fabricate membranes on porous alumina supports using techniques such as seeded-assisted secondary growth, in-situ growth and solution-processed method. PXRD on the membranes verified that the structures were well-grown on the surface of alumina support, while SEM provided visual confirmation of particle morphology. Importantly, defects were not visually observed in the fabricated membranes, which was further verified with pressure retention tests. We analyzed the separation performance of the synthesized membranes using a dilute gas mixture comprising of xenon, krypton and argon. We focused on PNW-6 to optimize the synthesis reaction time and study the effects of time on gas separation. While more research is necessary to reach a comprehensive conclusion, in alignment with our milestones, we have successfully achieved our goals.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

DOE OSTI2024

Precision Polishing of Ablator Capsules via in situ Process Monitoring and Machine Learning–Based Optimization

In inertial confinement fusion (ICF) experiments seeking output gains of unity and beyond, the quality of the ablator capsule is paramount for minimizing the hydrodynamic mix that quenches the central hot spot. Defects in the form of foreign particles or missing mass on the surface and within the wall of the capsule are primary offenders. High-density carbon capsules made for ICF experiments at the National Ignition Facility are precision polished to achieve surface smoothness on the order of a few nanometers as well as to minimize isolated defects in the form of pits. Given the critical role of this process, we are developing smart manufacturing techniques with the goal of elevating the efficiency of this process. Our approach is to use MEMS (micro-electromechanical systems)–based sensors to capture the fine vibration signals generated during the polishing process and combine them with synchronized visual feedback as needed. Beyond using these sensors for process monitoring, we use specific deep learning methods to analyze the data and extract correlations with both the process parameters and the final performance of the polishing run. Here, in this work, we describe the multiple fronts we have explored in this regard and the results we have gotten so far. This approach promises to have the potential to ultimately provide real-time feedback that can be used to ensure the progress of the run as well as a means for faster optimization.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2024

In-situ electrochemical optical techniques in the investigation of lithium interfacial phenomena with a liquid and a solid-state electrolyte

An in-situ electrochemical optical diagnosis is the key to the investigation of electrode interface during a redox reaction. Because the morphology changes particularly, dendrite formation, dendrite shapes, solid electrolyte interface formation and gas generation can be revealed visually. The challenge of ensuring uniform current density on a flat Li anode in a liquid electrolyte was addressed and uniform Li plating was demonstrated. The dendrite shape change under different reduction current density was discussed. Here the Li dendrite shape change and the performance of Li anodes with a surface lamination of graphite and red phosphate were used as examples to demonstrate the capability of the in-situ optical cell. An in-situ electrochemical optical cell used in the investigation of the increasingly popular solid-state Li batteries has its own challenges. Due to the untransparent nature of a solid-state electrolyte, an optical investigation on a solid-state electrolyte Li battery needs to be done by exposing the cross-section of the cell. In addition, it is very difficult to assemble an optical cell with a brittle and fragile solid-state electrolyte in a glove box. A set of formation and transfer dies, and an optical cell were introduced. The Li dendrite growth at the interface can be observed in a solid-state Li cell.

25 ENERGY STORAGE↗

DOE OSTI2025

A bi-channel aided stitching of atomic force microscopy images

Microscopy is an essential tool in scientific research, enabling the visualization of structures at micro- and nanoscale resolutions. However, the field of microscopy often encounters limitations in field-of-view (FOV), restricting the amount of sample that can be imaged in a single capture. To overcome this limitation, image stitching techniques have been developed to seamlessly merge multiple overlapping images into a single, high-resolution composite. The images collected from microscope need to be optimally stitched before accurate physical information can be extracted from post analysis. However, the existing stitching tools either struggle to stitch images together when the microscopy images are feature sparse or cannot address all the transformations of images when performing image stitching. To address these issues, we propose a bi-channel aided feature-based image stitching method and demonstrate its use on Atomic Force Microscopy (AFM) generated Pantoea sp. YR343 biofilm and PTO thin film sample images as experimental data. The topographical channel image of AFM data captures the morphological details of the sample, and a stitched topographical image is desired for researchers. We utilize the amplitude and phase channels of AFM data to maximize the matching features and to estimate the position of the original topographical images and show that the proposed bi-channel aided stitching method outperforms the traditional direct stitching approach in AFM topographical image stitching task. Here, we demonstrated the application on AFM, but similar approaches could be employed of optical microscopy with brightfield and fluorescence channels. We believe this proposed workflow can serve as a valuable augmentation strategy for microscopy image stitching tasks and will benefit the experimentalist to avoid erroneous analysis and discovery due to incorrect stitching.

Atomic force microscopy↗

DOE OSTI2024

Measurement of Photovoltaic Module Deformation Dynamics During Hail Impact Using Digital Image Correlation

Stereo high-speed video of photovoltaic modules undergoing laboratory hail tests was processed using digital image correlation to determine module surface deformation during and immediately following impact. The purpose of this work was to demonstrate a methodology for characterizing module impact response differences as a function of construction and incident hail parameters. Video capture and digital image analysis were able to capture out-of-plane module deformation to a resolution of ±0.1 mm at 11 kHz on an in-plane grid of 10 × 10 mm over the area of a 1 × 2 m commercial photovoltaic module. With lighting and optical adjustments, the technique was adaptable to arbitrary module designs, including size, backsheet color, and cell interconnection. Furthermore, impacts were observed to produce an initially localized dimple in the glass surface, with peak deflection proportional to the square root of incident energy. Subsequent deformation propagation and dissipation were also captured, along with behavior for instances when the module glass fractured. Natural frequencies of the module were identifiable by analyzing module oscillations postimpact. Limitations of the measurement technique were that the impacting ice ball obscured the data field immediately surrounding the point of contact, and both ice and glass fracture events occurred within 100 μs, which was not resolvable at the chosen frame rate. Increasing the frame rate and visualizing the back surface of the impact could be applied to avoid these issues. Applications for these data include validating computational models for hail impacts, identifying the natural frequencies of a module, and identifying damage initiation mechanisms.

14 SOLAR ENERGY↗

DOE OSTI2025

Phase segregation dynamics in mixed-halide perovskites revealed by plunge-freeze cryo-electron microscopy

Mixed-halide lead perovskites, with photoexcited charge-carrier properties suitable for high-efficiency photovoltaics, hold significant promise for high-efficiency tandem solar cells. However, phase segregation under illumination, where an iodide-rich phase forms carrier trap states, remains a barrier to application. This study employs plunge-freeze cryoelectron microscopy to visualize nanoscale phase segregation dynamics in CsPb(Br x I 1–x ) 3 films. By rapidly freezing the illuminated samples, we preserve transient photoexcited ion distributions for high-resolution structural and compositional analysis at the nanoscale. Cryogenic scanning transmission electron microscopy (STEM) techniques (electron energy loss spectroscopy [EELS] and 4D-STEM) captured the dynamics of photo-induced iodine migration from grain boundaries to centers, identified the buildup of anisotropic strain, and captured the heterogeneous evolution of this process within a single grain. These findings provide insight into microscopic phase segregation mechanisms and their dynamics, enhancing our understanding of mixed-halide perovskite photostability.

42 ENGINEERING↗

DOE OSTI2026

Unsupervised anomaly detection in MeV ultrafast electron diffraction

MeV ultrafast electron diffraction (MUED) is a pump-probe technique used to study the dynamic structural evolution of materials. An ultrashort laser pulse triggers structural changes, which are then probed by an ultrashort relativistic electron beam. To overcome low signal-to-noise ratios, diffraction patterns are averaged over thousands of shots. However, shot-to-shot instabilities in the electron beam can distort individual patterns, introducing uncertainty. Improving MUED accuracy requires detecting and removing these anomalous patterns from large datasets. In this work, we developed a fully unsupervised methodology for the detection of anomalous diffraction patterns. Using a convolutional autoencoder, we calculate the reconstruction mean squared error of the diffraction patterns. Based on the statistical analysis of this error, we provide the user an estimation of the probability that the pattern is normal, which also allows a posterior visual inspection of the images that are difficult to classify. This method has been trained with only 100 diffraction patterns and tested on 1521 patterns, resulting in a false positive rate between 0.2% and 0.4%, with a training time of 10 s per image and a test time of about 1 s per image. Here, the proposed methodology can also be applied to other diffraction techniques in which large datasets are collected that include faulty images due to instrumental instabilities.

43 PARTICLE ACCELERATORS↗

DOE OSTI2026

Mechanics of pore array collapse and interaction in shock-compressed polymethyl methacrylate (PMMA)

Recent studies on dynamic pore collapse have revealed significant development of shear localization, which can lead to material failure in porous structures and hot spot generation in energetic materials. These findings have dramatically improved the understanding of failure mechanisms during pore collapse but also prompt further investigation of realistic porous materials. In particular, porous media consist of many pores and porous networks. Even in low-porosity materials, pores can form in close proximity during the manufacturing process, leading to the critical question of pore–pore interaction during collapse under dynamic loading conditions. This study investigates, via plate impact experiments coupled with high-speed internal digital image correlation and shadowgraphy techniques, the collapse of two pores in shock-compressed PMMA at stresses between 0.4 and 1 GPa. The results of these experiments provide new insights into shear localization in pore collapse, in addition to distinct interactions between pores. Shadowgraphy measurements reveal novel, direct visualization of shear band development and crack evolution from pore surfaces. Spacing between adiabatic shear bands is measured over a range of impact stresses and is predicted accurately by the Grady–Kipp model. Pore interactions are found to effect a transition in the impact stress threshold at which different failure mechanisms initiate and are also found to possibly influence preferential sites for shear cracking. Throughout the study, numerical and theoretical models are leveraged to understand shear localization behavior. The role of baroclinicity and wave interactions between the pores is used to elucidate interaction mechanisms between pores.

Lawlor, Barry P. [California Institute of Technolo↗

DOE OSTI2024

Geophysical Signatures of Crack Network Coalescence in Rocks at Multiple Length Scales

The main goal of the research project was to identify the geophysical signatures of fracture growth in natural rocks by utilizing novel geophysical techniques. The research objectives were to (a) investigate the potential for geophysical methods to determine when cracks initiate, the types and locations of propagated cracks, and the coalescence of networks of cracks in natural rocks at multiple scales, (b) determine how damage at the microscale evolved into damage at the macroscale and then link the microscopic and macroscopic observations, (c) quantify crack coalescence in rocks under realistic stress conditions using coupled mechanical-geophysical-optical visualization, and (d) identify the precursors in geophysical signals to crack coalescence. The following research thrusts were explored to achieve the research objectives: (1) uniaxial compression testing of rock specimens with and without a set of pre‐existing flaws and (2) triaxial compression testing of natural rock specimens. These thrusts allowed for exploring fracturing in rocks under realistic in situ environments and at multiple scales. This project provided educational opportunities for nine graduate and undergraduate students and resulted in 27 peer-reviewed publications. This first research thrust focused on investigating the micromechanics of fractures in rocks through uniaxial compression testing combined with advanced geophysical and imaging techniques, specifically acoustic emission (AE) monitoring, ultrasonic imaging, and 2-dimensional Digital Image Correlation (2D-DIC). By examining damage processes under time-independent and time-dependent loading conditions, insights into damage localization, crack initiation, and fracturing mechanisms were gained. It was observed that the AE signals and the strain-based measurements directly reflect the state of damage in the rock specimen and could be used to identify the cracking levels, such as the crack initiation (CI) and crack damage (CD), and the mode of deformation. A novel calibration apparatus was developed to enhance the accuracy of AE sensors, allowing for the estimation of key parameters such as magnitude, source dimension, stress drop, and radiated seismic energy associated with the fractures. The findings highlighted significant variations in the temporal evolution of AE source parameters during the primary, secondary, and tertiary stages of creep, identifying tensile cracking as the primary deformation mode. The second research thrust focused on enhancing the understanding of fracturing processes in natural rocks through triaxial compression testing, real-time AE monitoring, and ultrasonic monitoring. We investigated the impact of various factors such as fracture propagation regimes, injection parameters, rock types, and pre-existing conditions on the hydraulic fracture (HF) behavior using scaled true-triaxially loaded specimens of Barre granite and Lyons sandstone. Custom sensor housing facilitated concurrent active and passive monitoring to analyze hydro-mechanical responses and microseismicity associated with different HF scenarios. A coupled investigation of passive microseismicity and active signal attributes permitted a detailed comprehension of the various HF processes (aseismic deformation, fracture initiation and propagation, fluid permeation, and leak-off) and their dependence on the specific rock type. The findings of this research demonstrated the effectiveness of AE monitoring techniques in providing valuable insights into the impact of various factors on the behavior and dynamics of HF processes. The advancements in monitoring techniques, offering a more thorough and precise approach, represent a significant step towards optimizing HF practices and ensuring sustainable resource extraction.

58 GEOSCIENCES↗

DOE OSTI2026

Mass spectral molecular mapping shows benefits of thermal evaporation in prelithiated silicon-based electrodes

Silicon based composites have become increasingly popular as potential anodes for lithium-ion batteries due to their large storage capacity and potential ability to generate batteries with energy densities greater than 350 Wh kg −1 . These anodes often see reduced initial columbic efficiency (ICE) due to disruptive volume expansionup to 300% and continuous solid electrolyte interphase (SEI) layer formation. Prelithiation, where an excess reservoir of Li is added to the electrode to compensate for irreversible SEI formation losses during their sample preparation, has proven to solve the issue of immediate capacity loss. Thermal evaporation is a prelithiation technique with limited studies on its effectiveness. In this study, time-of-flight secondary ion mass spectrometry (ToF-SIMS) is used to highlight the benefits of prelithiation via thermal evaporation. ToF-SIMS provides chemical mapping and spatial information in 2D and 3D visualizing the deposition of lithium, identifying Li x Si y alloy and Li x Si y O z silicate formation, and the distribution of lithium passivation into the electrodes. Passivation under different atmospheric conditions, such as inert Argon (Ar) and Ar/ carbon dioxide (CO 2 ), highlights the impact of the environment on the passivation effectiveness and formation of Li x Si y alloy and Li x Si y O z silicate. The ToF-SIMS molecular imaging and depth profiling results indicate that prelithiation via thermal evaporation effectively distributes lithium throughout the depth profile thickness of several hundred nanometers. It induces a greater degree of Li x Si y O z silicate formation over Li x Si y alloy. Our ToF-SIMS characterization results show the effectiveness of thermal evaporation in producing a more stable electrode and an electrode with an effective lithium reserve that can preserve its capacity.

Parker, Gabriel D. [Oak Ridge National Laboratory ↗

DOE OSTI2024

Towards interpretable Cryo-EM: disentangling latent spaces of molecular conformations

Molecules are essential building blocks of life and their different conformations (i.e., shapes) crucially determine the functional role that they play in living organisms. Cryogenic Electron Microscopy (cryo-EM) allows for acquisition of large image datasets of individual molecules. Recent advances in computational cryo-EM have made it possible to learn latent variable models of conformation landscapes. However, interpreting these latent spaces remains a challenge as their individual dimensions are often arbitrary. The key message of our work is that this interpretation challenge can be viewed as an Independent Component Analysis (ICA) problem where we seek models that have the property of identifiability. That means, they have an essentially unique solution, representing a conformational latent space that separates the different degrees of freedom a molecule is equipped with in nature. Thus, we aim to advance the computational field of cryo-EM beyond visualizations as we connect it with the theoretical framework of (nonlinear) ICA and discuss the need for identifiable models, improved metrics, and benchmarks. Moving forward, we propose future directions for enhancing the disentanglement of latent spaces in cryo-EM, refining evaluation metrics and exploring techniques that leverage physics-based decoders of biomolecular systems. Moreover, we discuss how future technological developments in time-resolved single particle imaging may enable the application of nonlinear ICA models that can discover the true conformation changes of molecules in nature. The pursuit of interpretable conformational latent spaces will empower researchers to unravel complex biological processes and facilitate targeted interventions. This has significant implications for drug discovery and structural biology more broadly. More generally, latent variable models are deployed widely across many scientific disciplines. Thus, the argument we present in this work has much broader applications in AI for science if we want to move from impressive nonlinear neural network models to mathematically grounded methods that can help us learn something new about nature.

59 BASIC BIOLOGICAL SCIENCES↗

DOE OSTI2025

A Dynamic Hierarchical Attention Framework for Multimodal Malware Detection

The increasing use of Android in the worldwide mobile ecosystem has come along with a significant increase in advanced malware, highlighting the critical necessity for efficient, scalable, and adaptable detection systems. Despite recent advancements in machine learning improving malware detection, the majority of current solutions are limited to one, two, or three data modalities, hence neglecting the comprehensive behavioral spectrum of contemporary multi-vector threats. This thesis presents the first comprehensive multimodal framework for Android malware detection, which combines textual, time-series (temporal), graph-based (structural), and visual information using an innovative hierarchical attention mechanism and Dynamic Fusion Controller (DFC). Our methodology consistently classifies and processes modalities as either sequential or structural, facilitating content-adaptive weighting and resilient cross-modal representation learning. We advance the implementation of cutting-edge time series techniques, such as MiniRocket, for malware detection, hence creating new opportunities for temporal analysis in cybersecurity. Comprehensive experimental assessment shows that our framework performs exceptionally well, with 99.46% classification accuracy and 97.15% detection accuracy, significantly outperforming existing approaches through effective multimodal integration and hierarchical attention mechanisms.

Nazmin, Tamanna↗