Search NASA⌕ Search

SEARCH · Search NASA

Results for “visualization technique”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

YOLO2U-Net: Detection-guided 3D instance segmentation for microscopy

Microscopy imaging techniques are instrumental for characterization and analysis of biological structures. As these techniques typically render 3D visualization of cells by stacking 2D projections, issues such as out-of-plane excitation and low resolution in the z-axis may pose challenges (even for human experts) to detect individual cells in 3D volumes as these non-overlapping cells may appear as overlapping. In this paper a comprehensive method for accurate 3D instance segmentation of cells in the brain tissue is introduced. The proposed method combines the 2D YOLO detection method with a multi-view fusion algorithm to construct a 3D localization of the cells. Next, the 3D bounding boxes along with the data volume are input to a 3D U-Net network that is designed to segment the primary cell in each 3D bounding box, and in turn, to carry out instance segmentation of cells in the entire volume. The promising performance of the proposed method is shown in comparison with current deep learning-based 3D instance segmentation methods.

3D instance segmentation↗

Stroboscopic ultrafast imaging using RF strip-lines in a commercial transmission electron microscope

The development of ultrafast electron microscopy (UEM), specifically stroboscopic imaging, has brought the study of structural dynamics to a new level by overcoming the spatial limitations of ultrafast spectroscopy and the temporal restrictions of traditional TEM simultaneously. Combining the concepts governing both techniques has enabled direct visualization of dynamics with spatiotemporal resolutions in the picosecond-nanometer regime. Here, in this study, we push the limits of imaging using a pulsed electron beam via RF induced transverse deflection based on the newly developed 200 keV frequency-tunable strip-line pulser. We demonstrate 0.2 nm spatial resolution at high magnifications and elucidation of Lorentz imaging using the phase-microscopy method. We also present beam coherence measurements and expand our study using the breathing modes of a silicon interdigitated comb under RF excitation which achieves improved temporal synchronization between the electron pulse-train and electric field. A new RF holder has also been developed with impedance matching to the RF signal to minimize transmission power loss to samples and its performance is compared with a conventional sample holder.

47 OTHER INSTRUMENTATION↗

Switching speed limits in electrically driven VO 2 structural Mott–Peierls transition

Mott materials are archetypal quantum systems actively explored as next-generation electronic and photonic platforms, with potential applications spanning non-Von Neumann computing, robotics, energy storage, and microwave technologies. Among these, vanadium dioxide (VO 2 ) has emerged as one of the most intensively studied compounds, owing to its sharp, near-room-temperature insulator-to-metal phase transition. VO 2 also serves as a benchmark system for testing cutting-edge theories and experimental techniques. Here, we directly visualize the electrically driven transition dynamics in VO 2 using a microwave-driven, frequency-tunable pulsed transmission electron microscope that combines nanometer spatial and picosecond temporal resolution. Under high-frequency (MHz–GHz) excitation, we capture the ultrafast nucleation, propagation, and dissolution of metallic domains within an operating device over millions of reversible cycles. We observe the ultrafast formation of consistent metallic nuclei beneath the electrodes, followed by the propagation of a structural phase front at 4.54 nm/ns. Our experiments show that phonon-mediated structural recovery ultimately limits reversible switching of VO 2 at GHz frequencies, and that a tunable regime for reversible operation spans from kHz to GHz through device engineering. Beyond VO 2 , our approach provides a powerful framework for probing non-equilibrium structural transformations in correlated and functional materials under realistic electrical stimuli.

36 MATERIALS SCIENCE↗

Discovering invariant spatial features in electron energy loss spectroscopy images on the mesoscopic and atomic levels

Over the last two decades, Electron Energy Loss Spectroscopy (EELS) imaging with a scanning transmission electron microscope has emerged as a technique of choice for visualizing complex chemical, electronic, plasmonic, and phononic phenomena in complex materials and structures. The availability of the EELS data necessitates the development of methods to analyze multidimensional data sets with complex spatial and energy structures. Traditionally, the analysis of these data sets has been based on analysis of individual spectra, one at a time, whereas the spatial structure and correlations between individual spatial pixels containing the relevant information of the physics of underpinning processes have generally been ignored and analyzed only via the visualization as 2D maps. Here, we develop a machine learning-based approach and workflows for the analysis of spatial structures in 3D EELS data sets using a combination of dimensionality reduction and multichannel rotationally invariant variational autoencoders. This approach is illustrated for the analysis of both the plasmonic phenomena in a system of nanowires and in the core excitations in functional oxides using low loss and core-loss EELS, respectively. The code developed in this manuscript is open sourced and freely available and provided as a Jupyter notebook for the interested reader.

36 MATERIALS SCIENCE↗

Information-Theoretic Exploration of Multivariate Time-Varying Image Databases

Modern scientific simulations produce very large datasets, making interactive exploration of such data computationally prohibitive. An increasingly common data reduction technique is to store visualizations and other data extracts in a database. The Cinema project is one such approach, storing visualizations in an image database for post hoc exploration and interactive image-based analysis. This work focuses on developing efficient algorithms that can quantify various types of multivariate dependencies existing within multi-variable datasets. It applies specific mutual information measures for the quantification of salient regions from multivariate image data. Here, using such information measures, the opacity of the images is modulated so that the salient regions are automatically highlighted and the domain scientists can interactively explore the most relevant regions for scientific discovery.

97 MATHEMATICS AND COMPUTING↗

FunM2C: A Filter for Uncertainty Visualization of Multivariate Data on Multi-Core Devices

Uncertainty visualization is an emerging research topic in data visualization because neglecting uncertainty in visualization can lead to inaccurate assessments. In this paper, we study the propagation of multivariate data uncertainty in visualization. Although there have been a few advancements in probabilistic uncertainty visualization of multivariate data, three critical challenges remain to be addressed. First, the state-of-the-art probabilistic uncertainty visualization framework is limited to bivariate data (two variables). Second, existing uncertainty visualization algorithms use computationally intensive techniques and lack support for cross-platform portability. Third, as a consequence of the computational expense, integration into production visualization tools is impractical. In this work, we address all three issues and make a threefold contribution. First, we take a step to generalize the state-of-the-art probabilistic framework for bivariate data to multivariate data with an arbitrary number of variables. Second, through utilization of VTK-m’s shared-memory parallelism and cross-platform compatibility features, we demonstrate acceleration of multivariate uncertainty visualization on different many-core architectures, including OpenMP and AMD GPUs. Third, we demonstrate the integration of our algorithms with the ParaView software. We demonstrate the utility of our algorithms through experiments on multivariate simulation data with three and four variables.

Hari, Gautam↗

Holotomography Phase-Retrieval

Holotomography is a non-destructive x-ray imaging technique which allows to visualize the interior morphology of object without damaging them. It is similar to x-ray computed tomography (CT), but unlike conventional CT, which is based on the attenuation of x-rays passing through the object, holotomography exploits the phase shift caused by the sample. This phase-contrast imaging allows to increase image contrast by recovering refractive index of materials and is proven to be more sensitive to density variations than conventional absorption-based X-ray imaging when applied to low-Z materials. In holotomography, the phase is retrieved by measuring the variations in intensity of the object at different sample to detector distances. Several algorithms exist to perform this task such as, contrast transfer function (CTF), transport of intensity equation (TIE), and a mixed approach which combine both TIE and CTF.

Forien, Jean-Baptiste↗

Switchable resolution in soft x-ray tomography of single cells

The diversity of living cells, in both size and internal complexity, calls for imaging methods with adaptable spatial resolution. Soft x-ray tomography (SXT) is a three-dimensional imaging technique ideally suited to visualizing and quantifying the internal organization of single cells of varying sizes in a near-native state. The achievable resolution of the soft x-ray microscope is largely determined by the objective lens, but switching between objectives is extremely time-consuming and typically undertaken only during microscope maintenance procedures. Since the resolution of the optic is inversely proportional to the depth of focus, an optic capable of imaging the thickest cells is routinely selected. This unnecessarily limits the achievable resolution in smaller cells and eliminates the ability to obtain high-resolution images of regions of interest in larger cells. Here, we describe developments to overcome this shortfall and allow selection of microscope optics best suited to the specimen characteristics and data requirements. We demonstrate that switchable objective capability advances the flexibility of SXT to enable imaging cells ranging in size from bacteria to yeast and mammalian cells without physically modifying the microscope, and we demonstrate the use of this technology to image the same specimen with both optics.

59 BASIC BIOLOGICAL SCIENCES↗

Accurate in vivo tumor detection using plasmonic-enhanced shifted-excitation Raman difference spectroscopy (SERDS)

For the majority of cancer patients, surgery is the primary method of treatment. In these cases, accurately removing the entire tumor without harming surrounding tissue is critical; however, due to the lack of intraoperative imaging techniques, surgeons rely on visual and physical inspection to identify tumors. Surface-enhanced Raman scattering (SERS) is emerging as a non-invasive optical alternative for intraoperative tumor identification, with high accuracy and stability. However, Raman detection requires dark rooms to work, which is not consistent with surgical settings. Methods: Herein, we used SERS nanoprobes combined with shifted-excitation Raman difference spectroscopy (SERDS) detection, to accurately detect tumors in xenograft murine model. Results: We demonstrate for the first time the use of SERDS for in vivo tumor detection in a murine model under ambient light conditions. We compare traditional Raman detection with SERDS, showing that our method can improve sensitivity and accuracy for this task. Conclusion: Our results show that this method can be used to improve the accuracy and robustness of in vivo Raman/SERS biomedical application, aiding the process of clinical translation of these technologies.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Immersive Digital Twins and Decision Making

This work focuses on developing and implementing immersive digital twins to support decision-making processes in construction automation and energy simulation analysis. The use of digital twins enables users to explore and interact with virtual replicas of physical systems, providing a unique and valuable perspective for problem-solving. In the context of construction automation, we present two case studies that integrate immersive visualization and worker-machine interaction. In the context of energy simulation analysis using digital twins, we describe our digital twin framework that combines interactive visualization with machine learning techniques to approximate computationally expensive simulations, allowing for faster and more efficient analysis of complex energy systems. Through these research endeavors, we demonstrate the potential of immersive digital twins in decision-making across various domains.

digital twins↗

Collaborative Exploration of Scientific Datasets Using Immersive and Statistical Visualization: Preprint

We discuss the value of collaborative, immersive visualization for the exploration of scientific datasets and review techniques and tools that have been developed and deployed at the National Renewable Energy Laboratory (NREL). We believe that collaborative visualizations linking statistical interfaces and graphics on laptops and high-performance computing (HPC) with 3D visualizations on immersive displays (head-mounted displays and large-scale immersive environments) enable scientific workflows that further rapid exploration of large, high-dimensional datasets by teams of analysts. We present a framework, PlottyVR, that blends statistical tools, general-purpose programming environments, and simulation with 3D visualizations. To contextualize this framework, we propose a categorization and loose taxonomy of collaborative visualization and analysis techniques. Finally, we describe how scientists and engineers have adopted this framework to investigate large, complex datasets.

collaborative visualization↗

Collaborative Exploration of Scientific Datasets Using Immersive and Statistical Visualization

We discuss the value of collaborative, immersive visualization for the exploration of scientific datasets and review techniques and tools that have been developed and deployed at the National Renewable Energy Laboratory (NREL). We believe that collaborative visualizations linking statistical interfaces and graphics on laptops and high-performance computing (HPC) with 3D visualizations on immersive displays (head-mounted displays and large-scale immersive environments) enable scientific workflows that further rapid exploration of large, high-dimensional datasets by teams of analysts. We present a framework, PlottyVR, that blends statistical tools, general-purpose programming environments, and simulation with 3D visualizations. To contextualize this framework, we propose a categorization and loose taxonomy of collaborative visualization and analysis techniques. Finally, we describe how scientists and engineers have adopted this framework to investigate large, complex datasets.

collaborative visualization↗

A Visual Analytic Platform for Interactive Validation of Human Mobility Simulations

Human mobility insights guide domain experts in an array of decisions, including critical infrastructure design, disaster response, epidemic modeling, national security, and policy making. Due to the inherent noise and privacy concerns in real-world individual-level mobility data, it is often preferred to leverage simulators that generate synthetic mobility data instead. However, it is critical to inspect and validate the output of such simulators to ensure the synthetic data is aligned with the characteristics of the population and the area of interest known to domain experts. While there exist many quantitative approaches for validating synthetic data, we argue it is also important to also validate such data qualitatively to capture aspects that are known to domain experts but difficult to quantify. In this work, we demonstrate a visual analytic platform that empowers domain experts to interact with their simulation outputs along spatial and temporal dimensions. By augmenting automated techniques and human skills, our visual analytic platform is a step towards interactive capabilities for model steering and quality control of mobility simulators.

Monadjemi, Shayan↗

Luminescence and Thermal Imaging Applied to Half-Cut-Cell and Emitter-Wrap-Through-Cell Modules

Imaging techniques provide spatial details and visualization of module defects and degradation mechanisms that affect energy conversion efficiency and performance. We apply photoluminescence, electroluminescence, and dark lock-in thermography imaging techniques to evaluate new modules in their initial state and after applying stresses of damp heat, light-induced-degradation regeneration parameters, thermal cycling, and humidity-freeze cycles. One module uses emitter-wrap-through cells with back contacts connected to a metal-foil backplane, and the other is composed of half-cut cells. Imaging shows examples on non-uniform degradation and damage such as cells that degrade and recover under the applied conditions, cells with cracks and handling damage, and cells with increasing series resistance.

degradation↗

Direct Observation of Twin van der Waals Molecular Chains

The van der Waals (vdW) assemblies are the most common structures of materials. However, directly mapping intermolecular electron clouds of a vdW assembly has never been obtained, even though the intramolecular electron clouds were visualized by atomic-resolution techniques. In this report, we unprecedently mapped the intermolecular electron cloud of the assembles of ethanol molecules via ethyl groups with noncontact atomic force microscopy at 5 K, leading to the first visualization of vdW molecular chains, in which ethanol molecules assemble into twin vdW molecular chains in a reverse parallel configuration on Ag(111) plane. Furthermore, spontaneous order-disorder transitions in the chain were dynamically observed, suggesting its unusual properties different from 2D vdW materials. In conclusion, these findings provide an "eye" to see the atomic world of vdW materials.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Explainable AI for Multivariate Time Series Pattern Exploration: Latent Space Visual Analytics With Temporal Fusion Transformer and Variational Autoencoders in Power Grid Event Diagnosis

Detecting and analyzing complex patterns in multivariate time-series data is crucial for decision-making in urban and environmental system operations. However, challenges arise from the high dimensionality, intricate complexity, and interconnected nature of complex patterns, which hinder the understanding of their underlying physical processes. Existing AI methods often face limitations in interpretability, computational efficiency, and scalability, reducing their applicability in real-world scenarios. This paper proposes a novel visual analytics framework that integrates two generative AI models, Temporal Fusion Transformer (TFT) and Variational Autoencoders (VAEs), to reduce complex patterns into lower-dimensional latent spaces and visualize them in 2D using dimensionality reduction techniques such as PCA, t-SNE, and UMAP with DBSCAN. These visualizations, presented through coordinated and interactive views and tailored glyphs, enable intuitive exploration of complex multivariate temporal patterns, identifying patterns’ similarities and uncover their potential correlations for a better interpretability of the AI outputs. The framework is demonstrated through a case study on power grid signal data, where it identifies multi-label grid event signatures, including faults and anomalies with diverse root causes. Additionally, novel metrics and visualizations are introduced to validate the models and assess the performance, efficiency, and consistency of latent maps generated by VAE, which have been utilized in prior studies for latent space cartography and used as a benchmark in this study, and the emerging TFT architecture under various configurations. These analyses provide actionable insights for model parameter tuning and reliability improvements. Comparative results highlight that TFT achieves shorter run times and superior scalability to diverse time-series data shapes compared to VAE. This work advances fault diagnosis in multivariate time series, fostering explainable AI to support critical system operations.

Explainable AI↗

Mapping Conductance and Switching Behavior of Graphene Devices In Situ

Graphene is proposed for use in various nanodevice designs, many of which harness emergent quantum properties for device functionality. However, visualization, measurement, and manipulation become nontrivial at nanometer and atomic scales, representing a significant challenge for device fabrication, characterization, and optimization at length scales where quantum effects emerge. Herein, proof of principle results at the crossroads between 2D nanoelectronic devices, e-beam-induced modulation, and imaging with secondary electron e-beam induced currents (SEEBIC) is presented. A device platform compatible with scanning transmission electron microscopy investigations is introduced. Then how the SEEBIC imaging technique can be used to visualize conductance and connectivity in single layer graphene nanodevices, even while supported on a thicker substrate (conditions under which conventional imaging fails) is shown. Finally, it is shown that the SEEBIC imaging technique can detect subtle differences in charge transport through time in nonohmic graphene nanoconstrictions indicating the potential to reveal dynamic electronic processes.

36 MATERIALS SCIENCE↗