Search NASA⌕ Search

SEARCH · Search NASA

Results for “Data visualization and analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,207 records · Page 67

Towards Interactive, Reproducible Analytics at Scale on HPC Systems

The growth in scientific data volumes has resulted in a need to scale up processing and analysis pipelines using High Performance Computing (HPC) systems. These workflows need interactive, reproducible analytics at scale. The Jupyter platform provides core capabilities for interactivity but was not designed for HPC systems. In this paper, we outline our efforts that bring together core technologies based on the Jupyter Platform to create interactive, reproducible analytics at scale on HPC systems. Our work is grounded in a real world science use case-applying geophysical simulations and inversions for imaging the subsurface. Our core platform addresses three key areas of the scientific analysis workflow-reproducibility, scalability, and interactivity. We describe our implemention of a system, using Binder, Science Capsule, and Dask software. We demonstrate the use of this software to run our use case and interactively visualize real-Time streams of HDF5 data.

containers↗

Statistical analysis of the horizontal divergent flow in emerging solar active regions

Solar active regions (ARs) are thought to be formed by magnetic fields from the convection zone. Our flux emergence simulations revealed that a strong horizontal divergent flow (HDF) of unmagnetized plasma appears at the photosphere before the flux begins to emerge. In our earlier study, we analyzed HMI data for a single AR and confirmed presence of this precursor plasma flow in the actual Sun. In this paper, as an extension of our earlier study, we conducted a statistical analysis of the HDFs to further investigate their characteristics and better determine the properties. From SDO/HMI data, we picked up 23 flux emergence events over a period of 14 months, the total flux of which ranges from 10{sup 20} to 10{sup 22} Mx. Out of 23 selected events, 6 clear HDFs were detected by the method we developed in our earlier study, and 7 HDFs detected by visual inspection were added to this statistic analysis. We found that the duration of the HDF is on average 61 minutes and the maximum HDF speed is on average 3.1 km s{sup –1}. We also estimated the rising speed of the subsurface magnetic flux to be 0.6-1.4 km s{sup –1}. These values are highly consistent with our previous one-event analysis as well as our simulation results. The observation results lead us to the conclusion that the HDF is a rather common feature in the earliest phase of AR emergence. Moreover, our HDF analysis has the capability of determining the subsurface properties of emerging fields that cannot be directly measured.

79 ASTRONOMY AND ASTROPHYSICS↗

Anomaly detection in Hyper Suprime-Cam galaxy images with generative adversarial networks

ABSTRACT The problem of anomaly detection in astronomical surveys is becoming increasingly important as data sets grow in size. We present the results of an unsupervised anomaly detection method using a Wasserstein generative adversarial network (WGAN) on nearly one million optical galaxy images in the Hyper Suprime-Cam (HSC) survey. The WGAN learns to generate realistic HSC-like galaxies that follow the distribution of the data set; anomalous images are defined based on a poor reconstruction by the generator and outlying features learned by the discriminator. We find that the discriminator is more attuned to potentially interesting anomalies compared to the generator, and compared to a simpler autoencoder-based anomaly detection approach, so we use the discriminator-selected images to construct a high-anomaly sample of ∼13 000 objects. We propose a new approach to further characterize these anomalous images: we use a convolutional autoencoder to reduce the dimensionality of the residual differences between the real and WGAN-reconstructed images and perform UMAP clustering on these. We report detected anomalies of interest including galaxy mergers, tidal features, and extreme star-forming galaxies. A follow-up spectroscopic analysis of one of these anomalies is detailed in the Appendix; we find that it is an unusual system most likely to be a metal-poor dwarf galaxy with an extremely blue, higher-metallicity H ii region. We have released a catalogue with the WGAN anomaly scores; the code and catalogue are available at https://github.com/kstoreyf/anomalies-GAN-HSC; and our interactive visualization tool for exploring the clustered data is at https://weirdgalaxi.es.

79 ASTRONOMY AND ASTROPHYSICS↗

Utah FORGE 2439: Well 16B(78)-32 Field-Test Data from Mini-Frac Tests

This submittal includes the field-test data collected during stress tests conducted in the Utah FORGE 16B(78)-32 wellbore to measure/characterize the stresses in the geothermal reservoir. The type of stress test performed is referred to as a mini-frac test or a micro-frac test. The test is a hydraulic fracture test that involves injecting a small volume of water into a short interval of the reservoir that is isolated by a straddle packer to create a fracture. The test provides information about the minimum and maximum horizontal stress at the test depths. A total of seven mini-frac tests were performed within the upper (vertical or nearly vertical) section of the 9-5/8-inch diameter uncased wellbore, between depths of 5,202 ft MD [5,202 ft TVD] and 5,980 ft MD [5966.18 ft TVD]. Two types of data were generated as part of the mini-frac tests. The first type of data is time-series data for each mini-frac test (e.g., injection-rate, test-interval pressure), and are contained in the "Mini-Frac Test Data.zip" file below. The second type is geophysical log data, attached below in the "Geophysical Logs.zip" file. Here, two types of image logs and acoustic logs were obtained before and after the mini-frac tests to examine each test depth for visual evidence of induced fracture(s) and to measure the azimuth (orientation) of any observed fractures. The attached Readme file includes the test depth information and contents of each data file included here. Analysis of the field-test data was conducted and is documented in the attached report below.

15 GEOTHERMAL ENERGY↗

Volumetric Rendering on Wavelet-Based Adaptive Grid

Numerical modeling of physical phenomena frequently involves processes across a wide range of spatial and temporal scales. In the last two decades, the advancements in wavelet-based numerical methodologies to solve partial differential equations, combined with the unique properties of wavelet analysis to resolve localized structures of the solution on dynamically adaptive computational meshes, make it feasible to perform large-scale numerical simulations of a variety of physical systems on a dynamically adaptive computational mesh that changes both in space and time. Volumetric visualization of the solution is an essential part of scientific computing, yet the existing volumetric visualization techniques do not take full advantage of multi-resolution wavelet analysis and are not fully tailored for visualization of a compressed solution on the wavelet-based adaptive computational mesh. Our objective is to explore the alternatives for the visualization of time-dependent data on space-time varying adaptive mesh using volume rendering while capitalizing on the available sparse data representation. Two alternative formulations are explored. The first one is based on volumetric ray casting of multi-scale datasets in wavelet space. Rather than working with the wavelets at the finest possible resolution, a partial inverse wavelet transform is performed as a preprocessing step to obtain scaling functions on a uniform grid at a user-prescribed resolution. As a result, a solution in physical space is represented by a superposition of scaling functions on a coarse regular grid and wavelets on an adaptive mesh. An efficient and accurate ray casting algorithm is based just on these coarse scaling functions. Additional details are added during the ray tracing by taking an appropriate number of wavelets into account based on support overlap with the interpolation point, wavelet coefficient magnitude, and other characteristics, such as opacity accumulation (front to back ordering) and deviation from frontal viewing direction. The second approach is based on complementing of wavelet-based adaptive mesh to the traditional Adaptive Mesh Refinement (AMR) mesh. Both algorithms are illustrated and compared to the existing volume visualization software for Rayleigh-Benard thermal convection and electron density data sets in terms of rendering time and visual quality for different data compression of both wavelet-based and AMR adaptive meshes.

Vezolainen, Alexei V.↗

Factorized visual representations in the primate visual system and deep neural networks

Object classification has been proposed as a principal objective of the primate ventral visual stream and has been used as an optimization target for deep neural network models (DNNs) of the visual system. However, visual brain areas represent many different types of information, and optimizing for classification of object identity alone does not constrain how other information may be encoded in visual representations. Information about different scene parameters may be discarded altogether (‘invariance’), represented in non-interfering subspaces of population activity (‘factorization’) or encoded in an entangled fashion. In this work, we provide evidence that factorization is a normative principle of biological visual representations. In the monkey ventral visual hierarchy, we found that factorization of object pose and background information from object identity increased in higher-level regions and strongly contributed to improving object identity decoding performance. We then conducted a large-scale analysis of factorization of individual scene parameters – lighting, background, camera viewpoint, and object pose – in a diverse library of DNN models of the visual system. Models which best matched neural, fMRI, and behavioral data from both monkeys and humans across 12 datasets tended to be those which factorized scene parameters most strongly. Notably, invariance to these parameters was not as consistently associated with matches to neural and behavioral data, suggesting that maintaining non-class information in factorized activity subspaces is often preferred to dropping it altogether. Thus, we propose that factorization of visual scene information is a widely used strategy in brains and DNN models thereof.

59 BASIC BIOLOGICAL SCIENCES↗

Computed Tomography Scanning and Geophysical Measurements of the Marcellus Formation from the Armstrong #1 Well

The computed tomography (CT) facilities and the Multi-Sensor Core Logger (MSCL) at the National Energy Technology Laboratory (NETL) in Morgantown, West Virginia were used to characterize core from the Marcellus Formation. The core is from a vertical well (Armstrong #1) drilled in Taylor County, West Virginia by the Petroleum Development Corporation (7,545 to 7,783.4 ft). Core was provided by Phillip Dinterman, West Virginia Geologic and Economical Survey (WVGES) and Tim Carr and Keithan Martin, West Virginia University (WVU). The primary impetus of this work is a collaboration between NETL, WVGES, and WVU to characterize core from multiple wells to better understand the structure and variation of the Marcellus and Utica Shale formations. As part of this effort, bulk scans of core were obtained from the Armstrong #1 well. This report, and the associated scans, provide detailed datasets not typically available from unconventional shales for analysis. The resultant datasets are presented in this report, and can be accessed from NETL's Energy Data eXchange (EDX) online system using the following link: https://edx.netl.doe.gov/dataset/armstrong-well. All equipment and techniques used were non-destructive, enabling future examinations and analyses to be performed on these cores. None of the equipment used was suitable for direct visualization of the shale pore space, although fractures and discontinuities were detectable with the methods tested. Low resolution CT imagery with the NETL medical CT scanner was performed on the entire core. Qualitative analysis of the medical CT images, coupled with X-ray fluorescence (XRF), P-wave, and magnetic susceptibility measurements from the MSCL were useful in identifying zones of interest for more detailed analysis as well as fractured zones. The ability to quickly identify key areas for more detailed study with higher resolution will save time and resources in future studies. The combination of methods used provides a multi-scale analysis of the core; the resulting macro and micro descriptions are relevant to many subsurface energy related examinations traditionally performed at NETL.

47 OTHER INSTRUMENTATION↗

Computed Tomography Scanning and Geophysical Measurements of the Patterson #5-25 Well in Western Kansas

The computed tomography (CT) facilities and the Multi-Sensor Core Logger (MSCL) at the National Energy Technology Laboratory (NETL) site in Morgantown, West Virginia, were used to characterize core from the Patterson Field site. This core came from a vertical well (Patterson #5-25 well) that was obtained as part of the U.S. Department of Energy (DOE) sponsored Integrated Midcontinental Stacked Carbon Storage Hub. The primary impetus of this work is a collaboration between NETL and the Kansas Geological Survey to characterize core from the Patterson Field site. The 625 ft of whole core from the Atoka Formation to Precambrian Basement was characterized at NETL. As part of this effort, bulk scans of core were obtained. This report, and the associated scans, provide detailed datasets not typically made publicly available for carbon capture utilization and storage analysis. The resultant datasets are presented in this report and can be accessed from NETL's Energy Data eXchange (EDX) online system using the following link: https://edx.netl.doe.gov/dataset/patterson-5-25-well. All equipment and techniques used were non-destructive, enabling future examinations and analyses to be performed on these cores. None of the equipment used was suitable for direct visualization of the shale pore space, although fractures and discontinuities were detectable with the methods tested. Low resolution CT imagery with the NETL medical CT scanner was performed on the entire core. Qualitative analysis of the medical CT images, coupled with x-ray fluorescence (XRF), P-wave, and magnetic susceptibility measurements from the MSCL are useful in identifying zones of interest for more detailed analysis as well as fractured zones. The ability to quickly identify key areas for more detailed study with higher resolution will save time and resources in future studies. The combination of methods used provided a multi-scale analysis of this core and provided both a macro and micro description of the core that is relevant for many subsurface energy related examinations that have traditionally been performed at NETL.

58 GEOSCIENCES↗

Efficient Clustering of Software Vulnerabilities using Self Organizing Map (SOM)

The common vulnerabilities and exposures (CVE) database was created with a mission to ``identify, define, and catalog publicly disclosed cybersecurity vulnerabilities''. This rich body of information can be used to enable rapid and efficient response to secure and defend cyber operations and protect critical cyber infrastructure. The main goal of this paper is to develop a visual analytics tool to enable deep analysis of CVEs using unsupervised clustering techniques. We enhance our analysis by first mapping CVEs to hierarchical-classes in Common Weakness Enumeration (CWE) using information in the National Vulnerability Database (NVD). Both the mapping and the numerical representation of CVEs are enabled by V2W-BERT, which uses natural language processing of the extensive information in NVD to generate a large tabular database of 137,226 CVE entries from 1999 to 2020, where each CVE is represented by a vector of 768 numerical features. The vectorized data is processed by Self-Organizing Maps (SOM), which is an unsupervised machine learning technique for dimensionality reduction, visual representation and clustering. Using a Torus map of 6417 units, we achieve ~10-fold data compression of ~140k CVEs using SOM. The trained map is further clustered using standard K-means clustering into 138 clusters of CVEs. We conducted a brief investigation of the rich mapping of CVEs to best-matching-units to K-means clusters, as well as CVEs to CWEs. For example, this novel mapping provided insight into the role of CWE-59 and CWE-264 in several CVEs that is otherwise hard to explore in the original data. We conclude that our this novel approach will not only enable deep analysis of the complex relationships between CVEs and CWEs, but also a mechanism to quickly respond to and design mitigation actions for rapidly evolving vulnerabilities that have not been mapped to existing CWEs.

Panchal, Khyati↗

Scalable analysis tools for sensitivity analysis and UQ (3160) results.

The 9/30/2009 ASC Level 2 Scalable Analysis Tools for Sensitivity Analysis and UQ (Milestone 3160) contains feature recognition capability required by the user community for certain verification and validation tasks focused around sensitivity analysis and uncertainty quantification (UQ). These feature recognition capabilities include crater detection, characterization, and analysis from CTH simulation data; the ability to call fragment and crater identification code from within a CTH simulation; and the ability to output fragments in a geometric format that includes data values over the fragments. The feature recognition capabilities were tested extensively on sample and actual simulations. In addition, a number of stretch criteria were met including the ability to visualize CTH tracer particles and the ability to visualize output from within an S3D simulation.

97 MATHEMATICS AND COMPUTING↗

Predicting U 3 O 8 powder processing conditions: An AI/ML approach analyzing deep learning embeddings of SEM micrographs

High-resolution SEM images of uranium-oxide powders encode micro- and nanoscale clues to their synthesis route and calcination temperature. We trained a ResNet-50 model on 11 commercial-scale U₃O₈ classes, ammonium diuranate (ADU) or uranyl peroxide (H₂O₂) precursors calcined at temperatures ranging from 400 to 750 °C and added a 256-D projection head before the classifier to analyze the learned representation. The best of eight seeds reached 92.4 % accuracy on reserved testing data, but our focus is the structure of the embedding space rather than the accuracy and labels. We quantify class relatedness in the original 256-D space using centroid similarity and distributional distances, and we use Uniform Manifold Approximation Projection (UMAP) for visualization. ‘Unknown’ images from different preparation methods, SEM operators, and from the literature localized near the expected classes under a nearest-centroid analysis without retraining, as well as clustered in similar UMAP space. In conclusion, this embedding-centered workflow complements black-box classification by providing quantitative, similarity-based comparisons of U₃O₈ morphologies and reduces storage space by up to 98 % for image data used in millisecond vector search comparisons.

36 MATERIALS SCIENCE↗

Memory-Aware External Facelist Calculation: A Data-Parallel Atomic Hash Counting Approach

Unstructured volumetric meshes serve as fundamental data representations in various scientific simulations and analyses. They play a crucial role in representing complex computational domains and are essential for important numerical techniques, such as finite element analysis. Whenever such a mesh is read from a file, streamed in-situ, or generated by algorithms, scientific visualization libraries rely on calculating the external surface of a geometry, named “external facelist”, to produce a polygonal mesh for rendering. Consequently, external facelist calculation has become one of the most widely used algorithms in the scientific visualization domain, necessitating optimal performance. In this paper, we explore relevant work on external facelist calculation algorithms in two common visualization libraries, VTK and Viskores, assess their performance and memory constraints, and introduce a novel memory-aware external facelist calculation algorithm employing an atomic hash counting approach. This algorithm fully leverages Viskores' data-parallel primitive operations, facilitating its execution across diverse many-core architectures. Our algorithm features the lowest memory footprint on the GPU and the second-lowest on the CPU among all evaluated methods, and it also delivers the fastest performance on both CPU and GPU. It has been made available under an open-source license in the VTK and Viskores visualization systems.

Tsalikis, Spiros [Kitware] (ORCID:0000000151137195↗

EPIsembleVis: A geo-visual analysis and comparison of the prediction ensembles of multiple COVID-19 models

In this work, we present EPIsembleVis, a web-based comparative visual analysis tool for evaluating the consistency of multiple COVID-19 prediction models. Our approach analyzes a collection of COVID-19 predictions from different epidemiological models as an ensemble and utilizes two metrics to quantify model performance. These metrics include (a) prediction uncertainty (represented as the dispersion of predictions in each ensemble) and (b) prediction error (calculated by comparing individual model predictions with the recorded data). Through an interactive visual interface, our approach provides a data-driven workflow for (a) selecting and constructing the COVID-19 model prediction ensemble based on the spatiotemporal overlap of available predictions of multiple epidemiological models, (b) quantifying the model performance using both the uncertainty of each model prediction ensemble, and the error of each ensemble member that represents individual model predictions, and (c) visualizing the spatiotemporal variability in the projection performance of individual models using a suite of novel ensemble visualization techniques, such as the data availability map, a spatiotemporal textured-tile calendar, multivariate rose chart, and time-series leaflet glyph. We demonstrate the capability of our ensemble visual interface through a case study that investigates the performance of weekly COVID-19 predictions, which are provided through the COVID-19 Forecast Hub UMass-Amherst Influenza Forecasting Center of Excellence [47] for the United States and United States Territories. The EPIsembleVis tool is implemented using open-source web technologies and adaptive system design, rendering it interoperable with Elasticsearch and Kibana for automatically ingesting COVID-19 predictions from online repositories, and it is generalizable for analyzing worldwide projections from more epidemiological models.

60 APPLIED LIFE SCIENCES↗

Exploiting correlations in multi-coincidence Coulomb explosion patterns for differentiating molecular structures using machine learning

Coulomb explosion imaging (CEI) is a powerful technique for capturing the real-time motion of individual atoms during ultrafast photochemical reactions. CEI generates high-dimensional data with naturally embedded correlations that allow mapping the coordinated motion of nuclei in molecules. This enables reliable separation of competing reaction pathways and makes this approach uniquely suited for characterizing weak reaction channels. However, rich information contained in experimental CEI patterns remains largely underexploited due to challenges in visualizing correlations between multiple observables in multi-dimensional parameter space. Here we present a new approach to CEI of intermediate-sized polyatomic molecules, detecting up to eight ionic fragments in coincidence and leveraging machine-learning-based analysis to identify patterns and correlations in the resulting high-dimensional momentum-space data, enabling robust molecular structure identification and differentiation. Our approach provides high-dimensional background-free data encoding exceptionally rich structural information and establishes an automated, scalable framework for extracting insightful information from the data. As a demonstration, we apply this method to image and distinguish dichloroethylene isomers, showcasing its potential for broader applications in molecular imaging. Our results pave the way for channel-specific analysis of ultrafast structural dynamics in chemically relevant systems, particularly for disentangling mixed reaction pathways and detecting contributions from weak channels and minority species.

Chemical Physics (physics.chem-ph)↗

Laboratory-Based Micro-X-ray Computed Tomography of Energy Materials at Idaho National Laboratory

Abstract The Idaho National Laboratory (INL) has implemented laboratory-based micro-X-ray computed tomography in a laboratory equipped for the examination of highly radioactive samples. This capability provides nondestructive three-dimensional volumetric information on samples to inform subsequent traditional destructive examinations as well as real-world inputs for high-fidelity scientific modeling. Samples can be imaged with spatial resolutions ranging from several hundred nm/voxel up to ~ 100 µm/voxel. The best usable spatial resolution achieved to date is 384 nm/voxel with this instrument, while the highest radiological dose rate of a sample imaged is ~ 60 R/h β/γ on contact. Advanced data analysis, including custom tomographic reconstruction and segmentation methods, have also been developed to support this capability. In addition to traditional digital X-ray radiography and tomography, this instrument is also able to visualize in situ tensile and compression testing as well as perform diffraction contrast tomography. This work describes the X-ray computed tomography post-irradiation examination capabilities at INL, as well as detailing a variety of applications this instrument has examined.

36 MATERIALS SCIENCE↗

Candidate Cell and Matrix Interaction Domains on the Collagen Fibril, the Predominant Protein of Vertebrates

Type I collagen, the predominant protein of vertebrates, polymerizes with type III and V collagens and non-collagenous molecules into large cable-like fibrils, yet how the fibril interacts with cells and other binding partners remains poorly understood. To help reveal insights into the collagen structure-function relationship, a data base was assembled including hundreds of type I collagen ligand binding sites and mutations on a two-dimensional model of the fibril. Visual examination of the distribution of functional sites, and statistical analysis of mutation distributions on the fibril suggest it is organized into two domains. The 'cell interaction domain' is proposed to regulate dynamic aspects of collagen biology, including integrin-mediated cell interactions and fibril remodeling. The 'matrix interaction domain' may assume a structural role, mediating collagen cross-linking, proteoglycan interactions, and tissue mineralization. Molecular modeling was used to superimpose the positions of functional sites and mutations from the two-dimensional fibril map onto a three-dimensional x-ray diffraction structure of the collagen microfibril in situ, indicating the existence of domains in the native fibril. Sequence searches revealed that major fibril domain elements are conserved in type I collagens through evolution and in the type II/XI collagen fibril predominant in cartilage. Moreover, the fibril domain model provides potential insights into the genotype-phenotype relationship for several classes of human connective tissue diseases, mechanisms of integrin clustering by fibrils, the polarity of fibril assembly, heterotypic fibril function, and connective tissue pathology in diabetes and aging.

59 BASIC BIOLOGICAL SCIENCES↗

Enabling direct nanoscale observations of biological reactions with dynamic TEM

Biological processes can occur over a wide range of spatial and temporal scales; from femtoseconds to hours and from angstroms to meters. Although no single experimental method can fully cover this entire phase space, many new biological insights can be expected from a better understanding of the processes that occur on the very fast timescales and very small length scales. In this regard, new instruments that use fast x-ray or electron pulses are now available that are expected to reveal new mechanistic insights for macromolecular protein dynamics. To ensure that any observed conformational change is physiologically relevant and not constrained by three-dimensional crystal packing, it would be preferable for experiments to utilize smaller protein samples such as single particles or two-dimensional crystals that mimic the target protein’s native environment. These samples aren’t typically amenable to x-ray analysis, but transmission electron microscopy has successfully imaged such sample geometries for over 40 years and permits data acquisition using both direct imaging and diffraction modes. While conventional transmission electron microscopes (TEM) have only visualized biological samples with atomic resolution in an arrested or frozen state, the recent development of the dynamic TEM (DTEM) extends electron microscopy capabilities into dynamics. A new 2nd generation DTEM that is currently being constructed has the potential to observe live biological processes with unprecedented spatiotemporal resolution by using pulsed electron packets to probe the sample on the micro- and nanosecond timescale. In addition to the enhanced temporal resolution, the DTEM also operates in the pump-probe regime that can permit visualizing reactions propagating in real-time. This article reviews the experimental parameters necessary for coupling DTEM with in situ liquid microscopy to allow direct imaging of protein conformational dynamics in a fully hydrated environment.

Dynamic TEM↗