Search NASA⌕ Search

SEARCH · Search NASA

Results for “Exploratory Visual Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

32 records · Page 2
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

A browser-based tool for visualization and analysis of diffusion MRI data

Human neuroscience research faces several challenges with regards to reproducibility. While scientists are generally aware that data sharing is important, it is not always clear how to share data in a manner that allows other labs to understand and reproduce published findings. Here we report a new open source tool, AFQ-Browser, that builds an interactive website as a companion to a diffusion MRI study. Because AFQ-Browser is portable—it runs in any web-browser—it can facilitate transparency and data sharing. Moreover, by leveraging new web-visualization technologies to create linked views between different dimensions of the dataset (anatomy, diffusion metrics, subject metadata), AFQ-Browser facilitates exploratory data analysis, fueling new discoveries based on previously published datasets. In an era where Big Data is playing an increasingly prominent role in scientific discovery, so will browser-based tools for exploring high-dimensional datasets, communicating scientific discoveries, aggregating data across labs, and publishing data alongside manuscripts.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2017

P-MartCancer–Interactive Online Software to Enable Analysis of Shotgun Cancer Proteomic Datasets

P-MartCancer is a new interactive web-based software environment that enables biomedical and biological scientists to perform in-depth analyses of global proteomics data without requiring direct interaction with the data or with statistical software. P-MartCancer offers a series of statistical modules associated with quality assessment, peptide and protein statistics, protein quantification and exploratory data analyses driven by the user via customized workflows and interactive visualization. Currently, P-MartCancer offers access to multiple cancer proteomic datasets generated through the Clinical Proteomics Tumor Analysis Consortium (CPTAC) at the peptide, gene and protein levels. P-MartCancer is deployed using Azure technologies (http://pmart.labworks.org/cptac.html), the web-service is alternatively available via Docker Hub (https://hub.docker.com/r/pnnl/pmart-web/) and many statistical functions can be utilized directly from an R package available on GitHub (https://github.com/pmartR).

Webb-Robertson, Bobbie-Jo M.↗
DOE OSTI2021

Exploring Explicit Uncertainty for Binary Analysis (EUBA)

Reverse engineering (RE) analysts struggle to address critical questions about the safety of binary code accurately and promptly, and their supporting program analysis tools are simply wrong sometimes. The analysis tools have to approximate in order to provide any information at all, but this means that they introduce uncertainty into their results. And those uncertainties chain from analysis to analysis. We hypothesize that exposing sources, impacts, and control of uncertainty to human binary analysts will allow the analysts to approach their hardest problems with high-powered analytic techniques that they know when to trust. Combining expertise in binary analysis algorithms, human cognition, uncertainty quantification, verification and validation, and visualization, we pursue research that should benefit binary software analysis efforts across the board. We find a strong analogy between RE and exploratory data analysis (EDA); we begin to characterize sources and types of uncertainty found in practice in RE (both in the process and in supporting analyses); we explore a domain-specific focus on uncertainty in pointer analysis, showing that more precise models do help analysts answer small information flow questions faster and more accurately; and we test a general population with domain-general sudoku problems, showing that adding "knobs" to an analysis does not significantly slow down performance. This document describes our explorations in uncertainty in binary analysis.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Revealing Fundamental Physics from the Daya Bay Neutrino Experiment Using Deep Neural Networks

Experiments in particle physics produce enormous quantities of data that must be analyzed and interpreted by teams of physicists. This analysis is often exploratory, where scientists are unable to enumerate the possible types of signal prior to performing the experiment. Thus, tools for summarizing, clustering, visualizing and classifying high-dimensional data are essential. Here in this work, we show that meaningful physical content can be revealed by transforming the raw data into a learned high-level representation using deep neural networks, with measurements taken at the Daya Bay Neutrino Experiment as a case study. We further show how convolutional deep neural networks can provide an effective classification filter with greater than 97% accuracy across different classes of physics events, significantly better than other machine learning approaches.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2018

Remote visual analysis of large turbulence databases at multiple scales

The remote analysis and visualization of raw large turbulence datasets is challenging. Current accurate direct numerical simulations (DNS) of turbulent flows generate datasets with billions of points per time-step and several thousand time-steps per simulation. Until recently, the analysis and visualization of such datasets was restricted to scientists with access to large supercomputers. The public Johns Hopkins Turbulence database simplifies access to multi-terabyte turbulence datasets and facilitates the computation of statistics and extraction of features through the use of commodity hardware. In this paper, we present a framework designed around wavelet-based compression for high-speed visualization of large datasets and methods supporting multi-resolution analysis of turbulence. By integrating common technologies, this framework enables remote access to tools available on supercomputers and over 230 terabytes of DNS data over the Web. Finally, the database toolset is expanded by providing access to exploratory data analysis tools, such as wavelet decomposition capabilities and coherent feature extraction.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

Slycat Enables Synchronized 3D Comparison of Surface Mesh Ensembles [Brief]

In support of analyst requests for Mobile Guardian Transport studies, researchers at Sandia National Laboratories have expanded data types for the Slycat ensemble-analysis and visualization tool to include 3D surface meshes. This new capability represents a significant advance in our ability to perform detailed comparative analysis of simulation results. Analyzing mesh data rather than images provides greater flexibility for post-processing exploratory analysis.

36 MATERIALS SCIENCE↗
DOE OSTI2016

SeekAView: An Intelligent Dimensionality Reduction Strategy for Navigating High-Dimensional Data Spaces

Dealing with the curse of dimensionality is a key challenge in high-dimensional data visualization. We present SeekAView to address three main gaps in the existing research literature. First, automated methods like dimensionality reduction or clustering suffer from a lack of transparency in letting analysts interact with their outputs in real-time to suit their exploration strategies. The results often suffer from a lack of interpretability, especially for domain experts not trained in statistics and machine learning. Second, exploratory visualization techniques like scatter plots or parallel coordinates suffer from a lack of visual scalability: it is difficult to present a coherent overview of interesting combinations of dimensions. Third, the existing techniques do not provide a flexible workflow that allows for multiple perspectives into the analysis process by automatically detecting and suggesting potentially interesting subspaces. In SeekAView we address these issues using suggestion based visual exploration of interesting patterns for building and refining multidimensional subspaces. Compared to the state-of-the-art in subspace search and visualization methods, we achieve higher transparency in showing not only the results of the algorithms, but also interesting dimensions calibrated against different metrics. We integrate a visually scalable design space with an iterative workflow guiding the analysts by choosing the starting points and letting them slice and dice through the data to find interesting subspaces and detect correlations, clusters, and outliers. We present two usage scenarios for demonstrating how SeekAView can be applied in real-world data analysis scenarios.

Krause, Josua↗
DOE OSTI2024

FREDA: A Web Application for the Processing, Analysis, and Visualization of Fourier‐Transform Mass Spectrometry Data

The high-resolution measurement capability of Fourier-transform mass spectrometry (FT-MS) has made it a necessity for exploring the molecular composition of complex organic mixtures, like soil, plant, aquatic, and petroleum samples. This demand has driven a need for informatics tools to explore and analyze FT-MS data in a robust and reproducible manner. FREDA is an interactive web application developed to enable spectrometrists to format, process, and explore their FT-MS data without the need for statistical programming expertise. FREDA was built to explore outputs from a molecular identification tool, like CoreMS, and provide a suite of methods to filter data, compute chemical properties of peaks, statistically compare samples and groups of samples, conduct exploratory data analysis, and download the results with a report detailing all steps conducted. To demonstrate the utility of FREDA, an example analysis was conducted using FT-MS data from a soil microbiology study of samples collected in two different soil depths at the Sphagnum bog forest north of Grand Rapids, Minnesota. Differences between the two depths are observed using Kendrick, Gibbs free energy, and van Krevelen plots. G-tests are used to quantify a significant difference between the groups. All analyses and plotting are conducted using only the FREDA application. FREDA is an open-source and readily available web application that allows users to explore and make statistically valid conclusions about their FT-MS data. The application is available online (https://map.emsl.pnnl.gov/app/freda) with a tutorial web series (https://youtu.be/k5HLE2kNSBY?si=yB6sGoyvzxrFf5MP) and freely accessible code on Github (https://github.com/EMSL-Computing/FREDA).

47 OTHER INSTRUMENTATION↗
DOE OSTI2022

Unsupervised Machine Learning for Exploratory Data Analysis of Exoplanet Transmission Spectra

Abstract Transit spectroscopy is a powerful tool for decoding the chemical compositions of the atmospheres of extrasolar planets. In this paper, we focus on unsupervised techniques for analyzing spectral data from transiting exoplanets. After cleaning and validating the data, we demonstrate methods for: (i) initial exploratory data analysis, based on summary statistics (estimates of location and variability); (ii) exploring and quantifying the existing correlations in the data; (iii) preprocessing and linearly transforming the data to its principal components; (iv) dimensionality reduction and manifold learning; (v) clustering and anomaly detection; and (vi) visualization and interpretation of the data. To illustrate the proposed unsupervised methodology, we use a well-known public benchmark data set of synthetic transit spectra. We show that there is a high degree of correlation in the spectral data, which calls for appropriate low-dimensional representations. We explore a number of different techniques for such dimensionality reduction and identify several suitable options in terms of summary statistics, principal components, etc. We uncover interesting structures in the principal component basis, namely well-defined branches corresponding to different chemical regimes of the underlying atmospheres. We demonstrate that those branches can be successfully recovered with a K-means clustering algorithm in a fully unsupervised fashion. We advocate for lower-dimensional representations of the spectroscopic data in terms of the main principal components, in order to reveal the existing structure in the data and quickly characterize the chemical class of a planet.

Matchev, Konstantin T. (ORCID:0000000341829096)↗
DOE OSTI2020

Hypergraph Analytics of Domain Name System Relationships

We report on the use of novel mathematical methods in hypergraph analytice over a large quantity of DNS data. Hypergraphs generalize graphs, as used in network science, to better model complex multiway relations in cyber data. Specifically, casting DNS data from Georgia Tech's ActiveDNS repository as hypergraphs allows us to fully represent the interactions between {\em collections} of domains and IP addresses. To facilitate large-scale analytics, we fielded an analytical pipeline of two capabilities. HyperNetX (HNX) is a Python package for the exploration and visualization of hypergraphs, acting as a frontend. For the backend, the Chapel HyperGraph Library (CHGL) is a library for high performance hypergraph analytics written in the exascale programming language Chapel. CHGL was used to process gigascale DNS data, performing compute-intensive calculations for data reduction and segmentation. Identified portions are then sent to HNX for both exploratory analysis and knowledge discovery targeting known tactics, techniques, and procedures.

Joslyn, Cliff A.↗
DOE OSTI2022

Pulsed Thermal Tomography Nondestructive Examination of Additively Manufactured Reactor Materials and Components (Final Technical Report)

Metal Additive Manufacturing (AM) is a promising method for cost-efficient fabrication of complex shape structures for applications in harsh environment, such as in a nuclear reactor. However, internal defects (pores) occur in high-strength AM alloys, which are manufactured with Laser Powder Bed Fusion (LPBF) AM method. Pulsed Infrared Thermography (PIT) is an efficient nondestructive evaluation (NDE) method to examine actual structures, because this method offers one-sided non-contact measurements, and fast processing of large sample areas. However, imaging of material defects, particularly defects with sizes at microscopic level, is challenging. In this report, we benchmark the performance of several Unsupervised Learning (UL) algorithms designed to enhance imaging of microscopic defects in metals with PIT. UL aims to learn the latent principal patterns (dictionaries) in PIT data to detect defects with minimal human supervision. Performance of Independent Component Analysis (ICA), Sparse Coding (SC), Principal Component Analysis (PCA) and Exploratory Factor Analysis (EFA) was compared using F-score, UL model training time and defects reconstruction time. We obtained the average F-score of 0.75, and a highest F-score of 0.89 for the EFA algorithm. Overall, EFA outperforms other UL algorithms considered in this study. In another approach, we investigate Thermal Tomography (TT), which is a computational method for reconstruction of depth profile of internal material defects from PIT nondestructive evaluation (NDE). TT algorithm obtains depth reconstructions of thermal effusivity, which has been shown to provide visualization of subsurface internals defects in metals. In many applications, one needs to determine the defect shape and orientation from reconstructed effusivity images. Interpretation of TT images is non-trivial because of blurring, which increases with depth due to heat diffusion-based nature of image formation. We have developed a deep learning convolutional neural network (CNN) to classify size and orientation of subsurface material defects in TT images. CNN was trained with TT images produced with computer simulations of 2D metallic structures (thin plates) containing elliptical subsurface voids. Performance of CNN was investigated using test TT images developed with computer simulations of plates containing elliptical defects, and defects with shape imported from scanning electron microscopy (SEM) images. CNN demonstrated the ability to classify radii and angular orientation of elliptical defects in previously unseen test TT images. We have also demonstrated that CNN trained on TT images of elliptical defects is capable of classifying shape and orientation of irregular defects. Training the CNN on irregular defect shapes instead of on elliptical shapes would make the resulting classifications more descriptive of actual defect shapes. However, this requires a much higher volume of SEM images of material defects, which are difficult to obtain because of random occurrence of defects in LPBF. To address this challenge, we developed a generative adversarial network (GAN) to augment the existing dataset of SEM defect images. The GAN model is demonstrated to create novel yet realistic defect shapes that can be used as input for simulated PTT images to train CNN. We also investigate several approaches based on Gaussian Random Circle and Bezier Curves for constructing parametric models of irregular-shape defects.

36 MATERIALS SCIENCE↗
DOE OSTI2022

AIMSim : An accessible cheminformatics platform for similarity operations on chemicals datasets

The recent advances in deep learning, generative modeling, and statistical learning have ushered in a renewed interest in traditional cheminformatics tools and methods. Quantifying molecular similarity is essential in molecular generative modeling, exploratory molecular synthesis campaigns, and drug-discovery applications to assess how new molecules differ from existing ones. Further, most tools target advanced users and lack general implementations accessible to the larger community. In this work, we introduce Artificial Intelligence Molecular Similarity (AIMSim), an accessible cheminformatics platform for performing similarity operations on collections of molecules called molecular datasets. AIMSim provides a unified platform to perform similarity-based tasks on molecular datasets, such as diversity quantification, outlier and novelty analysis, clustering, dimensionality reduction, and inter-molecular comparisons. AIMSim implements all major binary similarity metrics and molecular fingerprints and is provided as a Python package that includes support for command-line use as well as a Graphical User Interface for code-free utilization with fully interactive plots.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2017

Small Scale Field Test Demonstrating CO 2 Sequestration In Arbuckle Saline Aquifer And By CO 2 -Eor At Wellington Field, Sumner County, Kansas

The objectives of this project are to understand the processes that occur when a maximum of 70,000 metric tonnes of CO 2 are injected into two different formations to evaluate the response in different lithofacies and depositional environments. The evaluation will be accomplished through the use of both in situ and indirect MVA (monitoring, verification, and accounting) technologies. The project will optimize for carbon storage accounting for 99% of the CO 2 using lab and field testing and comprehensive characterization and modeling techniques. Site characterization and CO 2 injection should demonstrate state-of-the-art MVA tools and techniques to monitor and visualize the injected CO 2 plume and to refine geomodels developed using nearly continuous core, exhaustive wireline logs, and well tests and a multi-component 3-D seismic survey. Reservoir simulation studies will map the injected CO 2 plume and estimate tonnage of CO 2 stored in solution, as residual gas, and by mineralization and integrate MVA results and reservoir models shall be used to evaluate CO 2 leakage. A rapid-response mitigation plan was developed to minimize CO 2 leakage and provide a comprehensive risk management strategy. The CO 2 was intended to be supplied from a reliable facility and have an adequate delivery and quality of CO 2 . However, several unforeseen circumstances complicated this plan: (1) the initially negotiated CO 2 supply facility went offline and contracts associated with CO 2 supply had to be renegotiated, (2) a UIC Class VI permit proved to be difficult to obtain due to the experimental nature of the project. Both subjects are detailed in separate deliverables attached to this report. The CO 2 enhanced oil recovery (EOR) and geologic storage in Mississippian carbonate reservoir was sucessully deployed. Approximately 20,000 metric tons of CO 2 was injected in the upper part of the Mississippian reservoir to verify CO 2 EOR viability in carbonate reservoirs and evaluate a potential of transitioning to geologic CO 2 storage through EOR. A total of 1,101 truckloads, 19,803 metric tons—an average of 120 tonnes per day—were delivered over the course of injection that lasted from January 9 to June 21, 2016. After cessation of CO 2 injection, the KGS 2-32 well was converted to water injector and continues to operate. CO 2 EOR progression in the field was monitored weekly with fluid level, temperature, and production recording and formation fluid composition sampling. It is important to note that normally, CO 2 EOR pilots are less efficient than commercial operations due to lack of directional and precise well control, lack of surface facilities for CO 2 recycling, and other factors. As a result of this pilot CO 2 injection, the observed incremental average oil production increase was ~68% with only ~18% of injected CO 2 produced back. Decline curve analysis forecasts of additional cumulative oil produced were 32.44M STB to the end of 2027. Wellington Mississippian pilot efficiency by the end of forecast calculations is 11 MCF per barrel of produced oil. Using 32M STB oil production and $1,964,063 cost of CO 2 , CO 2 EOR cost per barrel of oil production is ~$60. Simple but robust monitoring technologies proved to be very efficient in detecting and locating CO 2 . High CO 2 reservoir retentions with low yields within an actively producing field could help to estimate real-world risks of CO 2 geological storage for future projects. The Wellington Field CO 2 EOR was executed in a controlled environment with high efficiency. This case study proves that CO 2 EOR could be successfully applied in Kansas carbonate reservoirs if CO 2 sources and associated infrastructure are available. Recent developments in unconventional resources development in Mid-Continent USA and associated large volume disposal of backflow water and the resulting seismic activity have brought more focus and attention to the Arbuckle Group in southern Kansas. Despite the commercial interest, limited essential information about reservoir properties and structural elements has impeded the management and regulation of disposal, an issue brought to the forefront by recent seismicity in and near areas of large volumes and rates of brine disposal. The Kansas Geological Survey (KGS) collected, compiled, and analyzed available data, including well logs, core data, step rate tests, drill stem tests, 2-D and 3-D seismic data, water level measurements, and others types of data. Several exploratory wells were drilled and core was collected and modern suites of logs were analyzed. Reservoir properties were populated into several site-specific geological models. The geological models illustrate the highly heterogeneous nature of the Arbuckle Group. Vertical and horizontal variability results in several distinct hydro-stratigraphic units that are the result of both depositional and diagenetic processes. During the course of this project, it has been demonstrated that advanced seismic interpretation methods can be used successfully for characterization of the Mississippian reservoir and Arbuckle saline aquifer. Analysis of post-stack 3-D seismic data at the Mississippian reservoir showed the response of a gradational velocity transition. Pre-stack gather analysis showed that porosity zones of the Mississippian and Arbuckle reservoirs exhibit characteristic amplitude versus offset (AVO) response. Simultaneous AVO inversion estimated P- and S-impedances. The 3-D survey gather azimuthal anisotropy analysis (AVAZ) provided information about the fault and fracture network and showed good agreement to the regional stress field and well data. Mississippian reservoir porosity and fracture predictions agreed well with the observed mobility of injected CO 2 in KGS well 2-32. Fluid substitution modeling predicted acoustic impedance reduction in the Mississippian carbonate reservoir introduced by the presence of CO 2 . Seismicity in the United States midcontinent has increased by orders of magnitude over the past decade. Spatiotemporal correlations of seismicity to wastewater injection operations have suggested that injection-related pore fluid pressure increases are inducing the earthquakes. In this investigation, we examine earthquake occurrence in southern Kansas and northern Oklahoma and its relation to the change in pore pressure. The main source of data comes from the Wellington Array in the Wellington oil field, in Sumner County, Kansas, which has monitored for earthquakes in central Sumner County, Kansas, since early 2015. The seismometer array was established to monitor CO 2 injection operations at Wellington Field. Although no seismicity was detected in association with the spring 2016 Mississippian CO 2 injection, the array has recorded more than 2,500 earthquakes in the region and is providing valuable understanding to induced seismicity. A catalog of earthquakes was built from this data and was analyzed for spatial and temporal changes, stress information, and anisotropy information. The region of seismic concern has been shown to be expanding through use of the Wellington earthquake catalog, which has revealed a northward progression of earthquake activity reaching the metropolitan area of Wichita. The stress orientation was also calculated from this earthquake catalog through focal mechanism inversion. The calculated stress orientation was confirmed through comparison to other stress measurements from well data and previous earthquake studies in the region. With this knowledge of the stress orientation, the anisotropy in the basement could be understood. This allowed for the anisotropy measurements to be correlated to pore pressure increases. The increase in pore pressure was monitored through time-lapse shear-wave anisotropy analysis. Since the onset of the observation period in 2010, the orientation of the fast shear wave has rotated 90°, indicating a change associated with critical pore pressure build up. The time delay between fast and slow shear wave arrivals has increased, indicating a corresponding increase in anisotropy induced by pore pressure rise. In-situ near-basement fluid pressure measurements corroborate the continuous pore pressure increase revealed by the shear-wave anisotropy analysis over the earthquake monitoring period. This research is the first to identify a change in pore fluid pressure in the basement using seismological data and it was recently published in the AAAS journal Science Advances (Nolte et al., 2017). The shear-wave splitting analysis is a novel application of the technique, which can be used in other regions to identify an increase in pore pressure. This increasing pore fluid pressure has become more regionally extensive as earthquakes are occurring in southern Kansas, where they previously were absent. These monitoring techniques and analyses provide new insight into mitigating induced seismicity’s impact on society.

02 PETROLEUM↗