Search NASA⌕ Search

SEARCH · Search NASA

Results for “statistical visualization”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2019

Full Integration of Lipidomics Data into Multi-OMIC Functional Enrichment

Lipids have numerous roles critical to living systems. Many of these vital functions are tightly linked or regulated by proteins. Even though the function of many lipid-related enzymes is known, direct links between most individual lipid species and the enzymes that metabolize them are severely lacking. This missing connection impedes biological progress. A resource that allows users to quickly identify protein-lipid relationships will advance our understanding of lipid homeostasis and metabolic perturbed systems. Databases are readily available for mapping small molecule metabolites (i.e., polar metabolites) and specific oxidized fatty acid lipids (e.g., arachidonic acid derivatives) to proteins/enzymes known to be directly involved in metabolism of these molecules (e.g. SMPDB, Reactome, HMDB, BioCyc). This enables the integration of metabolite and protein (as well as transcript) data when performing functional enrichment and metabolic modeling allowing researchers to rapidly examine metabolic pathways from multiple omics sources. Currently, linking lipidomics data with proteomics data is conducted using a time-intensive, user defined, manual process. Here we propose creating a tool that will link lipidomics and proteomics data and also conduct functional enrichment analysis and visualization allowing for full statistical integration. Using text-mining approaches, we will extract lipid references from uniprot and create a database linking lipid species to enzymes directly related to their metabolism. We will also extract directional annotation, which will allow even greater specificity when linking data types and will help eliminate false positives from functional associations.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2015

Kelvin Probe Force Microscopy in liquid using Electrochemical Force Microscopy

Conventional closed loop-Kelvin probe force microscopy (KPFM) has emerged as a powerful technique for probing electric and transport phenomena at the solid-gas interface. The extension of KPFM capabilities to probe electrostatic and electrochemical phenomena at the solid–liquid interface is of interest for a broad range of applications from energy storage to biological systems. However, the operation of KPFM implicitly relies on the presence of a linear lossless dielectric in the probe-sample gap, a condition which is violated for ionically-active liquids (e.g., when diffuse charge dynamics are present). Here, electrostatic and electrochemical measurements are demonstrated in ionically-active (polar isopropanol, milli-Q water and aqueous NaCl) and ionically-inactive (non-polar decane) liquids by electrochemical force microscopy (EcFM), a multidimensional (i.e., bias- and time-resolved) spectroscopy method. In the absence of mobile charges (ambient and non-polar liquids), KPFM and EcFM are both feasible, yielding comparable contact potential difference (CPD) values. In ionically-active liquids, KPFM is not possible and EcFM can be used to measure the dynamic CPD and a rich spectrum of information pertaining to charge screening, ion diffusion, and electrochemical processes (e.g., Faradaic reactions). EcFM measurements conducted in isopropanol and milli-Q water over Au and highly ordered pyrolytic graphite electrodes demonstrate both sample- and solvent-dependent features. Finally, the feasibility of using EcFM as a local force-based mapping technique of material-dependent electrostatic and electrochemical response is investigated. The resultant high dimensional dataset is visualized using a purely statistical approach that does not require a priori physical models, allowing for qualitative mapping of electrostatic and electrochemical material properties at the solid–liquid interface.

77 NANOSCIENCE AND NANOTECHNOLOGY↗
DOE OSTI2014

ORBiT - The Oak Ridge Biosurveillance Toolkit

We describe ORBiT, the Oak Ridge Biosurveillance Toolkit, the objective of which is to provide 1) forecasting and early warning, and 2) an extensible data analytics platform for biosurveillance by enabling the use of traditional and non-traditional datasets, consisting of heterogeneous data types and modalities. ORBiT includes a data collection interface, analytic components, higher-order statistical tools, and a visual front-end with visual analytics. ORBiT is implemented as a distributed analytic platform consisting of a software stack atop of Hadoop and uses Titan, a distributed graph database as a backend for data storage.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Characterizing Dislocation Defects in Dark Field X-ray Microscopy Images of Bulk Aluminum

Material defects play a large role in material response under shock loading, yet the process of how these defects initiate, propagate, and annihilate is not well understood. Using a newly developed diagnostic, dark field X-ray microscopy (DFXM), we can now visualize the behavior of dislocation defects in materials at the mesoscale under varying conditions. Using data from the European Synchrotron Radiation Facility, we apply a variety of image processing techniques to capture relevant features to locate and characterize size and orientation of dislocation defects in bulk aluminum DFXM images. Beyond simple visualization, this analysis drives statistical characterization of the defects and their dynamic response to further improve the relevant physics models.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2015

A Divergence Statistics Extension to VTK for Performance Analysis

This report follows the series of previous documents ([PT08, BPRT09b, PT09, BPT09, PT10, PB13], where we presented the parallel descriptive, correlative, multi-correlative, principal component analysis, contingency, k -means, order and auto-correlative statistics engines which we developed within the Visualization Tool Kit ( VTK ) as a scalable, parallel and versatile statistics package. We now report on a new engine which we developed for the calculation of divergence statistics, a concept which we hereafter explain and whose main goal is to quantify the discrepancy, in a stasticial manner akin to measuring a distance, between an observed empirical distribution and a theoretical, "ideal" one. The ease of use of the new diverence statistics engine is illustrated by the means of C++ code snippets. Although this new engine does not yet have a parallel implementation, it has already been applied to HPC performance analysis, of which we provide an example.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2014

Interactive XCMS Online: Simplifying Advanced Metabolomic Data Processing and Subsequent Statistical Analyses

XCMS Online (xcmsonline.scripps.edu) is a cloud-based informatic platform designed to process and visualize mass-spectrometry-based, untargeted metabolomic data. Initially, the platform was developed for two-group comparisons to match the independent, “control” versus “disease” experimental design. Here, we introduce an enhanced XCMS Online interface that enables users to perform dependent (paired) two-group comparisons, meta-analysis, and multigroup comparisons, with comprehensive statistical output and interactive visualization tools. Newly incorporated statistical tests cover a wide array of univariate analyses. Multigroup comparison allows for the identification of differentially expressed metabolite features across multiple classes of data while higher order meta-analysis facilitates the identification of shared metabolic patterns across multiple two-group comparisons. Given the complexity of these data sets, we have developed an interactive platform where users can monitor the statistical output of univariate (cloud plots) and multivariate (PCA plots) data analysis in real time by adjusting the threshold and range of various parameters. On the interactive cloud plot, metabolite features can be filtered out by their significance level (p-value), fold change, mass-to-charge ratio, retention time, and intensity. The variation pattern of each feature can be visualized on both extracted-ion chromatograms and box plots. The interactive principal component analysis includes scores, loadings, and scree plots that can be adjusted depending on scaling criteria. The utility of XCMS functionalities is demonstrated through the metabolomic analysis of bacterial stress response and the comparison of lymphoblastic leukemia cell lines.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2022

Translation and rotation equivariant normalizing flow (TRENF) for optimal cosmological analysis

ABSTRACT Our Universe is homogeneous and isotropic, and its perturbations obey translation and rotation symmetry. In this work, we develop translation and rotation equivariant normalizing flow (TRENF), a generative normalizing flow (NF) model which explicitly incorporates these symmetries, defining the data likelihood via a sequence of Fourier space-based convolutions and pixel-wise non-linear transforms. TRENF gives direct access to the high dimensional data likelihood p(x|y) as a function of the labels y, such as cosmological parameters. In contrast to traditional analyses based on summary statistics, the NF approach has no loss of information since it preserves the full dimensionality of the data. On Gaussian random fields, the TRENF likelihood agrees well with the analytical expression and saturates the Fisher information content in the labels y. On non-linear cosmological overdensity fields from N-body simulations, TRENF leads to significant improvements in constraining power over the standard power spectrum summary statistic. TRENF is also a generative model of the data, and we show that TRENF samples agree well with the N-body simulations it trained on, and that the inverse mapping of the data agrees well with a Gaussian white noise both visually and on various summary statistics: when this is perfectly achieved the resulting p(x|y) likelihood analysis becomes optimal. Finally, we develop a generalization of this model that can handle effects that break the symmetry of the data, such as the survey mask, which enables likelihood analysis on data without periodic boundaries.

79 ASTRONOMY AND ASTROPHYSICS↗
DOE OSTI2017

Wind Wake Watcher v. 1.0

This software enables the user to produce Google Earth visualizations of turbine wake effects for wind farms. The visualizations are based on computations of statistical quantities that vary with wind direction and help quantify the effects on power production of upwind turbines on turbines in their wakes. The results of the software are plot images and kml files that can be loaded into Google Earth. The statistics computed are described in greater detail in the paper: S. Martin, C. H. Westergaard, and J. White (2016), Visualizing Wind Farm Wakes Using SCADA Data, in Wither Turbulence and Big Data in the 21st Century? Eds. A. Pollard, L. Castillo, L. Danaila, and M. Glauser. Springer, pgs. 231-254.

Martin, Shawn↗
DOE OSTI2015

ND 2 AV: N-dimensional data analysis and visualization analysis for the National Ignition Campaign

Here, one of the biggest challenges in high-energy physics is to analyze a complex mix of experimental and simulation data to gain new insights into the underlying physics. Currently, this analysis relies primarily on the intuition of trained experts often using nothing more sophisticated than default scatter plots. Many advanced analysis techniques are not easily accessible to scientists and not flexible enough to explore the potentially interesting hypotheses in an intuitive manner. Furthermore, results from individual techniques are often difficult to integrate, leading to a confusing patchwork of analysis snippets too cumbersome for data exploration. This paper presents a case study on how a combination of techniques from statistics, machine learning, topology, and visualization can have a significant impact in the field of inertial confinement fusion. We present the $\mathrm{ND}^2\mathrm{AV}$: N-dimensional data analysis and visualization framework, a user-friendly tool aimed at exploiting the intuition and current workflow of the target users. The system integrates traditional analysis approaches such as dimension reduction and clustering with state-of-the-art techniques such as neighborhood graphs and topological analysis, and custom capabilities such as defining combined metrics on the fly. All components are linked into an interactive environment that enables an intuitive exploration of a wide variety of hypotheses while relating the results to concepts familiar to the users, such as scatter plots. $\mathrm{ND}^2\mathrm{AV}$ uses a modular design providing easy extensibility and customization for different applications. $\mathrm{ND}^2\mathrm{AV}$ is being actively used in the National Ignition Campaign and has already led to a number of unexpected discoveries.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

How “hot” are hotspots: Statistically localizing the high-activity areas on soil and rhizosphere images

The topic of microbial hotspots in soil requires not only visualizing their spatial distribution and biochemical analyses, but also statistical approaches to identify these hotspots and separate them from the surrounding activities (background). We hypothesized that each hotspot type (e.g. enzyme activities in the rhizosphere, root exudation, localization of herbicide accumulation) is a result of local process driven by biotic and/or abiotic factors, and the process rates in the hotspots are much faster than those in the soil background. We further hypothesized that the background and hotspot activities in soil belong to different statistical distributions. Consequently, hotspot determination should be based on statistical separation of activities significantly higher than the background. We analyzed for the statistical distributions of grey values on three groups of published images: 1) 14 C images of carbon input by roots into the rhizosphere, 2) 14 C glyphosate accumulation in the plant, and 3) zymogram of leucine aminopeptidase activity in rooted soil. The two Gaussian distributions were fit (the first representing the background, the second the hotspots) to the distribution of grey values in the images, the parameters (means and standard deviations, SD) of the fitted distributions were calculated, and the background was removed. Thus, we identified hotspots as areas outside of the Mean+2SD image intensity (corresponding to the upper ~ 2.5% of activity, being over 97.5% of background values) and finally, visualized images of solely hotspot locations. Finally, these results were compared with previously used decisions on hotspot intensity thresholding (i.e. Top-25% and 17 standard thresholding approaches in ImageJ) and discussed the advantages of the Mean+2SD as well as Mean+3SD approaches. These advantages include: i) simple unification of the thresholding approach for several imaging methods with various principles of activity distribution, ii) identification of hotspots with various activity levels, iii) analysis of “time-specific” hotspots in temporal sequences of images. Compared with 17 standard thresholding methods, we concluded that objectively elucidating and separating the hotspots should be based on statistical distribution analysis, e.g. using the Mean+2SD or Mean+3SD approaches. Furthermore, this simple Mean+2SD approach delivered suitable results for three groups of images and so, helps to understand the processes responsible for the highest activities and elucidate hotspots.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2017

Analysis of Radiation Transport Due to Activated Coolant in the ITER Neutral Beam Injection Cell

Detailed spatial distributions of the biological dose rate due to a variety of sources are required for the design of the ITER tokamak facility to ensure that all radiological zoning limits are met. During operation, water in the Integrated loop of Blanket, Edge-localized mode and vertical stabilization coils, and Divertor (IBED) cooling system will be activated by plasma neutrons and will flow out of the bioshield through a complex system of pipes and heat exchangers. This paper discusses the methods used to characterize the biological dose rate outside the tokamak complex due to 16 N gamma radiation emitted by the activated coolant in the Neutral Beam Injection (NBI) cell of the tokamak building. Activated coolant will enter the NBI cell through the IBED Primary Heat Transfer System (PHTS), and the NBI PHTS will also become activated due to radiation streaming through the NBI system. To properly characterize these gamma sources, the production of 16 N, the decay of 16 N, and the flow of activated water through the coolant loops were modeled. The impact of conservative approximations on the solution was also examined. Once the source due to activated coolant was calculated, the resulting biological dose rate outside the north wall of the NBI cell was determined through the use of sophisticated variance reduction techniques. The AutomateD VAriaNce reducTion Generator (ADVANTG) software implements methods developed specifically to provide highly effective variance reduction for complex radiation transport simulations such as those encountered with ITER. Using ADVANTG with the Monte Carlo N-particle (MCNP) radiation transport code, radiation responses were calculated on a fine spatial mesh with a high degree of statistical accuracy. In conclusion, advanced visualization tools were also developed and used to determine pipe cell connectivity, to facilitate model checking, and to post-process the transport simulation results.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

FeederGAN: Synthetic Feeder Generation via Deep Graph Adversarial Nets

This paper presents a novel, automated, generative adversarial networks (GAN) based synthetic feeder generation mechanism, abbreviated as FeederGAN. FeederGAN digests real feeder models represented by directed graphs via a deep learning framework powered by GAN and graph convolutional networks (GCN). Information of a distribution feeder circuit is extracted from its model input files so that the device connectivity is mapped onto the adjacency matrix and the device characteristics, such as circuit types (i.e., 3-phase, 2-phase, and 1-phase) and component attributes (e.g., length and current ratings), are mapped onto the attribute matrix. Then, Wasserstein distance is used to optimize the GAN and GCN is used to discriminate the generated graphs from the actual ones. A greedy method based on graph theory is developed to reconstruct the feeder using the generated adjacency and attribute matrices. Furthermore, our results show that the GAN generated feeders resemble the actual feeder in both topology and attributes verified by visual inspection and by empirical statistics obtained from actual distribution feeders.

42 ENGINEERING↗
DOE OSTI2022

gdess: A framework for evaluating simulated atmospheric CO 2 in Earth System Models

Atmospheric carbon dioxide (CO 2 ) plays a key role in the global carbon cycle and global warming. Climate-carbon feedbacks are often studied and estimated using Earth System Models (ESMs), which couple together multiple model components—including the atmosphere, ocean, terrestrial biosphere, and cryosphere—to jointly simulate mass and energy exchanges within and between these components. Despite tremendous advances, model intercomparisons and benchmarking are aspects of ESMs that warrant further improvement (Fer et al., 2021; Smith et al., 2014). Such benchmarking is critical because comparing the value of state variables in these simulations against observed values provides evidence for appropriately refining model components; moreover, researchers can learn much about Earth system dynamics in the process (Randall et al., 2019). We introduce `gdess` (a.k.a., Greenhouse gas Diagnostics for Earth System Simulations), which parses observational datasets and ESM simulation output, combines them to be in a consistent structure, computes statistical metrics, and generates diagnostic visualizations. In its current incarnation, `gdess` facilitates evaluating a model's ability to reproduce observed temporal and spatial variations of atmospheric CO 2 . The diagnostics implemented modularly in `gdess` support more rapid assessment and improvement of model-simulated global CO 2 sources and sinks associated with land and ocean ecosystem processes. We intend for this set of automated diagnostics to form an extensible, open source framework for future comparisons of simulated and observed concentrations of various greenhouse gases across Earth system models.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Watching for light: An enterprise roadmap for trustworthy laser threat warning (LTW) to protect national assets

Comprehensive space force protection must include effective and trustworthy laser threat warning (LTW). Effective LTW will detect and characterize threats to space assets and thus enhance space deterrence. LTW must be trustworthy: able to categorize threats and non-threats by being both sensitive to true events and resistant to false alarms. Outside of the laboratory, the statistics and even the roles of lasers become unclear. In the chain of events leading to an attack, the laser may be the last link to be understood. Human situational awareness and informal reasoning must blend statistics with circumstantial evidence to visualize these chains before they are clear. This paper sets out an industrial model for an enterprise that will routinely produce trustworthy LTW. By incorporating psychology and economics, this enterprise can overcome the difficulties and perils of cooperation in networked defense and intelligence. This roadmap suggests how the enterprise can incentivize distracted actors with different goals to share what they know and coordinate what they do.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗
DOE OSTI2023

PyFLEXTRKR: a flexible feature tracking Python software for convective cloud analysis

Abstract. This paper describes the new open-source framework PyFLEXTRKR (Python FLEXible object TRacKeR), a flexible atmospheric feature tracking software package with specific capabilities to track convective clouds from a variety of observations and model simulations. This software can track any atmospheric 2D objects and handle merging and splitting explicitly. The package has a collection of multi-object identification algorithms, scalable parallelization options, and has been optimized for large datasets including global high-resolution data. We demonstrate applications of PyFLEXTRKR on tracking individual deep convective cells and mesoscale convective systems from observations and model simulations ranging from large-eddy resolving (∼100s m) to mesoscale (∼10s km) resolutions. Visualization, post-processing, and statistical analysis tools are included in the package. New Lagrangian analyses of convective clouds produced by PyFLEXTRKR applicable to a wide range of datasets and scales facilitate advanced model evaluation and development efforts as well as scientific discovery.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2017

Simulation Exploration through Immersive Parallel Planes

We present a visualization-driven simulation system that tightly couples systems dynamics simulations with an immersive virtual environment to allow analysts to rapidly develop and test hypotheses in a high-dimensional parameter space. To accomplish this, we generalize the two-dimensional parallel-coordinates statistical graphic as an immersive 'parallel-planes' visualization for multivariate time series emitted by simulations running in parallel with the visualization. In contrast to traditional parallel coordinate's mapping the multivariate dimensions onto coordinate axes represented by a series of parallel lines, we map pairs of the multivariate dimensions onto a series of parallel rectangles. As in the case of parallel coordinates, each individual observation in the dataset is mapped to a polyline whose vertices coincide with its coordinate values. Regions of the rectangles can be 'brushed' to highlight and select observations of interest: a 'slider' control allows the user to filter the observations by their time coordinate. In an immersive virtual environment, users interact with the parallel planes using a joystick that can select regions on the planes, manipulate selection, and filter time. The brushing and selection actions are used to both explore existing data as well as to launch additional simulations corresponding to the visually selected portions of the input parameter space. As soon as the new simulations complete, their resulting observations are displayed in the virtual environment. This tight feedback loop between simulation and immersive analytics accelerates users' realization of insights about the simulation and its output.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

SeekAView: An Intelligent Dimensionality Reduction Strategy for Navigating High-Dimensional Data Spaces

Dealing with the curse of dimensionality is a key challenge in high-dimensional data visualization. We present SeekAView to address three main gaps in the existing research literature. First, automated methods like dimensionality reduction or clustering suffer from a lack of transparency in letting analysts interact with their outputs in real-time to suit their exploration strategies. The results often suffer from a lack of interpretability, especially for domain experts not trained in statistics and machine learning. Second, exploratory visualization techniques like scatter plots or parallel coordinates suffer from a lack of visual scalability: it is difficult to present a coherent overview of interesting combinations of dimensions. Third, the existing techniques do not provide a flexible workflow that allows for multiple perspectives into the analysis process by automatically detecting and suggesting potentially interesting subspaces. In SeekAView we address these issues using suggestion based visual exploration of interesting patterns for building and refining multidimensional subspaces. Compared to the state-of-the-art in subspace search and visualization methods, we achieve higher transparency in showing not only the results of the algorithms, but also interesting dimensions calibrated against different metrics. We integrate a visually scalable design space with an iterative workflow guiding the analysts by choosing the starting points and letting them slice and dice through the data to find interesting subspaces and detect correlations, clusters, and outliers. We present two usage scenarios for demonstrating how SeekAView can be applied in real-world data analysis scenarios.

Krause, Josua↗
DOE OSTI2016

On Improving Analytical Models of Cosmic Reionization for Matching Numerical Simulations

The methods for studying the epoch of cosmic reionization vary from full radiative transfer simulations to purely analytical models. While numerical approaches are computationally expensive and are not suitable for generating many mock catalogs, analytical methods are based on assumptions and approximations. We explore the interconnection between both methods. First, we ask how the analytical framework of excursion set formalism can be used for statistical analysis of numerical simulations and visual representation of the morphology of ionization fronts. Second, we explore the methods of training the analytical model on a given numerical simulation. We present a new code which emerged from this study. Its main application is to match the analytical model with a numerical simulation. Then, it allows one to generate mock reionization catalogs with volumes exceeding the original simulation quickly and computationally inexpensively, meanwhile reproducing large scale statistical properties. These mock catalogs are particularly useful for CMB polarization and 21cm experiments, where large volumes are required to simulate the observed signal.

79 ASTRONOMY AND ASTROPHYSICS↗