Search NASA⌕ Search

SEARCH · Search NASA

Results for “data parallel”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,441 records · Page 80

Redshift-space distortions with wide angular separations

Redshift-space distortions are generally considered in the plane parallel limit, where the angular separation between the two sources can be neglected. Given that galaxy catalogues now cover large fractions of the sky, it becomes necessary to consider them in a formalism which takes into account the wide angle separations. In this article we derive an operational formula for the matter correlators in the Newtonian limit to be used in actual data sets. In order to describe the geometrical nature of the wide angle RSD effect on Fourier space, we extend the formalism developed in configuration space to Fourier space without relying on a plane-parallel approximation, but under the extra assumption of no bias evolution. We then recover the plane-parallel limit not only in configuration space where the geometry is simpler, but also in Fourier space, and we exhibit the first corrections that should be included in large surveys as a perturbative expansion over the plane-parallel results. We finally compare our results to existing literature, and show explicitly how they are related.

79 ASTRONOMY AND ASTROPHYSICS↗

Optimization of SAMtools sorting using OpenMP tasks

SAMtools is a widely-used genomics application for post-processing high-throughput sequence alignment data. Such sequence alignment data are commonly sorted to make downstream analysis more efficient. However, this sorting process itself can be computationally- and I/O-intensive: high-throughput sequence alignment files in the de facto standard binary alignment/map (BAM) format can be many gigabytes in size, and may need to be decompressed before sorting and compressed afterwards. As a result, BAM-file sorting can be a bottleneck in genomics workflows. Here, this paper describes a case study on the performance analysis and optimization of SAMtools for sorting large BAM files. OpenMP task parallelism and memory optimization techniques resulted in a speedup of 5.9X versus the upstream SAMtools 1.3.1 for an internal (in-memory) sort of 24.6 GiB of compressed BAM data (102.6 GiB uncompressed) with 32 processor cores, while a 1.98X speedup was achieved for an external (out-of-core) sort of a 271.4 GiB BAM file.

97 MATHEMATICS AND COMPUTING↗

Predicting a Drug’s Membrane Permeability: A Computational Model Validated With in Vitro Permeability Assay Data

Membrane permeability is a key property to consider during the drug design process, and particularly vital when dealing with small molecules that have intracellular targets as their efficacy highly depends on their ability to cross the membrane. In this work, we describe the use of umbrella sampling Molecular Dynamics (MD) computational modeling to comprehensively assess the passive permeability profile of a range of compounds through a lipid bilayer. The model was initially calibrated through in vitro validation studies employing a Parallel Artificial Membrane Permeability Assay (PAMPA). The model was subsequently evaluated for its quantitative prediction of permeability profiles for a series of custom synthesized and closely related compounds. The results exhibited substantially improved agreement with the PAMPA data, relative to alternative existing methods. Our work introduces a computational model that underwent progressive molding and fine-tuning as a result of its synergistic collaboration with numerous in vitro PAMPA permeability assays. The presented computational model introduces itself as a useful, predictive tool for permeability prediction.

59 BASIC BIOLOGICAL SCIENCES↗

T-FSM: A Scalable Distributed Task-Based System for Frequent Subgraph Pattern Mining from a Big Graph

Finding frequent subgraph patterns in a big graph is an important problem with many applications such as classifying chemical compounds and building indexes to speed up graph queries. Since this problem is NP-hard, some recent parallel and distributed systems have been developed to accelerate the mining. However, they often have a huge memory cost, very long running time, suboptimal load balancing, poor scale-out capability, and possibly inaccurate results. In this article, we propose an efficient system called T-FSM for parallel mining of frequent subgraph patterns in a big graph. T-FSM supports a new anti-monotonic frequentness measure called Fraction-Score, which is more accurate than the widely used MNI measure. The execution engine of T-FSM supports both intra-machine parallelism and inter-machine parallelism. For intra-machine parallelism, T-FSM adopts a novel task-based execution model to ensure high multithreading concurrency, bounded memory consumption, and effective load balancing. For inter-machine parallelism, T-FSM ensures good scale-out performance with a lightweight pattern rebalancing approach that reduces workload skewness of pattern evaluations among machines. To avoid recomputing the contexts for migrated patterns, we design a novel context cache table to support concurrent and asynchronous requesting and caching of remote context data, which can timely evict and garbage collect used pattern contexts that are no longer needed to keep memory consumption bounded. Extensive experiments show that T-FSM is orders of magnitude faster than existing state-of-the-art parallel systems (more than 10×, 51×, 131×, 55× speedup over ScaleMine, DistGraph, Pangolin and Peregrine, respectively) and distributed systems (more than 42× and 88× over ScaleMine and DistGraph, respectively) for frequent subgraph pattern mining, and it scales out satisfactorily to 512 CPU cores on the Polaris supercomputer at Argonne National Laboratory.

97 MATHEMATICS AND COMPUTING↗

On the perturbation effect and LET dependence of beam quality correction factors in carbon ion beams

Background: In a recent study, we reported beam quality correction factors, f Q , in carbon ion beams using Monte Carlo (MC) methods for a cylindrical and a parallel-plate ionization chamber (IC). A non-negligible perturbation effect was observed; however, the magnitude of the perturbation correction due to the specific IC subcomponents was not included. Furthermore, the stopping power data presented in the International Commission on Radiation Units and Measurements (ICRU) report 73 were used, whereas the latest stopping power data have been reported in the ICRU report 90. Purpose: The aim of this study was to extend our previous work by computing f Q correction factors using the ICRU 90 stopping power data and by reporting IC-specific perturbation correction factors. Possible energy or linear energy transfer (LET) dependence of the f Q correction factor was investigated by simulating both pristine beams and spread-out Bragg peaks (SOBPs). Methods: The TOol for PArticle Simulation (TOPAS)/GEANT4 MC code was used in this study. A 30 × 30 × 50 cm 3 water phantom was simulated with a uniform 10 × 10 cm 2 parallel beam incident on the surface. A Farmer-type cylindrical IC (Exradin A12) and two parallel-plate ICs (Exradin P11 and A11) were simulated in TOPAS using the manufacturer-provided geometrical drawings. The f Q correction factor was calculated in pristine carbon ion beams in the 150–450 MeV/u energy range at 2 cm depth and in the middle of the flat region of four SOBPs. The k Q correction factor was calculated by simulating the f Qo correction factor in a 60 Co beam at 5 cm depth. The perturbation correction factors due to the presence of the individual IC subcomponents, such as the displacement effect in the air cavity, collecting electrode, chamber wall, and chamber stem, were calculated at 2 cm depth for monoenergetic beams only. Additionally, the mean dose-averaged and track-averaged LET was calculated at the depths at which the f Q was calculated. Results: The ICRU 90 f Q correction factors were reported. The p dis correction factor was found to be significant for the cylindrical IC with magnitudes up to 1.70%. The individual perturbation corrections for the parallel-plate ICs were <1.0% except for the A11 p cel correction at the lowest energy. The f Q correction for the P11 IC exhibited an energy dependence of >1.00% and displayed differences up to 0.87% between pristine beams and SOBPs. Conversely, the f Q for A11 and A12 displayed a minimal energy dependence of <0.50%. The energy dependence was found to manifest in the LET dependence for the P11 IC. A statistically significant LET dependence was found only for the P11 IC in pristine beams only with a magnitude of <1.10%. Conclusions: The perturbation and k Q correction factor should be calculated for the specific IC to be used in carbon ion beam reference dosimetry as a function of beam quality.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Polybrominated diphenyl ether (PBDE) neurotoxicity: a systematic review and meta-analysis of animal evidence

Background: Polybrominated diphenyl ethers (PBDEs) are ubiquitous in the environment, with well-documented and widespread human exposure. A recent systematic review and meta-analysis of human studies found an association between prenatal serum PBDE concentrations and a decrease in the IQ of children. Objective: Our goal was to demonstrate the application of systematic review methods, including meta-analysis (if possible), to animal toxicology data to draw conclusions about hazard. We performed a systematic review of experimental animal studies on the neurotoxicity of PBDEs following developmental exposure. Outcomes assessed included measures related to learning, memory, and attention, which parallel the intelligence-related outcomes evaluated in the systematic review of human studies. Methods: We searched PubMed, Embase, and Toxline for experimental studies in non-human mammals published in English through August 15, 2016. Evaluation of risk of bias and the overall body of evidence followed guidance developed by the National Toxicology Program’s Office of Health Assessment and Translation (OHAT). Results: The animal data on PBDEs and learning, memory, and attention were available for BDEs 47, 99, 153, 203, 206, and 209 and the technical mixture DE-71. These data were diverse and complex, with studies using varying designs and outcomes. There were concerns about risk of bias for many studies, and study reporting of methods and results was often incomplete. A meta-analysis of six studies showed consistent evidence of an increase in latency (effect size of 25.8 [CI, 20.3 to 31.2]) in the last trial of the Morris water maze in PBDE-exposed animals, with low heterogeneity. However, for most endpoints, there were unexplained inconsistencies across studies. There was also no consistent evidence of a dose-response relationship. Conclusions: Our analyses illustrates the application of systematic review methods to a chemical hazard assessment. There is a moderate level of evidence that exposure to BDEs 47, 99, and 209 affects learning. For other PBDEs and other endpoints, the level of evidence was low or very low. The meta-analysis led to stronger conclusions than would have been drawn based on a qualitative review of the evidence. The systematic review also identified factors that increased concerns about risk of bias in individual studies that might be remedied by better study reporting.

Polybrominated Diphenyl Ether↗

Investigation of LSM-YSZ Composite Cathode Performance Degradation with a Multistep Charge Transfer Model

The long-term performance degradation of LSM/YSZ composite cathodes is investigated via calibrated multiphysics simulation with a multistep oxygen reduction reaction (ORR) model and structural coarsening data from a phase field study. Multiphysics simulations, including a multistep ORR mechanism, are first developed for better understanding of the limiting processes in solid oxide fuel cells. The multistep ORR mechanism includes two parallel pathways, surface pathway and bulk pathway, which consist of elementary reaction steps. The multiphysics model is simultaneously calibrated with experimental polarization curves and impedance behavior for various air/fuel supply conditions. To our knowledge, this is the first time that a multistep ORR model is calibrated with such datasets. Next, the calibrated simulations are utilized to simulate a 2D half-cell constructed with measured microstructural data and random heterogeneity. Finally, the long-term performance degradation of the half-cell is predicted by the calibrated multiphysics model coupled with structural coarsening trends simulated using a phase field-based coarsening model. Degradation of both polarization curves and impedance behavior is investigated. Thorough analyses, including changes of contributions from different pathways, the resistance components, and overall reaction order, are performed to provide more insights into cathode performance degradation due to grain coarsening phenomena.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Exploring the interplay of resilience and energy consumption for a task-based partial differential equations preconditioner

Here, we discuss algorithm-based resilience to silent data corruptions (SDCs) in a task-based domain-decomposition preconditioner for partial differential equations (PDEs). The algorithm exploits a reformulation of the PDE as a sampling problem, followed by a solution update through data manipulation that is resilient to SDCs. The implementation is based on a server-client model where all state information is held by the servers, while clients are designed solely as computational units. Scalability tests run up to ~51K cores show a parallel efficiency greater than 90%. We use a 2D elliptic PDE and a fault model based on random single and double bit-flip to demonstrate the resilience of the application to synthetically injected SDC. We discuss two fault scenarios: one based on the corruption of all data of a target task, and the other involving the corruption of a single data point. We show that for our application, given the test problem considered, a four-fold increase in the number of faults only yields a 2% change in the overhead to overcome their presence, from 7% to 9%. We then discuss potential savings in energy consumption via dynamic voltage/frequency scaling, and its interplay with fault-rates, and application overhead.

97 MATHEMATICS AND COMPUTING↗

Parallel k-means++

A parallelization of the k-means++ seed selection algorithm on three distinct hardware platforms: GPU, multicore CPU, and multithreaded architecture. K-means++ was developed by David Arthur and Sergei Vassilvitskii in 2007 as an extension of the k-means data clustering technique. These algorithms allow people to cluster multidimensional data, by attempting to minimize the mean distance of data points within a cluster. K-means++ improved upon traditional k-means by using a more intelligent approach to selecting the initial seeds for the clustering process. While k-means++ has become a popular alternative to traditional k-means clustering, little work has been done to parallelize this technique. We have developed original C++ code for parallelizing the algorithm on three unique hardware architectures: GPU using NVidia's CUDA/Thrust framework, multicore CPU using OpenMP, and the Cray XMT multithreaded architecture. By parallelizing the process for these platforms, we are able to perform k-means++ clustering much more quickly than it could be done before.

Source record↗

On the Structure of the AGN Torus through the Fraction of Optically Selected Type 1 AGNs

The ratio in number between unobscured (type 1) and obscured (type 2) active galactic nuclei (AGNs) is often used to explore the structure of the torus in the unified scheme for AGNs. Oh et al. (2015) investigated the type 1 AGN fraction on two-dimensional space in terms of black hole mass (M{sub BH}) and bolometric luminosity (L{sub bol}) and found that the fraction changes depending on both M{sub BH} and L{sub bol}, forming a ridge-shaped distribution. In this study, based on the up-to-date type 1 AGN catalog of Oh et al. (2015), we examine how the trend of the type 1 AGN fraction in the M{sub BH}–L{sub bol} plane is affected by the different methods used to derive M{sub BH} and L{sub bol}, and suggest an analytic model to explain the observations. We use galaxies from the Sloan Digital Sky Survey Data Release 7 in the redshift range 0.01⩽z⩽0.2. In estimating L{sub bol}, we employ two different methods using [O III] and/or [O I] emission lines, and find that the L{sub bol} values obtained from the two methods agree well. We consider the M{sub BH}--σ{sub ∗} relation, the M{sub BH}–L {sub bulge} relation, and the single-epoch Hα-based M{sub BH} estimate in calculating M{sub BH}. We find that the trends of the type 1 AGN fraction with respect to M{sub BH} and L{sub bol} are similar for the different methods of deriving L{sub bol} but different when using different methods to derive M{sub BH}. We present a model based on the clumpy-torus scheme that reproduces the ridge-shaped distribution of the fraction parallel to the iso-Eddington ratio lines.

79 ASTRONOMY AND ASTROPHYSICS↗

Communication-avoiding optimization methods for distributed massive-scale sparse inverse covariance estimation

Across a variety of scientific disciplines, sparse inverse covariance estimation is a popular tool for capturing the underlying dependency relationships in multivariate data. Unfortunately, most estimators are not scalable enough to handle the sizes of modern high-dimensional data sets (often on the order of terabytes), and assume Gaussian samples. To address these deficiencies, we introduce HP-CONCORD, a highly scalable optimization method for estimating a sparse inverse covariance matrix based on a regularized pseudolikelihood framework, without assuming Gaussianity. Our parallel proximal gradient method uses a novel communication-avoiding linear algebra algorithm and runs across a multi-node cluster with up to 1k nodes (24k cores), achieving parallel scalability on problems with up to ≈819 billion parameters (1.28 million dimensions); even on a single node, HP-CONCORD demonstrates scalability, outperforming a state-of-the-art method. We also use HP-CONCORD to estimate the underlying dependency structure of the brain from fMRI data, and use the result to identify functional regions automatically. The results show good agreement with a clustering from the neuroscience literature.

97 MATHEMATICS AND COMPUTING↗

Communication-Avoiding Optimization Methods for Distributed Massive-Scale Sparse Inverse Covariance Estimation.

Across a variety of scientific disciplines, sparse inverse covariance estimation is a popular tool for capturing the underlying dependency relationships in multivariate data. Unfortunately, most estimators are not scalable enough to handle the sizes of modern high-dimensional data sets (often on the order of terabytes), and assume Gaussian samples. To address these deficiencies, we introduce HP-CONCORD, a highly scalable optimization method for estimating a sparse inverse covariance matrix based on a regularized pseudolikelihood framework, without assuming Gaussianity. Our parallel proximal gradient method uses a novel communication-avoiding linear algebra algorithm and runs across a multi-node cluster with up to 1k nodes (24k cores), achieving parallel scalability on problems with up to ~819 billion parameters (1.28 million dimensions); even on a single node, HP-CONCORD demonstrates scalability, outperforming a state-of-the-art method. We also use HP-CONCORD to estimate the underlying dependency structure of the brain from fMRI data, and use the result to identify functional regions automatically. The results show good agreement with a clustering from the neuroscience literature.

Koanantakool, Penporn↗

Umbrella sampling: a powerful method to sample tails of distributions

We present the umbrella sampling (US) technique and show that it can be used to sample extremely low-probability areas of the posterior distribution that may be required in statistical analyses of data. In this approach sampling of the target likelihood is split into sampling of multiple biased likelihoods confined within individual umbrella windows. We show that the US algorithm is efficient and highly parallel and that it can be easily used with other existing Markov Chain Monte Carlo (MCMC) samplers. The method allows the user to capitalize on their intuition and define umbrella windows and increase sampling accuracy along specific directions in the parameter space. Alternatively, one can define umbrella windows using an approach similar to parallel tempering. We provide a public code that implements US as a standalone PYTHON package. We present a number of tests illustrating the power of the US method in sampling low-probability areas of the posterior and show that this ability allows a considerably more robust sampling of multimodal distributions compared to standard sampling methods. We also present an application of the method in a real world example of deriving cosmological constraints using the supernova type Ia data. We show that US can sample the posterior accurately down to the approximate to 15 sigma credible region in the Omega(m) - Omega(Lambda) plane, while for the same computational effort the affine-invariant MCMC sampling implemented in the emcee code samples the posterior reliably only to approximate to 3 sigma.

cosmology: cosmological parameters↗

A network approach for multiscale catchment classification using traits

Abstract. The classification of river catchments into groups with similar biophysical characteristics is useful to understand and predict their hydrological behavior. The increasing availability of remote sensing and other large-scale geospatial datasets has enabled the use of advanced data-driven approaches to classify catchments using traits such as topography, geology, climate, land cover, land use, and human influence. Unsupervised clustering algorithms based on the Euclidean distance are commonly used for trait-based classification but are not suitable for highly dimensional data. In this study we present a new network-based method for multi-scale catchment classification, which can be applied to large datasets and used to determine the traits associated with different catchment groups. In this framework, two networks are analyzed in parallel: the first being where the nodes are traits and the second being where the nodes are catchments. In both cases, edges represent pairwise similarity, and a network cluster detection algorithm is used for the classification. The trait network is used to investigate redundancy in the trait data and to condense this information into a small number of interpretable categories. The catchments network is used to classify the catchments into clusters and to identify representative catchments for the different groups using the degree centrality metric. We apply this method to classify 9067 river catchments across the contiguous United States at both regional and continental scales using 274 non-categorical traits. At the continental scale, we identify 25 interpretable trait categories and 34 catchment clusters of sizes greater than 50. We find that catchments with similar trait categories are typically located in the same region, with different spatial patterns emerging among clusters dominated by natural and anthropogenic traits. We also find that the catchment clusters exhibit distinct hydrological behavior based on an analysis of streamflow indices. This network approach provides several advantages over traditional means of classification, including better separation of clusters, the use of alternate similarity metrics that are more suitable for highly dimensional data, and reducing redundancy in the trait information. The paired catchment–trait networks enable analysis of hydrological behavior using the dominant trait categories for each catchment cluster. The approach can be used at multiple spatial scales since the network topologies adjust automatically to reflect the trait patterns at the scale of investigation. Finally, the representative catchments identified as hub nodes in the network can be used to guide transferable observational and modeling strategies. The method is broadly applicable beyond hydrology for classification of other complex systems that utilize different types of trait datasets.

54 ENVIRONMENTAL SCIENCES↗

Rethinking Visual Analytics for Streaming Data Applications

In the age of data science, the use of interactive information visualization techniques has become increasingly ubiquitous. From online scientific journals to the New York Times graphics desk, the utility of interactive visualization for both storytelling and analysis has become ever more apparent. As these techniques have become more readily accessible, the appeal of combining interactive visualization with computational analysis continues to grow. Arising out of a need for scalable, human-driven analysis, primary objective of visual analytics systems is to capitalize on the complementary strengths of human and machine analysis, using interactive visualization as a medium for communication between the two. These systems leverage developments from the fields of information visualization, computer graphics, machine learning, and human-computer interaction to support insight generation in areas where purely computational analyses fall short. Over the past decade, visual analytics systems have generated remarkable advances in many historically challenging analytical contexts. These include areas such as modeling political systems [Crouser et al. 2012], detecting financial fraud [Chang et al. 2008], and cybersecurity [Harrison et al. 2012]. In each of these contexts, domain expertise and human intuition is a necessary component of the analysis. This intuition is essential to building trust in the analytical products, as well as supporting the translation of evidence into actionable insight. In addition, each of these examples also highlights the need for scalable analysis. In each case, it is infeasible for a human analyst to manually assess the raw information unaided, and the communication overhead to divide the task between a large number of analysts makes simple parallelism intractable. Regardless of the domain, visual analytics tools strive to optimize the allocation of human analytical resources, and to streamline the sensemaking process on data that is massive, complex, incomplete, and uncertain in scenarios requiring human judgment.

97 MATHEMATICS AND COMPUTING↗

Trends in data locality abstractions for HPC systems

The cost of data movement has always been an important concern in high performance computing (HPC) systems. It has now become the dominant factor in terms of both energy consumption and performance. Support for expression of data locality has been explored in the past, but those efforts have had only modest success in being adopted in HPC applications for various reasons. However, with the increasing complexity of the memory hierarchy and higher parallelism in emerging HPC systems, locality management has acquired a new urgency. Developers can no longer limit themselves to low-level solutions and ignore the potential for productivity and performance portability obtained by using locality abstractions. Fortunately, the trend emerging in recent literature on the topic alleviates many of the concerns that got in the way of their adoption by application developers. Data locality abstractions are available in the forms of libraries, data structures, languages and runtime systems; a common theme is increasing productivity without sacrificing performance. Furthermore, this paper examines these trends and identifies commonalities that can combine various locality concepts to develop a comprehensive approach to expressing and managing data locality on future large-scale high-performance computing systems.

97 MATHEMATICS AND COMPUTING↗

Towards performance portability in the Spark astrophysical magnetohydrodynamics solver in the Flash-X simulation framework

Simulations of core-collapse supernovae, and other astrophysical phenomena, are quintessential extreme-scale computing challenges. For core-collapse supernova simulations to be carried out by the ExaStar project under the Exascale Computing Project umbrella, a robust, efficient, and state-of-the-art magnetohydrodynamics solver is a critical requirement. In Flash-X, the primary software instrument for ExaStar, a new magnetohydrodynamics solver has been designed and implemented from the ground up to achieve accuracy and efficiency for simulations of complex astrophysical flows. This new solver, dubbed Spark, uses high-order spatial reconstruction, Runge-Kutta time integration, and an efficient cell-centered approach to satisfying the divergence-free condition for the magnetic fields. Spark was written to be optimized for data locality in cache hierarchy of CPUs. Since data locality optimizations for cache hierarchy are not directly compatible with those of accelerators, we have taken the approach of using program synthesis to avoid massive amounts of code replication that would be necessary if we were to maintain two different versions of the solver. Our program synthesis relies on a simple key-dictionary approach, implemented in python, that enables us to assemble the version of the solver suitable for the target hardware from code fragments identified by specific keys. In this work, we describe the data locality optimizations of the solver for CPUs and accelerators and the program synthesis tools that enable this portability. We also detail the parallel performance of Spark for both CPUs and accelerators.

97 MATHEMATICS AND COMPUTING↗

Rapid characterization and failure analysis of 6276 rooftop-harvested photovoltaic connectors

Photovoltaic (PV) connectors, which link modules in series and connect PV strings in parallel, have increasingly been recognized as a primary contributor to PV system failures and a source of numerous fire incidents. However, publicly available data on the rates and types of connector failures are scarce, primarily due to the proprietary nature of the information and the need for comprehensive analysis. This study represents the first large-scale investigation of harvested PV connectors, drawing from a dataset of 6276 connectors from residential rooftop solar systems across the United States. The outcome of this work is twofold: 1) we have established a rapid characterization method for large populations of harvested connectors, incorporating visual inspection, resistance measurements, and X-ray imaging; and 2) the analysis made possible by our rapid-processing method has revealed, for a population of connector models provided by a single rooftop installer, failure statistics and insights for various connector makes and models, installation practices, operating currents, and internal component displacements. This research identifies common failure modes that could be considered in future connector designs standards, and operations and maintenance practices, to ultimately improve the reliability of this vital component of PV infrastructure.

MC4↗