Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed computation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,261 records · Page 70

T-FSM: A Scalable Distributed Task-Based System for Frequent Subgraph Pattern Mining from a Big Graph

Finding frequent subgraph patterns in a big graph is an important problem with many applications such as classifying chemical compounds and building indexes to speed up graph queries. Since this problem is NP-hard, some recent parallel and distributed systems have been developed to accelerate the mining. However, they often have a huge memory cost, very long running time, suboptimal load balancing, poor scale-out capability, and possibly inaccurate results. In this article, we propose an efficient system called T-FSM for parallel mining of frequent subgraph patterns in a big graph. T-FSM supports a new anti-monotonic frequentness measure called Fraction-Score, which is more accurate than the widely used MNI measure. The execution engine of T-FSM supports both intra-machine parallelism and inter-machine parallelism. For intra-machine parallelism, T-FSM adopts a novel task-based execution model to ensure high multithreading concurrency, bounded memory consumption, and effective load balancing. For inter-machine parallelism, T-FSM ensures good scale-out performance with a lightweight pattern rebalancing approach that reduces workload skewness of pattern evaluations among machines. To avoid recomputing the contexts for migrated patterns, we design a novel context cache table to support concurrent and asynchronous requesting and caching of remote context data, which can timely evict and garbage collect used pattern contexts that are no longer needed to keep memory consumption bounded. Extensive experiments show that T-FSM is orders of magnitude faster than existing state-of-the-art parallel systems (more than 10×, 51×, 131×, 55× speedup over ScaleMine, DistGraph, Pangolin and Peregrine, respectively) and distributed systems (more than 42× and 88× over ScaleMine and DistGraph, respectively) for frequent subgraph pattern mining, and it scales out satisfactorily to 512 CPU cores on the Polaris supercomputer at Argonne National Laboratory.

97 MATHEMATICS AND COMPUTING↗

Polyphony: A Workflow Orchestration Framework for Cloud Computing

Cloud Computing has delivered unprecedented compute capacity to NASA missions at affordable rates. Missions like the Mars Exploration Rovers (MER) and Mars Science Lab (MSL) are enjoying the elasticity that enables them to leverage hundreds, if not thousands, or machines for short durations without making any hardware procurements. In this paper, we describe Polyphony, a resilient, scalable, and modular framework that efficiently leverages a large set of computing resources to perform parallel computations. Polyphony can employ resources on the cloud, excess capacity on local machines, as well as spare resources on the supercomputing center, and it enables these resources to work in concert to accomplish a common goal. Polyphony is resilient to node failures, even if they occur in the middle of a transaction. We will conclude with an evaluation of a production-ready application built on top of Polyphony to perform image-processing operations of images from around the solar system, including Mars, Saturn, and Titan.

Space Exploration,↗

Spatial fractionation of the dose using neon and heavier ions: A Monte Carlo study

Purpose: This work explores a new radiation therapy approach which might trigger a renewed use of neon and heavier ions to treat cancers. These ions were shown to be extremely efficient in radioresistant tumor killing. Unfortunately, the efficient region also extends into the normal tissue in front of the tumor. The strategy the authors propose is to profit from the well-established sparing effect of thin spatially fractionated beams, so that the impact on normal tissues might be minimized while a high tumor control is achieved. The main goal of this work is to provide a proof of concept of this new approach. With that aim, a dosimetric study was carried out as a first step to evaluate the interest of further explorations of this avenue. Methods: The GATE/GEANT4 v.6.1 Monte Carlo simulation platform was employed to simulate arrays of rectangular minibeams (700 μm × 2 cm) of four ions (Ne, Si, Ar, and Fe). The irradiations were performed with a 2 cm-long spread-out Bragg peak centered at 7 cm-depth. Dose distributions in a water phantom were scored considering two minibeams center-to-center distances: 1400 and 3500 μm. Peak and valley doses, peak-to-valley dose ratios (PVDRs), beam penumbras, and relative contribution of nuclear fragments and electromagnetic processes were assessed as figures of merit. In addition, the type and proportion of the secondary nuclear fragments were evaluated in both peak and valley regions. Results: Extremely high PVDR values (>100) and low valley doses were obtained. The higher the atomic number (Z) of the primary ion is, the lower the valleys and the narrower the penumbras. Although the yield of secondary nuclear products increases with Z, the actual dose being deposited by the secondary nuclear fragments in the valleys starts to be the dominant contribution at deeper points, helping in the sparing of proximal normal tissues. Additionally, a wider center-to-center distance leads to a minimized contribution of heavier secondary fragments in valleys. Conclusions: The computed dose distributions suggest that a spatial fractionation of the dose combined to the use of submillimetric field sizes might allow profiting from the high efficiency of neon and heavier ions for the treatment of radioresistant tumors, while preserving normal tissues. The authors’ results support the further exploration of this avenue. Next steps include the realization of biological experiment to confirm the shifting of normal tissue complication probability curves.

60 APPLIED LIFE SCIENCES↗

Optimal Communication Topology Determination and Sensor Selection for Independent Airspace Surveillance

The paper presents an approach to sensors selection and network topology determination for independent airspace surveillance with maximum outcome and minimum cost using ground based distributed sensing, computing and communication network infrastructure. The selection criteria includes minimum estimation error, maximum airspace coverage, minimum communication time and power consumption while guaranteeing the system observability and providing in-time quality information to a monitoring observer. The developed algorithm uses multi-objective optimization strategy taking into account trade-offs between conflicting objectives and relaxations for in time implementation. It is implemented utilizing graph theoretic tools. The approach is validated in a desktop simulation environment using synthetic sensors data generated for a simulated multi-vehicle flight scenario in the selected regional airspace.

Distributed sensing↗

Separation and Transition on the ROTEX-T Cone-Flare

As part of NATO STO AVT-346 “Predicting Hypersonic Boundary-Layer Transition on Complex Geometries,” coordinated experimental and computational studies were conducted on the ROTEX-T, a cone-flare geometry used in a successful flight-test experiment. At the as-flown conditions, a separation bubble existed at the compression corner. Separation, reattachment, and the multifaceted linear instability paths leading this bubble to transition to turbulence are challenging to predict, but have significant impact on surface pressure and heat flux. High-resolution background-oriented schlieren and infrared thermography measurements were made in the AFOSR–Notre Dame Large Mach-6 Quiet Tunnel at freestream unit Reynolds numbers from 5.8×10(exp 6) to 12.2×10(exp 6) m-1and nominally zero angle of attack. High-speed self-aligned focusing schlieren, infrared thermography, and focused laser differential interferometry measurements were made in the AFRL Mach-6 Ludwieg Tube from 2.2×10(exp 6) to 24.7×10(exp 6) m-1and nominally zero degrees angle of attack. The surface heat-flux and Stanton number distributions were computed. Separation and reattachment locations, as well as the flow state at each, were determined from the combination of surface and off-wall measurements. The convective and global boundary-layer instabilities of the axisymmetric laminar flow at the experimental conditions were investigated computationally. Amplification of Mack’s first and second modes were observed to have logarithmic amplification factors between 5 to 7.5 at the separation location, depending on conditions. The flow was found to be globally unstable to stationary three-dimensional disturbances concentrated in the reattachment region. Previous analysis of the ROTEX-T flight data had not assessed reattachment location or the flow state upon reattachment. Thanks to the insights gained from the coordinated, on- and off-wall ground-test measurements, these evaluations have now been made. The separation location indicated by laminar simulations is consistently numerically predicted to be upstream of the experimentally observed location for a transitional separation bubble. The cause of this difference is understood to lie in the steady-state and axisymmetric assumptions made by both solvers employed to compute the basic states analyzed, as flow topology considerations assert that unsteady two-dimensional or axisymmetric separation bubbles are structurally unstable and will become three-dimensional. Computed laminar heating rates prior to separation agreed well with experiment; transitional heating rates after reattachment were between laminar and turbulent computations.

CFD Validation↗

Separation and Transition on the ROTEX-T Cone-Flare

As part of NATO STO AVT-346 “Predicting Hypersonic Boundary-Layer Transition on Complex Geometries,” coordinated experimental and computational studies were conducted on the ROTEX-T, a cone-flare geometry used in a successful flight-test experiment. At the as-flown conditions, a separation bubble existed at the compression corner. Separation, reattachment, and the multifaceted linear instability paths leading this bubble to transition to turbulence are challenging to predict, but have significant impact on surface pressure and heat flux. High-resolution background-oriented schlieren and infrared thermography measurements were made in the AFOSR–Notre Dame Large Mach-6 Quiet Tunnel at freestream unit Reynolds numbers from 5.8×10(exp 6) to 12.2×10(exp 6) m-1and nominally zero angle of attack. High-speed self-aligned focusing schlieren, infrared thermography, and focused laser differential interferometry measurements were made in the AFRL Mach-6 Ludwieg Tube from 2.2×10(exp 6) to 24.7×10(exp 6) m-1and nominally zero degrees angle of attack. The surface heat-flux and Stanton number distributions were computed. Separation and reattachment locations, as well as the flow state at each, were determined from the combination of surface and off-wall measurements. The convective and global boundary-layer instabilities of the axisymmetric laminar flow at the experimental conditions were investigated computationally. Amplification of Mack’s first and second modes were observed to have logarithmic amplification factors between 5 to 7.5 at the separation location, depending on conditions. The flow was found to be globally unstable to stationary three-dimensional disturbances concentrated in the reattachment region. Previous analysis of the ROTEX-T flight data had not assessed reattachment location or the flow state upon reattachment. Thanks to the insights gained from the coordinated, on- and off-wall ground-test measurements, these evaluations have now been made. The separation location indicated by laminar simulations is consistently numerically predicted to be upstream of the experimentally observed location for a transitional separation bubble. The cause of this difference is understood to lie in the steady-state and axisymmetric assumptions made by both solvers employed to compute the basic states analyzed, as flow topology considerations assert that unsteady two-dimensional or axisymmetric separation bubbles are structurally unstable and will become three-dimensional. Computed laminar heating rates prior to separation agreed well with experiment; transitional heating rates after reattachment were between laminar and turbulent computations.

CFD Validation↗

On Eigenfunctions of the Fourier Transform

A nontrivial example of an eigenfunction in the sense of the theory of distributions for the planar Fourier transform was described by the authors in their previous work. In this paper, a method for obtaining other eigenfunctions is proposed. Positive homogeneous distributions in ℝ{sup n} of order −n/2 are considered, and it is shown that F(ω)|x|{sup −n/2}, |ω| = 1, is an eigenfunction in the sense of the theory of distributions of the Fourier transform if and only if F(ω) is an eigenfunction of a certain singular integral operator on the unit sphere of ℝ{sup n}. Since Y{sub m,n}{sup (k)}(ω)|x|{sup −n/2}, where Y{sub m,n}{sup (k)} denote the spherical functions of order m in ℝ{sup n}, are eigenfunctions of the Fourier transform, it follows that Y{sub m,n}{sup (k)} are eigenfunctions of the above-mentioned singular integral operator. In the planar case, all eigenfunctions of the Fourier transform of the form F(ω)|x|{sup −1} are described by means of the Fourier coefficients of F(ω).

97 MATHEMATICS AND COMPUTING↗

Time-Based Data Streams: Fundamental Concepts for a Data Resource for Streams

Real time data, which we call data streams, are readings from instruments, environmental, bodily or building sensors that are generated at regular intervals and often, due to their volume, need to be processed in real time. Often a single pass is all that can be made on the data, and a decision to discard or keep the instance is made on the spot. Too, the stream is for all practical purposes indefinite, so decisions must be made on incomplete knowledge. This notion of data streams has a different set of issues from a file, for instance, that is byte streamed to a reader. The file is finite, so the byte stream is becomes a processing convenience more than a fundamentally different kind of data. Through the duration of the project we examined three aspects of streaming data: the first, techniques to handle streaming data in a distributed system organized as a collection of web services, the second, the notion of the dashboard and real time controllable analysis constructs in the context of the Fermi Tevatron Beam Position Monitor, and third and finally, we examined provenance collection of stream processing such as might occur as raw observational data flows from the source and undergoes correction, cleaning, and quality control. The impact of this work is severalfold. We were one of the first to advocate that streams had little value unless aggregated, and that notion is now gaining general acceptance. We were one of the first groups to grapple with the notion of provenance of stream data also.

97 MATHEMATICS AND COMPUTING↗

Clustering at Massive Scale

ClaMS provides hierarchical clustering technology for use on massive, high-dimensional datasets that require distributed memory for processing. The algorithm employed is inspired by the popular HDBSCAN algorithm but makes use of computational kernels better suited for distributed computing. ClaMS is built on scalable nearest neighbor graph construction, metric forest completion, and approximate minimum spanning tree techniques.

Stanley, ThomasA [Lawrence Livermore National Labo↗

RatBot: anti-enumeration peer-to-peer botnets

Botnets have emerged as one of the most severe cyber threats in recent years. To obtain high resilience against a single point of failure, the new generation of botnets have adopted the peer-to-peer (P2P) structure. One critical question regarding these P2P botnets is: how big are they indeed? To address this question, researchers have proposed both actively crawling and passively monitoring methods to enumerate existing P2P botnets. In this work, we go further to explore the potential strategies that botnets may have to obfuscate their true sizes. Towards this end, this paper introduces RatBot, a P2P botnet that applies some statistical techniques to defeat existing P2P botnet enumeration methods. The key ideas of RatBot are two-fold: (1) there exist a fraction of bots that are indistinguishable from their fake identities, which are spoofing IP addresses they use to hide themselves; (2) we use a heavy-tailed distribution to generate the number of fake identities for each of these bots so that the sum of observed fake identities converges only slowly and thus has high variation. We use large-scale high-fidelity simulation to quantify the estimation errors under diverse settings, and the results show that a naive enumeration technique can overestimate the sizes of P2P botnets by one order of magnitude. We believe that our work reveals new challenges of accurately estimating the sizes of P2P botnets, and hope that it will raise the awareness of security practitioners with these challenges. We further suggest a few countermeasures that can potentially defeat RatBot's anti-enumeration scheme.

97 MATHEMATICS AND COMPUTING↗

Support Vector Machine-Based Endmember Extraction

Introduced in this paper is the utilization of Support Vector Machines (SVMs) to automatically perform endmember extraction from hyperspectral data. The strengths of SVM are exploited to provide a fast and accurate calculated representation of high-dimensional data sets that may consist of multiple distributions. Once this representation is computed, the number of distributions can be determined without prior knowledge. For each distribution, an optimal transform can be determined that preserves informational content while reducing the data dimensionality, and hence, the computational cost. Finally, endmember extraction for the whole data set is accomplished. Results indicate that this Support Vector Machine-Based Endmember Extraction (SVM-BEE) algorithm has the capability of autonomously determining endmembers from multiple clusters with computational speed and accuracy, while maintaining a robust tolerance to noise.

97 MATHEMATICS AND COMPUTING↗

Using Computational Fluid Dynamics of Wind Simulations Coupled With Weather Data to Calculate Dynamic Line Ratings

Dynamic line rating is a technology that allows for the rating of electrical conductors to be calculated based on local weather conditions rather than using ”worst-case” assumptions of weather conditions. The static ratings are typically based on weather conditions that are conservative in nature, and thus dynamic line rating may provide room to increase the current capacity. The local weather conditions may estimate conditions more accurately near the transmission lines accounting for terrain such as nearby hills. One way to estimate the local weather conditions is through the use of computational fluid dynamics. The results of a wind field simulation can be coupled with sparsely located weather stations to provide an accurate assessment of the wind speeds along the path of the conductor. Here, the wind field simulations are calculated using a steady state Reynolds-averaged Navier-Stokes model. These results along with local solar radiance measurements can be used to provide estimates of the steady state ampacity with the standard IEEE equations. An advanced test case for this process involves performing these simulations in a complex terrain, Hells Canyon, the deepest river gorge in North America. The results show that by using weather-based sensors without considering localized wind conditions, the available ampacity may be over-predicted significantly.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Modular chip-integrated photonic control of artificial atoms in diamond waveguides

A central goal in creating long-distance quantum networks and distributed quantum computing is the development of interconnected and individually controlled qubit nodes. Atom-like emitters in diamond have emerged as a leading system for optically networked quantum memories, motivating the development of visible-spectrum, multi-channel photonic integrated circuit (PIC) systems for scalable atom control. However, it has remained an open challenge to realize optical programmability with a qubit layer that can achieve high optical detection probability over many optical channels. Here, we address this problem by introducing a modular architecture of piezoelectrically actuated atom-control PICs (APICs) and artificial atoms embedded in diamond nanostructures designed for high-efficiency free-space collection. The high-speed four-channel APIC is based on a splitting tree mesh with triple-phase shifter Mach–Zehnder interferometers. This design simultaneously achieves optically broadband operation at visible wavelengths, high-fidelity switching (>40dB) at low voltages, submicrosecond modulation timescales (>30MHz), and minimal channel-to-channel crosstalk for repeatable optical pulse carving. Via a reconfigurable free-space interconnect, we use the APIC to address single silicon vacancy color centers in individual diamond waveguides with inverse tapered couplers, achieving efficient single photon detection probabilities (∼15%) and second-order autocorrelation measurements g (2) (0)<0.14 for all channels. The modularity of this distributed APIC–quantum memory system simplifies the quantum control problem, potentially enabling further scaling to thousands of channels.

47 OTHER INSTRUMENTATION↗

Analysis and Visualization of Discrete Fracture Networks Using a Flow Topology Graph

We present an analysis and visualization prototype using the concept of a flow topology graph (FTG) for characterization of flow in constrained networks, with a focus on discrete fracture networks (DFN), developed collaboratively by geoscientists and visualization scientists. Our method allows users to understand and evaluate flow and transport in DFN simulations by computing statistical distributions, segment paths of interest, and cluster particles based on their paths. The new approach enables domain scientists to evaluate the accuracy of the simulations, visualize features of interest, and compare multiple realizations over a specific domain of interest. Geoscientists can simulate complex transport phenomena modeling large sites for networks consisting of several thousand fractures without compromising the geometry of the network. However, few tools exist for performing higher-level analysis and visualization of simulated DFN data. The prototype system we present addresses this need. Here, we demonstrate its effectiveness for increasingly complex examples of DFNs, covering two distinct use cases - hydrocarbon extraction from unconventional resources and transport of dissolved contaminant from a spent nuclear fuel repository.

97 MATHEMATICS AND COMPUTING↗

Cultivating an Emergent Earth Observation Analytics Ecosystem in the Cloud

A diverse set of data analytics systems for Earth Observations are sprouting up in the Earth Science community, with a wealth of processing algorithms and analysis methods. There is a similar wealth of data resources available via myriad data providers and clearinghouses, including large institutional systems like the Earth Observing System Data and Information System, Comprehensive Large Scale Array-data Stewardship System, and Federated Earth Observation Missions gateway. With Earth system science driving a need to work with more datasets together, and the community developing more analysis tools (some of them dataset-specific), how can we develop analysis workflows that incorporate far-flung datasets and leverage analysis resources from multiple organizations? Cloud computing points the way toward a solution in two different respects. Firstly, the access to and abstraction of virtually unlimited storage and computing power provides an environment that enables more straightforward means of pulling datasets and analysis resources together. Just as importantly, however, cloud computing serves as an example of an "ecosystem" of interoperating services, since the essence of cloud computing is the presentation of all resources as a service, from hardware to infrastructure to platform to software. This enables the combination of off-the-shelf, diverse services to construct entire systems that emerge out of an equally diverse community of architects and developers. This approach can be similarly applied to the data and analysis resources in the Earth Observation community. By exposing these resources via well understood services, and consuming resources in the same way, different organizations can construct bespoke analysis workflows and systems for their own purposes. The key leap the community needs to make is to develop analysis systems in components that interact with other components via services. The result would be a rich ecosystem of analytics components that can be combined to analyze datasets at scale and in conjunction with other datasets from other sources.

chaos↗

Rare behavior of growth processes via umbrella sampling of trajectories

We compute probability distributions of trajectory observables for reversible and irreversible growth processes. These results reveal a correspondence between reversible and irreversible processes, at particular points in parameter space, in terms of their typical and atypical trajectories. Thus key features of growth processes can be insensitive to the precise form of the rate constants used to generate them, recalling the insensitivity to microscopic details of certain equilibrium behavior. We obtained these results using a sampling method, inspired by the "s-ensemble" large-deviation formalism, that amounts to umbrella sampling in trajectory space. The method is a simple variant of existing approaches, and applies to ensembles of trajectories controlled by the total number of events. It can be used to determine large-deviation rate functions for trajectory observables in or out of equilibrium.

97 MATHEMATICS AND COMPUTING↗

Non-Diffusive Volume Advection with A High Order Interface Reconstruction Method

We show that non-diffusive volume advection in two-dimensions is achieved with several benchmark problems using a newly developed high-order volume of fluids (VOF) interface reconstruction method. (1) A new VOF interface reconstruction method using circular/corner facets (linear facets are a degenerate case of arcs). We create a circular interface facet in each mixed zone by matching neighbor volume with a hybrid Newton’s-bisection method and the local solution is final. In the general case, the new VOF interface reconstruction has 3rd order accuracy and can be easily made seamless. The new method addresses intrinsic issues with Young’s method such as gaps between interface facets in the case of a curved interface, and inability to define curvature nor identify corners. (2) A non-diffusive volume advection scheme. In an ALE advection step, a well-defined interface can be carried over through a Lagrange step and used to compute volume distribution into a relaxed mesh. Then, an interface reconstruction step is performed to redefine the interface in the relaxed mesh. We must point out that the interface carried over is also a solution of interface reconstruction because all the volume fractions in the relaxed mesh are naturally matched. We provide an interface tracking method compatible with our reconstruction scheme, where it is granted to use the prior info as an initial guess to capture sub-mesh resolution features. As a result, we are able to treat multiple facets inside a single mixed cell and obtain highly accurate, non-diffusive solution for advection problems with rather coarse meshes. We show our solutions for two-dimensional incompressible flows with two materials with a) the X + O diagonal translation; b) the Zalesak rotational test; and c) the single vortex spiral test.

97 MATHEMATICS AND COMPUTING↗

SU-E-I-07: An Improved Technique for Scatter Correction in PET

Purpose: In positron emission tomography (PET), the single scatter simulation (SSS) algorithm is widely used for scatter estimation in clinical scans. However, bias usually occurs at the essential steps of scaling the computed SSS distribution to real scatter amounts by employing the scatter-only projection tail. The bias can be amplified when the scatter-only projection tail is too small, resulting in incorrect scatter correction. To this end, we propose a novel scatter calibration technique to accurately estimate the amount of scatter using pre-determined scatter fraction (SF) function instead of the employment of scatter-only tail information. Methods: As the SF depends on the radioactivity distribution and the attenuating material of the patient, an accurate theoretical relation cannot be devised. Instead, we constructed an empirical transformation function between SFs and average attenuation coefficients based on a serious of phantom studies with different sizes and materials. From the average attenuation coefficient, the predicted SFs were calculated using empirical transformation function. Hence, real scatter amount can be obtained by scaling the SSS distribution with the predicted SFs. The simulation was conducted using the SimSET. The Siemens Biograph™ 6 PET scanner was modeled in this study. The Software for Tomographic Image Reconstruction (STIR) was employed to estimate the scatter and reconstruct images. The EEC phantom was adopted to evaluate the performance of our proposed technique. Results: The scatter-corrected image of our method demonstrated improved image contrast over that of SSS. For our technique and SSS of the reconstructed images, the normalized standard deviation were 0.053 and 0.182, respectively; the root mean squared errors were 11.852 and 13.767, respectively. Conclusion: We have proposed an alternative method to calibrate SSS (C-SSS) to the absolute scatter amounts using SF. This method can avoid the bias caused by the insufficient tail information and therefore improve the accuracy of scatter estimation.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗