Search NASA⌕ Search

SEARCH · Search NASA

Results for “data parallel”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 829 records · Page 46
All sourcesNASA NTRSDOE OSTI
DOE OSTI2018

SLoG: Large-Scale Logging Middleware for HPC and Big Data Convergence

Cloud developers traditionally rely on purpose-specific services to provide the storage model they need for an application. In contrast, HPC developers have a much more limited choice, typically restricted to a centralized parallel file system for persistent storage. Unfortunately, these systems often offer low performance when subject to highly concurrent, conflicting I/O patterns. This makes difficult the implementation of inherently concurrent data structures such as distributed shared logs. Yet, this data structure is key to applications such as computational steering, data collection from physical sensor grids, or discrete event generators. In this paper we tackle this issue. We present SLoG, shared log middleware providing a shared log abstraction over a parallel file system, designed to circumvent the aforementioned limitations. We evaluate SLoG’s design on up to 100,000 cores of the Theta supercomputer: the results show high append velocity at scale while also providing substantial benefits for other persistent backend storage systems.

big data↗
DOE OSTI2020

High-performance computing in water resources hydrodynamics

In this work, we present a vision of future water resources hydrodynamics codes that can fully utilize the strengths of modern high-performance computing. The advances to computing power, formerly driven by the improvement of central processing unit processors, now focus on parallel computing and, in particular, the use of graphics processing units (GPUs). However, this shift to a parallel framework requires refactoring the code to make efficient use of the data as well as changing even the nature of the algorithm that solves the system of equations. These concepts along with other features such as the precision for the computations, dry regions management, and input/output data are analyzed in this paper. A 2D multi-GPU flood code applied to a large-scale test case is used to corroborate our statements and ascertain the new challenges for the next-generation parallel water resources codes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2015

Havery Mudd 2014-2015 Computer Science Conduit Clinic. Final Report

Conduit, a new open-source library developed at Lawrence Livermore National Laboratories, provides a C++ application programming interface (API) to describe and access scientific data. Conduit’s primary use is for inmemory data exchange in high performance computing (HPC) applications. Our team tested and improved Conduit to make it more appealing to potential adopters in the HPC community. We extended Conduit’s capabilities by prototyping four libraries: one for parallel communication using MPI, one for I/O functionality, one for aggregating performance data, and one for data visualization.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Decaf: Decoupled Dataflows for In Situ High-Performance Workflows

Decaf is a dataflow system for the parallel communication of coupled tasks in an HPC workflow. The dataflow can perform arbitrary data transformations ranging from simply forwarding data to complex data redistribution. Decaf does this by allowing the user to allocate resources and execute custom code in the dataflow. All communication through the dataflow is efficient parallel message passing over MPI. The runtime for calling tasks is entirely message-driven; Decaf executes a task when all messages for the task have been received. Such a messagedriven runtime allows cyclic task dependencies in the workflow graph, for example, to enact computational steering based on the result of downstream tasks. Decaf includes a simple Python API for describing the workflow graph. This allows Decaf to stand alone as a complete workflow system, but Decaf can also be used as the dataflow layer by one or more other workflow systems to form a heterogeneous task-based computing environment. In one experiment, we couple a molecular dynamics code with a visualization tool using the FlowVR and Damaris workflow systems and Decaf for the dataflow. In another experiment, we test the coupling of a cosmology code with Voronoi tessellation and density estimation codes using MPI for the simulation, the DIY programming model for the two analysis codes, and Decaf for the dataflow. Such workflows consisting of heterogeneous software infrastructures exist because components are developed separately with different programming models and runtimes, and this is the first time that such heterogeneous coupling of diverse components was demonstrated in situ on HPC systems.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

An alternate mode of oligomerization for E. coli SecA

SecA is the ATPase of preprotein translocase. SecA is a dimer in solution and changes in its oligomeric state may function in preprotein translocation. The SecA-N68 construct, in which the C-terminal helical domains of SecA are deleted, was used to investigate the mechanism of SecA oligomerization. SecA-N68 is in equilibrium between monomers, dimers, and tetramers. Subunit interactions in the SecA-N68 tetramer are mediated entirely by unstructured regions at its N- and C-termini: when the termini are deleted to yield SecA-N68ΔNC, the construct is completely monomeric. This monomeric construct yielded crystals diffracting to 2.6 Å that were used to solve the structure of SecA-N68, including the “preprotein crosslinking domain” (PPXD) that was missing from previous E. coli SecA structures. The SecA-N68 structure was combined with small angle X-ray scattering (SAXS) data to construct a model of the SecA-N68 tetramer that is consistent with the essential roles of the extreme N- and C-termini in oligomerization. This mode of oligomerization, which depends on binding of the extreme N-terminus to the DEAD motor domains, NBD1 and NBD2, was used to model a novel parallel and flexible SecA solution dimer that agrees well with SAXS data.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2016

SU-C-207A-01: A Novel Maximum Likelihood Method for High-Resolution Proton Radiography/proton CT

Purpose: Multiple Coulomb scattering is the largest contributor to blurring in proton imaging. Here we tested a maximum likelihood least squares estimator (MLLSE) to improve the spatial resolution of proton radiography (pRad) and proton computed tomography (pCT). Methods: The object is discretized into voxels and the average relative stopping power through voxel columns defined from the source to the detector pixels is optimized such that it maximizes the likelihood of the proton energy loss. The length spent by individual protons in each column is calculated through an optimized cubic spline estimate. pRad images were first produced using Geant4 simulations. An anthropomorphic head phantom and the Catphan line-pair module for 3-D spatial resolution were studied and resulting images were analyzed. Both parallel and conical beam have been investigated for simulated pRad acquisition. Then, experimental data of a pediatric head phantom (CIRS) were acquired using a recently completed experimental pCT scanner. Specific filters were applied on proton angle and energy loss data to remove proton histories that underwent nuclear interactions. The MTF10% (lp/mm) was used to evaluate and compare spatial resolution. Results: Numerical simulations showed improvement in the pRad spatial resolution for the parallel (2.75 to 6.71 lp/cm) and conical beam (3.08 to 5.83 lp/cm) reconstructed with the MLLSE compared to averaging detector pixel signals. For full tomographic reconstruction, the improved pRad were used as input into a simultaneous algebraic reconstruction algorithm. The Catphan pCT reconstruction based on the MLLSE-enhanced projection showed spatial resolution improvement for the parallel (2.83 to 5.86 lp/cm) and conical beam (3.03 to 5.15 lp/cm). The anthropomorphic head pCT displayed important contrast gains in high-gradient regions. Experimental results also demonstrated significant improvement in spatial resolution of the pediatric head radiography. Conclusion: The proposed MLLSE shows promising potential to increase the spatial resolution (up to 244%) in proton imaging.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2023

PhytoOracle: Scalable, modular phenomics data processing pipelines

As phenomics data volume and dimensionality increase due to advancements in sensor technology, there is an urgent need to develop and implement scalable data processing pipelines. Current phenomics data processing pipelines lack modularity, extensibility, and processing distribution across sensor modalities and phenotyping platforms. To address these challenges, we developed PhytoOracle (PO), a suite of modular, scalable pipelines for processing large volumes of field phenomics RGB, thermal, PSII chlorophyll fluorescence 2D images, and 3D point clouds. PhytoOracle aims to ( i ) improve data processing efficiency; ( ii ) provide an extensible, reproducible computing framework; and ( iii ) enable data fusion of multi-modal phenomics data. PhytoOracle integrates open-source distributed computing frameworks for parallel processing on high-performance computing, cloud, and local computing environments. Each pipeline component is available as a standalone container, providing transferability, extensibility, and reproducibility. The PO pipeline extracts and associates individual plant traits across sensor modalities and collection time points, representing a unique multi-system approach to addressing the genotype-phenotype gap. To date, PO supports lettuce and sorghum phenotypic trait extraction, with a goal of widening the range of supported species in the future. At the maximum number of cores tested in this study (1,024 cores), PO processing times were: 235 minutes for 9,270 RGB images (140.7 GB), 235 minutes for 9,270 thermal images (5.4 GB), and 13 minutes for 39,678 PSII images (86.2 GB). These processing times represent end-to-end processing, from raw data to fully processed numerical phenotypic trait data. Repeatability values of 0.39-0.95 (bounding area), 0.81-0.95 (axis-aligned bounding volume), 0.79-0.94 (oriented bounding volume), 0.83-0.95 (plant height), and 0.81-0.95 (number of points) were observed in Field Scanalyzer data. We also show the ability of PO to process drone data with a repeatability of 0.55-0.95 (bounding area).

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2018

Orientation of the intra-unit-cell magnetic moment in the high- T c superconductor HgBa 2 CuO 4+δ

Polarized-neutron diffraction (PND) experiments have revealed that the pseudogap state of the cuprates exhibits unusual intra-unit-cell (IUC) magnetism. At a qualitative level, the data indicate a moment direction that is neither perpendicular nor parallel to the CuO 2 layers, yet an accurate measurement at a high-symmetry momentum point in a structurally simple compound has been lacking. Such a measurement would be crucial, as it would help to narrow down the scenarios for the microscopic origin of the IUC magnetism. Here we report PND results with unprecedented accuracy for the IUC magnetic order in the simple-tetragonal single-CuO 2 -layer compound HgBa 2 CuO 4+δ . At the pseudogap temperature, we find evidence for magnetic critical scattering. Deep in the ordered state, we determine the moment direction to be 70° ± 10° away from the normal to the CuO 2 layers, which rules out both purely planar loop currents and high-symmetry Dirac multipoles, the two most prominent theoretical proposals for the microscopic origin of the IUC magnetism. Furthermore, the data are consistent with Dirac multipoles of lower symmetry or, alternatively, with a particular configuration of loop currents that flow on the faces of the CuO 6 octahedra.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2017

plexos-coad (Plexos Class-Object-Attribute Data manipulation tool)

Clean energy systems including the future power grid are enabled via the development, analysis and application of advanced simulation of complex systems based on large datasets. The ability to handle and enable the simulation of complex systems allows researchers and analysts to address significant problems with greater confidence and greater levels of integrity. Parallel execution of complex systems is paramount to addressing increasing complexity. Programmatic interfaces for software configuration and parallel execution enable handling greater complexity and improving simulation integrity. The Class Object Attribute Data (COAD) software is written as a programmatic interface to the PLEXOS dataset that enables the decomposition of the dataset in time and execution in parallel without loss of integrity. COAD also enable the recomposition of solution datasets that are the output of distributed parallel execution of the core simulator.

Jones, Wes↗
DOE OSTI2018

Parallel multiple-chain DRAM MCMC for large-scale geosteering inversion and uncertainty quantification

Geosteering is the proactive control of a wellbore placement based on the downhole measurements, aiming at maximizing economic production from the well. We report the recent development of azimuthal resistivity logging-whiledrilling (LWD) tools have a much larger depth of detection, thus sets higher demands for geosteering inversion as more unknown parameters need to be taken into account in the earth model to be inverted. For complicated nonlinear problems, traditional deterministic inversion methods are more likely to be trapped near local optima. In general, Markov chain Monte Carlo (MCMC) inversion methods are more capable of finding the global optimal solution and providing additional uncertainty analyses by sampling from the target distribution. However, MCMC methods usually have the problem of slow convergence. Even though optimization methods like delayed rejection (DR) and adaptive Metropolis (AM) were proposed to speed up the convergence, using MCMC methods to solve geosteering inversion problems may still incur unacceptable time cost. To reduce the sampling cost of MCMC methods, we use parallel multiple-chain DRAM MCMC methods to solve geosteering inverse problems and estimate the corresponding uncertainty. A clustering method, density-based spatial clustering of applications with noise (DBSCAN), is applied to select the best solution among many results. Lastly, the simulation results show that running many relatively short MCMC chains for one problem can obtain a similar result as running a long single chain. Besides, avoiding communications between multiple Markov chains during the sampling process yields almost linear scalability.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2020

An open source fast fluid dynamics model for data center thermal management

Although computational fluid dynamics (CFD) has been widely adopted to improve data center thermal management, the high computational demand limits its applications, such as multivariate optimal design and operation. Fast fluid dynamics (FFD), which has been applied for fast airflow simulation, shows great potential. However, few research applied FFD for optimal design and operation of data center thermal management. This research improves the FFD model for data centers and conducts a comprehensive evaluation and demonstration. First, the FFD model is improved by solving the advection and diffusion equations together using an upwind scheme instead of a semi-Lagrangian advection solver in the conventional FFD model. Second, new features for data centers are added, such as a pressure correction method to simulate plenum airflow and dynamic boundary conditions for IT racks. The new FFD model is first validated with two indoor environment cases and the results show that the new FFD model has slightly better overall prediction accuracy and faster speed compared to the conventional FFD model. It is also observed that both FFD models achieve acceptable accuracy, except for a few localized disparities with experimental data, which might be due to simplified handling of turbulence viscosity near the boundaries. Furthermore, validation with a real data center shows that the FFD model achieves a similar level of accuracy as CFD when compared to the experimental measurements with some level of uncertainties. It is then demonstrated for data center optimal design and operation, which saves 53.4–58.8% of annual energy while still meeting the thermal requirements. In conclusion, with a much faster speed and comparable accuracy compared to CFD, the FFD model parallelized on a graphics processing unit is promising for practical model-based data center early design and operation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2015

Exploratory Data analysis ENvironment eXtreme scale (EDENx)

EDENx is a multivariate data visualization tool that allows interactive user driven analysis of large-scale data sets with high dimensionality. EDENx builds on our earlier system, called EDEN to enable analysis of more dimensions and larger scale data sets. EDENx provides an initial overview of summary statistics for each variable in the data set under investigation. EDENx allows the user to interact with graphical summary plots of the data to investigate subsets and their statistical associations. These plots include histograms, binned scatterplots, binned parallel coordinate plots, timeline plots, and graphical correlation indicators. From the EDENx interface, a user can select a subsample of interest and launch a more detailed data visualization via the EDEN system. EDENx is best suited for high-level, aggregate analysis tasks while EDEN is more appropriate for detail data investigations.

Steed, Chad Allen↗
DOE OSTI2023

Determination of the titanium spectral function from ($e,e'p$) data

The E12-14-012 experiment, performed in Jefferson Lab Hall A, has measured the (e, e'p) cross section in parallel kinematics using a natural titanium target. In this paper, we report the analysis of the dataset obtained in different kinematics for our solid natural titanium target. Data were obtained in a range of missing momentum and missing energy between 15 ≲ p m ≲ 250 MeV / c and 12 ≲ E m ≲ 80 MeV, respectively, and using an electron beam energy of 2.2 GeV. We measured the reduced cross section with ~7% accuracy as a function of both missing momentum and missing energy. Furthermore, our Monte Carlo simulation, including both a model spectral function and the effects of final-state interactions, satisfactorily reproduces the data.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2021

GeantV: Results from the Prototype of Concurrent Vector Particle Transport Simulation in HEP

Full detector simulation was among the largest CPU consumers in all CERN experiment software stacks for the first two runs of the Large Hadron Collider. In the early 2010s, it was projected that simulation demands would scale linearly with increasing luminosity, with only partial compensation from increasing computing resources. The extension of fast simulation approaches to cover more use cases that represent a larger fraction of the simulation budget is only part of the solution, because of intrinsic precision limitations. The remainder corresponds to speeding up the simulation software by several factors, which is not achievable by just applying simple optimizations to the current code base. In this context, the GeantV R&D project was launched, aiming to redesign the legacy particle transport code in order to benefit from features of fine-grained parallelism, including vectorization and increased locality of both instruction and data. This paper provides an extensive presentation of the results and achievements of this R&D project, as well as the conclusions and lessons learned from the beta version prototype.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2015

The development of laser-plasma interaction program LAP3D on thousands of processors

Modeling laser-plasma interaction (LPI) processes in real-size experiments scale is recognized as a challenging task. For explorering the influence of various instabilities in LPI processes, a three-dimensional laser and plasma code (LAP3D) has been developed, which includes filamentation, stimulated Brillouin backscattering (SBS), stimulated Raman backscattering (SRS), non-local heat transport and plasmas flow computation modules. In this program, a second-order upwind scheme is applied to solve the plasma equations which are represented by an Euler fluid model. Operator splitting method is used for solving the equations of the light wave propagation, where the Fast Fourier translation (FFT) is applied to compute the diffraction operator and the coordinate translations is used to solve the acoustic wave equation. The coupled terms of the different physics processes are computed by the second-order interpolations algorithm. In order to simulate the LPI processes in massively parallel computers well, several parallel techniques are used, such as the coupled parallel algorithm of FFT and fluid numerical computation, the load balance algorithm, and the data transfer algorithm. Now the phenomena of filamentation, SBS and SRS have been studied in low-density plasma successfully with LAP3D. Scalability of the program is demonstrated with a parallel efficiency above 50% on about ten thousand of processors.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗
DOE OSTI2024

Summary of Savannah River Site FY23 Salt Waste Qualification Data

The Savannah River National Laboratory (SRNL) analyzed samples from Savannah River Site (SRS) Waste Tanks 41H and 21H to support qualification of Salt Waste Processing Facility (SWPF) Waste Batches 8 and 9 for processing (the FY23 Salt Batch Qualification samples). These Tanks (i.e. 41H and 21H) are blend tanks for feed to SWPF. None of the samples displayed any unusual or unexpected characteristics such as large amounts of solids, floating solids, or unusual color. Characterization of these samples confirmed similar chemical composition and characteristics to previous salt waste batches. The results for Batches 8 and 9 were provided by SRNL to Savannah River Mission Completion (SRMC), the Liquid Waste Operations subcontractor at SRS, as External Sample Results (Laboratory Information Management System (LIMS)) Reports. Additionally, a separate technical memo was issued by SRNL to report re-test data for Batch 8 for Cs-137 for filtered samples only which were run at the request of SWPF. For Batch 9, a set of samples was also analyzed in parallel by the SWPF-Analytical Laboratory (SWPF-AL). The SWPF-AL data is included herein for comparison with the SRNL data where applicable. The analytical results (both rapid, typically 4 weeks, and long term, typically 8 weeks) for Batches 8 and 9 are now summarized and discussed in this technical report.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
DOE OSTI2017

On the Scalability of Data Reduction Techniques in Current and Upcoming HPC Systems from an Application Perspective

We implement and benchmark parallel I/O methods for the fully-manycore driven particle-in-cell code PIConGPU. Identifying throughput and overall I/O size as a major challenge for applications on today’s and future HPC systems, we present a scaling law characterizing performance bottlenecks in state-of-the-art approaches for data reduction. Consequently, we propose, implement and verify multi-threaded data-transformations for the I/O library ADIOS as a feasible way to trade underutilized host-side compute potential on heterogeneous systems for reduced I/O latency.

Huebl, Axel↗
DOE OSTI2015

Identifying the location of the OMP separatrix in DIII-D using power accounting

In order to identify reliable scalings for the scrape-off layer (SOL) power width it is necessary to know the location of the separatrix in divertor tokamaks as accurately as possible, specifically its location at the outside midplane (OMP) the standard reference location. Two methods are described which use power accounting to improve the accuracy of identifying the location of the OMP separatrix. The first uses the infrared-measured deposited power profile at the outer target as the primary input, the ' $P_{{\rm SOL}}^{{\rm exhaust}}$ method'. The second uses the measured power input to the SOL, obtained by subtracting the power radiated from inside the separatrix from the total heating power, the ' $P_{{\rm SOL}}^{{\rm input}}$ method'. Furthermore, these two power accounting methods are illustrated with the examples of 21 H-mode DIII-D discharges. High spatial resolution Thomson scattering measured profiles of ne and Te for the main SOL near the OMP are also used as primary input to the analysis; only between-edge localized mode data are used here. The Thomson profiles are used to calculate the electron parallel conducted heat flux profiles which are then matched to the measured $P_{{\rm SOL}}^{{\rm exhaust}}$ and $P_{{\rm SOL}}^{{\rm input}}$ by adjusting the location of the OMP separatrix relative to that of the Thomson data. For these attached discharges, it is found that the values of $R_{{\rm sep}}^{{\rm omp}}$ given by the two power accounting methods agree to within ~1 mm of each other and also to within ~1 mm of the values given by the 'standard DIII-D method' described by Porter et al (1998 Phys. Plasmas 5 1410). Lastly, the shifted $R_{{\rm sep}}^{{\rm omp}}$ results in only modest changes to the values of ne and Te at the OMP separatrix relative to the 'standard' values, increasing $n_{{\rm e}}^{{\rm sep}}$ by 8% and $T_{{\rm e}}^{{\rm sep}}$ by 20%.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗