Search NASA⌕ Search

SEARCH · Search NASA

Results for “large data”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 631 records · Page 35

Interactive Exploration of High-Dimensional Phase Diagrams

High-dimensional thermodynamic phase stability databases are becoming increasingly common due to the convergence of three recent trends: (i) the widespread interest in so-called “high-entropy” alloys, (ii) the availability of high-throughput computational assessments of phase stability in broad composition spaces and (iii) the ongoing development of ever-increasingly broad, multicomponent, multiphase CALPHAD databases. Although automated computational tools can readily process such high-dimensional data, scientists are often unable to visualize the relevant phase relations, an ability that is crucial to gaining an intuitive understanding of the stability constraints governing materials design. The present work addresses this need by providing algorithms that enable the interactive exploration of phase equilibria in high-dimensional spaces. These algorithms concentrate the complex nonlinear nonsmooth optimization needed into a preprocessing step that generates a large number of high-dimensional yet elementary graphical primitives. Furthermore, these primitives can then be cross-sectioned to yield 3-dimensional views in a computationally efficient manner that enables an interactive exploration of high-dimensional spaces. All of these operations are highly parallelizable, thus facilitating scaling of this method to large data sets.

36 MATERIALS SCIENCE↗

Three-dimensional multiphase segmentation of X-ray CT data of porous materials using a Bayesian Markov random field framework

Advancements in noninvasive imaging methods such as X-ray computed tomography (CT) have led to a recent surge of applications in porous media research with objectives ranging from theoretical aspects of pore-scale fluid and interfacial dynamics to practical applications such as enhanced oil recovery and advanced contaminant remediation. While substantial efforts and resources have been devoted to advance CT technology, microscale analysis, and fluid dynamics simulations, the development of efficient and stable three-dimensional multiphase image segmentation methods applicable to large data sets is lacking. To eliminate the need for wet-dry or dual-energy scans, image alignment, and subtraction analysis, commonly applied in X-ray micro-CT, a segmentation method based on a Bayesian Markov random field (MRF) framework amenable to true three-dimensional multiphase processing was developed and evaluated. Furthermore, several heuristic and deterministic combinatorial optimization schemes required to solve the labeling problem of the MRF image model were implemented and tested for computational efficiency and their impact on segmentation results. Test results for three grayscale data sets consisting of dry glass beads, partially saturated glass beads, and partially saturated crushed tuff obtained with synchrotron X-ray micro-CT demonstrate great potential of the MRF image model for three-dimensional multiphase segmentation. While our results are promising and the developed algorithm is stable and computationally more efficient than other commonly applied porous media segmentation models, further potential improvements exist for fully automated operation.

42 ENGINEERING↗

Interactive Visualization of Complex Seismic Data and Models Using Bokeh

Visualizing multidimensional data and models becomes more challenging as the volume and resolution of seismic data and models increase. But thanks to the development of powerful and accessible computer systems, a model web browser can be used to visualize complex scientific data and models dynamically. In this paper, we present four examples of seismic model visualization using an open-source Python package Bokeh. One example is a visualization of a surface-wave dispersion data set, another presents a view of three-component seismograms, and two illustrate methods to explore a 3D seismic-velocity model. Unlike other 3D visualization packages, our visualization approach has a minimum requirement on users and is relatively easy to develop, provided you have reasonable programming skills. Finally, utilizing familiar web browsing interfaces, the dynamic tools provide us an effective and efficient approach to explore large data sets and models.

58 GEOSCIENCES↗

Machine Learning Approaches to Predicting Induced Seismicity and Imaging Geothermal Reservoir Properties

This project developed machine learning (ML) methods, lab data sets, and field data to advance geothermal exploration and geothermal energy production. The work had three focus areas. One involved the development of ML methods to use microearthquakes (MEQs) for imaging geothermal reservoir properties and improving subsurface characterization – most importantly the evolution of permeability within the evolving reservoir. This part of the work included development of ML approaches for automated MEQ location, focal mechanism determination and identification of earthquake precursors. The second area focused on using MEQ signals generated by geothermal exploration and production to predict the relationship between fluid injection and seismicity. Here, we extended to reservoir scale our success in using ML to predict laboratory earthquakes and fault zone stress state. The third focus area was on lab experiments. Here, we developed new ML models for lab earthquake prediction and identification of precursors to failure to improve earthquake forecasting and early warning in geothermal settings. Major outcomes of our work include ML models that learn from MEQ signals during geothermal exploration and production to predict induced seismicity. MEQs occur naturally in connection with drilling and energy production. We developed ML methods to use the seismic waves from these events to characterize the elastic, hydraulic and poromechanical properties of reservoirs. Our work illuminated fracture geometry and the evolution of fracture permeability by incorporating seismic coda wave analysis and ML methods to relate fluid injection and seismicity. We significantly expanded laboratory earthquake prediction to include methods that use both passive measurements of microearthquakes within the lab fault zones and also active source acoustic measurements of fault zone elastic properties. These methods can now predict fault zone stress state, time to failure and the magnitude of lab earthquakes. Our work showed that repetitive stick- slip failure events during frictional sliding (the lab equivalent of earthquakes) are preceded by a cascade of micro-failure events that radiate energy in a manner that foretells unstable failure – manifest as laboratory MEQs. We documented a mapping between fracture properties and statistical attributes of elastic radiation. We extended existing works to geothermal reservoir scale and developed ML methods to determine reservoir permeability, fracture properties, and their evolution during geothermal energy production. An attractive feature of ML algorithms is their ability to handle big datasets and reveal patterns and correlations that may remain invisible to conventional analyses. Our work connected data from field, laboratory and intermediate scales to study permeability, stress, strength, fracture stiffness and geometry. At the field scale we used data from the Newberry Volcano field site, UtahFORGE, EGS Collab, and also the Bedretto underground research lab in Switzerland. These data sets are bridging the gap between the lab scale, theory, and reservoir scale. Our work produced plain language summaries to improve public understanding of DOE research. We also developed openly distributed ML and seismicity datasets for use by all researchers and we published connections between induced seismicity in geothermal areas and reservoir properties including permeability, fracture properties, and stress state. Our models are designed for the large data sets of induced seismicity typically associated with geothermal sites. We produced labeled event catalogs and used them on geothermal data to assess how ML can facilitate geothermal production and exploration. All datasets are available on the GDR Productivity: The project produced 32 publications in peer reviewed journals (two are in review). It supported the work of 6 PhD students, 40 conference presentations, 6 keynote talks at national meetings, and mentoring and professional development for 4 postdoctoral fellows.

15 GEOTHERMAL ENERGY↗

High-latitude ion convection in the nighttime F region

A large data base of Atmosphere Explorer C measurements of the bulk ion velocity vector in the high-latitude F region has been examined. The concept of shear and rotational flow reversals is expanded upon to determine the extent to which the boundary between antisunward and sunward convection (i.e., a polar cap boundary) is an electrostatic equipotential. A most important factor in characterizing the nature of the large-scale geometrical configuration of the nighttime F region convection is the location and extent of quasi-equipotential regions of the convection reversal boundary.

Heelis, R. A.↗

Hierarchical and Parallelizable Direct Volume Rendering for Irregular and Multiple Grids

A general volume rendering technique is described that efficiently produces images of excellent quality from data defined over irregular grids having a wide variety of formats. Rendering is done in software, eliminating the need for special graphics hardware, as well as any artifacts associated with graphics hardware. Images of volumes with about one million cells can be produced in one to several minutes on a workstation with a 150 MHz processor. A significant advantage of this method for applications such as computational fluid dynamics is that it can process multiple intersecting grids. Such grids present problems for most current volume rendering techniques. Also, the wide range of cell sizes (by a factor of 10,000 or more), which is typical of such applications, does not present difficulties, as it does for many techniques. A spatial hierarchical organization makes it possible to access data from a restricted region efficiently. The tree has greater depth in regions of greater detail, determined by the number of cells in the region. It also makes it possible to render useful 'preview' images very quickly (about one second for one-million-cell grids) by displaying each region associated with a tree node as one cell. Previews show enough detail to navigate effectively in very large data sets. The algorithmic techniques include use of a kappa-d tree, with prefix-order partitioning of triangles, to reduce the number of primitives that must be processed for one rendering, coarse-grain parallelism for a shared-memory MIMD architecture, a new perspective transformation that achieves greater numerical accuracy, and a scanline algorithm with depth sorting and a new clipping technique.

Wilhelms, Jane↗

REVISITING {rho}{sup 1} CANCRI e: A NEW MASS DETERMINATION OF THE TRANSITING SUPER-EARTH

We present a mass determination for the transiting super-Earth {rho}{sup 1} Cancri e based on nearly 700 precise radial velocity (RV) measurements. This extensive RV data set consists of data collected by the McDonald Observatory planet search and published data from Lick and Keck observatories. We obtained 212 RV measurements with the Tull Coude Spectrograph at the Harlan J. Smith 2.7 m Telescope and combined them with a new Doppler reduction of the 131 spectra that we have taken in 2003-2004 with the High-Resolution Spectrograph (HRS) at the Hobby-Eberly Telescope for the original discovery of {rho}{sup 1} Cancri e. Using this large data set we obtain a five-planet Keplerian orbital solution for the system and measure an RV semi-amplitude of K = 6.29 {+-} 0.21 m s{sup -1} for {rho}{sup 1} Cnc e and determine a mass of 8.37 {+-} 0.38 M {sub Circled-Plus }. The uncertainty in mass is thus less than 5%. This planet was previously found to transit its parent star, which allowed them to estimate its radius. Combined with the latest radius estimate from Gillon et al., we obtain a mean density of {rho} = 4.50 {+-} 0.20 g cm{sup -3}. The location of {rho}{sup 1} Cnc e in the mass-radius diagram suggests that the planet contains a significant amount of volatiles, possibly a water-rich envelope surrounding a rocky core.

79 ASTRONOMY AND ASTROPHYSICS↗

Lost in space: Onboard star identification using CCD star tracker data without an a priori attitude

There are many algorithms in use today which determine spacecraft attitude by identifying stars in the field of view of a star tracker. Some methods, which date from the early 1960's, compare the angular separation between observed stars with a small catalog. In the last 10 years, several methods have been developed which speed up the process and reduce the amount of memory needed, a key element to onboard attitude determination. However, each of these methods require some a priori knowledge of the spacecraft attitude. Although the Sun and magnetic field generally provide the necessary coarse attitude information, there are occasions when a spacecraft could get lost when it is not prudent to wait for sunlight. Also, the possibility of efficient attitude determination using only the highly accurate CCD star tracker could lead to fully autonomous spacecraft attitude determination. The need for redundant coarse sensors could thus be eliminated at substantial cost reduction. Some groups have extended their algorithms to implement a computation intense full sky scan. Some require large data bases. Both storage and speed are concerns for autonomous onboard systems. Neural network technology is even being explored by some as a possible solution, but because of the limited number of patterns that can be stored and large overhead, nothing concrete has resulted from these efforts. This paper presents an algorithm which, by descretizing the sky and filtering by visual magnitude of the brightness observed star, speeds up the lost in space star identification process while reducing the amount of necessary onboard computer storage compared to existing techniques.

Ketchum, Eleanor A.↗

First Observation of Neutrino Candidates in ProtoDUNE

The Neutrino Platform at CERN hosts two massive prototypes for the DUNE Far Detector to test the technology for the coming Horizontal Drift and Vertical Drift designs, almost perfectly on axis with the direction of the SPS beamline pointed towards the North Area. The 400 GeV/c SPS protons impacting on the T2 target area may produce exotic particles that could travel ~700 meters to the detectors, in addition to a substantial flux of neutrinos. Simulations of the neutrino flux demonstrate that thousands of neutrino interactions are expected per week in the active volume of NP04 spanning energies from a few GeV up to 180 GeV, constituting the main background for such search. The first step towards establishing a BSM physics program at the Neutrino Platform is therefore to observe neutrinos originating from the SPS beam. A sample of high-energy neutrino events in a DUNE FD-like LArTPC may also be of broader use to the DUNE collaboration. For example, by testing the performance of reconstruction algorithms on highly-energetic neutrino interactions with large hadronic showers. An initial neutrino search was performed by developing filters to remove cosmic events. After filtering, the remaining events were eye-scanned to identify neutrino candidates amongst the residual cosmic background. Over two of the available NP04 runs, 29 neutrino candidates were identified. A separate run taken with the SPS beam off yielded no neutrino candidates. An analysis is now under development that will use all available data, large Monte Carlo samples and full event reconstruction, with the aim of confirming whether NP04 is capable of observing feebly interacting particles originating from the SPS beam.

Pullia, Dario [CERN]↗

Multi-reference evaluation of uncertainty in earth orientation parameter measurements

Uncertainties in polar motion and length-of-day measurements are evaluated empirically using several data series from the space-geodetic techniques of the global positioning system (GPS), satellite laser ranging (SLR), and very long baseline interferometry (VLBI) during 1997-2002. In the evaluation procedure employed here, known as the three-corner hat (TCH) technique, the signal common to each series is eliminated by forming pair-wise differences between the series, thus requiring no assumed values for the 'truth' signal. From the variances of the differenced series, the uncertainty of each series can be recovered when reasonable assumptions are made about the correlations between the series. In order to form the pair-wise differences, the series data must be given at the same epoch. All measurement data sets studied here were sampled at noon (UTC); except for the VLBI series, whose data are interpolated to noon and whose UT1 values are also numerically differentiated to obtain LOD. The numerical error introduced to the VLBI values by the interpolation and differentiation is shown to be comparable in magnitude to the values determined by the TCH method for the uncertainties of the VLBI series. The TCH estimates for the VLBI series are corrupted by such numerical errors mostly as a result of the relatively large data intervals. Of the remaining data sets studied here, it is found that the IGS Final combined series has the smallest polar motion and length-of-day uncertainties.

Combination↗

Spectrum of the Isotropic Diffuse Gamma-Ray Emission Derived from First-Year Fermi Large Area Telescope Data

Here, we report on the first Fermi Large Area Telescope (LAT) measurements of the so-called “extragalactic” diffuse γ -ray emission (EGB). This component of the diffuse γ -ray emission is generally considered to have an isotropic or nearly isotropic distribution on the sky with diverse contributions discussed in the literature. The derivation of the EGB is based on detailed modeling of the bright foreground diffuse Galactic γ -ray emission, the detected LAT sources, and the solar γ -ray emission. We also find the spectrum of the EGB is consistent with a power law with a differential spectral index γ = 2.41 ± 0.05 and intensity I ( > 100 MeV ) = ( 1.03 ± 0.17 ) × 10 - 5 cm -2 s - 1 sr - 1 , where the error is systematics dominated. The EGB spectrum, presented here, is featureless, less intense, and softer than that derived from EGRET data.

79 ASTRONOMY AND ASTROPHYSICS↗

Brillouin Sensing with PCA, and PCA-Based Neural Networks for Efficient Temperature Monitoring

This work explores peak estimation techniques in Brillouin Optical Time Domain Analysis (BOTDA), emphasizing both accuracy and efficiency. Euclidean distance measurement method is applied to principal components derived from Brillouin Gain Spectrum data. It offers a major speed advantage being 180 170 times faster than traditional curve fitting methods such as Lorentzian curve fitting, while maintaining similar accuracy. Additionally, a PCA- based neural network model shows significant reduction of peak estimation time compared to Lorentzian fitting. Results show Brillouin frequency shift errors lie under 0.75 MHz in both Euclidean distance-based and neural network-based methods, both of which utilize PCA components. For large data sets and long length fibers, PCA- assisted neural network for peak estimation would be an efficient solution.

Distributed optical fiber sensing↗

Studying Z/γ*+Jet Production in proton-antiproton collisions at √s = 1.96 TeV

The production of jets in association with a Z/γ* boson is an example of an important class of processes at hadron colliders, namely vector boson + jet (V + jet) production. Comparisons of measurements of this class of processes with theory predictions constitute an important, fundamental test of the Standard Model of particle physics, and of the theory of QCD in particular. While having a smaller cross section than other V +jet processes, Z/γ*(→ e + e - ) + jets production, with Z/γ* {yields} e + e - /μ + μ - , has a distinct experimental signature allowing for measurements characterized by low backgrounds and a direct, precise measurement of the properties of the decay products of the Z/γ* boson. In this thesis, several new measurements of the properties of jets produced in association with a Z/γ* boson in p$\bar{p}$ collisions at √s = 1.96 TeV are presented. The cross section for Z/γ*(→ e + e - ) + N jet production (N ≤ 3) is measured, differential in the transverse momentum of the Nth jet in the event, normalized to the inclusive Z/γ* cross section. Also, the cross section for Z/γ*(→e + e - ) + N jets (N ≥ 1) is measured, differential in the difference in azimuthal angle between the di-electron system and any jet in the event, normalized to unity. The data used in the measurements were collected by the D0 experiment located at the Tevatron Collider of the Fermi National Accelerator Laboratory and correspond to an integrated luminosity of 1.04 fb -1 . The measured jet transverse momentum spectra are compared with the predictions of perturbative calculations at the next-to-leading order in the strong coupling constant. Given the low sensitivity of the calculations to model parameters, these comparisons represent a stringent test of perturbative QCD. One of the main goals currently being pursued in particle physics is the discovery of the only particle predicted by the Standard Model which has so far no been detected experimentally, namely the Higgs boson. It is assumed that the ATLAS and CMS experiments located at the Large Hadron Collider (LHC), a proton-proton collider at √s = 14 TeV, will be able to detect the Higgs boson, or rule out its existence, within the next few years. The collisions delivered by the LHC will also be used to perform a long range of searches for other new particles, for instance particles predicted by models based on the principle of supersymmetry. The associated production of vector bosons with jets has relatively large production rates at the LHC and can produce a long list of different final states which can include charged leptons, missing transverse energy, as well as light- and heavy-flavour jets. This makes V + jet production a major source of background events to many searches for new particles. Most techniques used for estimating the expected number of background events to searches rely on passing the stable final-state particles of simulated hadron collisions generated using a so-called event generator code, through a simulation of the experimental detector system. The development of event generators which are capable of reliably predicting the properties of jets produced in association with a core process, e.g. the production of a vector boson, has been the subject of a large amount of research activity during the last ten years. These efforts have led to the appearance of the CKKW and MLM algorithms which are implemented in several event generators, among them SHERPA and ALPGEN + PYTHIA. The large data sample collected by the D0 experiment during Run II offers an excellent opportunity for validating these new event generators against experimental measurements of V + jet production. As argued above, the Z/γ*(→ e + e - ) + jets process offers the combination of a clean experimental signature and large production rates, making it the process of choice for these studies.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Characterizing Space Environments with Long-Term Space Plasma Archive Resources

A significant scientific benefit of establishing and maintaining long-term space plasma data archives is the ready access the archives afford to resources required for characterizing spacecraft design environments. Space systems must be capable of operating in the mean environments driven by climatology as well as the extremes that occur during individual space weather events. Long- term time series are necessary to obtain quantitative information on environment variability and extremes that characterize the mean and worst case environments that may be encountered during a mission. In addition, analysis of large data sets are important to scientific studies of flux limiting processes that provide a basis for establishing upper limits to environment specifications used in radiation or charging analyses. We present applications using data from existing archives and highlight their contributions to space environment models developed at Marshall Space Flight Center including the Chandra Radiation Model, ionospheric plasma variability models, and plasma models of the L2 space environment.

Minow, Joseph I.↗

The Ejectable Data Recorder: A Lean, Risk-Informed Approach for Hardware Development

NASA is developing the Orion spacecraft to transport crew from the Earth to the Moon as part of the Artemis series of missions. To provide a crew escape capability from pre-launch through ascent, the Orion vehicle is equipped with a Launch Abort System (LAS), built by Lockheed Martin, which pulls the capsule away from the launch vehicle in the event of an abort scenario. The Ascent Abort 2 (AA-2) test flight occurred on July 2, 2019,and tested a production version of the LAS to ensure that it can operate as intended, and to collect a large data set from hundreds of sensors on the vehicle to support Orion flight certification. In the original AA-2 architecture, a single-string set of communications antennas on the LAS would downlink all of the in-flight test data to ground stations. However, that communications architecture was predicted to have data dropouts during abort and jettison of the LAS, and would not support data transmission at all after LAS jettison. As a result, a comprehensive trade study was completed, yielding the addition of antennas on the crew module (CM), a buffer/rebroadcast capability for key portions of the flight, and an ejectable data recorder (EDR) subsystem. This EDR subsystem would serve as a backup to the radio frequency (RF) communications system, and would be non-flight critical, providing a unique capability that enabled management to take a different approach with the hardware and software development. The Crew Module and Separation Ring were developed as “Class 1”Flight Hardware, albeit with some tailoring approaches to enable efficiencies. The Class 1 designation requires full rigor for flight hardware and software, documenting everything that happens to a piece of hardware from procurement through disposal, requiring a full spectrum of acceptance tests, and the highest rigor of quality assurance processes. At the other end of the spectrum, Class 3hardware is controlled, but not intended for flight, and leaves the level of rigor up to the project manager. This classification is often used for research and development projects. Similarly,Class-1E has been recently defined at NASA for ISS payloads and technology development projects that are not flight critical and do not need the full rigor of Class 1 to be successful. The EDR subsystem was challenged at commencement to adopt a skunkworks and agile-like approach to hardware development, allowing for a different risk posture than the rest of the AA-2 hardware. After initially pursuing Class 1 processes, the EDR subsystem design evolved to incorporating numerous commercial components, leading to re-designation as a Class-1E subsystem. The resulting EDR subsystem was fully successful in meeting all flight system requirements, and achieved 100% retrieval of flight test data. This paper will discuss the risk posture of the EDR subsystem and the subsequent tailoring that was enacted as part of its Class-1E status.

EDR↗

Integration experiments and performance studies of a COTS parallel archive system

Current and future Archive Storage Systems have been asked to (a) scale to very high bandwidths, (b) scale in metadata performance, (c) support policy-based hierarchical storage management capability, (d) scale in supporting changing needs of very large data sets, (e) support standard interface, and (f) utilize commercial-off-the-shelf (COTS) hardware. Parallel file systems have been asked to do the same thing but at one or more orders of magnitude faster in performance. Archive systems continue to move closer to file systems in their design due to the need for speed and bandwidth, especially metadata searching speeds such as more caching and less robust semantics. Currently the number of extreme highly scalable parallel archive solutions is very small especially those that will move a single large striped parallel disk file onto many tapes in parallel. We believe that a hybrid storage approach of using COTS components and innovative software technology can bring new capabilities into a production environment for the HPC community much faster than the approach of creating and maintaining a complete end-to-end unique parallel archive software solution. In this paper, we relay our experience of integrating a global parallel file system and a standard backup/archive product with a very small amount of additional code to provide a scalable, parallel archive. Our solution has a high degree of overlap with current parallel archive products including (a) doing parallel movement to/from tape for a single large parallel file, (b) hierarchical storage management, (c) ILM features, (d) high volume (non-single parallel file) archives for backup/archive/content management, and (e) leveraging all free file movement tools in Linux such as copy, move, Is, tar, etc. We have successfully applied our working COTS Parallel Archive System to the current world's first petafiop/s computing system, LANL's Roadrunner machine, and demonstrated its capability to address requirements of future archival storage systems.

99 GENERAL AND MISCELLANEOUS↗

High repetition rate neutron flux array using digital-signal processing and scintillators for study of high performance plasma at JT-60U

Aiming at increasing the count rate capability of the radial neutron collimator system in JT-60U, a digital-signal processing system has been extended to seven channels for data acquisition of stilbene crystal detector using analog-to-digital converters equipped with a fast flash memory. In this method, the detected pulses were postprocessed concerning pulse shape and pulse height. Using this system, the radial neutron collimator system can provide the information on the temporal evolution of emission rate of d-T neutrons and gamma rays as well as d-D neutrons. On the course of the development, the fast and stable handling of the large data around 7 GB is undertaken for a discharge.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Exploring the All-to-All Collective Optimization Space with ConnectX CORE-Direct

The all-to-all collective communication operation is used by many scientific applications, and is one of the most time consuming and challenging collective operation to optimize. The algorithms for all-to-all operations typically fall into two classes, logarithmic and linear scaling algorithms, with Bruck's algorithm, a logarithmic scaling algorithm, used in many small-data all-to-all implementations. The recent addition of InfiniBand CORE-Direct support for network management of collective communications offers new opportunities for optimizing all-to-all operation as well as supporting truly asynchronous implementations of these operations. This paper presents several new enhancements to the Bruck small-data algorithm that leverage CORE-Direct and other InfiniBand network capabilities to produce efficient implementations of this collective operation. These include RDMA, SR-RNR, and SR-RTR algorithms. In addition, nonblocking implementations of these collective operations are also presented. Benchmark results show that the RDMA algorithm, which uses CORE-Direct capabilities to offload collective communication management to the Host Channel Adapter (HCA), hardware gather support for sending non-continuous data, and low-latency RDMA semantics, performs the best. For a 64 processes and 128 byte-per-process all-to-all, the RDMA algorithm performs 27% better than Bruck's algorithm implementation in Open MPI and 136% better than the SR-RTR algorithm. In addition, the nonblocking versions of these algorithms have the same performance characteristics as the blocking algorithms. Finally, measurements of computation/communication overlap capacity show that all offloaded algorithms achieve about 98% overlap for large data all-to-all, whereas implementations using host-based progress achieve only about 9.5% overlap.

Venkata, Manjunath Gorentla↗