Nelson, Brian | Search NASA

DOE OSTI2017

PSI-Center Final Progress Report

This is the Final Progress Report of the Plasma Science and Innovation Center (PSI-Center) covering March 2014 through February 2017. The Center has accomplished a great deal during this period. The PSI-Center is organized into four groups: Edge and Dynamic Neutrals; Transport and Kinetic Effects; Equilibrium, Stability, and Kinetic Effects in 3D Topologies; and Interface for Validation. Each group has made good progress and the results from each group are given in detail.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

NASA NTRS2016

Evaluating the Impact of Data Placement to Spark and SciDB with an Earth Science Use Case

We investigate the impact of data placement for two Big Data technologies, Spark and SciDB, with a use case from Earth Science where data arrays are multidimensional. Simultaneously, this investigation provides an opportunity to evaluate the performance of the technologies involved. Two datastores, HDFS and Cassandra, are used with Spark for our comparison. It is found that Spark with Cassandra performs better than with HDFS, but SciDB performs better yet than Spark with either datastore. The investigation also underscores the value of having data aligned for the most common analysis scenarios in advance on a shared nothing architecture. Otherwise, repartitioning needs to be carried out on the fly, degrading overall performance.

Spark↗