Search NASA⌕ Search

SEARCH · Search NASA

Results for “distributed parallel computing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 739 records · Page 41

"Tools For Analysis and Visualization of Large Time- Varying CFD Data Sets"

During the four years of this grant (including the one year extension), we have explored many aspects of the visualization of large CFD (Computational Fluid Dynamics) datasets. These have included new direct volume rendering approaches, hierarchical methods, volume decimation, error metrics, parallelization, hardware texture mapping, and methods for analyzing and comparing images. First, we implemented an extremely general direct volume rendering approach that can be used to render rectilinear, curvilinear, or tetrahedral grids, including overlapping multiple zone grids, and time-varying grids. Next, we developed techniques for associating the sample data with a k-d tree, a simple hierarchial data model to approximate samples in the regions covered by each node of the tree, and an error metric for the accuracy of the model. We also explored a new method for determining the accuracy of approximate models based on the light field method described at ACM SIGGRAPH (Association for Computing Machinery Special Interest Group on Computer Graphics) '96. In our initial implementation, we automatically image the volume from 32 approximately evenly distributed positions on the surface of an enclosing tessellated sphere. We then calculate differences between these images under different conditions of volume approximation or decimation.

Wilhelms, Jane↗

Formulas for the Supersonic Loading, Lift, and Drag of Flat Swept-Back Wings with Leading Edges Behind the Mach Line

The method of superposition of linearized conical flows has been applied to the calculation of the aerodynamic properties, in supersonic flight, of thin flat, swept-back wings at an angle of attack. The wings are assumed to have rectilinear plan forms, with tips parallel to the stream, and to taper in the conventional sense. The investigation covers the moderately supersonic speed range where the Mach lines from the leading-edge apex lie ahead of the wing. The trailing edge may lie ahead of or behind the Mach lines from its apex. The case in which the Mach cone from one tip intersects the other tip is not treated. Formulas are obtained for the load distribution, the total lift, and the drag due to lift. For the cases in which the trailing edge is outside the Mach cone from its apex the formulas are complete. For wings with both leading and trailing edges behind their respective Mach lines, a degree of approximation is necessary. Charts of some of the functions derived are included to facilitate computing, and several examples are worked out in outline.

Cohen, Doris↗

An Empirical Temperature Variance Source Model in Heated Jets

An acoustic analogy approach is implemented that models the sources of jet noise in heated jets. The equivalent sources of turbulent mixing noise are recognized as the differences between the fluctuating and Favre-averaged Reynolds stresses and enthalpy fluxes. While in a conventional acoustic analogy only Reynolds stress components are scrutinized for their noise generation properties, it is now accepted that a comprehensive source model should include the additional entropy source term. Following Goldstein s generalized acoustic analogy, the set of Euler equations are divided into two sets of equations that govern a non-radiating base flow plus its residual components. When the base flow is considered as a locally parallel mean flow, the residual equations may be rearranged to form an inhomogeneous third-order wave equation. A general solution is written subsequently using a Green s function method while all non-linear terms are treated as the equivalent sources of aerodynamic sound and are modeled accordingly. In a previous study, a specialized Reynolds-averaged Navier-Stokes (RANS) solver was implemented to compute the variance of thermal fluctuations that determine the enthalpy flux source strength. The main objective here is to present an empirical model capable of providing a reasonable estimate of the stagnation temperature variance in a jet. Such a model is parameterized as a function of the mean stagnation temperature gradient in the jet, and is evaluated using commonly available RANS solvers. The ensuing thermal source distribution is compared with measurements as well as computational result from a dedicated RANS solver that employs an enthalpy variance and dissipation rate model. Turbulent mixing noise predictions are presented for a wide range of jet temperature ratios from 1.0 to 3.20.

Khavaran, Abbas↗

Simple Models of the Spatial Distribution of Cloud Radiative Properties for Remote Sensing Studies

This project aimed to assess the degree to which estimates of three-dimensional cloud structure can be inferred from a time series of profiles obtained at a point. The work was motivated by the desire to understand the extent to which high-frequency profiles of the atmosphere (e.g. ARM data streams) can be used to assess the magnitude of non-plane parallel transfer of radiation in thc atmosphere. We accomplished this by performing an observing system simulation using a large-eddy simulation and a Monte Carlo radiative transfer model. We define the 3D effect as the part of the radiative transfer that isn't captured by one-dimensional radiative transfer calculations. We assess the magnitude of the 3D effect in small cumulus clouds by using a fine-scale cloud model to simulate many hours of cloudiness over a continental site. We then use a Monte Carlo radiative transfer model to compute the broadband shortwave fluxes at the surface twice, once using the complete three-dimensional radiative transfer F(sup 3D), and once using the ICA F (sup ICA); the difference between them is the 3D effect given.

Source record↗

Parallel quantum computing simulations via quantum accelerator platform virtualization

Quantum circuit execution is a central task in quantum computation. Due to inherent quantum-mechanical constraints, quantum computing workflows often involve a considerable number of independent measurements over a large set of slightly different quantum circuits. Here we discuss a simple model for parallelizing such quantum circuit executions that is based on introducing a large array of virtual quantum processing units (mapped to HPC nodes in our case) as a parallel quantum computing platform. Implemented within the XACC framework, the model can readily take advantage of its backend-agnostic features, enabling parallel quantum computing/simulation over any target backend supported by XACC. We illustrate the performance of this approach by demonstrating strong scaling in two pertinent domain science problems, namely in computing the gradients for the multi-contracted variational quantum eigensolver and in data-driven quantum circuit learning, where we vary the number of qubits and the number of circuit layers. Here, the latter simulation leverages the cuQuantum library to run efficiently on GPU-accelerated HPC platforms.

97 MATHEMATICS AND COMPUTING↗

SAIGE-GPU: accelerating genome- and phenome-wide association studies using GPUs

Genome-wide association studies (GWAS) at biobank scale are computationally intensive, especially for admixed populations requiring robust statistical models. SAIGE is a widely used method for generalized linear mixed-model GWAS but is limited by its CPU-based implementation, making phenome-wide association studies impractical for many research groups. We developed SAIGE-GPU, a GPU-accelerated version of SAIGE that replaces CPU-intensive matrix operations with GPU-optimized kernels. The core innovation is distributing genetic relationship matrix calculations across GPUs and communication layers. Applied to 2068 phenotypes from 635 969 participants in the Million Veteran Program, including diverse and admixed populations, SAIGE-GPU achieved a 5-fold speedup in mixed model fitting on supercomputing infrastructure and cloud platforms. We further optimized the variant association testing step through multi-core and multi-trait parallelization. Deployed on Google Cloud Platform and Azure, the method provided substantial cost and time savings. Source code and binaries are available for download at https://github.com/saigegit/SAIGE/tree/SAIGE-GPU-1.3.3. A code snapshot is archived at Zenodo for reproducibility (DOI: [10.5281/zenodo.17642591]). SAIGE-GPU is available in a containerized format for use across HPC and cloud environments and is implemented in R/C++ and runs on Linux systems.

Rodriguez, Alex [Argonne National Laboratory (ANL)↗

Interactive computer modeling of combustion chemistry and coalescence-dispersion modeling of turbulent combustion

An interactive computer code for simulation of a high-intensity turbulent combustor as a single point inhomogeneous stirred reactor was developed from an existing batch processing computer code CDPSR. The interactive CDPSR code was used as a guide for interpretation and direction of DOE-sponsored companion experiments utilizing Xenon tracer with optical laser diagnostic techniques to experimentally determine the appropriate mixing frequency, and for validation of CDPSR as a mixing-chemistry model for a laboratory jet-stirred reactor. The coalescence-dispersion model for finite rate mixing was incorporated into an existing interactive code AVCO-MARK I, to enable simulation of a combustor as a modular array of stirred flow and plug flow elements, each having a prescribed finite mixing frequency, or axial distribution of mixing frequency, as appropriate. Further increase the speed and reliability of the batch kinetics integrator code CREKID was increased by rewriting in vectorized form for execution on a vector or parallel processor, and by incorporating numerical techniques which enhance execution speed by permitting specification of a very low accuracy tolerance.

Pratt, D. T.↗

Experimental Investigation of Pool Boiling Heat Transfer Enhancement in Microgravity in the Presence of Electric Fields

In boiling high heat fluxes are possible driven by relatively small temperature differences, which make its use increasingly attractive in aerospace applications. The objective of the research is to develop ways to overcome specific problems associated with boiling in the low gravity environment by substituting the buoyancy force with the electric force to enhance bubble removal from the heated surface. Previous studies indicate that in terrestrial applications nucleate boiling heat transfer can be increased by a factor of 50, as compared to values obtained for the same system without electric fields. The goal of our research is to experimentally explore the mechanisms responsible for EHD heat transfer enhancement in boiling in low gravity conditions, by visualizing the temperature distributions in the vicinity of the heated surface and around the bubble during boiling using real-time holographic interferometry (HI) combined with high-speed cinematography. In the first phase of the project the influence of the electric field on a single bubble is investigated. Pool boiling is simulated by injecting a single bubble through a nozzle into the subcooled liquid or into the thermal boundary layer developed along the flat heater surface. Since the exact location of bubble formation is known, the optical equipment can be aligned and focused accurately, which is an essential requirement for precision measurements of bubble shape, size and deformation, as well as the visualization of temperature fields by HI. The size of the bubble and the frequency of bubble departure can be controlled by suitable selection of nozzle diameter and mass flow rate of vapor. In this approach effects due to the presence of the electric field can be separated from effects caused by the temperature gradients in the thermal boundary layer. The influence of the thermal boundary layer can be investigated after activating the heater at a later stage of the research. For the visualization experiments a test cell was developed. All four vertical walls of the test cell are transparent, and they allow transillumination with laser light for visualization experiments by HI. The bottom electrode is a copper cylinder, which is electrically grounded. The copper block is heated with a resistive heater and it is equipped with 6 thermocouples that provide reference temperatures for the measurements with HI. The top electrode is a mesh electrode. Bubbles are injected with a syringe into the test cell through the bottom electrode. The working fluids presently used in the interferometric visualization experiments, water and PF 5052, satisfy requirements regarding thermophysical, optical and electrical properties. A 30kV power supply equipped with a voltmeter allows to apply the electric field to the electrodes during the experiments. The magnitude of the applied voltage can be adjusted either manually or through the LabVIEW data acquisition and control system connected to a PC. Temperatures of the heated block are recorded using type-T thermocouples, whose output is read by a data acquisition system. Images of the bubbles are recorded with 35mm photographic and 16mm high-speed cameras, scanned and analyzed using various software packages. Visualized temperature fields HI allows the visualization of temperature fields in the vicinity of bubbles during boiling in the form of fringes. Typical visualized temperature distributions around the air bubbles injected into the thermal boundary layer in PF5052 are shown. The temperature of the heated surface is 35 C. The temperature difference for a pair of fringes is approximately 0.05 C. The heat flux applied to the bottom surface is moderate, and the fringe patterns are regular. In the image a bubble penetrating the thermal boundary layer is visible. Because of the axial symmetry of the problem, simplified reconstruction techniques can be applied to recover the temperature field. The thermal plume developing above the heated surface for more intensive heating is shown. The temperature distribution in the liquid is clearly 3D, and tomographic techniques have to be applied to recover the temperature distribution in such a physical situation. A sequence of interferometric images showing the temperature distribution around the rising bubble, recorded with a high-speed camera is shown. Again, the temperature distribution is 3D, and a more complex approach to the evaluation, the tomographic reconstruction has to be taken. Measurement of the temperature distribution from the fringe pattern temperature distributions that yield important information regarding heat transfer are determined. Two algorithms that allow the quantitative evaluation of interferometric fringe patterns and the reconstruction of temperature fields during boiling have been developed at the Heat Transfer Laboratory of the Johns Hopkins University. In the first algorithm the bubble is assumed to be axially symmetrical, which significantly reduces the computational effort for quantifying the temperature distribution around the bubble. For this purpose the thermal boundary layer around the bubble is divided into equidistant concentric shells, and the refractive index is assumed to be constant in each of the shells. Since large temperature gradients are expected in the vicinity of the bubble during boiling, the deflection of the light beam cannot be neglected in boiling experiments. Since the exit angle of the light beam is known, this allows to account for the deflections and phase shifts outside the boundary layer (in the bulk fluid and in the windows of the test cell). Three dimensional temperature distributions in the vicinity of the bubble are reconstructed using tomographic techniques. In tomography, the measurement volume is sliced into 2D planes. In the present study these planes are parallel to the heated surface. The objective is to determine the values of the field parameter of interest in form of the field function in these 2D planes. The field parameter is the change of the refractive index of the liquid in the measurement volume caused by temperature changes. By superimposing data for many 2D planes recorded at the same time instant, the 3D temperature distribution in the measurement volume is recovered.

Herman, Cila↗

A Survey on Error-Bounded Lossy Compression for Scientific Datasets

Error-bounded lossy compression has been effective in significantly reducing the data storage/transfer burden while preserving the reconstructed data fidelity very well. Many error-bounded lossy compressors have been developed for a wide range of parallel and distributed use cases for years. They are designed with distinct compression models and principles, such that each of them features particular pros and cons. In this article, we provide a comprehensive survey of emerging error-bounded lossy compression techniques. The key contribution is fourfold. (1) We summarize a novel taxonomy of lossy compression into six classic models. (2) We provide a comprehensive survey of 10 commonly used compression components/modules. (3) We summarized pros and cons of 47 state-of-the-art lossy compressors and present how state-of-the-art compressors are designed based on different compression techniques. (4) We discuss how customized compressors are designed for specific scientific applications and use-cases. We believe this survey is useful to multiple communities including scientific applications, high-performance computing, lossy compression, and big data.

Error-Bounded Lossy Compression↗

Blasim: A computational tool to assess ice impact damage on engine blades

A portable computer called BLASIM was developed at NASA LeRC to assess ice impact damage on aircraft engine blades. In addition to ice impact analyses, the code also contains static, dynamic, resonance margin, and supersonic flutter analysis capabilities. Solid, hollow, superhybrid, and composite blades are supported. An optional preprocessor (input generator) was also developed to interactively generate input for BLASIM. The blade geometry can be defined using a series of airfoils at discrete input stations or by a finite element grid. The code employs a coarse, fixed finite element mesh containing triangular plate finite elements to minimize program execution time. Ice piece is modeled using an equivalent spherical objective that has a high velocity opposite that of the aircraft and parallel to the engine axis. For local impact damage assessment, the impact load is considered as a distributed force acting over a region around the impact point. The average radial strain of the finite elements along the leading edge is used as a measure of the local damage. To estimate damage at the blade root, the impact is treated as an impulse and a combined stress failure criteria is employed. Parametric studies of local and root ice impact damage, and post-impact dynamics are discussed for solid and composite blades.

Reddy, E. S.↗

Particle/Continuum Hybrid Simulation in a Parallel Computing Environment

The objective of this study was to modify an existing parallel particle code based on the direct simulation Monte Carlo (DSMC) method to include a Navier-Stokes (NS) calculation so that a hybrid solution could be developed. In carrying out this work, it was determined that the following five issues had to be addressed before extensive program development of a three dimensional capability was pursued: (1) find a set of one-sided kinetic fluxes that are fully compatible with the DSMC method, (2) develop a finite volume scheme to make use of these one-sided kinetic fluxes, (3) make use of the one-sided kinetic fluxes together with DSMC type boundary conditions at a material surface so that velocity slip and temperature slip arise naturally for near-continuum conditions, (4) find a suitable sampling scheme so that the values of the one-sided fluxes predicted by the NS solution at an interface between the two domains can be converted into the correct distribution of particles to be introduced into the DSMC domain, (5) carry out a suitable number of tests to confirm that the developed concepts are valid, individually and in concert for a hybrid scheme.

Baganoff, Donald↗

Safe Reinforcement Learning-Based Transient Stability Control for Islanded Microgrids With Topology Reconfiguration

This paper proposes a safe reinforcement learning (RL)-based transient stability emergency control (TSEC) method for islanded microgrids. RL requires extensive interaction with the environment to learn control strategies, hence, a data-driven approach is used as a substitute for time-consuming time-domain simulation calculations. Deep sigma point processes (DSPP), which is a Gaussian process model, is utilized to predict the normal distribution of transient stability of microgrids and to construct a transient stability chance constraint. Reward-constrained policy optimization (RCPO) can simultaneously achieve objective prediction, policy learning, and constraint cost coefficient update across multiple timescales. RCPO interacts with the DSPP-based microgrid environment through a multi-process parallel manner, greatly increasing the training speed. Case studies on a real islanded microgrid demonstrate that the proposed method can efficiently and quickly obtain the optimal emergency control strategy while adhering to all hard constraints.

14 SOLAR ENERGY↗

Real-Time GPU-Accelerated OFDR With an Integrated Auxiliary Interferometer

A GPU-accelerated optical frequency domain reflectometry (OFDR) system with an improved integrated auxiliary interferometer is proposed. Unlike conventional approaches that require separate auxiliary interferometers and multiple detection channels, the proposed OFDR system embeds this functionality directly into the signal via an intentional beat component. This enables self-calibration of laser nonlinearity while maintaining a cost-effective hardware configuration. Building on this simplified configuration, the system leverages GPU acceleration with an NVIDIA RTX 4070 Ti to achieve real-time performance, delivering high-throughput signal processing for continuous OFDR interrogation. The signal processing pipeline comprises signal capture, resampling for nonlinearity compensation, and frequency shift computation, all optimized for parallel execution. Hardware benchmarking demonstrates substantial acceleration over CPU implementations, achieving up to a 45× speedup for resampling and frequency shift computations and enabling processing latencies below 30 ms. Thermal response validation is conducted under two complementary scenarios: localized heating using a water bath and cryogenic-temperature conditions using liquid nitrogen. Under localized heating, the system achieves an accuracy of 0.249 °C with a thermal sensitivity of 5.971 GHz/°C, while cryogenic-temperature validation demonstrates a frequency shift response with a sensitivity of 2.383 GHz/°C and an accuracy of 2.04 °C. The high acceleration of the proposed GPU-accelerated OFDR system and its accuracy are achieved by exploiting CUDA-based stride indexing, enabling efficient parallel segmentation and processing of large datasets without additional memory copies. The benchmarking results confirm the robustness, accuracy, and deployability of the proposed OFDR system across a wide temperature range, establishing it as a practical platform for real-time distributed fiber sensing in structurally dynamic environments.

Harb, Salah [Lawrence Berkeley National Laboratory↗

Shell Models of RMHD Turbulence and the Heating of Solar Coronal Loops

A simplified nonlinear numerical model for the development of incompressible magnetohydrodynamics in the presence of a strong magnetic field B|| and stratification, nicknamed 'Shell-Atm,' is presented. In planes orthogonal to the mean field, the nonlinear incompressible dynamics is replaced by two-dimensional shell models for the complex variables u and b, allowing one to reach large Reynolds numbers while at the same time carrying out sufficiently long integrations to obtain good statistics at moderate computational cost. The shell models of different planes are coupled by Alfve'n waves propagating along B||. The model may be applied to open or closed magnetic field configurations where the axial field dominates and the plasma pressure is low; here we apply it to the specific case of a magnetic loop of the solar corona heated by means of turbulence driven by photospheric motions, and we use statistics for its analysis. The Alfven waves interact nonlinearly and form turbulent spectra in the directions perpendicular and, through propagation, also parallel to the mean field. A heating function is obtained and shown to be intermittent; the average heating is consistent with values required for sustaining a hot corona and is proportional to the aspect ratio of the loop to the -1.5 power, and haracteristic properties of heating events are distributed as power laws. Crosscorrelations show a delay of dissipation compared with energy content.

corona↗

Continuous Electrode Inertial Electrostatic Confinement Fusion

The NIAC Phase I project on Inertial Electrostatic Confinement was a continuation of early stage research that was funded by an NSTRF. The student on the project, Andrew Chap, was funded by the NSTRF from Fall 2013 through the Summer of 2017, and then was funded on the NIAC through the completion of his PhD. A significant amount of work targeting the plasma confinement physics was the focus of his NSTRF, and over the course of that effort he developed a number of analyses and computational tools that leveraged GPU parallelization. A detailed discussion of these models can be found in his dissertation, which has been included as Appendix D in this report. As a requirement for the NSTRF, Andrew's full dissertation was submitted at the end of the program.Having developed the computational tools, a substantial amount of simulation and analyses leveraging those tools were conducted during the Fall of 2017, under the auspices of the NIAC funded research. Much of this work targeted optimization of the confinement fields, investigating their structure and the possible advantages of having them be time-varying. The results of these simulations can also be found in Appendix D.One of the main results from this research is that the density of ions electrostatically confined within the system can indeed be increased by several orders of magnitude by optimizing the radial potential distribution, and by dynamically varying these fields to maintain compressed ion bunches. An electron population can also be confined within the core by a static radial cusped magnetic field,which helps to support a greater ion density within the core. The issue with the confinement mechanism is that as the ion densities are increased toward fusion-relevant levels, the electrostatic forces generated by the confined electron population become so great that the ions are no longer energetic enough to leave the device core. As their excursions into the outer channels are diminished, the mechanism that is used to maintain their non-thermal velocity distributions becomes ineffective, and eventually the ions become fully confined within the core, where they thermalize. A possible fix to the problem comes by discarding the active ion control (a main pillar of the concept)but retaining the structure of the permanent magnet confinement of the electron population. Such cusped field confinement has been the focus of other IEC approaches (e.g. Polywell), but the high transparency of the permanent magnet structure lends itself to better ion extraction and power conversion (a second pillar of the concept). The question then becomes whether any influence on the ion evolution within the core can be achieved to slow the thermalization of the ions. Such approaches have been studied in highly idealized analytic models, but face major criticisms within the literature. While this is a possible path forward, the uncertainty in the approach did not warrant committing NIAC Phase II resources to investigating the concept at this time.

Sedwick, Raymond↗

Enhanced quantum state transfer by circumventing quantum chaotic behavior

The ability to realize high-fidelity quantum communication is one of the many facets required to build generic quantum computing devices. In addition to quantum processing, sensing, and storage, transferring the resulting quantum states demands a careful design that finds no parallel in classical communication. Existing experimental demonstrations of quantum information transfer in solid-state quantum systems are largely confined to small chains with few qubits, often relying upon non-generic schemes. Here, by using a superconducting quantum circuit featuring thirty-six tunable qubits, accompanied by general optimization procedures deeply rooted in overcoming quantum chaotic behavior, we demonstrate a scalable protocol for transferring few-particle quantum states in a two-dimensional quantum network. These include single-qubit excitation, two-qubit entangled states, and two excitations for which many-body effects are present. Our approach, combined with the quantum circuit’s versatility, paves the way to short-distance quantum communication for connecting distributed quantum processors or registers, even if hampered by inherent imperfections in actual quantum devices.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

Boundary of the Distribution of Solar Wind Proton Beta versus Temperature Anisotropy

Abstract The frequency distribution of solar wind protons, measured in the vicinity of Earth’s orbit, is customarily plotted in ( β ∥ , T ⊥ / T ∥ ) phase space. Here, T ⊥ / T ∥ is the ratio of perpendicular and parallel temperatures, and β ∥ = 8 π nT ∥ / B 2 is the ratio of parallel thermal energy to background magnetic field energy, the so-called “parallel beta,” with ⊥ and ∥ denoting directions with respect to the ambient magnetic field. Such a frequency distribution, plotted as a two-dimensional histogram, forms a peculiar rhombic shape defined with an outer boundary in the said phase space. Past studies reveal that the threshold conditions for temperature anisotropy–driven plasma instability partially account for the boundary on the high- β ∥ side. The low- β ∥ side remains largely unexplained despite some efforts. Work by Vafin et al. recently showed that certain contours of collisional relaxation frequency, ν pp , when parameterized by T ⊥ / T ∥ and β ∥ , could match the overall shape of the left-hand boundary, thus suggesting that the collisional relaxation process might be closely related to the formation of the left-hand boundary. The present paper extends the analysis by Vafin et al. and carries out the dynamical computation of the collisional relaxation process for an ensemble of initial proton states with varying degrees of anisotropic temperatures. The final states of the relaxed protons are shown to closely match the observed boundary to the left of the ( β ∥ , T ⊥ / T ∥ ) phase space. When coupled with a similar set of calculations for the ensemble in the collective instability regime, it is found that the combined collisional/collective effects provide the baseline explanation for the observation.

Astronomy & Astrophysics↗

Polyphony: A Workflow Orchestration Framework for Cloud Computing

Cloud Computing has delivered unprecedented compute capacity to NASA missions at affordable rates. Missions like the Mars Exploration Rovers (MER) and Mars Science Lab (MSL) are enjoying the elasticity that enables them to leverage hundreds, if not thousands, or machines for short durations without making any hardware procurements. In this paper, we describe Polyphony, a resilient, scalable, and modular framework that efficiently leverages a large set of computing resources to perform parallel computations. Polyphony can employ resources on the cloud, excess capacity on local machines, as well as spare resources on the supercomputing center, and it enables these resources to work in concert to accomplish a common goal. Polyphony is resilient to node failures, even if they occur in the middle of a transaction. We will conclude with an evaluation of a production-ready application built on top of Polyphony to perform image-processing operations of images from around the solar system, including Mars, Saturn, and Titan.

Space Exploration,↗