DOE OSTI · 2440426
Extreme-scale workflows: A perspective from the JLESC international community
Abstract
The Joint Laboratory for Extreme-Scale Computing (JLESC) focuses on software challenges in high-performance computing systems to meet the needs of today’s science campaigns, which often require large resources, consist of multiple tasks, and generate vast amounts of data. In this context, extreme-scale workflows have been the key factor in enabling scientific discoveries by helping scientists automate the dependencies and data exchanges between workflow tasks, instead of managing those manually. Here, in this paper, we present representative extreme-scale workflows and feature workflow systems developed by JLESC participating institutions. We present lessons learned while developing these tools, alongside with the open challenges and future research directions in the field of extreme-scale workflows.
Explore related subjects
Keep this discovery
Explore connections, maps & timelines
Yildiz, Orcun, Gueroudji, Amal, Bigot, Julien, Raffin, Bruno, Badia, Rosa M., Peterka, Tom. 2024-07-23. Extreme-scale workflows: A perspective from the JLESC international community. https://doi.org/10.1016/j.future.2024.07.041
Cite the original work for its findings. Save a collection to share your selection of sources.