Search NASA⌕ Search

DOE OSTI · 1463670

Towards understanding HPC users and systems: A NERSC case study

Also available from

Abstract

High performance computing (HPC) scheduling landscape currently faces new challenges due to thechanges in the workload. Previously, HPC centers were dominated by tightly coupled MPI jobs. HPCworkloads increasingly include high-throughput, data-intensive, and stream-processing applications. Asa consequence, workloads are becoming more diverse at both application and job levels, posing newchallenges to classical HPC schedulers. There is a need to understand the current HPC workloads andtheir evolution to facilitate informed future scheduling research and enable efficient scheduling in futureHPC systems.In this paper, we present a methodology to characterize workloads and assess their heterogeneity,at a particular time period and its evolution over time. We apply this methodology to the workloads ofthree systems (Hopper, Edison, and Carver) at the National Energy Research Scientific Computing Center(NERSC). We present the resulting characterization of jobs, queues, heterogeneity, and performance thatincludes detailed information of a year of workload (2014) and evolution through the systems’ lifetime(2010–2014).

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Rodrigo, Gonzalo P., �stberg, P. -O., Elmroth, Erik, Antypas, Katie, Gerber, Richard, Ramakrishnan, Lavanya. 2018-01-01. Towards understanding HPC users and systems: A NERSC case study. https://doi.org/10.1016/j.jpdc.2017.09.002. https://searchnasa.com/record/osti%3A1463670/towards-understanding-hpc-users-and-systems-a-nersc-case-study

Citations retain the original authors and DOI and include this site’s record URL. If this discovery service contributed to your research, you can also cite Search NASA by Indiciae: BibTeX · RIS.