Search NASA⌕ Search
Home/Archive/DOE OSTI

DOE OSTI · 3005909

Predicting Runtime and Resource Utilization of Jobs on Integrated Cloud and HPC Systems

Yildirim, Esma [Queensborough Community College, CUNY; Rutgers University - Busch Campus] (ORCID:0000000194853714)
View original source ↗Read source document ↗Export metadata ↓

Abstract

This is a time series data set of resource utilizations and runtime for jobs run on both HPC systems (IC2 at Brookhaven Naional Lab, Polaris at Argonne National Lab and Amazon Web Services. The data set can be used for machine learning models to predict runtime and resource utilization of jobs on a variety of systems.

Explore related subjects

cloud computinghigh performance computing

Keep this discovery

Explore connections, maps & timelines

BibTeXRIS

Yildirim, Esma [Queensborough Community College, CUNY; Rutgers University - Busch Campus] (ORCID:0000000194853714). 2025-01-01. Predicting Runtime and Resource Utilization of Jobs on Integrated Cloud and HPC Systems. https://doi.org/10.5281/zenodo.15545096

Cite the original work for its findings. Save a collection to share your selection of sources.

KEEP EXPLORING

Related reports

NASA NTRS2015

Climate Model Diagnostic Analyzer

The comprehensive and innovative evaluation of climate models with newly available global observations is critically needed for the improvement of climate model current-state representation and future-state predictability. A climate model diagnostic evaluation process requires physics-based multi-variable analyses that typically involve large-volume and heterogeneous datasets, making them both computation- and data-intensive. With an exploratory nature of climate data analyses and an explosive growth of datasets and service tools, scientists are struggling to keep track of their datasets, tools, and execution/study history, let alone sharing them with others. In response, we have developed a cloud-enabled, provenance-supported, web-service system called Climate Model Diagnostic Analyzer (CMDA). CMDA enables the physics-based, multivariable model performance evaluations and diagnoses through the comprehensive and synergistic use of multiple observational data, reanalysis data, and model outputs. At the same time, CMDA provides a crowd-sourcing space where scientists can organize their work efficiently and share their work with others. CMDA is empowered by many current state-of-the-art software packages in web service, provenance, and semantic search.

cloud computing↗