Skip to main content

SLAQ: quality-driven scheduling for distributed machine learning

Author(s): Zhang, Haoyu; Stafman, Logan; Or, Andrew; Freedman, Michael J

Download
To refer to this page use: http://arks.princeton.edu/ark:/88435/pr1d530
Full metadata record
DC FieldValueLanguage
dc.contributor.authorZhang, Haoyu-
dc.contributor.authorStafman, Logan-
dc.contributor.authorOr, Andrew-
dc.contributor.authorFreedman, Michael J-
dc.date.accessioned2021-10-08T19:46:23Z-
dc.date.available2021-10-08T19:46:23Z-
dc.date.issued2017-09en_US
dc.identifier.citationZhang, Haoyu, Logan Stafman, Andrew Or, and Michael J. Freedman. "Slaq: quality-driven scheduling for distributed machine learning." In Symposium on Cloud Computing (2017): pp. 390-404. doi:10.1145/3127479.3127490en_US
dc.identifier.urihttp://arks.princeton.edu/ark:/88435/pr1d530-
dc.description.abstractTraining machine learning (ML) models with large datasets can incur significant resource contention on shared clusters. This training typically involves many iterations that continually improve the quality of the model. Yet in exploratory settings, better models can be obtained faster by directing resources to jobs with the most potential for improvement. We describe SLAQ, a cluster scheduling system for approximate ML training jobs that aims to maximize the overall job quality. When allocating cluster resources, SLAQ explores the quality-runtime trade-offs across multiple jobs to maximize system-wide quality improvement. To do so, SLAQ leverages the iterative nature of ML training algorithms, by collecting quality and resource usage information from concurrent jobs, and then generating highly-tailored quality-improvement predictions for future iterations. Experiments show that SLAQ achieves an average quality improvement of up to 73% and an average delay reduction of up to 44% on a large set of ML training jobs, compared to resource fairness schedulers.en_US
dc.format.extent390 - 404en_US
dc.language.isoen_USen_US
dc.relation.ispartofSymposium on Cloud Computingen_US
dc.rightsFinal published version. This is an open access article.en_US
dc.titleSLAQ: quality-driven scheduling for distributed machine learningen_US
dc.typeConference Articleen_US
dc.identifier.doi10.1145/3127479.3127490-
pu.type.symplectichttp://www.symplectic.co.uk/publications/atom-terms/1.0/conference-proceedingen_US

Files in This Item:
File Description SizeFormat 
SlaqSchedulingDistMachineLearning.pdf425.62 kBAdobe PDFView/Download


Items in OAR@Princeton are protected by copyright, with all rights reserved, unless otherwise indicated.