Skip to main content

SVE: Distributed Video Processing at Facebook Scale

Author(s): Huang, Qi; Ang, Petchean; Knowles, Peter; Nykiel, Tomasz; Tverdokhlib, Iaroslav; et al

To refer to this page use:
Full metadata record
DC FieldValueLanguage
dc.contributor.authorHuang, Qi-
dc.contributor.authorAng, Petchean-
dc.contributor.authorKnowles, Peter-
dc.contributor.authorNykiel, Tomasz-
dc.contributor.authorTverdokhlib, Iaroslav-
dc.contributor.authorYajurvedi, Amit-
dc.contributor.authorDapolito, Paul-
dc.contributor.authorYan, Xifan-
dc.contributor.authorBykov, Maxim-
dc.contributor.authorLiang, Chuen-
dc.contributor.authorTalwar, Mohit-
dc.contributor.authorMathur, Abhishek-
dc.contributor.authorKulkarni, Sachin-
dc.contributor.authorBurke, Matthew-
dc.contributor.authorLloyd, Wyatt-
dc.identifier.citationHuang, Qi, Petchean Ang, Peter Knowles, Tomasz Nykiel, Iaroslav Tverdokhlib, Amit Yajurvedi, Paul Dapolito, Xifan Yan, Maxim Bykov, Chuen Liang, Mohit Talwar, Abhishek Mathur, Sachin Kulkarni, Matthew Burke, Wyatt Lloyd. "SVE: Distributed Video Processing at Facebook Scale." In Proceedings of the 26th Symposium on Operating Systems Principles (2017): pp. 87-103. doi:10.1145/3132747.3132775en_US
dc.description.abstractVideos are an increasingly utilized part of the experience of the billions of people that use Facebook. These videos must be uploaded and processed before they can be shared and downloaded. Uploading and processing videos at our scale, and across our many applications, brings three key requirements: low latency to support interactive applications; a flexible programming model for application developers that is simple to program, enables efficient processing, and improves reliability; and robustness to faults and overload. This paper describes the evolution from our initial monolithic encoding script (MES) system to our current Streaming Video Engine (SVE) that overcomes each of the challenges. SVE has been in production since the fall of 2015, provides lower latency than MES, supports many diverse video applications, and has proven to be reliable despite faults and overload.en_US
dc.format.extent87 - 103en_US
dc.relation.ispartofProceedings of the 26th Symposium on Operating Systems Principlesen_US
dc.rightsFinal published version. This is an open access article.en_US
dc.titleSVE: Distributed Video Processing at Facebook Scaleen_US
dc.typeConference Articleen_US

Files in This Item:
File Description SizeFormat 
VideoProcessing.pdf1.03 MBAdobe PDFView/Download

Items in OAR@Princeton are protected by copyright, with all rights reserved, unless otherwise indicated.