QoS-driven scheduling in the cloud

Journal of Internet Services and Applications

Daniel Turull¹  Raquel Lopes²  Giovanni Farias da Silva²  Francisco Brasileiro²  Fabio Morais³  Marcus Carvalho³ 

[1] Ericsson Research, Torshamnsgatan 21, 164 83, Stockholm, Sweden;Federal University of Campina Grande, Department of Computing and Systems, Av. Aprígio Veloso, 882 – Bloco CO, 58.429-900, Campina Grande – PB, Brazil;Federal University of Paraíba, Department of Exact Sciences, Av. Santa Elisabete, 160, 58.297-000, Rio Tinto – PB, Brazil;

关键词: Scheduling;    Datacenter;    Fairness;    Service classes;   

DOI  :  10.1186/s13174-020-00129-0

来源: Springer

【 摘 要 】

Priority-based scheduling policies are commonly used to guarantee that requests submitted to the different service classes offered by cloud providers achieve the desired Quality of Service (QoS). However, the QoS delivered during resource contention periods may be unfair on certain requests. In particular, lower priority requests may have their resources preempted to accommodate resources associated with higher priority ones, even if the actual QoS delivered to the latter is above the desired level, while the former is underserved. Also, competing requests with the same priority may experience quite different QoS, since some of them may have their resources preempted, while others do not. In this paper we present a new scheduling policy that is driven by the QoS promised to individual requests. Benefits of using the QoS-driven policy are twofold: it maintains the QoS of each request as high as possible, considering their QoS targets and available resources; and it minimizes the variance of the QoS delivered to requests of the same class, promoting fairness. We used simulation experiments fed with traces from a production system to compare the QoS-driven policy with a state-of-the-practice priority-based one. In general, the QoS-driven policy delivers a better service than the priority-based one. Moreover, the equity of the QoS delivered to requests of the same class is much higher when the QoS-driven policy is used, particularly when not all requests get the promised QoS, which is the most important scenario. Finally, based on the current practice of large public cloud providers, our results show that penalties incurred by the priority-based scheduler in the scenarios studied can be, on average, as much as 193% higher than those incurred by the QoS-driven one.

【 授权许可】

CC BY