Dynamic Scale-out Mechanisms for Partitioned Shared-Nothing Databases

DBMS;Scalability;Cloud Computing;Computer Science

Karyakin, Alexey

University of Waterloo

关键词: DBMS;    Scalability;    Cloud Computing;    Computer Science;   

Others  :  https://uwspace.uwaterloo.ca/bitstream/10012/6312/1/Karyakin_Alexey.pdf

瑞士|英语

来源: UWSPACE Waterloo Institutional Repository

【 摘 要 】

For a database system used in pay-per-use cloud environments, elastic scaling becomes an essential feature, allowing for minimizing costs while accommodating fluctuations of load. One approach to scalability involves horizontal database partitioning and dynamic migration of partitions between servers. We define a scale-out operation as a combination of provisioning a new server followed by migration of one or more partitions to the newly-allocated server. In this thesis we study the efficiency of different implementations of the scale-out operation in the context of online transaction processing (OLTP) workloads. We designed and implemented three migration mechanisms featuring different strategies for data transfer. The first one is based on a modification of the Xen hypervisor, Snowflock, and uses on-demand block transfers for both server provisioning and partition migration. The second one is implemented in a database management system (DBMS) and uses bulk transfers for partition migration, optimized for higher bandwidth utilization. The third one is a conventional application, using SQL commands to copy partitions between servers.We perform an experimental comparison of those scale-out mechanisms for disk-bound and CPU-bound configurations. When comparing the mechanisms we analyze their impact on whole-system performance and on the experience of individual clients.