Effective Load Metric and Efficient Initial Job Placement for Dynamic Load Balancing in Cluster| Science Publications

Journal of Computer Science

M. V. Gopalachari¹  A. V. Babu¹  P. Sammulal¹ 

关键词: High Performance Cluster Computing;    Load Balancing;    Memory Management;    Load Metric;    Initial Job Placement;   

DOI  :  10.3844/jcssp.2008.72.79

学科分类：计算机科学（综合）

来源: Science Publications

【 摘 要 】

High performance clusters are being configured specially to give data centers that require extreme performance, the processing power they need. In Cluster Computing Environment the data latency time has significant impact on the performance, when the data is accessed across clusters. Instead of processing power, memory and I/O have become the new bottleneck in achieving efficient load balance at higher performance for cluster computer systems. Initial job placement and load balancing are the key aspects affecting the performance. In this research, data access patterns, memory and CPU utilization and locality of memory are combined to consider as load metric in the load balancing aspect across cluster. A scheduling algorithm based on this metric has been proposed to dynamically balance the load in the cluster. Initial job placement for a job in the cluster considers data access patterns and for load balance aspect metric constitutes CPU, memory utilization including locality of memory. Experimental results show performance improvement to considerable levels with the implementation of the concept, specifically when the cost of data access from other clusters is higher and is proportionate to the amount of data.

【 授权许可】

Unknown