FastReplica: Efficient Large File Distribution within Content Delivery Networks

4th USENIX Symposium on Internet Technologies and Systems

Ludmila Cherkasova ; Jangwon Lee

Others  :  http://www.usenix.org/publications/library/proceedings/usits03/tech/full_papers/cherkasova/cherkasova.pdf
PID  :  8302

来源: CEUR

【 摘 要 】

In this work, we consider a large-scale distributednetwork of servers and a problem of content distributionacross it. We propose a novel algorithm, calledFastReplica, for an efficient and reliable replication of largefiles in the Internet environment. There are a few basic ideasexploited in FastReplica. In order to replicate a large fileamong n nodes (n is in the range of 10-30 nodes), the originalfile is partitioned into n subfiles of equal size and eachsubfile is transferred to a different node in the group. Afterthat, each node propagates its subfile to the remaining nodesin the group. Thus instead of the typical replication of an entirefile to n nodes by using n Internet paths, connecting theoriginal node to the replication group, FastReplica exploitsn×n Internet paths within the replication group where eachpath is used for transferring 1/n-th of the file. We design ascalable and reliable FastReplica algorithm which can be usedfor replication of large files to a large group of nodes. Thenew method is simple and inexpensive. It does not requireany changes or modifications to the existing Internet infrastructure,and at the same time, it significantly reduces thefile replication time as we demonstrate through experimentson a prototype implementation of FastReplica in a wide-areatestbed.