Towards a scalable design of video content distribution over the internet

Peer-to-peer;Flash memory;Solid-state drive;Adaptive HTTP streaming;Video-on-demand

Ryu, Mungyung ; Ramachandran, Umakishore Computer Science Schwan, Karsten Dovrolis, Constantine Qureshi, Moinuddin K. Patel, Naresh ; Ramachandran, Umakishore

University:Georgia Institute of Technology

Department:Computer Science

关键词: Peer-to-peer;    Flash memory;    Solid-state drive;    Adaptive HTTP streaming;    Video-on-demand;   

Others  :  https://smartech.gatech.edu/bitstream/1853/53998/1/RYU-DISSERTATION-2014.pdf

美国|英语

来源: SMARTech Repository

【 摘 要 】

We are witnessing a proliferation of video in the Internet;YouTubeis the most bandwidth intensive service of today’s Internet.It accounts for 20 - 35% of the Internet traffic with 35 hours of videos uploaded every minute and more than 700 billion playbacks in 2010. Netflix, a web service that streams premium contentssuch as TV series, shows, and movies, consumes 30% of the network bandwidth in North America at peak time. Recently, leveraging the content distribution networks (CDNs), a new paradigm for video streaming on the Internet has emerged, namely, Adaptive HTTP Streaming (AHS). AHS has become the industry standard for video streaming over the Internet adopted by broadcast networks as well as VoD services such as YouTube, Netflix, Hulu, etc.In the 90’s and early 2000’s, Internet-basedvideo streaming for high-bitrate video was challenging due to hardware limitations. In thatera, to cover thehardware limitations, every software component of a video server needed to be carefully optimized to support the real-time guarantees for jitter-free video delivery. However, most of the software solutions havebecome less importantwiththe remarkable hardware improvements over the past twodecades. Thereis 100×speedupin CPU speeds;RAMcapacity has increased by1,000×; hard disk drive (HDD) capacity has grown by 10,000×.Today, CPU is no longer a bottleneck for video streaming.On the other hand, storage bandwidth and network bandwidth are still serious bottlenecksfor large scale on-demandvideo streaming.In this dissertation, we aim at a scalable video content distribution system that addresses both storage bottleneck and network bottleneck. The first part of the dissertation pertains to the storage system on the server side: A multi-tieredstorage system thatexploits a flash memory solid-state drive (SSD) can meet the bandwidth needs in a much more cost- effective way than a traditional two-tier storage system. We first identify the challenges in architecting such a system given the performance quirks of flash-based SSDs, and the lim- itations of state-of-the-art multi-tieredstorage systems for video streaming. Armed with the knowledge of these challenges, we show how to construct such a storage system and implement a real web server with multi-tiered storage, evaluate the system with AHS work- loads, and demonstrate significant performance gains while reducing the TCO. The second part of the dissertation pertains to the network system on the client side: Integrating peer- to-peer (P2P) technology with the client-server paradigm results in a much more scalable video content distribution system. AHS is a paradigm for client-driven video streaming; its philosophy matches well with that of P2P video streaming. An adaptation mechanism is the most important component of AHS that determines overall video streaming quality and user experience. Weshow a throughput-smoothing-based adaptation mechanism thatis designed for a client-server architecture does not work well for a P2P architecture. We pro- vide a buffer-based adaptation mechanism, evaluate our solution with OMNeT++/INET simulator, and demonstrate significant performance gains.