Scale and performance in the CoBlitz large-file distribution service

@inproceedings{citeulike:3378447, abstract = {Scalable distribution of large files has been the area of much research and commercial interest in the past few years. In this paper, we describe the CoBlitz system, which efficiently distributes large files using a content distribution network (CDN) designed for HTTP. As a result, CoBlitz is able to serve large files without requiring any modifications to standard Web servers and clients, making it an interesting option both for end users as well as infrastructure services. Over the 18 months that CoBlitz and its partner service, CoDeploy, have been running on PlanetLab, we have had the opportunity to observe its algorithms in practice, and to evolve its design. These changes stem not only from observations on its use, but also from a better understanding of their behavior in real-world conditions. This utilitarian approach has led us to better understand the effects of scale, peering policies, replication behavior, and congestion, giving us new insights into how to better improve their performance. With these changes, CoBlitz is able to deliver in excess of 1 Gbps on PlanetLab, and to outperform a range of systems, including research systems as well as the widely-used BitTorrent.}, address = {Berkeley, CA, USA}, author = {Park, Kyoungsoo and Pai, Vivek S.}, booktitle = {NSDI'06: Proceedings of the 3rd conference on Networked Systems Design \& Implementation}, citeulike-article-id = {3378447}, keywords = {cdn, planetlab}, location = {San Jose, CA}, pages = {3}, posted-at = {2008-10-06 05:15:17}, priority = {2}, publisher = {USENIX Association}, title = {Scale and performance in the CoBlitz large-file distribution service}, url = {http://portal.acm.org/citation.cfm?id=1267680.1267683}, year = {2006} }

TY - CONF ID - citeulike:3378447 L3 - citeulike-article-id:3378447 N2 - Scalable distribution of large files has been the area of much research and commercial interest in the past few years. In this paper, we describe the CoBlitz system, which efficiently distributes large files using a content distribution network (CDN) designed for HTTP. As a result, CoBlitz is able to serve large files without requiring any modifications to standard Web servers and clients, making it an interesting option both for end users as well as infrastructure services. Over the 18 months that CoBlitz and its partner service, CoDeploy, have been running on PlanetLab, we have had the opportunity to observe its algorithms in practice, and to evolve its design. These changes stem not only from observations on its use, but also from a better understanding of their behavior in real-world conditions. This utilitarian approach has led us to better understand the effects of scale, peering policies, replication behavior, and congestion, giving us new insights into how to better improve their performance. With these changes, CoBlitz is able to deliver in excess of 1 Gbps on PlanetLab, and to outperform a range of systems, including research systems as well as the widely-used BitTorrent. CY - San Jose, CA AD - Berkeley, CA, USA EP - 3 TI - Scale and performance in the CoBlitz large-file distribution service PB - USENIX Association T2 - NSDI'06: Proceedings of the 3rd conference on Networked Systems Design \& Implementation SP - 3 KW - cdn KW - planetlab AU - Park, Kyoungsoo AU - Pai, Vivek PY - 2006/// UR - http://portal.acm.org/citation.cfm?id=1267680.1267683 ER -