On blind mice and the elephant: Understanding the network impact of a large distributed system

John S. Otto*, Mario A. Sánchez, David R. Choffnes, Fabian E Bustamante, Georgos Siganos

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

49 Scopus citations

Abstract

A thorough understanding of the network impact of emerging large-scale distributed systems - where traffic flows and what it costs -must encompass users' behavior, the traffic they generate and the topology over which that traffic flows. In the case of BitTorrent, however, previous studies have been limited by narrow perspectives that restrict such analysis. This paper presents a comprehensive view of BitTorrent, using data from a representative set of 500,000 users sampled over a two year period, located in 169 countries and 3,150 networks. This unique perspective captures unseen trends and reveals several unexpected features of the largest peer-to-peer system. For instance, over the past year total BitTorrent traffic has increased by 12%, driven by 25% increases in per-peer hourly download volume despite a 10% decrease in the average number of online peers. We also observe stronger diurnal usage patterns and, surprisingly given the bandwidth-intensive nature of the application, a close alignment between these patterns and overall traffic. Considering the aggregated traffic across access links, this has potential implications on BitTorrent-associated costs for Internet Service Providers (ISPs). Using data from a transit ISP, we find a disproportionately large impact under a commonly used burstable (95th-percentile) billing model. Last, when examining BitTorrent traffic's paths, we find that for over half its users, most network traffic never reaches large transit networks, but is instead carried by small transit ISPs. This raises questions on the effectiveness of most in-network monitoring systems to capture trends on peer-to-peer traffic and further motivates our approach.

Original languageEnglish (US)
Title of host publicationProceedings of the ACM SIGCOMM 2011 Conference, SIGCOMM'11
Pages110-121
Number of pages12
DOIs
StatePublished - Sep 29 2011
EventACM SIGCOMM 2011 Conference, SIGCOMM'11 - Toronto, ON, Canada
Duration: Aug 15 2011Aug 19 2011

Publication series

NameProceedings of the ACM SIGCOMM 2011 Conference, SIGCOMM'11

Other

OtherACM SIGCOMM 2011 Conference, SIGCOMM'11
CountryCanada
CityToronto, ON
Period8/15/118/19/11

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design

Fingerprint Dive into the research topics of 'On blind mice and the elephant: Understanding the network impact of a large distributed system'. Together they form a unique fingerprint.

  • Cite this

    Otto, J. S., Sánchez, M. A., Choffnes, D. R., Bustamante, F. E., & Siganos, G. (2011). On blind mice and the elephant: Understanding the network impact of a large distributed system. In Proceedings of the ACM SIGCOMM 2011 Conference, SIGCOMM'11 (pp. 110-121). (Proceedings of the ACM SIGCOMM 2011 Conference, SIGCOMM'11). https://doi.org/10.1145/2018436.2018450