WebProphet: Automating performance prediction for web services

Zhichun Li, Ming Zhang, Zhaosheng Zhu, Yan Chen, Albert Greenberg, Yi Min Wang

Research output: Contribution to conferencePaperpeer-review

55 Scopus citations

Abstract

Today, large-scale web services run on complex systems, spanning multiple data centers and content distribution networks, with performance depending on diverse factors in end systems, networks, and infrastructure servers. Web service providers have many options for improving service performance, varying greatly in feasibility, cost and benefit, but have few tools to predict the impact of these options. A key challenge is to precisely capture web object dependencies, as these are essential for predicting performance in an accurate and scalable manner. In this paper, we introduce WebProphet, a system that automates performance prediction for web services. WebProphet employs a novel technique based on timing perturbation to extract web object dependencies, and then uses these dependencies to predict the performance impact of changes to the handling of the objects. We have built, deployed, and evaluated the accuracy and efficiency of WebProphet. Applying WebProphet to the Search and Maps services of Google and Yahoo, we find WebProphet predicts the median and 95th percentiles of the page load time distribution with an error rate smaller than 16% in most cases. Using Yahoo Maps as an example, we find that WebProphet reduces the problem of performance optimization to a small number of web objects whose optimization would reduce the page load time by nearly 40%.

Original languageEnglish (US)
Pages143-158
Number of pages16
StatePublished - 2010
Event7th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2010 - San Jose, United States
Duration: Apr 28 2010Apr 30 2010

Conference

Conference7th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2010
Country/TerritoryUnited States
CitySan Jose
Period4/28/104/30/10

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'WebProphet: Automating performance prediction for web services'. Together they form a unique fingerprint.

Cite this