Mining the web with webcoin

Uri Klarman, Marcel Flores, Aleksandar Kuzmanovic

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Scopus citations

Abstract

Four major search engines, Google in particular, hold a unique position in enabling the use of the Internet, as they alone direct over 98% of Internet users to the content they seek, using proprietary indices. While the contribution of these companies is undeniable, their design is necessarily affected by their economic interests, which may or may not align with those of the users, raising concerns regarding their effect on the availability of information around the globe. While multiple academic and commercial projects aimed to distribute and democratize the Web search, they failed to gain much traction, mostly due to inferior results and lack of incentives for participation. In this paper, we show how complex networking-intensive tasks can be crowdsourced using Bitcoin’s incentive model. We present Webcoin, a novel distributed digital-currency which utilizes networking resources rather then computational, and can only be mined through Web indexing. Webcoin provides both the incentives and the means to create Google-scale indices, freely available to competing services and the public. Webcoin’s design overcomes numerous unique challenges, such as index verification, scalability, and nodes’ ability to actively manipulate webpages. We deploy 200 fully-functioning Webcoin nodes and demonstrate their low bandwidth requirements.

Original languageEnglish (US)
Title of host publicationCoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies
PublisherAssociation for Computing Machinery, Inc
Pages165-177
Number of pages13
ISBN (Electronic)9781450360807
DOIs
StatePublished - Dec 4 2018
Event14th International Conference on Emerging Networking EXperiments and Technologies, CoNEXT 2018 - Heraklion, Greece
Duration: Dec 4 2018Dec 7 2018

Publication series

NameCoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies

Other

Other14th International Conference on Emerging Networking EXperiments and Technologies, CoNEXT 2018
Country/TerritoryGreece
CityHeraklion
Period12/4/1812/7/18

Keywords

  • Blockchain
  • Crowdsourcing
  • Incentives
  • Web indexing

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'Mining the web with webcoin'. Together they form a unique fingerprint.

Cite this