Mining the web with webcoin

Uri Klarman, Marcel Flores, Aleksandar Kuzmanovic

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Four major search engines, Google in particular, hold a unique position in enabling the use of the Internet, as they alone direct over 98% of Internet users to the content they seek, using proprietary indices. While the contribution of these companies is undeniable, their design is necessarily affected by their economic interests, which may or may not align with those of the users, raising concerns regarding their effect on the availability of information around the globe. While multiple academic and commercial projects aimed to distribute and democratize the Web search, they failed to gain much traction, mostly due to inferior results and lack of incentives for participation. In this paper, we show how complex networking-intensive tasks can be crowdsourced using Bitcoin’s incentive model. We present Webcoin, a novel distributed digital-currency which utilizes networking resources rather then computational, and can only be mined through Web indexing. Webcoin provides both the incentives and the means to create Google-scale indices, freely available to competing services and the public. Webcoin’s design overcomes numerous unique challenges, such as index verification, scalability, and nodes’ ability to actively manipulate webpages. We deploy 200 fully-functioning Webcoin nodes and demonstrate their low bandwidth requirements.

Original languageEnglish (US)
Title of host publicationCoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies
PublisherAssociation for Computing Machinery, Inc
Pages165-177
Number of pages13
ISBN (Electronic)9781450360807
DOIs
StatePublished - Dec 4 2018
Event14th International Conference on Emerging Networking EXperiments and Technologies, CoNEXT 2018 - Heraklion, Greece
Duration: Dec 4 2018Dec 7 2018

Publication series

NameCoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies

Other

Other14th International Conference on Emerging Networking EXperiments and Technologies, CoNEXT 2018
CountryGreece
CityHeraklion
Period12/4/1812/7/18

Fingerprint

World Wide Web
Internet
Search engines
Scalability
Availability
Bandwidth
Economics
Industry
Electronic money

Keywords

  • Blockchain
  • Crowdsourcing
  • Incentives
  • Web indexing

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture
  • Electrical and Electronic Engineering

Cite this

Klarman, U., Flores, M., & Kuzmanovic, A. (2018). Mining the web with webcoin. In CoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies (pp. 165-177). (CoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies). Association for Computing Machinery, Inc. https://doi.org/10.1145/3281411.3281415
Klarman, Uri ; Flores, Marcel ; Kuzmanovic, Aleksandar. / Mining the web with webcoin. CoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies. Association for Computing Machinery, Inc, 2018. pp. 165-177 (CoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies).
@inproceedings{3727709f2e00446da487f3b29f9c969e,
title = "Mining the web with webcoin",
abstract = "Four major search engines, Google in particular, hold a unique position in enabling the use of the Internet, as they alone direct over 98{\%} of Internet users to the content they seek, using proprietary indices. While the contribution of these companies is undeniable, their design is necessarily affected by their economic interests, which may or may not align with those of the users, raising concerns regarding their effect on the availability of information around the globe. While multiple academic and commercial projects aimed to distribute and democratize the Web search, they failed to gain much traction, mostly due to inferior results and lack of incentives for participation. In this paper, we show how complex networking-intensive tasks can be crowdsourced using Bitcoin’s incentive model. We present Webcoin, a novel distributed digital-currency which utilizes networking resources rather then computational, and can only be mined through Web indexing. Webcoin provides both the incentives and the means to create Google-scale indices, freely available to competing services and the public. Webcoin’s design overcomes numerous unique challenges, such as index verification, scalability, and nodes’ ability to actively manipulate webpages. We deploy 200 fully-functioning Webcoin nodes and demonstrate their low bandwidth requirements.",
keywords = "Blockchain, Crowdsourcing, Incentives, Web indexing",
author = "Uri Klarman and Marcel Flores and Aleksandar Kuzmanovic",
year = "2018",
month = "12",
day = "4",
doi = "10.1145/3281411.3281415",
language = "English (US)",
series = "CoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies",
publisher = "Association for Computing Machinery, Inc",
pages = "165--177",
booktitle = "CoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies",

}

Klarman, U, Flores, M & Kuzmanovic, A 2018, Mining the web with webcoin. in CoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies. CoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies, Association for Computing Machinery, Inc, pp. 165-177, 14th International Conference on Emerging Networking EXperiments and Technologies, CoNEXT 2018, Heraklion, Greece, 12/4/18. https://doi.org/10.1145/3281411.3281415

Mining the web with webcoin. / Klarman, Uri; Flores, Marcel; Kuzmanovic, Aleksandar.

CoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies. Association for Computing Machinery, Inc, 2018. p. 165-177 (CoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

TY - GEN

T1 - Mining the web with webcoin

AU - Klarman, Uri

AU - Flores, Marcel

AU - Kuzmanovic, Aleksandar

PY - 2018/12/4

Y1 - 2018/12/4

N2 - Four major search engines, Google in particular, hold a unique position in enabling the use of the Internet, as they alone direct over 98% of Internet users to the content they seek, using proprietary indices. While the contribution of these companies is undeniable, their design is necessarily affected by their economic interests, which may or may not align with those of the users, raising concerns regarding their effect on the availability of information around the globe. While multiple academic and commercial projects aimed to distribute and democratize the Web search, they failed to gain much traction, mostly due to inferior results and lack of incentives for participation. In this paper, we show how complex networking-intensive tasks can be crowdsourced using Bitcoin’s incentive model. We present Webcoin, a novel distributed digital-currency which utilizes networking resources rather then computational, and can only be mined through Web indexing. Webcoin provides both the incentives and the means to create Google-scale indices, freely available to competing services and the public. Webcoin’s design overcomes numerous unique challenges, such as index verification, scalability, and nodes’ ability to actively manipulate webpages. We deploy 200 fully-functioning Webcoin nodes and demonstrate their low bandwidth requirements.

AB - Four major search engines, Google in particular, hold a unique position in enabling the use of the Internet, as they alone direct over 98% of Internet users to the content they seek, using proprietary indices. While the contribution of these companies is undeniable, their design is necessarily affected by their economic interests, which may or may not align with those of the users, raising concerns regarding their effect on the availability of information around the globe. While multiple academic and commercial projects aimed to distribute and democratize the Web search, they failed to gain much traction, mostly due to inferior results and lack of incentives for participation. In this paper, we show how complex networking-intensive tasks can be crowdsourced using Bitcoin’s incentive model. We present Webcoin, a novel distributed digital-currency which utilizes networking resources rather then computational, and can only be mined through Web indexing. Webcoin provides both the incentives and the means to create Google-scale indices, freely available to competing services and the public. Webcoin’s design overcomes numerous unique challenges, such as index verification, scalability, and nodes’ ability to actively manipulate webpages. We deploy 200 fully-functioning Webcoin nodes and demonstrate their low bandwidth requirements.

KW - Blockchain

KW - Crowdsourcing

KW - Incentives

KW - Web indexing

UR - http://www.scopus.com/inward/record.url?scp=85060378921&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85060378921&partnerID=8YFLogxK

U2 - 10.1145/3281411.3281415

DO - 10.1145/3281411.3281415

M3 - Conference contribution

T3 - CoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies

SP - 165

EP - 177

BT - CoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies

PB - Association for Computing Machinery, Inc

ER -

Klarman U, Flores M, Kuzmanovic A. Mining the web with webcoin. In CoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies. Association for Computing Machinery, Inc. 2018. p. 165-177. (CoNEXT 2018 - Proceedings of the 14th International Conference on Emerging Networking EXperiments and Technologies). https://doi.org/10.1145/3281411.3281415