Crowdsourcing with heterogeneous workers in social networks

Chao Huang, Haoran Yu, Jianwei Huang, Randall A. Berry

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Scopus citations

Abstract

Many online social networking platforms are leveraging crowdsourcing to enhance the user experience. These platforms seek to incentivize heterogeneous workers to exert efforts to complete tasks (e.g., moderation of posts and articles) and truthfully report their solutions. Output agreement mechanism (e.g., majority voting) is a common approach to this end. In an output agreement mechanism, a worker is rewarded according to whether his solution matches those of his peers. However, prior related work has not studied the workers' heterogeneous solution accuracy and how this heterogeneity affects the platform's payoff. We fill this void by modeling and analyzing the interactions between the platform and workers as a two-stage Stackelberg game. In Stage I, the platform chooses the reward level for the majority voting to maximize its payoff. In Stage II, the workers decide their effort levels and reporting strategies to maximize their payoffs. We show that as a worker's solution accuracy increases, he is more likely to exert effort and truthfully report his solution under the equilibrium reward mechanism. However, given a fixed total worker population, it is surprising that the platform's overall payoff does not monotonically increase in the number of high-accuracy workers. This is because a larger number of high-accuracy workers brings marginally decreasing benefit to the platform, but the rewards required to incentivize them may significantly grow. Moreover, we show that as the solutions of the high-accuracy workers become more accurate, the platform needs a smaller number of such workers to achieve the maximum payoff.

Original languageEnglish (US)
Title of host publication2019 IEEE Global Communications Conference, GLOBECOM 2019 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728109626
DOIs
StatePublished - Dec 2019
Event2019 IEEE Global Communications Conference, GLOBECOM 2019 - Waikoloa, United States
Duration: Dec 9 2019Dec 13 2019

Publication series

Name2019 IEEE Global Communications Conference, GLOBECOM 2019 - Proceedings

Conference

Conference2019 IEEE Global Communications Conference, GLOBECOM 2019
Country/TerritoryUnited States
CityWaikoloa
Period12/9/1912/13/19

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Hardware and Architecture
  • Information Systems
  • Signal Processing
  • Information Systems and Management
  • Safety, Risk, Reliability and Quality
  • Media Technology
  • Health Informatics

Fingerprint

Dive into the research topics of 'Crowdsourcing with heterogeneous workers in social networks'. Together they form a unique fingerprint.

Cite this