TurkServer: Enabling synchronous and longitudinal online experiments

Andrew Mao*, Yiling Chen, Krzysztof Z. Gajos, David C. Parkes, Ariel D. Procaccia, Haoqi Zhang

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

5 Scopus citations

Abstract

With the proliferation of online labor markets and other social computing platforms, online experiments have become a low-cost and scalable way to empirically test hypotheses and mechanisms in both human computation and social science. Yet, despite the potential in designing more powerful and expressive online experiments using multiple subjects, researchers still face many technical and logistical difficulties. We see synchronous and longitudinal experiments involving real-time interaction between participants as a dual-use paradigm for both human computation and social science, and present TurkServer, a platform that facilitates these types of experiments on Amazon Mechanical Turk. Our work has the potential to make more fruitful online experiments accessible to researchers in many different fields.

Original languageEnglish (US)
Title of host publicationHuman Computation - Papers from the 2012 AAAI Workshop, Technical Report
Pages33-39
Number of pages7
StatePublished - Dec 1 2012
Event2012 AAAI Workshop - Toronto, ON, Canada
Duration: Jul 23 2012Jul 23 2012

Publication series

NameAAAI Workshop - Technical Report
VolumeWS-12-08

Other

Other2012 AAAI Workshop
CountryCanada
CityToronto, ON
Period7/23/127/23/12

ASJC Scopus subject areas

  • Engineering(all)

Fingerprint Dive into the research topics of 'TurkServer: Enabling synchronous and longitudinal online experiments'. Together they form a unique fingerprint.

  • Cite this

    Mao, A., Chen, Y., Gajos, K. Z., Parkes, D. C., Procaccia, A. D., & Zhang, H. (2012). TurkServer: Enabling synchronous and longitudinal online experiments. In Human Computation - Papers from the 2012 AAAI Workshop, Technical Report (pp. 33-39). (AAAI Workshop - Technical Report; Vol. WS-12-08).