Critiki: A scaffolded approach to gathering design feedback from paid crowdworkers

Research output: Chapter in Book/Report/Conference proceedingConference contribution

44 Scopus citations

Abstract

Feedback is important to the creative process, but not everyone has a personal crowd of individuals they can turn to for high-quality feedback. We introduce and evaluate Critiki, a novel system for gathering design critiques on crowdfunding project pages from paid crowdworkers. Stemming from previous research on crowdfunding project creators and their need for early-stage design feedback, we design and build a working system which fits the need of this population: rapid and inexpensive feedback. To solve issues with critique quality we describe a scaffolding technique designed to assist crowdworkers in writing high-quality critiques. We evaluate Critiki with two field deployments: 1) A randomized controlled experiment with 450 crowdworkers to evaluate the efficacy of the scaffolding technique and 2) A user study with 31 crowdfunding project creators to determine usability and user satisfaction. We contribute to research on Creativity and Cognition by demonstrating a working creativity support system, empirically evaluating the system, and describing how scaffolding approaches can be designed for other crowdsourced tasks.

Original languageEnglish (US)
Title of host publicationC and C 2015 - Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition
PublisherAssociation for Computing Machinery, Inc
Pages235-244
Number of pages10
ISBN (Electronic)9781450335980
DOIs
StatePublished - Jun 22 2015
EventACM SIGCHI Conference on Creativity and Cognition, C and C 2015 - Glasgow, United Kingdom
Duration: Jun 22 2015Jun 25 2015

Publication series

NameC and C 2015 - Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition

Other

OtherACM SIGCHI Conference on Creativity and Cognition, C and C 2015
Country/TerritoryUnited Kingdom
CityGlasgow
Period6/22/156/25/15

Funding

ACKNOWLEDGMENTS We would like to thank all members of the Delta Lab for their helpful feedback through the process of this project. Special thanks to Darren Gergle and Haoqi Zhang for their detailed critiques along the way. This work was supported by the Segal Design Institute, NSF GFRP and NSF Grants IIS- 1320693 & IIS-1217225.

Keywords

  • Crowdfunding
  • Crowdsourcing
  • Design
  • Feedback
  • Mechanical Turk
  • Scaffolding

ASJC Scopus subject areas

  • Software

Fingerprint

Dive into the research topics of 'Critiki: A scaffolded approach to gathering design feedback from paid crowdworkers'. Together they form a unique fingerprint.

Cite this