Abstract
Feedback is important to the creative process, but not everyone has a personal crowd of individuals they can turn to for high-quality feedback. We introduce and evaluate Critiki, a novel system for gathering design critiques on crowdfunding project pages from paid crowdworkers. Stemming from previous research on crowdfunding project creators and their need for early-stage design feedback, we design and build a working system which fits the need of this population: rapid and inexpensive feedback. To solve issues with critique quality we describe a scaffolding technique designed to assist crowdworkers in writing high-quality critiques. We evaluate Critiki with two field deployments: 1) A randomized controlled experiment with 450 crowdworkers to evaluate the efficacy of the scaffolding technique and 2) A user study with 31 crowdfunding project creators to determine usability and user satisfaction. We contribute to research on Creativity and Cognition by demonstrating a working creativity support system, empirically evaluating the system, and describing how scaffolding approaches can be designed for other crowdsourced tasks.
Original language | English (US) |
---|---|
Title of host publication | C and C 2015 - Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition |
Publisher | Association for Computing Machinery, Inc |
Pages | 235-244 |
Number of pages | 10 |
ISBN (Electronic) | 9781450335980 |
DOIs | |
State | Published - Jun 22 2015 |
Event | ACM SIGCHI Conference on Creativity and Cognition, C and C 2015 - Glasgow, United Kingdom Duration: Jun 22 2015 → Jun 25 2015 |
Publication series
Name | C and C 2015 - Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition |
---|
Other
Other | ACM SIGCHI Conference on Creativity and Cognition, C and C 2015 |
---|---|
Country/Territory | United Kingdom |
City | Glasgow |
Period | 6/22/15 → 6/25/15 |
Funding
ACKNOWLEDGMENTS We would like to thank all members of the Delta Lab for their helpful feedback through the process of this project. Special thanks to Darren Gergle and Haoqi Zhang for their detailed critiques along the way. This work was supported by the Segal Design Institute, NSF GFRP and NSF Grants IIS- 1320693 & IIS-1217225.
Keywords
- Crowdfunding
- Crowdsourcing
- Design
- Feedback
- Mechanical Turk
- Scaffolding
ASJC Scopus subject areas
- Software