TY - GEN
T1 - Critiki
T2 - ACM SIGCHI Conference on Creativity and Cognition, C and C 2015
AU - Greenberg, Michael D.
AU - Easterday, Matthew W.
AU - Gerber, Elizabeth M.
N1 - Funding Information:
ACKNOWLEDGMENTS We would like to thank all members of the Delta Lab for their helpful feedback through the process of this project. Special thanks to Darren Gergle and Haoqi Zhang for their detailed critiques along the way. This work was supported by the Segal Design Institute, NSF GFRP and NSF Grants IIS- 1320693 & IIS-1217225.
PY - 2015/6/22
Y1 - 2015/6/22
N2 - Feedback is important to the creative process, but not everyone has a personal crowd of individuals they can turn to for high-quality feedback. We introduce and evaluate Critiki, a novel system for gathering design critiques on crowdfunding project pages from paid crowdworkers. Stemming from previous research on crowdfunding project creators and their need for early-stage design feedback, we design and build a working system which fits the need of this population: rapid and inexpensive feedback. To solve issues with critique quality we describe a scaffolding technique designed to assist crowdworkers in writing high-quality critiques. We evaluate Critiki with two field deployments: 1) A randomized controlled experiment with 450 crowdworkers to evaluate the efficacy of the scaffolding technique and 2) A user study with 31 crowdfunding project creators to determine usability and user satisfaction. We contribute to research on Creativity and Cognition by demonstrating a working creativity support system, empirically evaluating the system, and describing how scaffolding approaches can be designed for other crowdsourced tasks.
AB - Feedback is important to the creative process, but not everyone has a personal crowd of individuals they can turn to for high-quality feedback. We introduce and evaluate Critiki, a novel system for gathering design critiques on crowdfunding project pages from paid crowdworkers. Stemming from previous research on crowdfunding project creators and their need for early-stage design feedback, we design and build a working system which fits the need of this population: rapid and inexpensive feedback. To solve issues with critique quality we describe a scaffolding technique designed to assist crowdworkers in writing high-quality critiques. We evaluate Critiki with two field deployments: 1) A randomized controlled experiment with 450 crowdworkers to evaluate the efficacy of the scaffolding technique and 2) A user study with 31 crowdfunding project creators to determine usability and user satisfaction. We contribute to research on Creativity and Cognition by demonstrating a working creativity support system, empirically evaluating the system, and describing how scaffolding approaches can be designed for other crowdsourced tasks.
KW - Crowdfunding
KW - Crowdsourcing
KW - Design
KW - Feedback
KW - Mechanical Turk
KW - Scaffolding
UR - http://www.scopus.com/inward/record.url?scp=84962103786&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84962103786&partnerID=8YFLogxK
U2 - 10.1145/2757226.2757249
DO - 10.1145/2757226.2757249
M3 - Conference contribution
AN - SCOPUS:84962103786
T3 - C and C 2015 - Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition
SP - 235
EP - 244
BT - C and C 2015 - Proceedings of the 2015 ACM SIGCHI Conference on Creativity and Cognition
PB - Association for Computing Machinery, Inc
Y2 - 22 June 2015 through 25 June 2015
ER -