TY - GEN
T1 - Social network, Web forum, or task market? Comparing different crowd genres for design feedback exchange
AU - Yen, Yu Chun Grace
AU - Dow, Steven P.
AU - Gerber, Elizabeth
AU - Bailey, Brian P.
N1 - Funding Information:
This work was supported in part by the National Science Foundation under awards 1462693, 1530818, and 1213091.
Publisher Copyright:
© 2016 ACM.
PY - 2016/6/4
Y1 - 2016/6/4
N2 - Increasingly, designers seek feedback on their designs from crowd platforms such as social networks, Web forums, and paid task markets which demand different amounts of social capital, financial resources, and time. Yet it is unknown how the choice of crowd platform affects feedback generation. We conducted an online study where designers created initial designs and revised the designs based on crowd feedback. We measured the quantity, quality, and content of the feedback received at two iterations and from crowds driven by social status, enjoyment, and financial gain. Our results show, for example, that task markets yield more suggestions, online forums provide more process feedback, and social networks give the most suggestions without payment. We contribute an emergent framework for crowd feedback selection, opportunities for enhancing feedback services, and an experimental platform that researchers can adapt to reduce the burden of conducting online studies of design feedback.
AB - Increasingly, designers seek feedback on their designs from crowd platforms such as social networks, Web forums, and paid task markets which demand different amounts of social capital, financial resources, and time. Yet it is unknown how the choice of crowd platform affects feedback generation. We conducted an online study where designers created initial designs and revised the designs based on crowd feedback. We measured the quantity, quality, and content of the feedback received at two iterations and from crowds driven by social status, enjoyment, and financial gain. Our results show, for example, that task markets yield more suggestions, online forums provide more process feedback, and social networks give the most suggestions without payment. We contribute an emergent framework for crowd feedback selection, opportunities for enhancing feedback services, and an experimental platform that researchers can adapt to reduce the burden of conducting online studies of design feedback.
KW - Creativity
KW - Critique
KW - Crowdsourcing
KW - Design methods
KW - Feedback
KW - Online crowds
UR - http://www.scopus.com/inward/record.url?scp=84978634576&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84978634576&partnerID=8YFLogxK
U2 - 10.1145/2901790.2901820
DO - 10.1145/2901790.2901820
M3 - Conference contribution
AN - SCOPUS:84978634576
T3 - DIS 2016 - Proceedings of the 2016 ACM Conference on Designing Interactive Systems: Fuse
SP - 773
EP - 784
BT - DIS 2016 - Proceedings of the 2016 ACM Conference on Designing Interactive Systems
PB - Association for Computing Machinery, Inc
T2 - 11th ACM SIGCHI Conference on Designing Interactive Systems, DIS 2016
Y2 - 4 June 2016 through 8 June 2016
ER -