Abstract
Increasingly, designers seek feedback on their designs from crowd platforms such as social networks, Web forums, and paid task markets which demand different amounts of social capital, financial resources, and time. Yet it is unknown how the choice of crowd platform affects feedback generation. We conducted an online study where designers created initial designs and revised the designs based on crowd feedback. We measured the quantity, quality, and content of the feedback received at two iterations and from crowds driven by social status, enjoyment, and financial gain. Our results show, for example, that task markets yield more suggestions, online forums provide more process feedback, and social networks give the most suggestions without payment. We contribute an emergent framework for crowd feedback selection, opportunities for enhancing feedback services, and an experimental platform that researchers can adapt to reduce the burden of conducting online studies of design feedback.
Original language | English (US) |
---|---|
Title of host publication | DIS 2016 - Proceedings of the 2016 ACM Conference on Designing Interactive Systems |
Subtitle of host publication | Fuse |
Publisher | Association for Computing Machinery, Inc |
Pages | 773-784 |
Number of pages | 12 |
ISBN (Electronic) | 9781450340311 |
DOIs | |
State | Published - Jun 4 2016 |
Event | 11th ACM SIGCHI Conference on Designing Interactive Systems, DIS 2016 - Brisbane, Australia Duration: Jun 4 2016 → Jun 8 2016 |
Publication series
Name | DIS 2016 - Proceedings of the 2016 ACM Conference on Designing Interactive Systems: Fuse |
---|
Other
Other | 11th ACM SIGCHI Conference on Designing Interactive Systems, DIS 2016 |
---|---|
Country/Territory | Australia |
City | Brisbane |
Period | 6/4/16 → 6/8/16 |
Funding
This work was supported in part by the National Science Foundation under awards 1462693, 1530818, and 1213091.
Keywords
- Creativity
- Critique
- Crowdsourcing
- Design methods
- Feedback
- Online crowds
ASJC Scopus subject areas
- Computer Graphics and Computer-Aided Design
- Human-Computer Interaction
- Software