Understanding and overcoming biases in online review systems

Georgios Askalidis, Su Jung Kim*, Edward C. Malthouse

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

19 Scopus citations

Abstract

This study addresses the issues of social influence and selection biases in the context of online review systems. We propose that one way to reduce these biases is to send email invitations to write a review to a random sample of buyers, and not exposing them to existing reviews while they write their reviews. We provide empirical evidence showing how such a simple intervention from the retailer mitigates the biases by analyzing data from four diverse online retailers over multiple years. The data include both self-motivated reviews, where the reviewer sees other reviews at the time of writing, and retailer-prompted reviews generated by an email invitation to verified buyers, where the reviewer does not see existing reviews. Consistent with previous research on the social influence bias, we find that the star ratings of self-motivated reviews decrease over time (i.e., downward trend), while the star ratings of retailer-prompted reviews remain constant. As predicted by theories on motivation, the self-motivated reviews are shown to be more negative (lower valence), longer, and more helpful, which suggests that the nature of self-motivated and retailer-prompted reviews is distinctively different and the influx of retailer-prompted reviews would enhance diversity in the overall review system. Regarding the selection bias, we found that email invitations can improve the representativeness of reviews by adding a new segment of verified buyers. In sum, implementing appropriate design and policy in online review systems will improve the quality and validity of online reviews and help practitioners provide more credible and representative ratings to their customers.

Original languageEnglish (US)
Pages (from-to)23-30
Number of pages8
JournalDecision Support Systems
Volume97
DOIs
StatePublished - May 1 2017

Keywords

  • Electronic word-of-mouth (eWOM)
  • Extrinsic motivation
  • Intrinsic motivation
  • Online customer reviews
  • Selection bias
  • Social influence bias

ASJC Scopus subject areas

  • Management Information Systems
  • Information Systems
  • Developmental and Educational Psychology
  • Arts and Humanities (miscellaneous)
  • Information Systems and Management

Fingerprint Dive into the research topics of 'Understanding and overcoming biases in online review systems'. Together they form a unique fingerprint.

Cite this