Does social interaction improve learning outcomes? Evidence from field experiments on massive open online courses

Dennis J. Zhang, Gad Allon, Jan Van Mieghem

Research output: Contribution to journalArticle

15 Scopus citations

Abstract

This paper studies how service providers can design social interaction among participants and quantify the causal impact of that interaction on service quality. We focus on education and analyze whether encouraging social interaction among students improves learning outcomes in massive open online courses (MOOCs), which are a new service delivery channel with universal access at reduced, if not zero, cost. We analyze three randomized experiments in a MOOC with more than 30,317 students from 183 countries. Two experiments study large-group interaction by encouraging a random subset of students to visit the course discussion board. The majority of students treated in these experiments had higher social engagement, higher quiz completion rates, and higher course grades. Using these treatments as instrumental variables, we estimate that one additional board visit causally increases the probability that a student finishes the quiz in the subsequent week by up to 4:3%. The third experiment studies small-group interaction by encouraging a random subset of students to conduct one-onone synchronous discussions. Students who followed through and actually conducted pairwise discussions increased their quiz completion rates and quiz scores by 10% in the subsequent week. Combining results from these three experiments, we provide recommendations for designing social interaction mechanisms to improve service quality.

Original languageEnglish (US)
Pages (from-to)347-367
Number of pages21
JournalManufacturing and Service Operations Management
Volume19
Issue number3
DOIs
StatePublished - Jun 1 2017

    Fingerprint

Keywords

  • Education
  • Field experiments
  • Massive open online courses (MOOCs)
  • Service operations
  • Social interaction

ASJC Scopus subject areas

  • Strategy and Management
  • Management Science and Operations Research

Cite this