Does social interaction improve learning outcomes? Evidence from field experiments on massive open online courses

Dennis J. Zhang, Gad Allon, Jan Van Mieghem

Research output: Contribution to journalArticle

11 Citations (Scopus)

Abstract

This paper studies how service providers can design social interaction among participants and quantify the causal impact of that interaction on service quality. We focus on education and analyze whether encouraging social interaction among students improves learning outcomes in massive open online courses (MOOCs), which are a new service delivery channel with universal access at reduced, if not zero, cost. We analyze three randomized experiments in a MOOC with more than 30,317 students from 183 countries. Two experiments study large-group interaction by encouraging a random subset of students to visit the course discussion board. The majority of students treated in these experiments had higher social engagement, higher quiz completion rates, and higher course grades. Using these treatments as instrumental variables, we estimate that one additional board visit causally increases the probability that a student finishes the quiz in the subsequent week by up to 4:3%. The third experiment studies small-group interaction by encouraging a random subset of students to conduct one-onone synchronous discussions. Students who followed through and actually conducted pairwise discussions increased their quiz completion rates and quiz scores by 10% in the subsequent week. Combining results from these three experiments, we provide recommendations for designing social interaction mechanisms to improve service quality.

Original languageEnglish (US)
Pages (from-to)347-367
Number of pages21
JournalManufacturing and Service Operations Management
Volume19
Issue number3
DOIs
StatePublished - Jun 1 2017

Fingerprint

Experiment
Social interaction
Field experiment
Online courses
Learning outcomes
Group interaction
Service quality
Interaction
Student learning
Randomized experiments
Costs
Service delivery
Instrumental variables
Education
Service provider
Large groups
Universal access
New services

Keywords

  • Education
  • Field experiments
  • Massive open online courses (MOOCs)
  • Service operations
  • Social interaction

ASJC Scopus subject areas

  • Strategy and Management
  • Management Science and Operations Research

Cite this

@article{607d562d657e4768a79fe5f0a8138484,
title = "Does social interaction improve learning outcomes? Evidence from field experiments on massive open online courses",
abstract = "This paper studies how service providers can design social interaction among participants and quantify the causal impact of that interaction on service quality. We focus on education and analyze whether encouraging social interaction among students improves learning outcomes in massive open online courses (MOOCs), which are a new service delivery channel with universal access at reduced, if not zero, cost. We analyze three randomized experiments in a MOOC with more than 30,317 students from 183 countries. Two experiments study large-group interaction by encouraging a random subset of students to visit the course discussion board. The majority of students treated in these experiments had higher social engagement, higher quiz completion rates, and higher course grades. Using these treatments as instrumental variables, we estimate that one additional board visit causally increases the probability that a student finishes the quiz in the subsequent week by up to 4:3{\%}. The third experiment studies small-group interaction by encouraging a random subset of students to conduct one-onone synchronous discussions. Students who followed through and actually conducted pairwise discussions increased their quiz completion rates and quiz scores by 10{\%} in the subsequent week. Combining results from these three experiments, we provide recommendations for designing social interaction mechanisms to improve service quality.",
keywords = "Education, Field experiments, Massive open online courses (MOOCs), Service operations, Social interaction",
author = "Zhang, {Dennis J.} and Gad Allon and {Van Mieghem}, Jan",
year = "2017",
month = "6",
day = "1",
doi = "10.1287/msom.2016.0615",
language = "English (US)",
volume = "19",
pages = "347--367",
journal = "Manufacturing and Service Operations Management",
issn = "1523-4614",
publisher = "INFORMS Inst.for Operations Res.and the Management Sciences",
number = "3",

}

Does social interaction improve learning outcomes? Evidence from field experiments on massive open online courses. / Zhang, Dennis J.; Allon, Gad; Van Mieghem, Jan.

In: Manufacturing and Service Operations Management, Vol. 19, No. 3, 01.06.2017, p. 347-367.

Research output: Contribution to journalArticle

TY - JOUR

T1 - Does social interaction improve learning outcomes? Evidence from field experiments on massive open online courses

AU - Zhang, Dennis J.

AU - Allon, Gad

AU - Van Mieghem, Jan

PY - 2017/6/1

Y1 - 2017/6/1

N2 - This paper studies how service providers can design social interaction among participants and quantify the causal impact of that interaction on service quality. We focus on education and analyze whether encouraging social interaction among students improves learning outcomes in massive open online courses (MOOCs), which are a new service delivery channel with universal access at reduced, if not zero, cost. We analyze three randomized experiments in a MOOC with more than 30,317 students from 183 countries. Two experiments study large-group interaction by encouraging a random subset of students to visit the course discussion board. The majority of students treated in these experiments had higher social engagement, higher quiz completion rates, and higher course grades. Using these treatments as instrumental variables, we estimate that one additional board visit causally increases the probability that a student finishes the quiz in the subsequent week by up to 4:3%. The third experiment studies small-group interaction by encouraging a random subset of students to conduct one-onone synchronous discussions. Students who followed through and actually conducted pairwise discussions increased their quiz completion rates and quiz scores by 10% in the subsequent week. Combining results from these three experiments, we provide recommendations for designing social interaction mechanisms to improve service quality.

AB - This paper studies how service providers can design social interaction among participants and quantify the causal impact of that interaction on service quality. We focus on education and analyze whether encouraging social interaction among students improves learning outcomes in massive open online courses (MOOCs), which are a new service delivery channel with universal access at reduced, if not zero, cost. We analyze three randomized experiments in a MOOC with more than 30,317 students from 183 countries. Two experiments study large-group interaction by encouraging a random subset of students to visit the course discussion board. The majority of students treated in these experiments had higher social engagement, higher quiz completion rates, and higher course grades. Using these treatments as instrumental variables, we estimate that one additional board visit causally increases the probability that a student finishes the quiz in the subsequent week by up to 4:3%. The third experiment studies small-group interaction by encouraging a random subset of students to conduct one-onone synchronous discussions. Students who followed through and actually conducted pairwise discussions increased their quiz completion rates and quiz scores by 10% in the subsequent week. Combining results from these three experiments, we provide recommendations for designing social interaction mechanisms to improve service quality.

KW - Education

KW - Field experiments

KW - Massive open online courses (MOOCs)

KW - Service operations

KW - Social interaction

UR - http://www.scopus.com/inward/record.url?scp=85026290923&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85026290923&partnerID=8YFLogxK

U2 - 10.1287/msom.2016.0615

DO - 10.1287/msom.2016.0615

M3 - Article

VL - 19

SP - 347

EP - 367

JO - Manufacturing and Service Operations Management

JF - Manufacturing and Service Operations Management

SN - 1523-4614

IS - 3

ER -