TY - GEN
T1 - Designing for preregistration
T2 - 2019 CHI Conference on Human Factors in Computing Systems, CHI EA 2019
AU - Pu, Xiaoying
AU - Kay, Matthew
AU - Zhu, Licheng
AU - Conrad, Frederick
N1 - Publisher Copyright:
© 2019 Copyright held by the owner/author(s).
Copyright:
Copyright 2019 Elsevier B.V., All rights reserved.
PY - 2019/5/2
Y1 - 2019/5/2
N2 - The replication crisis-a failure to replicate foundational studies-has sparked a conversation in psychology, HCI, and beyond about scientific reliability. To address the crisis, researchers increasingly adopt preregistration: the practice of documenting research plans before conducting a study. Done properly, preregistration should reduce bias from taking exploratory findings as confirmatory. It is crucial to treat preregistration, often an online form/template, as a user-centered design problem to ensure preregistration achieves its intended goal. To understand preregistration in practice, we conducted 14 semi-structured interviews with preregistration users (researchers) who ranged in seniority and experience. We identified two main purposes researchers have for using preregistration in addition to different user roles and adoption barriers. With the ultimate goal of improving the reliability of scientific findings, we suggest opportunities to explicitly support the different aspects of preregistration use based on our findings.
AB - The replication crisis-a failure to replicate foundational studies-has sparked a conversation in psychology, HCI, and beyond about scientific reliability. To address the crisis, researchers increasingly adopt preregistration: the practice of documenting research plans before conducting a study. Done properly, preregistration should reduce bias from taking exploratory findings as confirmatory. It is crucial to treat preregistration, often an online form/template, as a user-centered design problem to ensure preregistration achieves its intended goal. To understand preregistration in practice, we conducted 14 semi-structured interviews with preregistration users (researchers) who ranged in seniority and experience. We identified two main purposes researchers have for using preregistration in addition to different user roles and adoption barriers. With the ultimate goal of improving the reliability of scientific findings, we suggest opportunities to explicitly support the different aspects of preregistration use based on our findings.
KW - Open Science
KW - Preregistration
KW - User-centered Design
UR - http://www.scopus.com/inward/record.url?scp=85067305074&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85067305074&partnerID=8YFLogxK
U2 - 10.1145/3290607.3312862
DO - 10.1145/3290607.3312862
M3 - Conference contribution
AN - SCOPUS:85067305074
T3 - Conference on Human Factors in Computing Systems - Proceedings
BT - CHI EA 2019 - Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems
PB - Association for Computing Machinery
Y2 - 4 May 2019 through 9 May 2019
ER -