Abstract
Increased execution of replication studies contributes to the effort to restore credibility of empirical research. However, a second generation of problems arises: the number of potential replication targets is at a serious mismatch with available resources. Given limited resources, replication target selection should be well-justified, systematic and transparently communicated. At present the discussion on what to consider when selecting a replication target is limited to theoretical discussion, self-reported justifications and a few formalized suggestions. In this Registered Report, we proposed a study involving the scientific community to create a list of considerations for consultation when selecting a replication target in psychology. We employed a modified Delphi approach. First, we constructed a preliminary list of considerations. Second, we surveyed psychologists who previously selected a replication target with regards to their considerations. Third, we incorporated the results into the preliminary list of considerations and sent the updated list to a group of individuals knowledgeable about concerns regarding replication target selection. Over the course of several rounds, we established consensus regarding what to consider when selecting a replication target. The resulting checklist can be used for transparently communicating the rationale for selecting studies for replication.
Original language | English (US) |
---|---|
Article number | 210586 |
Journal | Royal Society Open Science |
Volume | 10 |
Issue number | 2 |
DOIs | |
State | Published - Feb 1 2023 |
Funding
M.-M.P. and D.v.R. were supported by an NWO Vidi grant to D.v.R. (016.Vidi.188.001). Acknowledgements
Keywords
- consensus
- replication
- study selection
ASJC Scopus subject areas
- General
Fingerprint
Dive into the research topics of 'The process of replication target selection in psychology: what to consider?'. Together they form a unique fingerprint.Datasets
-
Supplementary material from "The process of replication target selection in psychology: what to consider?"
Pittelkow, M.-M. (Creator), Field, S. M. (Creator), Isager, P. M. (Creator), Van't Veer, A. E. (Contributor), Anderson, T. (Creator), Cole, S. N. (Creator), Dominik, T. (Creator), Giner-Sorolla, R. (Creator), Gok, S. (Creator), Heyman, T. (Creator), Jekel, M. (Creator), Luke, T. J. (Creator), Mitchell, D. B. (Creator), Peels, R. (Creator), Pendrous, R. (Creator), Sarrazin, S. (Creator), Schauer, J. M. (Creator), Specker, E. (Creator), Tran, U. S. (Creator), Vranka, M. A. (Creator), Wicherts, J. M. (Creator), Yoshimura, N. (Creator), Zwaan, R. A. (Creator), Van Ravenzwaaij, D. (Contributor), van’t Veer, A. E. (Creator), Mitchell, D. B. (Creator) & Yoshimura, N. (Creator), The Royal Society, 2023
DOI: 10.6084/m9.figshare.c.6403449, https://rs.figshare.com/collections/Supplementary_material_from_The_process_of_replication_target_selection_in_psychology_what_to_consider_/6403449
Dataset