Supplementary material from "The process of replication target selection in psychology: what to consider?"

  • Merle Marie Pittelkow (Creator)
  • Sarahanne M. Field (Creator)
  • Peder M. Isager (Creator)
  • Anna E. Van't Veer (Contributor)
  • Thomas Anderson (Creator)
  • Scott N. Cole (Creator)
  • Tomáš Dominik (Creator)
  • Roger Giner-Sorolla (Creator)
  • Sebahat Gok (Creator)
  • Tom Heyman (Creator)
  • Marc Jekel (Creator)
  • Timothy J. Luke (Creator)
  • David B. Mitchell (Creator)
  • Rik Peels (Creator)
  • Rosina Pendrous (Creator)
  • Samuel Sarrazin (Creator)
  • Jacob Michael Schauer (Creator)
  • Eva Specker (Creator)
  • Ulrich S. Tran (Creator)
  • Marek A. Vranka (Creator)
  • Jelte M. Wicherts (Creator)
  • Naoto Yoshimura (Creator)
  • Rolf A. Zwaan (Creator)
  • Don Van Ravenzwaaij (Contributor)
  • Anna E. Van't Veer (Creator)
  • David B. Mitchell (Creator)
  • Naoto Yoshimura (Creator)

Dataset

Description

Increased execution of replication studies contributes to the effort to restore credibility of empirical research. However, a second generation of problems arises: the number of potential replication targets is at a serious mismatch with available resources. Given limited resources, replication target selection should be well-justified, systematic and transparently communicated. At present the discussion on what to consider when selecting a replication target is limited to theoretical discussion, self-reported justifications and a few formalized suggestions. In this Registered Report, we proposed a study involving the scientific community to create a list of considerations for consultation when selecting a replication target in psychology. We employed a modified Delphi approach. First, we constructed a preliminary list of considerations. Second, we surveyed psychologists who previously selected a replication target with regards to their considerations. Third, we incorporated the results into the preliminary list of considerations and sent the updated list to a group of individuals knowledgeable about concerns regarding replication target selection. Over the course of several rounds, we established consensus regarding what to consider when selecting a replication target. The resulting checklist can be used for transparently communicating the rationale for selecting studies for replication.
Date made available2023
PublisherThe Royal Society
  • The process of replication target selection in psychology: what to consider?

    Pittelkow, M. M., Field, S. M., Isager, P. M., Van't Veer, A. E., Anderson, T., Cole, S. N., Dominik, T., Giner-Sorolla, R., Gok, S., Heyman, T., Jekel, M., Luke, T. J., Mitchell, D. B., Peels, R., Pendrous, R., Sarrazin, S., Schauer, J. M., Specker, E., Tran, U. S., Vranka, M. A., & 4 othersWicherts, J. M., Yoshimura, N., Zwaan, R. A. & Van Ravenzwaaij, D., Feb 1 2023, In: Royal Society Open Science. 10, 2, 210586.

    Research output: Contribution to journalArticlepeer-review

    Open Access
    1 Scopus citations

Cite this