Sources used to assemble the replications database
FORRT FReD and FLoRA
Our Replications Database incorporates 2,018 rows from FORRT’s FReD and FLoRA projects. If you use FORRT-derived data, please cite:
L. Wallrich, L. Röseler, et al., “FORRT Library of Replication Attempts (FLoRA)” [Data set], OSF, 2026.
See FORRT’s citation guidance for the full author list and current citation, or their maintained citation metadata. Also, we recommend citing this background reference:
L. Röseler et al., “The Replication Database: Documenting the Replicability of Psychological Science”, Journal of Open Psychology Data, 12(1), Article 8, pp. 1–23, 2024.
FReD data is © 2024 The Author(s) and licensed under CC-BY 4.0. Data imported from FORRT FLoRA is licensed under CC BY 4.0. Data that comes from FORRT FReD has a source column value that starts with "FORRT FReD". Rows from FLoRA have "FLoRA" in the Source column.
"A decade of replication study in education.."
We thank Tom Perry for providing the replication data from this paper:
T. Perry, R. Morris, and R. Lea, “A decade of replication study in education? A mapping review (2011–2020)”, Educational Research and Evaluation, 27(1–2), pp. 12–34, 2022.
Replication initiatives
Data from 23 replication initiatives was imported with the help of Claude Code. After each import some manual checks were done to verify the integrity of the import. Here we provide references for each source. See replication initiatives page for more info on these initiatives.
Brazilian Reproducibility Initiative (BRI)
The Brazilian Reproducibility Initiative, et al., “Estimating the replicability of Brazilian biomedical science”, bioRxiv, 2025.
Preprint reporting the Brazilian Reproducibility Initiative.
DARPA SCORE Social and Behavioural Sciences Replication Project (socsci_2026)
A. H. Tyner, et al., “Investigating the replicability of the social and behavioural sciences”, Nature, 652(8108), pp. 143–150, 2026.
Data Replicada — Data Colada Replication Series (DataReplicada)
J. P. Simmons, et al., “Data Replicada”, Data Colada, Post 81, 2019, December 9.
Empirical Audit of Scarcity Research (ScarcityPNAS)
M. O’Donnell, et al., “Empirical audit and review and an assessment of evidentiary value in research on the psychological consequences of scarcity”, Proceedings of the National Academy of Sciences, 118(44), e2103313118, 2021.
Examining Replicability of Online Experiments (EROE)
F. Holzmeister, et al., “Examining the replicability of online experiments selected by a decision market”, Nature Human Behaviour, 9(2), pp. 316–330, 2025.
Experimental Economics Replications (ExECON)
C. F. Camerer, et al., “Evaluating replicability of laboratory experiments in economics”, Science, 351(6280), pp. 1433–1436, 2016.
Experimental Philosophy Reproducibility Project (XPHIR)
F. Cova, et al., “Estimating the Reproducibility of Experimental Philosophy”, Review of Philosophy and Psychology, 12(1), pp. 9–44, 2021.
International Initiative for Impact Evaluation — Replication Paper Series (3ie)
International Initiative for Impact Evaluation (3ie), “Replication papers”, 3ie, n.d..
(Official index of the replication paper series. Accessed Spring 2026.)
Life Outcomes of Personality Replication Project (Soto et al LOPPRP)
C. J. Soto, “How Replicable Are Links Between Personality Traits and Consequential Life Outcomes? The Life Outcomes of Personality Replication Project”, Psychological Science, 30(5), pp. 711–727, 2019.
Many Labs 1 (ML1)
R. A. Klein, et al., “Investigating Variation in Replicability: A “Many Labs” Replication Project”, Social Psychology, 45(3), pp. 142–152, 2014.
Many Labs 2 (ML2)
R. A. Klein, et al., “Many Labs 2: Investigating Variation in Replicability Across Samples and Settings”, Advances in Methods and Practices in Psychological Science, 1(4), pp. 443–490, 2018.
Many Labs 3 (ML3)
C. R. Ebersole, et al., “Many Labs 3: Evaluating participant pool quality across the academic semester via replication”, Journal of Experimental Social Psychology, 67, pp. 68–82, 2016.
Many Labs 4 (ML4)
R. A. Klein, et al., “Many Labs 4: Failure to Replicate Mortality Salience Effect With and Without Original Author Involvement”, Collabra: Psychology, 8(1), 35271, 2022.
Many Labs 5 (ML5)
C. R. Ebersole, et al., “Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability”, Advances in Methods and Practices in Psychological Science, 3(3), pp. 309–331, 2020.
Registered Replication Reports (RRR)
D. J. Simons, et al., “An Introduction to Registered Replication Reports at Perspectives on Psychological Science”, Perspectives on Psychological Science, 9(5), pp. 552–555, 2014.
Introduction to the Registered Replication Reports series.
Replicability of Sports and Exercise Science Research (RSESR)
J. Murphy, et al., “Estimating the Replicability of Sports and Exercise Science Research”, Sports Medicine, 55(10), pp. 2659–2679, 2025.
Replication in Second Language Research (L2R:Marsden2018)
E. Marsden, et al., “Replication in Second Language Research: Narrative and Systematic Reviews and Recommendations for the Field”, Language Learning, 68(2), pp. 321–391, 2018.
Reproducibility Project: Cancer Biology (RP:CB)
T. M. Errington, et al., “Investigating the replicability of preclinical cancer biology”, eLife, 10, e71601, 2021.
Reproducibility Project: Psychology (RP:P)
Open Science Collaboration, “Estimating the reproducibility of psychological science”, Science, 349(6251), aac4716, 2015.
Sensory Marketing Replications (SMR)
K. Motoki, et al., “Evaluating replicability of ten influential research on sensory marketing”, Frontiers in Communication, 7, 1048896, 2022.
Social Psychology Special Issue on Registered Replication Reports (SPRRR)
B. A. Nosek, et al., “Registered Reports: A Method to Increase the Credibility of Published Results”, Social Psychology, 45(3), pp. 137–141, 2014.
Social Science Replication Project (SSRP)
C. F. Camerer, et al., “Evaluating the replicability of social science experiments in Nature and Science between 2010 and 2015”, Nature Human Behaviour, 2(9), pp. 637–644, 2018.
Student Replication Projects (SRP)
V. Boyce, et al., “Eleven years of student replication projects provide evidence on the correlates of replicability in psychology”, Royal Society Open Science, 10(11), 231240, 2023.