Previous replication database initiatives

Curate Science

This was a website documenting and summarizing the individual efforts as well as large-scale collective projects in the social sciences. Info there has been ingested into our replication database. It can be viewed on the Internet Archive.

PsychFileDrawer.org

This was an online tool designed to archive replication reports in psychology. It went offline a few years ago but can viewed on the Internet Archive.

Economics Replication Wiki

This was a website compiling and storing published replications of empirical studies in economics. The wiki operated with papers being the unit of replication, not experiments. Not everything was categorized, but when categorizd they typically used a binary label ("successful” or “failed”). We scraped the data, but found it difficult to work with. The "replications" were usually not direct replications of experiments. At other times, they were actually technical replications (for instance replicating a forecasting model by simply reanalyzing the same data using the same code provided by the original authors). Other times, what was considered a "replication" used the same data as the original study to study the same hypothesis but analyzed the data differently. The website offered this categorization scheme (i) same data, same code, (ii) new data, same methods, (iii) same data, new methods, (iv) new methods, new data. However, most papers were not categorized. It can be viewed on the Internet Archive.