Replication Rate by Journal OpenAlex 2-Year Mean Citedness

OpenAlex 2-year mean citedness is a single current snapshot from the OpenAlex API (as of 2026), so it does not vary by publication year; the basis is fixed to that snapshot.

Rate = success / (success + failure + reversal); inconclusive and unrecorded outcomes excluded, where success means the outcome recorded in the database. Unit: replication effect (n = 7,296 — originals whose journal is matched in the impact-factor dataset). How this is defined.

4,664 papers plotted · 512 excluded (no recent impact factor) · 890 excluded (inconclusive outcome)

Replication rate by OpenAlex 2-year mean citedness quintile

0%25%50%75%100%IF 0.1–1.8: 62.1% replicated (579/932), cluster-bootstrap 95% CI [58–66%]62%0.1–1.8n=932IF 1.8–2.8: 60.9% replicated (568/933), cluster-bootstrap 95% CI [54–64%]61%1.8–2.8n=933IF 2.8–3.7: 59.6% replicated (556/933), cluster-bootstrap 95% CI [59–69%]60%2.8–3.7n=933IF 3.7–6.7: 55.2% replicated (515/933), cluster-bootstrap 95% CI [49–62%]55%3.7–6.7n=933IF 6.7–1575: 50.5% replicated (471/933), cluster-bootstrap 95% CI [46–56%]50%6.7–1575n=933Journal OpenAlex 2-year mean citedness in 2026 (quintile range)Replication rate (%)The Metascience Observatory

All papers with a publication-year impact factor, split into five equal-count bins. Hover a bar for its journal-cluster bootstrap 95% interval.

Replication rate by OpenAlex 2-year mean citedness

0%25%50%75%100%IF 0.0–4.0: 60.9% replicated (1806/2966), cluster-bootstrap 95% CI [58–64%]61%0–4n=2966IF 4.0–8.0: 53.9% replicated (510/947), cluster-bootstrap 95% CI [48–62%]54%4–8n=947IF 8.0–12: 51.4% replicated (125/243), cluster-bootstrap 95% CI [42–62%]51%8–12n=243IF 12–16: 51.8% replicated (59/114), cluster-bootstrap 95% CI [36–63%]52%12–16n=114IF 16–1575: 48.0% replicated (189/394), cluster-bootstrap 95% CI [42–53%]48%16+n=394Journal OpenAlex 2-year mean citedness in 2026Replication rate (%)The Metascience Observatory

The same papers as above, grouped into equal-width impact-factor intervals (the top bin is a catch-all for IF ≥ 16). Unlike the equal-count quintiles, this shows the trend against a true impact-factor scale; most papers fall in the low bins.

Per-journal replication rate vs OpenAlex 2-year mean citedness

0%25%50%75%100%151015202530Journal of Experimental Psychology: Learning, Memory, and Cognition OpenAlex 2-year mean citedness: 1.1 Replication rate: 65% (n=57), 95% CI [52–76%]Neurology OpenAlex 2-year mean citedness: 1.1 Replication rate: 47% (n=15), 95% CI [25–70%]Biological Psychiatry OpenAlex 2-year mean citedness: 1.2 Replication rate: 74% (n=35), 95% CI [58–86%]Journal of Experimental Social Psychology OpenAlex 2-year mean citedness: 1.6 Replication rate: 47% (n=34), 95% CI [31–63%]Vision Research OpenAlex 2-year mean citedness: 1.9 Replication rate: 71% (n=17), 95% CI [47–87%]Neuroscience Letters OpenAlex 2-year mean citedness: 1.9 Replication rate: 27% (n=15), 95% CI [11–52%]Journal of Experimental Psychology: General OpenAlex 2-year mean citedness: 2.0 Replication rate: 52% (n=64), 95% CI [40–63%]Personality and Individual Differences OpenAlex 2-year mean citedness: 2.1 Replication rate: 81% (n=16), 95% CI [57–93%]Journal of Consulting and Clinical Psychology OpenAlex 2-year mean citedness: 2.2 Replication rate: 67% (n=21), 95% CI [45–83%]Neuropsychologia OpenAlex 2-year mean citedness: 2.2 Replication rate: 76% (n=21), 95% CI [55–89%]Child Development OpenAlex 2-year mean citedness: 2.4 Replication rate: 53% (n=15), 95% CI [30–75%]Developmental Science OpenAlex 2-year mean citedness: 2.6 Replication rate: 53% (n=15), 95% CI [30–75%]Cortex OpenAlex 2-year mean citedness: 2.7 Replication rate: 50% (n=16), 95% CI [28–72%]Journal of Applied Behavior Analysis OpenAlex 2-year mean citedness: 2.7 Replication rate: 85% (n=47), 95% CI [72–93%]Behaviour Research and Therapy OpenAlex 2-year mean citedness: 2.7 Replication rate: 67% (n=15), 95% CI [42–85%]Cognition OpenAlex 2-year mean citedness: 2.8 Replication rate: 47% (n=60), 95% CI [35–59%]Journal of Personality and Social Psychology OpenAlex 2-year mean citedness: 2.8 Replication rate: 45% (n=154), 95% CI [37–53%]Personality and Social Psychology Bulletin OpenAlex 2-year mean citedness: 2.8 Replication rate: 55% (n=22), 95% CI [35–73%]Psychonomic Bulletin & Review OpenAlex 2-year mean citedness: 2.8 Replication rate: 46% (n=28), 95% CI [30–64%]Human Molecular Genetics OpenAlex 2-year mean citedness: 2.8 Replication rate: 42% (n=36), 95% CI [27–58%]Schizophrenia Research OpenAlex 2-year mean citedness: 2.9 Replication rate: 74% (n=19), 95% CI [51–88%]PLOS One OpenAlex 2-year mean citedness: 2.9 Replication rate: 55% (n=87), 95% CI [45–65%]Journal of Memory and Language OpenAlex 2-year mean citedness: 2.9 Replication rate: 70% (n=20), 95% CI [48–85%]Journal of Cognitive Neuroscience OpenAlex 2-year mean citedness: 3.1 Replication rate: 50% (n=20), 95% CI [30–70%]Frontiers in Psychology OpenAlex 2-year mean citedness: 3.3 Replication rate: 62% (n=21), 95% CI [41–79%]Journal of Experimental Psychology: Human Perception and Performance OpenAlex 2-year mean citedness: 3.5 Replication rate: 74% (n=31), 95% CI [57–86%]Journal of Neuroscience OpenAlex 2-year mean citedness: 3.8 Replication rate: 54% (n=24), 95% CI [35–72%]NeuroImage OpenAlex 2-year mean citedness: 3.8 Replication rate: 77% (n=31), 95% CI [60–89%]Cerebral Cortex OpenAlex 2-year mean citedness: 3.9 Replication rate: 47% (n=19), 95% CI [27–68%]PLoS Genetics OpenAlex 2-year mean citedness: 4.1 Replication rate: 37% (n=19), 95% CI [19–59%]Scientific Reports OpenAlex 2-year mean citedness: 4.6 Replication rate: 75% (n=24), 95% CI [55–88%]Annals of Neurology OpenAlex 2-year mean citedness: 4.8 Replication rate: 21% (n=19), 95% CI [9–43%]Organizational Behavior and Human Decision Processes OpenAlex 2-year mean citedness: 5.2 Replication rate: 41% (n=17), 95% CI [22–64%]Psychological Science OpenAlex 2-year mean citedness: 5.5 Replication rate: 42% (n=238), 95% CI [36–48%]Current Biology OpenAlex 2-year mean citedness: 5.7 Replication rate: 62% (n=26), 95% CI [43–78%]American Journal of Human Genetics OpenAlex 2-year mean citedness: 6.7 Replication rate: 44% (n=43), 95% CI [30–59%]Journal of Consumer Research OpenAlex 2-year mean citedness: 7.0 Replication rate: 25% (n=36), 95% CI [14–41%]American Journal of Psychiatry OpenAlex 2-year mean citedness: 7.5 Replication rate: 83% (n=24), 95% CI [64–93%]Proceedings of the National Academy of Sciences OpenAlex 2-year mean citedness: 8.0 Replication rate: 54% (n=95), 95% CI [44–63%]Molecular Psychiatry OpenAlex 2-year mean citedness: 8.2 Replication rate: 38% (n=40), 95% CI [24–53%]Neuron OpenAlex 2-year mean citedness: 12.9 Replication rate: 53% (n=15), 95% CI [30–75%]American Economic Review OpenAlex 2-year mean citedness: 13.7 Replication rate: 53% (n=58), 95% CI [41–66%]Nature Communications OpenAlex 2-year mean citedness: 16.2 Replication rate: 37% (n=27), 95% CI [22–56%]Nature Genetics OpenAlex 2-year mean citedness: 17.0 Replication rate: 53% (n=124), 95% CI [44–62%]Nature OpenAlex 2-year mean citedness: 17.6 Replication rate: 47% (n=59), 95% CI [35–60%]The Quarterly Journal of Economics OpenAlex 2-year mean citedness: 18.3 Replication rate: 56% (n=18), 95% CI [34–75%]Science OpenAlex 2-year mean citedness: 19.5 Replication rate: 43% (n=88), 95% CI [33–54%]New England Journal of Medicine OpenAlex 2-year mean citedness: 28.8 Replication rate: 52% (n=21), 95% CI [32–72%]NeuronAm. Econ. ReviewNature CommunicationsNature GeneticsNatureQuarterly Journal of EconomicsScienceNEJMJournal OpenAlex 2-year mean citedness in 2026Replication rate (%)The Metascience ObservatoryWilson 95%Confidence Interval

One point per journal with at least 15 plotted papers. Point size reflects the number of papers; whiskers are 95% Wilson CIs.

Metric sources. The 2-year and 5-year impact factors and the CiteScore-style 4-year metric are self-computed from the SciSciNet-v2 / OpenAlex citation graph — not the official Clarivate Journal Impact Factor™ or Scopus CiteScore, which are proprietary. They differ from the vendor figures in two ways that pull in opposite directions. Their denominator counts every document a venue publishes, where the real JIF counts only “citable items” (articles and reviews), so journals carrying heavy front matter or conference abstracts are pushed down sharply — the effect is severe enough that Cancer Research, which publishes thousands of meeting abstracts, lands near 0.6. Their numerator, meanwhile, draws on a broader citation graph than Web of Science, which pushes figures up. Deflation usually wins: against the citable-denominator metric below, 85% of journals here come out lower (median ratio 0.80), but 12% come out higher. Treat them as internally consistent relative indicators rather than as JIF estimates, and prefer the citable-denominator metric when comparing across journals of different types. OpenAlex 2-year mean citedness is OpenAlex’s own published impact-factor-like metric, fetched from the OpenAlex API as a single current snapshot (it does not vary by year). SCImago SJR is a prestige-weighted metric (citations weighted by the citing journal’s standing) taken per publication year from SCImago; papers before 1999 use the 1999 ranking. Citations per citable document (SCImago, 3-yr) is a CiteScore-style ratio — SCImago’s Total Citations (3 years) divided by its Citable Docs (3 years) — per publication year (pre-1999 uses 1999). Because its denominator counts only citabledocuments (excluding news, editorials and other front-matter), it is normalized like the real JIF/CiteScore and, unlike the self-computed IFs above, does not deflate high-front-matter journals such as Nature and Science.

Matching. Journal names in the replications database are matched to the impact-factor dataset by normalized name; SCImago SJR is joined by ISSN with a name fallback (~94% of matched journals). Books, preprints, and conference proceedings have no journal metric and are excluded.

Attribution. SJR data: SCImago, (n.d.). SJR — SCImago Journal & Country Rank [Portal], retrieved from scimagojr.com (used non-commercially). OpenAlex data is CC0.

Data: replications_database_2026_09_28_155521.csv; metrics generated 2026-08-03.

← Back to the replications database