Replication Rate by Journal OpenAlex 2-Year Mean Citedness

OpenAlex 2-year mean citedness is a single current snapshot from the OpenAlex API (as of 2026), so it does not vary by publication year; the basis is fixed to that snapshot.

Rate = success / (success + failure + reversal); inconclusive and unrecorded outcomes excluded, where success means the outcome recorded in the database. Unit: replication effect (n = 6,931 — originals whose journal is matched in the impact-factor dataset). How this is defined.

4,462 papers plotted · 456 excluded (no recent impact factor) · 838 excluded (inconclusive outcome)

Replication rate by OpenAlex 2-year mean citedness quintile

0%25%50%75%100%IF 0.1–1.8: 62.3% replicated (556/892), cluster-bootstrap 95% CI [58–66%]62%0.1–1.8n=892IF 1.8–2.8: 60.4% replicated (539/892), cluster-bootstrap 95% CI [53–64%]60%1.8–2.8n=892IF 2.8–3.7: 58.9% replicated (526/893), cluster-bootstrap 95% CI [58–69%]59%2.8–3.7n=893IF 3.7–6.5: 54.8% replicated (489/892), cluster-bootstrap 95% CI [48–63%]55%3.7–6.5n=892IF 6.5–1575: 49.0% replicated (438/893), cluster-bootstrap 95% CI [44–54%]49%6.5–1575n=893Journal OpenAlex 2-year mean citedness in 2026 (quintile range)Replication rate (%)The Metascience Observatory

All papers with a publication-year impact factor, split into five equal-count bins. Hover a bar for its journal-cluster bootstrap 95% interval.

Replication rate by OpenAlex 2-year mean citedness

0%25%50%75%100%IF 0.0–4.0: 60.6% replicated (1720/2836), cluster-bootstrap 95% CI [58–63%]61%0–4n=2836IF 4.0–8.0: 52.6% replicated (480/912), cluster-bootstrap 95% CI [46–62%]53%4–8n=912IF 8.0–12: 50.4% replicated (118/234), cluster-bootstrap 95% CI [42–60%]50%8–12n=234IF 12–16: 52.7% replicated (58/110), cluster-bootstrap 95% CI [35–63%]53%12–16n=110IF 16–1575: 46.5% replicated (172/370), cluster-bootstrap 95% CI [39–52%]46%16+n=370Journal OpenAlex 2-year mean citedness in 2026Replication rate (%)The Metascience Observatory

The same papers as above, grouped into equal-width impact-factor intervals (the top bin is a catch-all for IF ≥ 16). Unlike the equal-count quintiles, this shows the trend against a true impact-factor scale; most papers fall in the low bins.

Per-journal replication rate vs OpenAlex 2-year mean citedness

0%25%50%75%100%151015202530Journal of Experimental Psychology: Learning, Memory, and Cognition OpenAlex 2-year mean citedness: 1.1 Replication rate: 62% (n=53), 95% CI [49–74%]Neurology OpenAlex 2-year mean citedness: 1.1 Replication rate: 47% (n=15), 95% CI [25–70%]Biological Psychiatry OpenAlex 2-year mean citedness: 1.2 Replication rate: 74% (n=34), 95% CI [57–85%]Journal of Experimental Social Psychology OpenAlex 2-year mean citedness: 1.6 Replication rate: 41% (n=29), 95% CI [26–59%]Vision Research OpenAlex 2-year mean citedness: 1.9 Replication rate: 67% (n=15), 95% CI [42–85%]Journal of Experimental Psychology: General OpenAlex 2-year mean citedness: 2.0 Replication rate: 51% (n=63), 95% CI [39–63%]Personality and Individual Differences OpenAlex 2-year mean citedness: 2.1 Replication rate: 81% (n=16), 95% CI [57–93%]Journal of Consulting and Clinical Psychology OpenAlex 2-year mean citedness: 2.2 Replication rate: 63% (n=19), 95% CI [41–81%]Neuropsychologia OpenAlex 2-year mean citedness: 2.2 Replication rate: 75% (n=20), 95% CI [53–89%]Developmental Science OpenAlex 2-year mean citedness: 2.6 Replication rate: 53% (n=15), 95% CI [30–75%]Cortex OpenAlex 2-year mean citedness: 2.7 Replication rate: 47% (n=15), 95% CI [25–70%]Journal of Applied Behavior Analysis OpenAlex 2-year mean citedness: 2.7 Replication rate: 84% (n=44), 95% CI [71–92%]Cognition OpenAlex 2-year mean citedness: 2.8 Replication rate: 48% (n=58), 95% CI [36–61%]Journal of Personality and Social Psychology OpenAlex 2-year mean citedness: 2.8 Replication rate: 42% (n=149), 95% CI [35–50%]Personality and Social Psychology Bulletin OpenAlex 2-year mean citedness: 2.8 Replication rate: 55% (n=22), 95% CI [35–73%]Psychonomic Bulletin & Review OpenAlex 2-year mean citedness: 2.8 Replication rate: 46% (n=28), 95% CI [30–64%]Human Molecular Genetics OpenAlex 2-year mean citedness: 2.8 Replication rate: 42% (n=33), 95% CI [27–59%]PLOS One OpenAlex 2-year mean citedness: 2.9 Replication rate: 54% (n=87), 95% CI [44–64%]Schizophrenia Research OpenAlex 2-year mean citedness: 2.9 Replication rate: 72% (n=18), 95% CI [49–88%]Journal of Memory and Language OpenAlex 2-year mean citedness: 2.9 Replication rate: 70% (n=20), 95% CI [48–85%]Journal of Cognitive Neuroscience OpenAlex 2-year mean citedness: 3.1 Replication rate: 47% (n=19), 95% CI [27–68%]Frontiers in Psychology OpenAlex 2-year mean citedness: 3.3 Replication rate: 62% (n=21), 95% CI [41–79%]Journal of Experimental Psychology: Human Perception and Performance OpenAlex 2-year mean citedness: 3.5 Replication rate: 70% (n=27), 95% CI [52–84%]Journal of Neuroscience OpenAlex 2-year mean citedness: 3.8 Replication rate: 55% (n=20), 95% CI [34–74%]NeuroImage OpenAlex 2-year mean citedness: 3.8 Replication rate: 79% (n=29), 95% CI [62–90%]Cerebral Cortex OpenAlex 2-year mean citedness: 3.9 Replication rate: 47% (n=17), 95% CI [26–69%]PLoS Genetics OpenAlex 2-year mean citedness: 4.1 Replication rate: 37% (n=19), 95% CI [19–59%]Scientific Reports OpenAlex 2-year mean citedness: 4.6 Replication rate: 75% (n=24), 95% CI [55–88%]Annals of Neurology OpenAlex 2-year mean citedness: 4.8 Replication rate: 21% (n=19), 95% CI [9–43%]Organizational Behavior and Human Decision Processes OpenAlex 2-year mean citedness: 5.2 Replication rate: 41% (n=17), 95% CI [22–64%]Psychological Science OpenAlex 2-year mean citedness: 5.5 Replication rate: 40% (n=229), 95% CI [34–47%]Current Biology OpenAlex 2-year mean citedness: 5.7 Replication rate: 63% (n=24), 95% CI [43–79%]American Journal of Human Genetics OpenAlex 2-year mean citedness: 6.7 Replication rate: 32% (n=34), 95% CI [19–49%]Journal of Consumer Research OpenAlex 2-year mean citedness: 7.0 Replication rate: 25% (n=36), 95% CI [14–41%]American Journal of Psychiatry OpenAlex 2-year mean citedness: 7.5 Replication rate: 83% (n=24), 95% CI [64–93%]Proceedings of the National Academy of Sciences OpenAlex 2-year mean citedness: 8.0 Replication rate: 52% (n=90), 95% CI [42–62%]Molecular Psychiatry OpenAlex 2-year mean citedness: 8.2 Replication rate: 38% (n=40), 95% CI [24–53%]Neuron OpenAlex 2-year mean citedness: 12.9 Replication rate: 53% (n=15), 95% CI [30–75%]American Economic Review OpenAlex 2-year mean citedness: 13.7 Replication rate: 55% (n=55), 95% CI [42–67%]Nature Communications OpenAlex 2-year mean citedness: 16.2 Replication rate: 37% (n=27), 95% CI [22–56%]Nature Genetics OpenAlex 2-year mean citedness: 17.0 Replication rate: 53% (n=117), 95% CI [44–62%]Nature OpenAlex 2-year mean citedness: 17.6 Replication rate: 44% (n=54), 95% CI [32–58%]The Quarterly Journal of Economics OpenAlex 2-year mean citedness: 18.3 Replication rate: 53% (n=17), 95% CI [31–74%]Science OpenAlex 2-year mean citedness: 19.5 Replication rate: 43% (n=86), 95% CI [33–54%]New England Journal of Medicine OpenAlex 2-year mean citedness: 28.8 Replication rate: 50% (n=18), 95% CI [29–71%]NeuronAm. Econ. ReviewNature CommunicationsNature GeneticsNatureQuarterly Journal of EconomicsScienceNEJMJournal OpenAlex 2-year mean citedness in 2026Replication rate (%)The Metascience ObservatoryWilson 95%Confidence Interval

One point per journal with at least 15 plotted papers. Point size reflects the number of papers; whiskers are 95% Wilson CIs.

Metric sources. The 2-year and 5-year impact factors and the CiteScore-style 4-year metric are self-computed from the SciSciNet-v2 / OpenAlex citation graph — not the official Clarivate Journal Impact Factor™ or Scopus CiteScore, which are proprietary. They differ from the vendor figures in two ways that pull in opposite directions. Their denominator counts every document a venue publishes, where the real JIF counts only “citable items” (articles and reviews), so journals carrying heavy front matter or conference abstracts are pushed down sharply — the effect is severe enough that Cancer Research, which publishes thousands of meeting abstracts, lands near 0.6. Their numerator, meanwhile, draws on a broader citation graph than Web of Science, which pushes figures up. Deflation usually wins: against the citable-denominator metric below, 85% of journals here come out lower (median ratio 0.80), but 12% come out higher. Treat them as internally consistent relative indicators rather than as JIF estimates, and prefer the citable-denominator metric when comparing across journals of different types. OpenAlex 2-year mean citedness is OpenAlex’s own published impact-factor-like metric, fetched from the OpenAlex API as a single current snapshot (it does not vary by year). SCImago SJR is a prestige-weighted metric (citations weighted by the citing journal’s standing) taken per publication year from SCImago; papers before 1999 use the 1999 ranking. Citations per citable document (SCImago, 3-yr) is a CiteScore-style ratio — SCImago’s Total Citations (3 years) divided by its Citable Docs (3 years) — per publication year (pre-1999 uses 1999). Because its denominator counts only citabledocuments (excluding news, editorials and other front-matter), it is normalized like the real JIF/CiteScore and, unlike the self-computed IFs above, does not deflate high-front-matter journals such as Nature and Science.

Matching. Journal names in the replications database are matched to the impact-factor dataset by normalized name; SCImago SJR is joined by ISSN with a name fallback (~94% of matched journals). Books, preprints, and conference proceedings have no journal metric and are excluded.

Attribution. SJR data: SCImago, (n.d.). SJR — SCImago Journal & Country Rank [Portal], retrieved from scimagojr.com (used non-commercially). OpenAlex data is CC0.

Data: replications_database_2026_08_01_120356.csv; metrics generated 2026-08-03.

← Back to the replications database