In this study of access models, we compared citation performance in journals that do and do not levy article processing charges (APCs) as part of their business model. We used a sample of journals from the Directory of Open Access Journals (DOAJ) science class and its 13 subclasses and recorded four citation metrics: JIF, H-index, citations per publication (CPP) and quartile rank. We examined 1881 science journals indexed in DOAJ. Thomson Reuters Journal Citation Reports and Web of Science were used to extract JIF, H-index, CPP and quartile category. Overall, the JIF, H-index and CPP indicated that APC and non-APC open access (OA) journals had equal impact. Quartile category ranking indicated a difference in favour of APC journals. In each science subclass, we found significant differences between APC and non-APC journals in all citation metrics except for quartile rank. Discipline-related variations were observed in non-APC journals. Differences in the rank positions of scores in different groups identified citation advantages for non-APC journals in physiology, zoology, microbiology and geology, followed by botany, astronomy and general biology. Impact ranged from moderate to low in physics, chemistry, human anatomy, mathematics, general science and natural history. The results suggest that authors should consider field- and discipline-related differences in the OA citation advantage, especially when they are considering non-APC OA journals categorised in two or more subjects. This may encourage OA publishing at least in the science class.

References

[1] Björk, B-C, Welling, P, Laakso, M, et al . Open access to the scientific journal literature: situation 2009 . PLoS ONE 2010 ; 5(6): e11273.

Google Scholar Crossref

[2] Björk, B-C, Solomon, D. Developing an effective market for open access article processing charges , 2014 , https://wellcome.ac.uk/sites/default/files/developing-effective-market-for-open-access-article-processing-charges-mar14.pdf (accessed 1 March 2019).

Google Scholar

[3] Archambault, É, Amyot, D, Deschamps, P, et al . Proportion of open access papers published in peer-reviewed journals at the European and world levels – 1996–2013 , 2014, http://digitalcommons.unl.edu/cgi/viewcontent.cgi?article=1007&context=scholcom

Google Scholar

[4] Laakso, M, Welling, P, Bukvova, H, et al . The development of open access journal publishing from 1993 to 2009 . PLoS ONE 2011 ; 6(6): e20961 .

Google Scholar Crossref | Medline | ISI

[5] Lewis, DW. The inevitability of open access . College Res Lib 2012 ; 73(5): 493 – 506 .

Google Scholar Crossref

[6] Koler-Povh, T, Južnič, P, Turk, G. Impact of open access on citation of scholarly publications in the field of civil engineering . Scientometrics 2014 ; 98(2): 1033 – 1045 .

Google Scholar Crossref

[7] McCabe, M, Snyder, C. Identifying the effect of open access on citations using a panel of science journals . Econ Inquiry 2013 ; 52: 1284 – 1300 .

Google Scholar Crossref

[8] Koler-Povh, T, Turk, G, Južnič, P, et al . Does the open access business model have a significant impact on the citation of publications? Case study in the field of civil engineering . In: Journal publishing in developing, transition and emerging countries: proceedings of the 5th Belgrade international open access conference , 2012 , https://scholar.valpo.edu/cgi/viewcontent.cgi?article=1020&context=ccls_fac_pub

Google Scholar

[9] Laakso, M, Björk, BC. Delayed open access: an overlooked high-impact category of openly available scientific literature . J Assoc Inform Sci Tech 2013 ; 64(7): 1323 – 1329 .

Google Scholar Crossref

[10] Wohlrabe, K, Birkmeier, D. Do open access articles in economics have a citation advantage? 2014 , https://mpra.ub.uni-muenchen.de/56842/1/MPRA_paper_56842.pdf

Google Scholar

[11] Solomon, DJ, Laakso, M, Björk, B-C. A longitudinal comparison of citation rates and growth among open access journals . J Inform 2013 ; 7(3): 642 – 650 .

Google Scholar Crossref

[12] Björk, B-C, Solomon, D. Open access versus subscription journals: a comparison of scientific impact . BMC Med 2012 ; 10(1): 73 .

Google Scholar Crossref | Medline

[13] Erfanmanesh, M. Status and quality of open access journals in Scopus . Collect Build 2017 ; 36(4): 155 – 162 .

Google Scholar Crossref

[14] Gumpenberger, C, Ovalle-Perandones, M-A, Gorraiz, J. On the impact of gold open access journals . Scientometrics 2013 ; 96(1): 221 – 238 .

Google Scholar Crossref

[15] Eysenbach, G. Citation advantage of open access articles . PLoS Biol 2006 ; 4(5): e157 .

Google Scholar Crossref | Medline | ISI

[16] Shamash, K. Article processing charges (APCs) and subscriptions: Monitoring open access costs. Bristol : Jisc , 2016 .

Google Scholar

[17] Eve, MP. Open access and the humanities. Cambridge : Cambridge University Press , 2014 .

Google Scholar Crossref

[18] Rowley, J, Johnson, F, Sbaffi, L, et al . Academics’ behaviors and attitudes towards open access publishing in scholarly journals . J Assoc Inform Sci Tech 2017 ; 68: 1201 – 1211 .

Google Scholar Crossref | ISI

[19] Cullen, R, Chawner, B. Institutional repositories, open access, and scholarly communication: a study of conflicting paradigms . J Acad Libra 2011 ; 37(6): 460 – 470 .

Google Scholar Crossref

[20] Creaser, C. Open access to research outputs – institutional policies and researchers’ views: results from two complementary surveys . New Rev Acad Librar 2010 ; 16(1): 4 – 25 .

Google Scholar Crossref

[21] Solomon, DJ, Björk, BC. Publication fees in open access publishing: sources of funding and factors influencing choice of journal . J Assoc Inform Sci Tech 2012 ; 63(1): 98 – 107 .

Google Scholar Crossref

[22] Coonin, B, Younce, L (eds). Publishing in open access journals in the social sciences and humanities: who’s doing it and why . ACRL fourteenth national conference , 2009 , http://www.ala.org/acrl/sites/ala.org.acrl/files/content/conferences/confsandpreconfs/national/seattle/papers/85.pdf

Google Scholar

[23] Spezi, V, Fry, J, Creaser, C, et al . Researchers’ green open access practice: a cross-disciplinary analysis . J Document 2013 ; 69(3): 334 – 359 .

Google Scholar Crossref

[24] Fry, J, Oppenheim, C, Probets, S, et al . PEER behavioural research: authors and users vis-à-vis journals and repositories , 2009 , https://www.stm-assoc.org/2010_01_20_Final_revision_behavioural_baseline_report.pdf

Google Scholar

[25] Bird, C. Continued adventures in open access: 2009 perspective . Learn Pub 2010 ; 23(2): 107 – 116 .

Google Scholar Crossref

[26] Jamali, HR, Nicholas, D, Watkinson, A, et al . How scholars implement trust in their reading, citing and publishing activities: geographical differences . Lib Inform Sci Res 2014 ; 36(3–4): 192 – 202 .

Google Scholar Crossref

[27] Bollen, J, Van, de, Sompel, H, Hagberg, A, et al . A principal component analysis of 39 scientific impact measures . PLoS ONE 2009 ; 4(6): e6022 .

Google Scholar Crossref | Medline | ISI

[28] Seglen, PO. Why the impact factor of journals should not be used for evaluating research . BMJ 1997 ; 314(7079): 498 .

Google Scholar Crossref | Medline

[29] Leydesdorff, L, Bornmann, L, Comins, JA, et al . Citations: indicators of quality? The impact fallacy . Front Res Metr Anal 2016 ; 1: 1 .

Google Scholar Crossref

[30] Moed, HF. Toward new indicators of a journal’s manuscript peer review process . Front Res Metr Anal 2016 ; 1: 5 .

Google Scholar Crossref

[31] Swan, A. The open access citation advantage: studies and results to date , 2010 , https://eprints.soton.ac.uk/268516/

Google Scholar

[32] Norris, M, Oppenheim, C, Rowland, F. The citation advantage of open-access articles . J Assoc Inform Sci Tech 2008 ; 59(12): 1963 – 1972 .

Google Scholar Crossref

[33] Frisch, NK, Nathan, R, Ahmed, YK, et al . Authors attain comparable or slightly higher rates of citation publishing in an open access journal (CytoJournal) compared to traditional cytopathology journals-A five year (2007–2011) experience . CytoJournal 2014 ; 11: 10 .

Google Scholar Crossref | Medline

[34] Piwowar, HA, Vision, TJ. Data reuse and the open data citation advantage . PeerJ 2013 ; 1: e175 .

Google Scholar Crossref | Medline

[35] Donovan, JM, Watson, CA, Osborne, C. The open access advantage for American law reviews . J Pat Trademark Off Soc 2015 ; 97: 4 .

Google Scholar

[36] Atchison, A, Bull, J. Will open access get me cited? An analysis of the efficacy of open access publishing in political science . Politic Sci Politics 2015 ; 48(1): 129 – 137 .

Google Scholar Crossref

[37] Mueller-Langer, F, Watt, R. The hybrid open access citation advantage: how many more cites is a $3,000 fee buying you? 2014 , https://www.researchgate.net/publication/272305315_The_Hybrid_Open_Access_Citation_Advantage_How_Many_More_Cites_is_a_3000_Fee_Buying_You

Google Scholar

[38] Kullman, L (ed.). The effect of Open Access on citation rates of self-archived articles at Chalmers. In: IATUL 2014–35th annual conference–Aalto University , Espoo , .

Google Scholar

[39] Aman, V. The potential of preprints to accelerate scholarly communication-A bibliometric analysis based on selected journals , 2013 , https://arxiv.org/abs/1306.4856

Google Scholar

[40] Kim, HH. The effect of free access on the diffusion of scholarly ideas , 2012 , http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.648.9681&rep=rep1&type=pdf

Google Scholar

[41] Wang, X, Liu, C, Mao, W, et al . The open access advantage considering citation, article usage and social media attention . Scientometrics 2015 ; 103(2): 555 – 564 .

Google Scholar Crossref

[42] Björk, B-C, Solomon, D. Article processing charges in OA journals: relationship between price and quality . Scientometrics 2015 ; 103(2): 373 – 385 .

Google Scholar Crossref

[43] Corbyn, Z. Price doesn’t always buy prestige in open access . Nature, 2013 , https://www.nature.com/news/price-doesn-t-always-buy-prestige-in-open-access-1.12259

Google Scholar

[44] McCabe, M, Snyder, C. The best business model for scholarly journals: an economist’s perspective . Nature, July 2004 ; 15, https://www.nature.com/nature/focus/accessdebate/28.html

Google Scholar

[45] Ennas, G, Di Guardo, MC. Features of top-rated gold open access journals: an analysis of the scopus database . J Inform 2015 ; 9(1): 79 – 89 .

Google Scholar Crossref

[46] Shen, C-C, Hu, Y-H, Lin, W-C, et al . Research impact of general and funded papers: a citation analysis of two ACM international conference proceeding series . Online Inform Rev 2016 ; 40(4): 472 – 480 .

Google Scholar Crossref

[47] García, JA, Rodriguez-Sánchez, R, Fdez-Valdivia, J, et al . On first quartile journals which are not of highest impact . Scientometrics 2011 ; 90(3): 925 – 943 .

Google Scholar Crossref

[48] Yi, H, Ao, X, Ho, Y-S. Use of citation per publication as an indicator to evaluate pentachlorophenol research . Scientometrics 2008 ; 75(1): 67 – 80 .

Google Scholar Crossref

[49] Bornmann, L, Marx, W. Methods for the generation of normalized citation impact scores in bibliometrics: which method best reflects the judgements of experts? J Inform 2015 ; 9(2): 408 – 418 .

Google Scholar Crossref

[50] Xu, L, Liu, J, Fang, Q, et al . Analysis on open access citation advantage: an empirical study based on Oxford open journals . In: Proceedings of the 2011 iConference , Seattle, WA , . New York : ACM .

Google Scholar

[51] Davis, PM. Does open access lead to increased readership and citations? A randomized controlled trial of articles published in APS journals . Physiologist 2010 ; 53(6): 197 – 201 .

Google Scholar Medline

[52] Henneken, EA, Kurtz, MJ, Eichhorn, G, et al . Effect of e-printing on citation rates in astronomy and physics , 2006 , https://arxiv.org/abs/cs/0604061

Google Scholar

[53] Kurtz, MJ, Henneken, EA. Open access does not increase citations for research articles from The Astrophysical Journal , 2007 , https://arxiv.org/abs/0709.0896

Google Scholar

[54] Metcalfe, TS. The rise and citation impact of astro-ph in major journals , 2005 , https://arxiv.org/abs/astro-ph/0503519

Google Scholar

[55] Gargouri, Y, Hajjem, C, Larivière, V, et al . Self-selected or mandated, open access increases citation impact for higher quality research . PLoS ONE 2010 ; 5(10): e13636 .

Google Scholar Crossref | Medline | ISI

[56] Cheng, W, Ren, S. Evolution of open access publishing in Chinese scientific journals . Learn Pub 2008 ; 21(2): 140 – 152 .

Google Scholar Crossref

[57] Bordons, M, Fernández, M, Gómez, I. Advantages and limitations in the use of impact factor measures for the assessment of research performance . Scientometrics 2002 ; 53(2): 195 – 206 .

Google Scholar Crossref

[58] Sharma, M, Sarin, A, Gupta, P, et al . Journal impact factor: its use, significance and limitations . World J Nucl Med 2014 ; 13(2): 146 .

Google Scholar Crossref | Medline

[59] Bornmann, L, Marx, W, Gasparyan, AY, et al . Diversity, value and limitations of the journal impact factor and alternative metrics . Rheumatol Int 2012 ; 32(7): 1861 – 1867 .

Google Scholar Crossref | Medline | ISI

[60] Costas, R, Bordons, M. The H-index: advantages, limitations and its relation with other bibliometric indicators at the micro level . J Inform 2007 ; 1(3): 193 – 203 .

Google Scholar Crossref | ISI