Abstract
Citation distributions are extremely skewed. This paper addresses the following question: To what extent are national citation indicators influenced by a small minority of highly cited articles? This question has not been studied before at the level of national indicators. Using the scientific production of Norway as a case, we find that the average citation rates in major subfields are highly determined by one or only a few highly cited papers. Furthermore, there are large annual variations in the influence of highly cited papers on the average citation rate of the subfields. We conclude that an analysis of the underlying data for national indicators may be useful in creating awareness towards the occurrence of particular articles with great influence on what is normally considered an indicator of “national performance”, and that the common interpretation of the indicator on research policy level needs to be informed by this fact.
Similar content being viewed by others
References
D. J. De Solla Price, Networks of scientific papers, Science, 149 (1965) 510-515.
P. O. Seglen, The skewness of science, Journal of the American Society for Information Science, 43 (1992) 628-638.
W. GlÄnzel, Science in Scandinavia: A bibliometric approach, Scientometrics, 48 (2000) 121-150.
H. F. Moed, T. N. Van Leeuwen, J. Reedijk, Towards appropriate indicators of journal impact, Scientometrics, 46 (1999) 575-589.
E. Garfield, The use of journal impact factors and citation analysis for evaluation of science, Paper presented at the 41st Annual Meeting of the Council of Biology Editors, Salt Lake City (1998), available at: http://www.garfield.library.upenn.edu/papers/eval_of_science_CBE(Utah).html
National Science Board, Science and Engineering Indicators — 2002. National Science Foundation, Arlington 2002.
D. W. Aksnes, Characteristics of highly cited papers, Research Evaluation, 12(3) (2003).
European Commission, Third European Report on Science & Technology Indicators 2003, Brussels 2003.
P. O. Seglen, Causal relationship between article citedness and journal impact, Journal of the American Society for Information Science, 45 (1994) 1-11.
B. R. Martin, J. Irvine, Assessing basic research: Some partial indicators of scientific progress in radio astronomy, Research Policy, 12 (1983) 61-90.
R. Plomp, The highly cited papers of professors as an indicator of a research group's scientific performance, Scientometrics, 29 (1994) 377-393.
B. R. Martin, The use of multiple indicators in the assessment of basic research, Scientometrics, 36 (1996) 343-362.
R. J. W. Tijssen, M. S. Visser, T. N. Van Leeuwen, Benchmarking international scientific excellence: Are highly cited research papers an appropriate frame of reference? Scientometrics, 54 (2002) 381-397.
European Commission, Key Figures 2001. Special Edition. Indicators for Benchmarking of National Research Policies. Brussels 2001.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Aksnes, D.W., Sivertsen, G. The effect of highly cited papers on national citation indicators. Scientometrics 59, 213–224 (2004). https://doi.org/10.1023/B:SCIE.0000018529.58334.eb
Issue Date:
DOI: https://doi.org/10.1023/B:SCIE.0000018529.58334.eb