Citation analysis for measuring the value of scientific publications: quality assessment tool or comedy of errors?

It is concluded that citation analysis, even when based on Journal impact factors, can be a worthwhile criterion for evaluating publication records of individual scientists or research units, as long as some of the problems discussed are sufficiently taken into account.

Abstract

The basic concepts of citation analysis and journal impact factors are discussed in the light of quality assessment of scientific publications, individual scientists and research units. The major controversies concerning this topic are addressed: technical limitations, database selectivity, time and discipline-related biases, language and publication type biases, multiple authorship merits and citing motivations. Both positive and negative aspects are put into perspective. The authors conclude that citation analysis, even when based on journal impact factors, can be a worthwhile criterion for evaluating publication records of individual scientists or research units, as long as some of the problems discussed are sufficiently taken into account. However, this conclusion in no way implies that citation analysis may be considered as the one and only evaluation criterion.