Universality of citation distributions–A validation of Radicchi et al.'s relative indicator <i>c</i><sub><i>f</i></sub> = <i>c</i>/<i>c</i><sub>0</sub> at the micro level using data from chemistry
Journal of the American Society for Information Science and TechnologyPublished 13 April 2009
Lutz Bornmann, Hans‐Dieter Daniel
Citations37
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
Abstract In a recently published PNAS paper, Radicchi, Fortunato, and Castellano (2008) propose the relative indicator c f as an unbiased indicator for citation performance across disciplines (fields, subject areas). To calculate c f , the citation rate for a single paper is divided by the average number of citations for all papers in the discipline in which the single paper has been categorized. c f values are said to lead to a universality of discipline‐specific citation distributions. Using a comprehensive dataset of an evaluation study on Angewandte Chemie International Edition (AC‐IE), we tested the advantage of using this indicator in practical application at the micro level, as compared with (1) simple citation rates, and (2) z ‐scores, which have been used in psychological testing for many years for normalization of test scores. To calculate z ‐scores, the mean number of citations of the papers within a discipline is subtracted from the citation rate of a single paper, and the difference is then divided by the citations' standard deviation for a discipline. Our results indicate that z ‐scores are better suited than c f values to produce universality of discipline‐specific citation distributions.
Keywords
Decision SciencesArts and Humanities
Journal of DocumentationWhat do citation counts measure? A review of studies on citing behavior
1,531 Citations2008Lutz Bornmann, Hans‐Dieter Daniel
The general tendency of the results of the empirical studies makes it clear that citing behavior is not motivated solely by the wish to acknowledge intellectual and cognitive influences of colleague scientists, since the individual studies reveal also other, in part non‐scientific, factors that play a part in the decision to cite.
Information science and knowledge managementCitation Analysis in Research Evaluation
1,319 Citations2005Henk F. Moed
This work focuses on assessing Basic Science Research Departments and Scientific Journals, as well as Empirical and Theoretical Chapters, and the Citation Indexes, which summarize the literature on empirical and theoretical determinants of scientific research.
Proceedings of the National Academy of SciencesUniversality of citation distributions: Toward an objective measure of scientific impact
834 Citations2008Filippo Radicchi, Santo Fortunato +1 more
It is shown that the probability that an article is cited c times has large variations between different disciplines, but all distributions are rescaled on a universal curve when the relative indicator cf = c/c0 is considered, where c0 is the average number of citations per article for the discipline.
ScientometricsRelative indicators and relational charts for comparative assessment of publication output and citation impact
461 Citations1986A. Schubert, T. Braun
Journal of InformetricsDo open access articles have greater citation impact?A critical review of the literature
374 Citations2007Iain Craig, Andrew Plume +3 more
The most rigorous study to date showed that, after controlling for the early view postulate, the remaining difference in citation counts between OA and non-OA articles is explained by the selection bias postulate.
Ethics in Science and Environmental PoliticsCitation counts for research evaluation: standards of good practice for analyzing bibliometric data and presenting and interpreting results
361 Citations2007Lutz Bornmann, Rüdiger Mutz +2 more
Journal of InformetricsLifting the crown—citation z-score
273 Citations2007Jonas Lundberg
An item oriented field normalized citation score average (c¯f) is an incremental improvement as it differs from the crown indicator in so much as normalization takes place on the level of individual publication (or item) rather than on aggregated levels, and therefore assigns equal weight to each publication.
Europhysics Letters (EPL)The first-mover advantage in scientific publication
192 Citations2009M. E. J. Newman
It is suggested that some later-published papers, albeit only a small fraction, that buck the trend and attract significantly more citations than theory predicts are probably worthy of the authors' attention.
Research EvaluationPeer reviews and bibliometric indicators: a comparative study at a Norwegian university
177 Citations2004Dag W. Aksnes, Randi Elisabeth Taxt
ScientometricsEvaluation of some methods for the relative assessment of scientific publications
160 Citations1986Péter Vinkler
A new bibliometric indicator, “relative subfield impact”, is introduced which compares the number of citations received by papers of a research unit to the average sub field impact factor.
PLoS ONEDoes the Committee Peer Review Select the Best Applicants for Funding? An Investigation of the Selection Process for Two European Molecular Biology Organization Programmes
116 Citations2008Lutz Bornmann, Gerlind Wallon +1 more
The results show a statistically significant association between selection decisions and the applicants' scientific achievements, if quantity and impact of research publications are used as a criterion for scientific achievement.
ScientometricsThe significance of the number of highly cited papers as an indicator of scientific prolificacy
72 Citations1990R. Plomp
An analysis of the distribution of HCPs over the years provides support for the claim that the number of highly cited papers has some advantages as an indicator of an author's scientific impact.
Angewandte Chemie International EditionThe Effectiveness of the Peer Review Process: Inter‐Referee Agreement and Predictive Validity of Manuscript Refereeing at <i>Angewandte Chemie</i>
69 Citations2008Lutz Bornmann, Hans‐Dieter Daniel
The quality of peer review at Angewandte Chemie is examined according to the criteria of reliability (agreement among referees) and predictive validity, using an optimized study design and modern methods of statistical data analysis.
Journal of the American Society for Information Science and TechnologySelecting manuscripts for a high‐impact journal through peer review: A citation analysis of communications that were accepted by <i>Angewandte Chemie International Edition</i>, or rejected but published elsewhere
69 Citations2008Lutz Bornmann, Hans‐Dieter Daniel
IEEE Transactions on Engineering ManagementProgrammatic evaluation and comparison based on standardized citation scores
66 Citations1983Paul R. McAllister, Francis Narin +1 more
A methodology is proposed for standardizing citation counts that allows them to be directly compared for individuals working in different time frames and in different subject areas to provide large-scale evaluations at relatively low cost.
ScientometricsMedian and percentile impact factors: A set of new indicators
63 Citations2005Ronald Rousseau
The idea introduced by Sombatsompop, Markpin and Premkamolnetr has a great theoretical value as they are the first ones to consider impact factors not using years as a basic ingredient, but an element of the actual form of the citation curve.
ScientometricsRelations of relative scientometric impact indicators. The relative publication strategy index
54 Citations1997Péter Vinkler
The findings indicate that publishing in journals with relatively high impact factor is a necessary but not sufficient condition for attaining a high RW index.
Learned PublishingThe luck of the referee draw: the effect of exchanging reviews
53 Citations2009Lutz Bornmann, Hans‐Dieter Daniel
This study tested what would have happened if referee reports had been received in a different order and found that 23% of manuscripts for which a third referee report arrived after the editorial decision was made would have led to a different decision if the third report had replaced either of the others.
ScientometricsA new reference standard for citation analysis in chemistry and related fields based on the sections of Chemical Abstracts
52 Citations2008Christoph Neuhaus, Hans‐Dieter Daniel
Overall, the sections of Chemical Abstracts seem to be a promising basis for reference standards in chemistry and related fields for four reasons: The wider coverage of the pertinent literature, the quality of indexing, the assignment of papers published in multidisciplinary and general journals to their respective fields, and the resolution of fields on a lower level.
The Stata Journal Promoting communications on statistics and StataSpeaking Stata: Graphing Distributions
24 Citations2004Nicholas J. Cox
For plotting histogram-like displays, kernel-density estimates and plots based on distribution functions or quantile functions, a large variety of choices is now available to the researcher.
DIGITAL.CSIC (Spanish National Research Council (CSIC))The b index as a measure of scientific excellence. A promising supplement to the h index
14 Citations2007Lutz Bornmann, Ruediger Mutz +1 more
The b index is proposed as a measure of scientific excellence at the micro and meso levels, as a promising supplement to the h index and its variants (such as g index and R index).