Bibliometric rankings of journals based on Impact Factors: An axiomatic approach
Journal of InformetricsPublished 3 November 2010Open access
Denis Bouyssou, Thierry Marchant
Citations71
SJR quartileQ1
SJR score1.32
SNIP1.79
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
An axiomatic analysis of Impact Factors when used as tools for ranking journals draws on the similarities between the problem of comparing distribution of citations among papers and that of comparing probability distributions on consequences as commonly done in decision theory.
Abstract
International audience
Keywords
Decision Sciences
Proceedings of the National Academy of SciencesAn index to quantify an individual's scientific research output
11,535 Citations2005J. E. Hirsch
The index hbar, defined as the number of papers of an individual that have citation count larger than or equal to the citation count of all coauthors of each paper, is proposed as a useful index to characterize the scientific output of a researcher that takes into account the effect of multiple authorship.
ScienceThe Matthew Effect in Science
6,270 Citations1968Robert Κ. Merton
The psychosocial conditions and mechanisms underlying the Matthew effect are examined and a correlation between the redundancy function of multiple discoveries and the focalizing function of eminent men of science is found—a function which is reinforced by the great value these men place upon finding basic problems and by their self-assurance.
PubMedThe Matthew effect in science. The reward and communication systems of science are considered.
4,872 Citations1968Robert Κ. Merton
Journal of Economic TheoryIncreasing risk: I. A definition
3,918 Citations1970Michael Rothschild, Joseph E. Stiglitz
ScienceCitation Analysis as a Tool in Journal Evaluation
2,760 Citations1972Eugene Garfield
In 1971, the Institute for Scientfic Information decided to undertake a systematic analysis of journal citation patterns across the whole of science and technology.
Operational Research Quarterly (1970-1977)Utility Theory for Decision Making
2,502 Citations1971Roger Adelson, Peter C. Fishburn
BMJWhy the impact factor of journals should not be used for evaluating research
2,448 Citations1997Per O. Seglen
ScientometricsTheory and practise of the g-index
2,302 Citations2006Leo Egghe
It is shown that the g-index inherits all the good properties of the h-index and better takes into account the citation scores of the top articles and yields a better distinction between and order of the scientists from the point of view of visibility.
ScientometricsIs citation analysis a legitimate evaluation tool?
906 Citations1979Eugene Garfield
It is concluded that as the scientific enterprise becomes larger and more complex, and its role in society more critical, it will become more difficult, expensive and necessary to evaluate and identify the largest contributors.
Management ScienceStochastic Dominance and Expected Utility: Survey and Analysis
853 Citations1992Haim Levy
Journal of the American Society for Information ScienceThe skewness of science
697 Citations1992Per O. Seglen
The citational variability between articles in a journal is less (semilog linearity) than in the corresponding field as a whole, suggesting that each journal represents a select, stratified sample of the field.
Stochastic Dominance: Investment Decision Making under Uncertainty
608 Citations2010Haim Levy
ScientometricsImpact of bibliometrics upon the science system: Inadvertent consequences?
598 Citations2005Peter Weingart
The core of the problem lies not necessarily at the side of the data producer, but part of the broader problem of the application of insufficiently developed bibliometric indicators used by persons who do not have clear competence and experience in the field of quantitative studies of science.
ScientometricsJournal impact measures in bibliometric research
564 Citations2002Wolfgang Glänzel, Henk F. Moed
It is shown that in contrast to a common misbelief statistical methods can be applied to discrete "skewed" distributions, and that the statistical reliability of these statistics can be used as a basis for application of journal impact measures in comparative analyses.
The Economic JournalNonlinear Preference and Utility Theory.
498 Citations1989Robert Sugden, Peter C. Fishburn
Journal of InformetricsInformetrics at the beginning of the 21st century—A review
442 Citations2008Judit Bar‐Ilan
This paper reviews developments in informetrics between 2000 and 2006 and sees considerable growth in webometrics, mapping and visualization and open access, and traditional topics like citation analysis and informetric theory continue to develop.
Journal of InformetricsTowards a new crown indicator: Some theoretical considerations
422 Citations2010Ludo Waltman, Nees Jan van Eck +3 more
This work critically examine the theoretical basis of the normalization mechanism applied in the crown indicator and makes a comparison with an alternativenormalization mechanism, which turns out to have more satisfactory properties than the mechanism applied.
Handbook of Utility Theory
391 Citations2004Salvador Barberà, Peter J. Hammond +1 more
ScientometricsHistory of the journal impact factor: Contingencies and consequences
326 Citations2009Éric Archambault, Vincent Larivière
The paper shows how the various building blocks of the dominant JIF came into being and argues that these building blocks were all constructed fairly arbitrarily or for different purposes than those that govern the contemporary use of the JIF.
EconometricaThe Measurement of Intellectual Influence
323 Citations2004Ignacio Palacios‐Huerta, Oscar Volij
Power Laws in the Information Production Process: Lotkaian Informetrics
292 Citations2005Leo Egghe
This book discusses Lotkaian Informetrics of Systems in which Items can have Multiple Sources and Construction of Fractional Size-Frequency Functions Based on Two Dual Lotka laws.
The Journal of Experimental MedicineShow me the data
283 Citations2007Mike Rossner, Heather Van Epps +1 more
The integrity of data, and transparency about their acquisition, are vital to science, and members of the community seem to have little understanding of how impact factors are determined, and, to the authors' knowledge, no one has independently audited the underlying data to validate their reliability.
Journal of Risk and UncertaintyNontransitive preferences in decision theory
249 Citations1991Peter C. Fishburn
Journal of the American Society for Information ScienceCausal relationship between article citedness and journal impact
241 Citations1994Per O. Seglen
The relationship between article citedness and journal impact was investigated on the basis of complete publication lists provided by 16 senior scientists from a major Norwegian biomedical research institute, and it was possible to observe a twofold ratio in citedness between the two groups throughout the journal impact range.
Journal of the American Society for Information Science and TechnologyThe impact factor's Matthew Effect: A natural experiment in bibliometrics
230 Citations2009Vincent Larivière, Yves Gingras
ScientometricsTowards a new crown indicator: an empirical analysis
224 Citations2011Ludo Waltman, Nees Jan van Eck +3 more
An empirical comparison between two normalization mechanisms for citation-based indicators of research performance aims to normalize citation counts for the field and the year in which a publication was published finds that at high aggregation levels, such as at the level of large research institutions or at thelevel of countries, the differences between the two mechanisms are very small.
Science CommunicationPeer Review for Journals as it Stands Today—Part 1
200 Citations1998Juan Miguel Campanario
It is difficult to imagine how science could advance without such a key quality control mechanism as peer review, the author concludes.
Journal of InformetricsCitations to scientific articles: Its distribution and dependence on the article features
174 Citations2009Elizabeth S. Vieira, J.A.N.F. Gomes
The aim of the work presented here is to show how citations are distributed within a scientific area and determine the dependence of the citation count on the article features.
Mathematical Social SciencesAn axiomatic characterization of the Hirsch-index
147 Citations2008Gerhard J. Woeginger
An axiomatic characterization of the Hirsch-index in terms of three natural axioms is presented, which is a well-known index for measuring and comparing the output of scientific researchers.
Science CommunicationPeer Review for Journals as it Stands Today—Part 2
134 Citations1998Juan Miguel Campanario
Measurement Interdisciplinary Research and PerspectivesMeasurement of Central Aspects of Scientific Research: Performance, Interdisciplinarity, Structure
111 Citations2005Anthony F. J. van Raan
ScientometricsAn axiomatic characterization of the ranking based on the h-index and some other bibliometric rankings of authors
103 Citations2009Thierry Marchant
A formal framework in which rankings can be axiomatically characterized is proposed and it is argued that such analyses can help the user of a ranking to choose one that is adequate in the context where she/he is working.
Journal of InformetricsAn axiomatic analysis of Egghe’s g-index
83 Citations2008Gerhard J. Woeginger
An axiomatic characterization of the g-index in terms of three natural axioms is given, which is an improvement of the Hirsch-index.
ScientometricsCharacteristics of journal impact factors: The effects of uncitedness and citation distribution on the understanding of journal impact factors
75 Citations2005Thed N. van Leeuwen, Henk F. Moed
It is shown that these aspects of journal impact measurement play a significant role, and are strongly inter-related, and the separation between journals on the basis of the differences in output volume seems to be relevant.
Journal of InformetricsCiting-side normalization of journal impact: A robust variant of the Audience Factor
74 Citations2010Michel Zitt
The variant proposed relies on the relative neighborhood of a citing journal, regarded as its micro-field and assumed to reflect the citation behavior in this area of science, which allows a large range of variation of the neighborhood, reflecting the local citation network, and partly alleviates the “cross-scale” normalization issue.
Journal of the American Society for Information Science and TechnologyScore‐based bibliometric rankings of authors
53 Citations2009Thierry Marchant
An axiomatic analysis of the family of all scoring rules and of some particular cases within this family of authors is presented.
Journal of InformetricsJournal influence factors
51 Citations2010Massimo Franceschet
Surprisingly, the eigenfactor is also the most variable indicator when computed across different fields of science and social science, while article influence is the most stable in this respect, and hence the most suitable metric to be used interdisciplinarily.
ScientometricsCompetition amongst scientists for publication status:Toward a model of scientific publication and citation distributions
47 Citations2001Anthony F. J. van Raan
It is concluded that this distribution of citation sover publications, which is a crucial phenomenon in scientometrics, is not a power law, but amodified Bessel-function.
Alternatives to Expected Utility: Foundations
46 Citations2004Robert Sugden
Journal of InformetricsA symmetry axiom for scientific impact indices
40 Citations2008Gerhard J. Woeginger
A new axiomatic characterization of the Hirsch-index is provided based on a simple and appealing symmetry axiom which essentially imposes that the number of citations and the number-of- publications should be treated in the same way and should be measured in the the same scale.
Journal of InformetricsMonotonicity and the Hirsch index
39 Citations2009Antonio Quesada
The Hirsch index is characterized, when indices are allowed to be real-valued, by adding to Woeginger's monotonicity two axioms in a way related to the concept ofmonotonicity.
Journal of InformetricsConsistent bibliometric rankings of authors and of journals
37 Citations2010Denis Bouyssou, Thierry Marchant
A pair of consistent rankings are presented (impact factor for the journals and total number of citations for the authors) and an axiomatic characterization of these rankings is provided.
Journal of InformetricsRankings of information and library science journals by JIF and by h-type indices
32 Citations2009Judit Bar‐Ilan
This paper compute journal rankings in the Information and Library Science JCR category according to the JIF and according to several h-type indices, finding Spearman's footrule and the M-measure that are more sensitive to the differences between the rankings.
Journal of InformetricsWoeginger's axiomatisation of the h-index and its relation to the g-index, the h(2)-index and the R2-index
25 Citations2008Ronald Rousseau
Journal of Mathematical EconomicsUtility theory based on rational probabilities
24 Citations1980J. C. Shepherdson
RePub (Erasmus University, Rotterdam)A Taxonomy of Bibliometric Performance Indicators Based on the Property of Consistency
13 Citations2009Ludo Waltman, Nees Jan van Eck
The h-index is shown not to have this important property of consistency, and a taxonomy of bibliometric indicators of scientific performance is proposed.
RePEc: Research Papers in EconomicsDominance relations and universities ranking
6 Citations2009Nicolas Carayol, Agénor Lahatte
arXiv (Cornell University)Towards a new crown indicator: An empirical analysis
5 Citations2010Ludo Waltman, Nees Jan van Eck +3 more
arXiv (Cornell University)Towards a new crown indicator: Some theoretical considerations
1 Citations2010Ludo Waltman, Nees Jan van Eck +3 more