Comments on a critique of the Thomson Reuters journal impact factor
ScientometricsPublished 14 March 2012
David Pendlebury, Jonathan Adams
Citations46
SJR quartileQ1
SJR score1.15
SNIP1.82
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
Abstract We discuss research evaluation, the nature of impact, and the use of the Thomson Reuters journal impact factor and other indicators in scientometrics in the light of recent commentary.
Keywords
Computer ScienceDecision Sciences
Proceedings of the National Academy of SciencesAn index to quantify an individual's scientific research output
11,535 Citations2005J. E. Hirsch
The index hbar, defined as the number of papers of an individual that have citation count larger than or equal to the citation count of all coauthors of each paper, is proposed as a useful index to characterize the scientific output of a researcher that takes into account the effect of multiple authorship.
ScienceCitation Analysis as a Tool in Journal Evaluation
2,760 Citations1972Eugene Garfield
In 1971, the Institute for Scientfic Information decided to undertake a systematic analysis of journal citation patterns across the whole of science and technology.
Information science and knowledge managementCitation Analysis in Research Evaluation
1,319 Citations2005Henk F. Moed
This work focuses on assessing Basic Science Research Departments and Scientific Journals, as well as Empirical and Theoretical Chapters, and the Citation Indexes, which summarize the literature on empirical and theoretical determinants of scientific research.
ScientometricsFatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods
754 Citations2005Anthony F. J. van Raan
A system of input, output, and efficiency indicators is sketched out, with each indicator related to basic research, applied research, and experimental development and inspired by empirical innovation economics.
American DocumentationNew factors in the evaluation of scientific literature through citation indexing
433 Citations1963Eugene Garfield, Irving H. Sher
The Citation Index Project will be described briefly, and new methods of using citation data for evaluation of publications will be discussed, andSummaries of statistical data, compiled by computer methods such as the following, will be given.
ScientometricsImpact factor: outdated artefact or stepping-stone to journal certification?
374 Citations2011Jerome K. Vanclay
There are indications that the scientific community seeks and needs better certification of journal procedures to improve the quality of published science and comprehensive certified editorial and review procedures could help ensure adequate procedures to detect duplicate and fraudulent submissions.
The Journal of Experimental MedicineShow me the data
283 Citations2007Mike Rossner, Heather Van Epps +1 more
The integrity of data, and transparency about their acquisition, are vital to science, and members of the community seem to have little understanding of how impact factors are determined, and, to the authors' knowledge, no one has independently audited the underlying data to validate their reliability.
Archivum Immunologiae et Therapiae ExperimentalisThe use and misuse of journal metrics and other citation indicators
225 Citations2009David Pendlebury
The nature and use of the journal impact factor and other common bibliometric measures for assessing research in the sciences and social sciences based on data compiled by Thomson Reuters are reviewed to help government policymakers, university administrators, and individual researchers become better acquainted with the potential benefits and limitations of bibliometrics in the evaluation of research.
Journal of the American Society for Information Science and TechnologyIntegrated impact indicators compared with impact factors: An alternative research design with policy implications
174 Citations2011Loet Leydesdorff, Lutz Bornmann
I3 is compared with IFs for the journals in two Institute for Scientific Information subject categories (“Information Science & Library Science” and “Multidisciplinary Sciences”), and the library and information science set is additionally decomposed in terms of nations.
ScientometricsEarly citation counts correlate with accumulated impact
158 Citations2005Jonathan Adams
There is a statistically highly significant correlation between initial (years 1-2) and later (years 3-10) citations in six research categories across the life and physical sciences and it seems reasonable to conclude that leading indicators of research excellence could be developed.
Transnational Corporation ReviewThe Thomson Reuters Journal Selection Process
152 Citations2009James Testa
A detailed description of the Thomson Reuters Journal Selection Process, which evaluates many criteria, including timeliness of publication, adherence to international editorial conventions, and English language bibliographic information, is included.
NatureSignificant journals of science
106 Citations1976Eugene Garfield
Results of an analysis of more than 5 million citations in the references of journal articles indexed for the SCI in 1974 are presented and an attempt is made to interpret of those results in the light of an earlier study of 1969 citations.
Archivum Immunologiae et Therapiae ExperimentalisThe use of bibliometrics to measure research quality in UK higher education institutions
103 Citations2009Jonathan Adams
Research assessment in the UK has evolved over a quarter of a century from a loosely structured, peer-review based process to one with a well understood data portfolio and assessment methodology, but the shift from peer assessment to a quantitative methodology raises critical issues about which metrics are appropriate and informative and how such metrics should be managed to produce weighting factors for funding formulae.
ScientometricsAlternatives to the journal impact factor: I3 and the top-10% (or top-25%?) of the most-highly cited papers
81 Citations2012Loet Leydesdorff
A proportion of most-highly cited papers (the top-10% or top-quartile) on the basis of fractional counting of the citations may provide an alternative to the current IF.
College & Research LibrariesAccuracy of Cited References: The Role of Citation Databases
67 Citations2006R. A. Buchanan
The nature and extent of errors made by Science Citation Index Expanded TM and SciFinder ® Scholar TM during data entry have been characterized by analysis of more than 5,400 cited articles from 204 randomly selected cited-article lists published in three core chemistry journals.
ScientometricsEmpirical study of journal impact factors obtained using the classical two-year citation window versus a five-year citation window
61 Citations2010Juan Miguel Campanario
The results suggest that gains in JIF with the longer citation window tend to distribute similarly in all years, and changes in these gains also tend to distributed similarly from 1 year to the following year.
ScientometricsProfiling citation impact: A new methodology
43 Citations2007Jonathan Adams, Karen Gurney +1 more
The value of impact profiles lies in their role as an interpretive aid for non-specialists, not as a technical transformation of the data for scientometricians.
Journal of the American Society for Information Science and TechnologySpecial features of historical papers from the viewpoint of bibliometrics
42 Citations2011Werner Marx
This paper deals with the specific features of historical papers relevant for information retrieval and bibliometrics based mainly on the citation indexes accessible under the Web of Science but also on field-specific databases: the Chemical Abstracts Service literature database and the INSPEC database.
ScientometricsThe impact factor: its place in Garfield’s thought, in science evaluation, and in library collection management
25 Citations2011Stephen J. Bensman
It is argued here that Vanclay's analysis is itself seriously flawed, because he appears totally ignorant of the thought structure of Eugene Garfield, IF’s creator, and abandoning the measure would be counterproductive because of its demonstrated ability to identify small important journals like review journals, giving it an important role in science evaluation and library collection management.
Learned PublishingCasting a wide net: the Journal Impact Factor numerator
25 Citations2011Stephen C. HUBBARD, Marie McVeigh
How unique cited titles are created for Thomson Reuters indexing, and how variations and ambiguities in titles are collected in order to create the Journal Impact Factor numerator are explained.
HydrobiologiaLoading constraints, body size and mating preference in Gammarus species
23 Citations1989Jonathan Adams, Penelope J. Watt +2 more
The experimental results present a complex picture which suggests that both sexual selection and loading constraints are likely to play a role in determining mating decisions in these animals.
ScientometricsEffect on the journal impact factor of the number and document type of citing records: a wide-scale study
19 Citations2010Juan Miguel Campanario, Jesús Carretero +3 more
It is found that most journals obtained citations that contribute to the impact factor from documents labeled as articles and reviews, and in most of journals the ratio between citations that contributed to theimpact factor and citing records was greater than 80% in all years.
London School of Economics and Political Science Research Online (London School of Economics and Political Science)The Dearing Report: ten years on
19 Citations2007David Watson, Michael Amoah
ScienceResearch Assessment in the UK
18 Citations2002Jonathan Adams
The United Kingdom now needs a replacement assessment and allocation system to maintain the momentum of research excellence, and any new system must continue to provide accountability for the use of public funds, be at least as selective in distributing those funds to the places that will use them most effectively, and be flexible enough to treat sciences and arts in a comparable way.
LibGuides: Research Impact Library Guide: Journal Citation Reports (Thomson Reuters)
8 Citations2012Ingrid Thomson
The guide covers ways you can measure your impact as a researcher and suggests ways to improve the quality of research and reduce the likelihood of bias.
ScientometricsUpdating the journal impact factor or total overhaul?
7 Citations2012Ronald Rousseau
It is agreed that a major overhaul is necessary: journal evaluation must be performed using instruments and not artefacts, and Vanclay’s proposal (Vanclay (2012)) is discussed.