Evaluating tagging behavior in social bookmarking systems

Published 1 January 2007

Umer Farooq, Thomas Kannampallil, Yang Song, Craig H. Ganoe, John M. Carroll, C. Lee Giles

Citations85

TL;DR

This paper analyzes over two years of data from CiteULike, a social bookmarking system for tagging academic papers, and proposes six tag metrics-tag growth, tag reuse, tag non-obviousness, tag discrimination, tag frequency, and tag patterns-to understand the characteristics of a socialBookmarking system.

Abstract

To improve existing social bookmarking systems and to design new ones, researchers and practitioners need to understand how to evaluate tagging behavior. In this paper, we analyze over two years of data from CiteULike, a social bookmarking system for tagging academic papers. We propose six tag metrics-tag growth, tag reuse, tag non-obviousness, tag discrimination, tag frequency, and tag patterns-to understand the characteristics of a social bookmarking system. Using these metrics, we suggest possible design heuristics to implement a social bookmarking system for CiteSeer, a popular online scholarly digital library for computer science. We believe that these metrics and design heuristics can be applied to social bookmarking systems in other domains.

Keywords

Computer SciencePhysics and Astronomy

Computer Networks and ISDN SystemsThe anatomy of a large-scale hypertextual Web search engine

15,828 Citations1998Sergey Brin, Lawrence M. Page

This paper provides an in-depth description of Google, a prototype of a large-scale search engine which makes heavy use of the structure present in hypertext and looks at the problem of how to effectively deal with uncontrolled hypertext collections where anyone can publish anything they want.

Journal of Information ScienceUsage patterns of collaborative tagging systems

1,830 Citations2006Scott A. Golder, Bernardo A. Huberman

A dynamic model of collaborative tagging is presented that predicts regularities in user activity, tag frequencies, kinds of tags used, bursts of popularity in bookmarking and a remarkable stability in the relative proportions of tags within a given URL.

CiteSeer

1,031 Citations1998C. Lee Giles, Kurt Bollacker +1 more

CiteSeer has many advantages over traditional citation indexes, including the ability to create more up-to-date databases which are not limited to a preselected set of journals or restricted by journal publication delays, completely autonomous operation with a corresponding reduction in cost, and powerful interactive browsing of the literature using the context of citations.

HT06, tagging paper, taxonomy, Flickr, academic article, to read

876 Citations2006Cameron Marlow, Mor Naaman +2 more

A model of tagging systems, specifically in the context of web-based systems, is offered to help illustrate the possible benefits of these tools and a simple taxonomy of incentives and contribution models is provided to inform potential evaluative frameworks.

Human-Computer InteractionThe Intellectual Challenge of CSCW: The Gap Between Social Requirements and Technical Feasibility

839 Citations2000Mark S. Ackerman

It is argued that there is an inherent gap between the social requirements of CSCW and its technical mechanisms and that the challenge of the social-technical gap creates an opportunity to refocus CSCw.

interactionsHuman-centered design considered harmful

476 Citations2005Donald A. Norman

The purpose of this essay is to provoke thought, discussion, and reconsideration of some of the fundamental principles of human-centered design, which can be helpful, misleading, or wrong.

tagging, communities, vocabulary, evolution

401 Citations2006Shilad Sen, Shyong K. Lam +6 more

A user-centric model of vocabulary evolution in tagging communities based on community influence and personal tendency is presented and evaluated in an emergent tagging system by introducing tagging features into the MovieLens recommender system.

Dogear

297 Citations2006David R. Millen, Jonathan Feinberg +1 more

The feedback from the user trial, comprising survey results, log file analysis and informal communica-tions, is quite positive and suggests several promising en-hancements to the service.

QueueSocial Bookmarking in the Enterprise

127 Citations2005David R. Millen, Jonathan Feinberg +1 more

View PDF

The European Physical Journal CSemiotic dynamics in online social communities

67 Citations2006Ciro Cattuto

It is found that the frequencies of tags obey to a generalized Zipf’s law and it is shown that a Yule–Simon process with memory can be used to explain the observed frequency distributions in terms of a simple model of user behavior.