Using cocitation information to estimate political orientation in web documents

Knowledge and Information SystemsPublished 9 September 2005

Miles Efron

DOI10.1007/s10115-005-0214-9

Source URL

Citations15

SJR quartileQ2

SJR score0.83

SNIP1.37

Abstract

This paper introduces a simple method for estimating cultural orientation, the affiliation of online entities in a polarized field of discourse. In particular, cocitation information is used to estimate the political orientation of hypertext documents. A type of cultural orientation, the political orientation of a document is the degree to which it participates in traditionally left- or right-wing beliefs. Estimating documents' political orientation is of interest for personalized information retrieval and recommender systems. In its application to politics, the method uses a simple probabilistic model to estimate the strength of association between a document and left- and right-wing communities. The model estimates the likelihood of cocitation between a document of interest and a small number of documents of known orientation. The model is tested on three sets of data, 695 partisan web documents, 162 political weblogs, and 198 nonpartisan documents. Accuracy above 90% is obtained from the cocitation model, outperforming lexically based classifiers at statistically significant levels.

Keywords

Social SciencesPhysics and Astronomy

Data Mining and Knowledge DiscoveryA Tutorial on Support Vector Machines for Pattern Recognition

16,433 Citations1998Christopher J. C. Burges

There are several arguments which support the observed high accuracy of SVMs, which are reviewed and numerous examples and proofs of most of the key theorems are given.

Computer Networks and ISDN SystemsThe anatomy of a large-scale hypertextual Web search engine

15,828 Citations1998Sergey Brin, Lawrence M. Page

This paper provides an in-depth description of Google, a prototype of a large-scale search engine which makes heavy use of the structure present in hypertext and looks at the problem of how to effectively deal with uncontrolled hypertext collections where anyone can publish anything they want.

Journal of the ACMAuthoritative sources in a hyperlinked environment

9,060 Citations1999Jon Kleinberg

This work proposes and test an algorithmic formulation of the notion of authority, based on the relationship between a set of relevant authoritative pages and the set of “hub pages” that join them together in the link structure, and has connections to the eigenvectors of certain matrices associated with the link graph.

View PDF

Wiley series in probability and statisticsCategorical Data Analysis

6,670 Citations2002Alan Agresti

Mining the peanut gallery

1,908 Citations2003Kushal Dave, Steve Lawrence +1 more

This work develops a method for automatically distinguishing between positive and negative reviews and draws on information retrieval techniques for feature extraction and scoring, and the results for various metrics and heuristics vary depending on the testing situation.

Topic-sensitive PageRank

1,524 Citations2002Taher H. Haveliwala

A set of PageRank vectors are proposed, biased using a set of representative topics, to capture more accurately the notion of importance with respect to a particular topic, and are shown to generate more accurate rankings than with a single, generic PageRank vector.

Choice Reviews OnlineSix degrees: the science of a connected age

1,376 Citations2003Albert-lászló Barabási, Duncan J. Watts +1 more

Duncan Watts explores the science of networks and its implications, ranging from the Dutch tulipmania of the 17th century to the success of Harry Potter, from the impact of September 11 on Manhattan to the brain of the sea-slug, and from the processes that lead to stockmarket crashes to the structure of the world wide web.

Word association norms, mutual information, and lexicography

1,066 Citations1989Kenneth Church, Patrick Hanks

The proposed measure, the association ratio, estimates word association norms directly from computer readable corpora, making it possible to estimate norms for tens of thousands of words.

View PDF

Inferring Web communities from link topology

772 Citations1998David Gibson, Jon Kleinberg +1 more

This investigation shows that although the process by which users of the Web create pages and links is very difficult to understand at a “local” level, it results in a much greater degree of orderly high-level structure than has typically been assumed.

Mining newsgroups using networks arising from social behavior

290 Citations2003Rakesh Agrawal, Sridhar Rajagopalan +2 more

This work investigates the feasibility of applying link-based methods in new applications domains to partition authors into opposite camps within a given topic in the context of newsgroups and analyzes the graph structure of the responses.