Finding unusual review patterns using unexpected rules

Published 26 October 2010

Nitin Jindal, Bing Liu, Ee‐Peng Lim

Citations339

TL;DR

Using the technique, an Amazon.com review dataset is analyzed and many unexpected rules and rule groups which indicate spam activities are found.

Abstract

In recent years, opinion mining attracted a great deal of research attention. However, limited work has been done on detecting opinion spam (or fake reviews). The problem is analogous to spam in Web search [1, 9 11]. However, review spam is harder to detect because it is very hard, if not impossible, to recognize fake reviews by manually reading them [2]. This paper deals with a restricted problem, i.e., identifying unusual review patterns which can represent suspicious behaviors of reviewers. We formulate the problem as finding unexpected rules. The technique is domain independent. Using the technique, we analyzed an Amazon.com review dataset and found many unexpected rules and rule groups which indicate spam activities.

Keywords

Computer Science

C4.5: Programs for Machine Learning

23,665 Citations1992J. R. Quinlan

A complete guide to the C4.5 system as implemented in C for the UNIX environment, which starts from simple core learning methods and shows how they can be elaborated and extended to deal with typical problems such as missing data and over hitting.

Integrating classification and association rule mining

2,223 Citations1998Bing Liu, Wynne Hsu +1 more

The integration is done by focusing on mining a special subset of association rules, called class association rules (CARs), and shows that the classifier built this way is more accurate than that produced by the state-of-the-art classification system C4.5.

Sentiment Analysis and Subjectivity

1,594 Citations2010Liu Bing

An intraocular lens for implantation in an eye comprising an optic configured so that the optic can be deformed to permit the intraocular Lens to be passed through an incision into the eye is provided.

Opinion spam and analysis

1,520 Citations2008Nitin Jindal, Bing Liu

It is shown that opinion spam is quite different from Web spam and email spam, and thus requires different detection techniques, and therefore requires some novel techniques to detect them.

Detecting product review spammers using rating behaviors

720 Citations2010Ee‐Peng Lim, Viet-An Nguyen +3 more

This paper identifies several characteristic behaviors of review spammers and model these behaviors so as to detect the spammers, and shows that the detected spammers have more significant impact on ratings compared with the unhelpful reviewers.

Detecting spam web pages through content analysis

612 Citations2006Alexandros Ntoulas, Marc Najork +2 more

Some previously-undescribed techniques for automatically detecting spam pages are considered, and the effectiveness of these techniques in isolation and when aggregated using classification algorithms is examined.

Adversarial Information Retrieval on the WebWeb Spam Taxonomy

488 Citations2005Zoltán Gyöngyi, Héctor García-Molina

This paper presents a comprehensive taxonomy of current spamming techniques, which it is believed can help in developing appropriate countermeasures.

Low-Quality Product Review Detection in Opinion Summarization

392 Citations2007Jingjing Liu, Yunbo Cao +3 more

Experimental results show that the proposed approach effectively discriminates lowquality reviews from high-quality ones and enhances the task of opinion summarization by detecting and filtering low quality reviews.

Utility scoring of product reviews

238 Citations2006Zhu Zhang, Balaji Varadarajan

A new task in the ongoing research in text sentiment analysis: predicting utility of product reviews, which is orthogonal to polarity classification and opinion extraction is identified, and regression models are built by incorporating a diverse set of features.

Overview of the TREC-2009 Blog Track

219 Citations2009Craig Macdonald, Iadh Ounis +1 more

This paper has created the first blog test collection, namely the TREC Blog06 collection, for adhoc retrieval and opinion finding, and provides an overview of each task, summarises the obtained results and draws conclusions for the future.