Analyzing Online Review Helpfulness Using a Regressional ReliefF-Enhanced Text Mining Method
ACM Transactions on Management Information SystemsPublished 1 July 2012
Thomas Ngo-Ye, Atish P. Sinha
Citations37
SJR quartileQ1
SJR score0.97
SNIP1.31
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This study is the first to investigate and compare different dimension reduction techniques in the context of applying text regression for predicting online review helpfulness, and finds that RReliefF significantly outperforms two popular dimension reduction methods.
Abstract
Within the emerging context of Web 2.0 social media, online customer reviews are playing an increasingly important role in disseminating information, facilitating trust, and promoting commerce in the e-marketplace. The sheer volume of customer reviews on the web produces information overload for readers. Developing a system that can automatically identify the most helpful reviews would be valuable to businesses that are interested in gathering informative and meaningful customer feedback. Because the target variable---review helpfulness---is continuous, common feature selection techniques from text classification cannot be applied. In this article, we propose and investigate a text mining model, enhanced using the Regressional ReliefF (RReliefF) feature selection method, for predicting the helpfulness of online reviews from Amazon.com. We find that RReliefF significantly outperforms two popular dimension reduction methods. This study is the first to investigate and compare different dimension reduction techniques in the context of applying text regression for predicting online review helpfulness. Another contribution is that our analysis of the keywords selected by RReliefF reveals meaningful feature groupings.
Keywords
Computer Science
ACM Transactions on Intelligent Systems and TechnologyLIBSVM
41,340 Citations2011Chih-Chung Chang, Chih‐Jen Lin
Issues such as solving SVM optimization problems theoretical convergence multiclass classification probability estimates and parameter selection are discussed in detail.
Elsevier eBooksData Mining: Practical Machine Learning Tools and Techniques
25,718 Citations2011Ian H. Witten, Eibe Frank
Journal of the American Society for Information ScienceIndexing by latent semantic analysis
12,677 Citations1990Scott Deerwester, Susan Dumais +3 more
Artificial IntelligenceWrappers for feature subset selection
8,925 Citations1997Ron Kohavi, George H. John
The wrapper method searches for an optimal feature subset tailored to a particular algorithm and a domain and compares the wrapper approach to induction without feature subset selection and to Relief, a filter approach tofeature subset selection.
Program electronic library and information systemsAn algorithm for suffix stripping
8,136 Citations1980Martin Porter
An algorithm for suffix stripping is described, which has been implemented as a short, fast program in BCPL, and performs slightly better than a much more elaborate system with which it has been compared.
ACM Computing SurveysMachine learning in automated text categorization
7,899 Citations2002Fabrizio Sebastiani
This survey discusses the main approaches to text categorization that fall within the machine learning paradigm and discusses in detail issues pertaining to three different problems, namely, document representation, classifier construction, and classifier evaluation.
Journal of Machine Learning ResearchAn introduction to variable and feature selection
7,831 Citations2003GuyonIsabelle, ElisseeffAndré
Communications of the ACMA vector space model for automatic indexing
7,434 Citations1975Gerard Salton, Anita M.-Y. Wong +1 more
An approach based on space density computations is used to choose an optimum indexing vocabulary for a collection of documents, demonstating the usefulness of the model.
now publishers, Inc. eBooksOpinion Mining and Sentiment Analysis
6,745 Citations2008Bo Pang, Lillian Lee
An introduction to variable and feature selection
6,577 Citations2009Isabelle Guyon
Foundations and Trends® in Information RetrievalOpinion Mining and Sentiment Analysis
6,204 Citations2008Bo Pang, Lillian Lee
This survey covers techniques and approaches that promise to directly enable opinion-oriented information-seeking systems and focuses on methods that seek to address the new challenges raised by sentiment-aware applications, as compared to those that are already present in more traditional fact-based analysis.
A Comparative Study on Feature Selection in Text Categorization
4,766 Citations1997Yiming Yang, Jan Pedersen
DF thresholding, the simplest method with the lowest cost in computation, can be reliably used instead of IG or CHI when the computation of these measures are too expensive, and strong correlations between the DF, IG and CHI values of a term are found.
Machine LearningTheoretical and Empirical Analysis of ReliefF and RReliefF
2,986 Citations2003Marko Robnik‐Šikonja, Igor Kononenko
How and why Relief algorithms work, their theoretical and practical properties, their parameters, what kind of dependencies they detect, how do they scale up to large number of examples and features, how to sample data for them, how robust are they regarding the noise, how irrelevant and redundant attributes influence their output and how different metrics influences them.
Elsevier eBooksA Practical Approach to Feature Selection
2,954 Citations1992Kenji Kira, Larry Rendell
Comparison with other feature selection algorithms shows Relief's advantages in terms of learning time and the accuracy of the learned concept, suggesting Relief's practicality.
Lecture notes in computer scienceEstimating attributes: Analysis and extensions of RELIEF
2,950 Citations1994Igor Kononenko
In the context of machine learning from examples this paper deals with the problem of estimating the quality of attributes with and without dependencies among them and is analysed and extended to deal with noisy, incomplete, and multi-class data sets.
Journal of Artificial Intelligence ResearchFrom Frequency to Meaning: Vector Space Models of Semantics
2,883 Citations2010Peter D. Turney, Patrick Pantel
The goal in this survey is to show the breadth of applications of VSMs for semantics, to provide a new perspective on VSMs, and to provide pointers into the literature for those who are less familiar with the field.
Support Vector Method for Function Approximation, Regression Estimation and Signal Processing
2,702 Citations1996Vladimir Vapnik, Steven E. Golowich +1 more
This presentation reports results of applying the Support Vector method to problems of estimating regressions, constructing multidimensional splines, and solving linear operator equations.
MIS QuarterlyWhat Makes a Helpful Online Review? A Study of Customer Reviews on Amazon.Com1
2,414 Citations2010Susan M. Mudambi, David Schuff
An extensive empirical study of feature selection metrics for text classification
2,389 Citations2003George Forman
Research Commons (University of Waikato)Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning
1,718 Citations2000Mark A. Hall
Sentiment Analysis and Subjectivity
1,594 Citations2010Liu Bing
An intraocular lens for implantation in an eye comprising an optic configured so that the optic can be deformed to permit the intraocular Lens to be passed through an incision into the eye is provided.
MIS QuarterlyWhat makes a helpful online review? a study of customer reviews on amazon.com
1,290 Citations2010Susan M. Mudambi, David Schuff
Data Mining Techniques: For Marketing, Sales, and Customer Relationship Management
1,241 Citations2004Gordon S. Linoff, M. J. Berry
Data Mining Techniques, Third Edition covers a new data mining technique with each successive chapter and then demonstrates how you can apply that technique for improved marketing, sales, and customer support to get immediate results.
IEEE Transactions on Knowledge and Data EngineeringBenchmarking attribute selection techniques for discrete class data mining
1,231 Citations2003Mark A. Hall, Geoffrey Holmes
A benchmark comparison of several attribute selection methods for supervised classification by cross-validating the attribute rankings with respect to a classification learner to find the best attributes.
YALE
1,018 Citations2006Ingo Mierswa, Michael Wurst +3 more
Yale is described, a free open-source environment for KDD and machine learning which provides a rich variety of methods which allows rapid prototyping for new applications and makes costlyre-implementations unnecessary and offers extensive functionality for process evaluation and optimization.
ACM Transactions on Information SystemsSentiment analysis in multiple languages
894 Citations2008Ahmed Abbasi, Hsinchun Chen +1 more
Stylistic features significantly enhanced performance across all testbeds while EWGA also outperformed other feature selection methods, indicating the utility of these features and techniques for document-level classification of sentiments.
Applied IntelligenceOvercoming the Myopia of Inductive Learning Algorithms with RELIEFF
798 Citations1997Igor Kononenko, Edvard Šimec +1 more
This work reimplemented Assistant, a system for top down induction of decision trees, using RELIEFF, an extension of RELIEF, as an estimator of attributes at each selection step for heuristic guidance of inductive learning algorithms.
Automatically assessing review helpfulness
522 Citations2006Soo-Min Kim, Patrick Pantel +2 more
This paper considers the task of automatically assessing review helpfulness, and finds that the most useful features include the length of the review, its unigrams, and its product rating.
An adaptation of Relief for attribute estimation in regression
480 Citations1997Marko Robnik‐Šikonja, Igor Kononenko
The analysis of ReliefF is presented which lead to its adaptation to regression (continuous class) problems, and Regressional ReliefF and ReliefF provide a unified view on estimating the attribute quality in regression and classification.
ACM Computing SurveysWeb page classification
432 Citations2009Xiaoguang Qi, Brian D. Davison
As work in Web page classification is reviewed, the importance of these Web-specific features and algorithms are noted, state-of-the-art practices are described, and the underlying assumptions behind the use of information from neighboring pages are tracked.
Low-Quality Product Review Detection in Opinion Summarization
392 Citations2007Jingjing Liu, Yunbo Cao +3 more
Experimental results show that the proposed approach effectively discriminates lowquality reviews from high-quality ones and enhances the task of opinion summarization by detecting and filtering low quality reviews.
Text Mining
386 Citations2009
This book examines methods to automatically cluster and classify text documents and applies these methods in a variety of areas, including adaptive information filtering, information distillation, and text search.
Designing novel review ranking systems
324 Citations2007Anindya Ghose, Panagiotis G. Ipeirotis
It is shown that subjectivity analysis can give useful clues about the helpfulness of a review and about its impact on sales and the results can have several implications for the market design of online opinion forums.
Exploiting social context for review quality prediction
309 Citations2010Yue Lu, Panayiotis Tsaparas +2 more
A generic framework for incorporating social context information by adding regularization constraints to the text-based predictor is proposed and has the advantage that the resulting predictor is usable even when social context is unavailable.
Utility scoring of product reviews
238 Citations2006Zhu Zhang, Balaji Varadarajan
A new task in the ongoing research in text sentiment analysis: predicting utility of product reviews, which is orthogonal to polarity classification and opinion extraction is identified, and regression models are built by incorporating a diverse set of features.
How opinions are received by online communities
236 Citations2009Cristian Danescu-Niculescu-Mizil, Gueorgi Kossinets +2 more
It is found that the perceived helpfulness of a review depends not just on its content but also but also in subtle ways on how the expressed evaluation relates to other evaluations of the same product.
Journal of Management Information SystemsA Visual Framework for Knowledge Discovery on the Web: An Empirical Study of Business Intelligence Exploration
232 Citations2005Wingyan Chung, Hsinchun Chen +1 more
Results show that knowledge map outperformed Kartoo, a commercial search engine with graphical display, in terms of effectiveness and efficiency, and Web community was found to be more effective, efficient, and usable than result list.
MIS QuarterlyCyberGate: A Design Framework and System for Text Analysis of Computer-Mediated Communication1
198 Citations2008Ahmed Abbasi, Hsinchun Chen
The results revealed that the CyberGate system and its underlying design framework can dramatically improve CMC text analysis capabilities over those provided by existing systems.
IEEE Intelligent SystemsAI and Opinion Mining
189 Citations2010Hsinchun Chen, David Zimbra
Opinion mining, a subdiscipline within data mining and computational linguistics, refers to the computational techniques for extracting, classifying, understanding, and assessing the opinions expressed in various online news sources, social media comments, and other user-generated content.
'Helpfulness' in online communities
170 Citations2009Jahna Otterbacher
A correlation and regression analysis uncovers a strong relationship between the chronological ordering of reviews and helpfulness, which both community participants and designers should keep in mind when using this method of social navigation.
Lecture notes in computer scienceMulti-facet Rating of Product Reviews
148 Citations2009Stefano Baccianella, Andrea Esuli +1 more
This work tackles the problem of rating (i.e., attributing a numerical score of satisfaction to) consumer reviews based on their textual content by exploring several aspects of the problem, with special emphasis on how to generate vectorial representations of the text by means of POS tagging, sentiment analysis, and feature selection for ordinal regression learning.
Lecture notes in computer scienceCharacterization of classification algorithms
117 Citations1995João Gama, Pavel Brazdil
This paper is concerned with the problem of characterization of classification algorithms and involves generation of different kinds of models, which include regression and rule models, piecewise linear models (model trees) and instance based models.
IEEE Intelligent SystemsWeighing Stars: Aggregating Online Product Reviews for Intelligent E-commerce Applications
83 Citations2008Zhu Zhang
A new task in text-sentiment analysis adds usefulness scoring to polarity/ opinion extraction to improve product- review ranking services, helping shoppers and vendors leverage information from multiple sources.
Understanding deja reviewers
68 Citations2010Éric Gilbert, Karrie Karahalios
A mixed-method study of deja reviewers, latecomers who echo what other people said, finds that roughly 10-15% of reviews substantially resemble previous ones, and interviews reviewers to understand their motives.
From frequency to meaning
67 Citations2010D TurneyPeter, PantelPatrick
The ability of computers to explain their actions to us and to give instructions to computers is limited by the fact that computers understand very little of the meaning of human language.
Journal of the American Society for Information Science and TechnologyEBizPort: Collecting and analyzing business intelligence information
59 Citations2004Byron Marshall, Daniel McDonald +2 more
Results from the evaluation study suggest that the visualization function added value to the search and analysis process, that the generalizable collection-building technique can be useful for domain-specific information searching on the Web, and that the search interface was important for Web search and browse support.
IEEE Transactions on Information Technology in BiomedicineOptimal Search-Based Gene Subset Selection for Gene Array Cancer Classification
54 Citations2007Jiexun Li, Hua Su +2 more
This paper is the first to introduce tabu search (TS) to gene selection from high-dimensional gene array data and demonstrates the effectiveness of optimal search-based gene subset selection to identify cancer marker genes.
Lecture notes in business information processingHelping E-Commerce Consumers Make Good Purchase Decisions: A User Reviews-Based Approach
38 Citations2009Richong Zhang, Thomas Tran
A model to discover the helpfulness of online product reviews is proposed and can be analyzed and ranked by the scoring system and those reviews that may help consumers better than others will be found.
A quality-aware model for sales prediction using reviews
20 Citations2010Xiaohui Yu, Yang Liu +2 more
This paper proposes a regression model that explicitly takes into account the quality factor, and discusses how this quality information can be predicted when it is not readily available, and results on a movie review dataset confirm the effectiveness of the proposed model.
A Model for Evaluating the Quality of User-Created Documents
16 Citations2009Linh Hoang, Jung‐Tae Lee +2 more
An Entropy-Based Model for Discovering the Usefulness of Online Product Reviews
16 Citations2008Richong Zhang, Thomas Tran
An entropy-based model to predict the helpfulness of reviews is proposed and results show that the approach is effective in ranking and classifying online reviews.
Americas Conference on Information SystemsInvestigating Determinants of Voting for the "Helpfulness" of Online Consumer Reviews: A Text Mining Approach
11 Citations2010Wenjing Duan, Qing Cao +1 more
It is suggested that reviews with extreme opinions receive more helpfulness votes than those with mixed or neutral opinions and the design of a better helpfulness voting mechanism for online user review systems is needed.
Web based Quality Assessment of Customer Reviews using Quartile Measure
6 Citations2009P. S. Hiremath, Siddu P. Algur +1 more
An attempt to assess a review based on its quality, to help the customer make a proper buying decision and the efficiency of the task of customer review summarization can be enhanced by identifying and eliminating insignificant reviews.