The influence of reviewer engagement characteristics on online review helpfulness: A text regression model
Decision Support SystemsPublished 25 January 2014
Thomas Ngo-Ye, Atish P. Sinha
Citations236
SJR quartileQ1
SJR score2.37
SNIP2.59
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
It is found that both review text and reviewer engagement characteristics help predict review helpfulness, making it possible for social media platforms to dynamically adjust the presentation of those reviews on their websites.
Abstract
The era of Web 2.0 is witnessing the proliferation of online social media platforms, which develop new business models by leveraging user-generated content. One rapidly growing source of user-generated data is online reviews, which play a very important role in disseminating information, facilitating trust, and promoting commerce in the e-marketplace. In this paper, we develop and compare several text regression models for predicting the helpfulness of online reviews. In addition to using review words as predictors, we examine the influence of reviewer engagement characteristics such as reputation, commitment, and current activity. We employ a reviewer's RFM (Recency, Frequency, Monetary Value) dimensions to characterize his/her overall engagement and investigate if the inclusion of those dimensions helps improve the prediction of online review helpfulness. Empirical findings from text mining experiments conducted using reviews from Yelp and Amazon offer strong support to our thesis. We find that both review text and reviewer engagement characteristics help predict review helpfulness. The hybrid approach of combining the textual features of bag-of-words model and RFM dimensions produces the best prediction results. Furthermore, our approach facilitates the estimation of the helpfulness of new reviews instantly, making it possible for social media platforms to dynamically adjust the presentation of those reviews on their websites.
Keywords
Computer ScienceSocial Sciences
Elsevier eBooksData Mining: Practical Machine Learning Tools and Techniques
25,718 Citations2011Ian H. Witten, Eibe Frank
Information Processing & ManagementTerm-weighting approaches in automatic text retrieval
9,532 Citations1988Gerard Salton, Chris Buckley
This paper summarizes the insights gained in automatic term weighting, and provides baseline single term indexing models with which other more elaborate content analysis procedures can be compared.
Program electronic library and information systemsAn algorithm for suffix stripping
8,136 Citations1980Martin Porter
An algorithm for suffix stripping is described, which has been implemented as a short, fast program in BCPL, and performs slightly better than a much more elaborate system with which it has been compared.
ACM Computing SurveysMachine learning in automated text categorization
7,899 Citations2002Fabrizio Sebastiani
This survey discusses the main approaches to text categorization that fall within the machine learning paradigm and discusses in detail issues pertaining to three different problems, namely, document representation, classifier construction, and classifier evaluation.
Communications of the ACMA vector space model for automatic indexing
7,434 Citations1975Gerard Salton, Anita M.-Y. Wong +1 more
An approach based on space density computations is used to choose an optimum indexing vocabulary for a collection of documents, demonstating the usefulness of the model.
now publishers, Inc. eBooksOpinion Mining and Sentiment Analysis
6,745 Citations2008Bo Pang, Lillian Lee
Journal of Management Information SystemsBeyond Accuracy: What Data Quality Means to Data Consumers
4,330 Citations1996Richard Y. Wang, Diane M. Strong
Using this framework, IS managers were able to better understand and meet their data consumers' data quality needs and this research provides a basis for future studies that measure data quality along the dimensions of this framework.
Journal of Artificial Intelligence ResearchFrom Frequency to Meaning: Vector Space Models of Semantics
2,883 Citations2010Peter D. Turney, Patrick Pantel
The goal in this survey is to show the breadth of applications of VSMs for semantics, to provide a new perspective on VSMs, and to provide pointers into the literature for those who are less familiar with the field.
Research Commons (University of Waikato)Correlation-based Feature Selection for Discrete and Numeric Class Machine Learning
1,718 Citations2000Mark A. Hall
Sentiment Analysis and Subjectivity
1,594 Citations2010Liu Bing
An intraocular lens for implantation in an eye comprising an optic configured so that the optic can be deformed to permit the intraocular Lens to be passed through an incision into the eye is provided.
Journal of MarketingOn the Profitability of Long-Life Customers in a Noncontractual Setting: An Empirical Investigation and Implications for Marketing
1,364 Citations2000Werner Reinartz, V. Kumar
MIS QuarterlyWhat makes a helpful online review? a study of customer reviews on amazon.com
1,290 Citations2010Susan M. Mudambi, David Schuff
MIS QuarterlyPredictive Analytics in Information Systems Research1
1,239 Citations2011Galit Shmueli, Koppius
IEEE Transactions on Knowledge and Data EngineeringBenchmarking attribute selection techniques for discrete class data mining
1,231 Citations2003Mark A. Hall, Geoffrey Holmes
A benchmark comparison of several attribute selection methods for supervised classification by cross-validating the attribute rankings with respect to a classification learner to find the best attributes.
Handbook of Natural Language Processing
1,080 Citations2010Nitin Indurkhya, Fred J. Damerau
Fully updated with the latest developments in the field, this comprehensive, modern handbook emphasizes how to implement practical language processing tools in computational systems.
YALE
1,018 Citations2006Ingo Mierswa, Michael Wurst +3 more
Yale is described, a free open-source environment for KDD and machine learning which provides a rich variety of methods which allows rapid prototyping for new applications and makes costlyre-implementations unnecessary and offers extensive functionality for process evaluation and optimization.
Decision Support SystemsWhat drives consumers to spread electronic word of mouth in online consumer-opinion platforms
1,003 Citations2012Christy M.K. Cheung, Matthew Lee
A model examining motives of consumers' eWOM intention is developed and reputation, sense of belonging, and enjoyment of helping are significant factors, and the model explains 69 percent of the variance.
Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing - EMNLP '06
650 Citations2006
The proceedings of the 11th Conference on Empirical Methods in Natural Language Processing are introduced, organized under the auspices of SIGDAT, the ACL Special Interest Group for linguistic data and corpus-based approaches to NLP.
Decision Support SystemsExploring determinants of voting for the “helpfulness” of online user reviews: A text mining approach
647 Citations2010Qing Cao, Wenjing Duan +1 more
It is suggested that reviews with extreme opinions receive more helpfulness votes than those with mixed or neutral opinions and the design of a better helpfulness voting mechanism for online user review systems is needed.
Information Technology and ManagementDo online reviews affect product sales? The role of reviewer characteristics and temporal effects
602 Citations2008Nan Hu, Ling Liu +1 more
Journal of Marketing ResearchRFM and CLV: Using Iso-Value Curves for Customer Base Analysis
582 Citations2005Peter S. Fader, Bruce G. S. Hardie +1 more
A new model is presented that links the well-known RFM (recency, frequency, and monetary value) paradigm with customer lifetime value (CLV) and is based on the Pareto/NBD framework to capture the flow of transactions over time and a gamma-gamma submodel for spend per transaction.
Decision Support SystemsManipulation of online reviews: An analysis of ratings, readability, and sentiments
529 Citations2011Nan Hu, Indranil Bose +2 more
A simple statistical method is proposed to detect online reviews manipulation, and assess how consumers respond to products with manipulated reviews, and the effectiveness of manipulation through ratings, sentiments, and readability is investigated.
Automatically assessing review helpfulness
522 Citations2006Soo-Min Kim, Patrick Pantel +2 more
This paper considers the task of automatically assessing review helpfulness, and finds that the most useful features include the length of the review, its unigrams, and its product rating.
PubMedA comparative study on feature selection and classification methods using gene expression profiles and proteomic patterns.
412 Citations2002Huiqing Liu, Jinyan Li +1 more
This work presents a comparative study on six feature selection heuristics by applying them to two sets of data, which are gene expression profiles from Acute Lymphoblastic Leukemia and proteomic patterns from ovarian cancer patients.
Low-Quality Product Review Detection in Opinion Summarization
392 Citations2007Jingjing Liu, Yunbo Cao +3 more
Experimental results show that the proposed approach effectively discriminates lowquality reviews from high-quality ones and enhances the task of opinion summarization by detecting and filtering low quality reviews.
Designing novel review ranking systems
324 Citations2007Anindya Ghose, Panagiotis G. Ipeirotis
It is shown that subjectivity analysis can give useful clues about the helpfulness of a review and about its impact on sales and the results can have several implications for the market design of online opinion forums.
Modeling and Predicting the Helpfulness of Online Reviews
324 Citations2008Yang Liu, Xiangji Huang +2 more
This paper shows that the helpfulness of a review depends on three important factors: the reviewerpsilas expertise, the writing style of the review, and the timeliness of thereview, and presents a nonlinear regression model for helpfulness prediction.
Exploiting social context for review quality prediction
309 Citations2010Yue Lu, Panayiotis Tsaparas +2 more
A generic framework for incorporating social context information by adding regularization constraints to the text-based predictor is proposed and has the advantage that the resulting predictor is usable even when social context is unavailable.
Decision Support SystemsQuality evaluation of product reviews using an information quality framework
274 Citations2010Chien Chin Chen, You-De Tseng
This paper treats the evaluation of review quality as a classification problem and employs an effective information quality framework to extract representative review features and demonstrates that the proposed method outperforms state-of-the-art approaches significantly.
IEEE Transactions on Knowledge and Data EngineeringMining Online Reviews for Predicting Sales Performance: A Case Study in the Movie Domain
241 Citations2011Xiaohui Yu, Yang Liu +2 more
A case study in the movie domain is conducted, and it is shown that both the sentiments expressed in the reviews and the quality of the reviews have a significant impact on the future sales performance of products in question.
Utility scoring of product reviews
238 Citations2006Zhu Zhang, Balaji Varadarajan
A new task in the ongoing research in text sentiment analysis: predicting utility of product reviews, which is orthogonal to polarity classification and opinion extraction is identified, and regression models are built by incorporating a diverse set of features.
Data Mining for Business Intelligence: Concepts, Techniques, and Applications in Microsoft Office Excel with XLMiner
228 Citations2006Galit Shmueli, Nitin Patel +1 more
International Journal of Human-Computer StudiesInteractive machine learning: letting users build classifiers
211 Citations2001Malcolm Ware, Eibe Frank +3 more
It is shown that appropriate techniques can empower users to create models that compete with classifiers built by state-of-the-art learning algorithms, and that small expert-defined models offer the additional advantage that they will generally be more intelligible than those generated by automatic techniques.
Journal of Database Marketing & Customer Strategy ManagementSocial CRM as a business strategy
211 Citations2011Neil Woodcock, Andrew Green +2 more
Social customer relationship management is about people and relationships and demands a customer focus as never before, and pioneers in large companies face three hurdles: organisational readiness, over-hype and over-expectation and project management failings.
Research and Development in Intelligent Systems XXVI
208 Citations2009Max Bramer, Richard Ellis +5 more
IEEE Intelligent SystemsAI and Opinion Mining
189 Citations2010Hsinchun Chen, David Zimbra
Opinion mining, a subdiscipline within data mining and computational linguistics, refers to the computational techniques for extracting, classifying, understanding, and assessing the opinions expressed in various online news sources, social media comments, and other user-generated content.
Decision Support SystemsExpertRank: A topic-aware expert finding algorithm for online knowledge communities
184 Citations2013G. Alan Wang, Jian Jiao +3 more
A novel expert finding algorithm, ExpertRank, is proposed that evaluates expertise based on both document-based relevance and one's authority in his or her knowledge community and modified the PageRank algorithm to evaluate one's Authority so that it reduces the effect of certain biasing communication behavior in online communities.
'Helpfulness' in online communities
170 Citations2009Jahna Otterbacher
A correlation and regression analysis uncovers a strong relationship between the chronological ordering of reviews and helpfulness, which both community participants and designers should keep in mind when using this method of social navigation.
Journal of Consumer MarketingA practical yet meaningful approach to customer segmentation
165 Citations1998Claudio Marcus
Learning to recommend helpful hotel reviews
150 Citations2009Michael P. O’Mahony, Barry Smyth
A classification-based recommender system that is designed to recommend the most helpful reviews for a given product, and it is shown that this approach is capable of suggesting superior reviews compared to a number of alternative recommendation benchmarks.
Lecture notes in computer scienceCharacterization of classification algorithms
117 Citations1995João Gama, Pavel Brazdil
This paper is concerned with the problem of characterization of classification algorithms and involves generation of different kinds of models, which include regression and rule models, piecewise linear models (model trees) and instance based models.
AIS Electronic Library (AISeL) (Association for Information Systems)Continental Airlines Flies High with Real-Time Business Intelligence
112 Citations2004Ron Anderson-Lehman, Hugh J. Watson +2 more
SSRN Electronic JournalDo Online Reviews Affect Product Sales? The Role of Reviewer Characteristics and Temporal Effects
110 Citations2008Nan Hu, Ling Liu +1 more
It is demonstrated that consumers understand the value difference between favorable news and unfavorable news and respond accordingly, and the impact of online reviews on sales diminishes over time, suggesting that firms need not provide incentives for customers to write reviews beyond a certain time period after products have been released.
Decision Support SystemsTo whom should I listen? Finding reputable reviewers in opinion-sharing communities
105 Citations2012Yi-Cheng Ku, Chih‐Ping Wei +1 more
This study attempts to discriminate members with a high reputation from those with a low reputation on the basis of members' web trust network and review behaviors in an opinion-sharing community, and results indicate that four variables successfully discriminate reviewers into the two groups.
Knowledge-Based SystemsA classification-based review recommender
99 Citations2009Michael P. O’Mahony, Barry Smyth
Journal of Consumer MarketingUsing database marketing techniques to enhance your one‐to‐one marketing initiatives
98 Citations1998Ron Kahan
It is asserted that there are two approaches to successful database marketing: cognitive and behavioral analysis, and the advantages of the mathematical computation RFM in consumer behavioral analysis are described.
Expert Systems with ApplicationsCRM strategies for a small-sized online shopping mall based on association rules and sequential patterns
84 Citations2012Beomsoo Shim, Keunho Choi +1 more
IEEE Intelligent SystemsWeighing Stars: Aggregating Online Product Reviews for Intelligent E-commerce Applications
83 Citations2008Zhu Zhang
A new task in text-sentiment analysis adds usefulness scoring to polarity/ opinion extraction to improve product- review ranking services, helping shoppers and vendors leverage information from multiple sources.
Decision Support SystemsDirect marketing decision support through predictive customer response modeling
73 Citations2012David L. Olson, Bongsug Chae
Variants of RFM-based predictive models are constructed and compared to classical data mining techniques of logistic regression, decision trees, and neural networks, which were found to yield better prediction in terms of both prediction accuracy and cumulative gains.
Understanding deja reviewers
68 Citations2010Éric Gilbert, Karrie Karahalios
A mixed-method study of deja reviewers, latecomers who echo what other people said, finds that roughly 10-15% of reviews substantially resemble previous ones, and interviews reviewers to understand their motives.
Decision Support SystemsInput online review data and related bias in recommender systems
40 Citations2012Selwyn Piramuthu, Gaurav Kapoor +2 more
This work considers a specific type of bias that is introduced in online product reviews due to the sequence in which these reviews are written and model several scenarios in this context and study their properties.
The Faculty Digital Archive (New York University)Estimating the Socio-Economic Impact of Product Reviews: Mining Text and Reviewer Characteristics
38 Citations2008Anindya Ghose, Panagiotis G. Ipeirotis
This paper is the first study that integrates econometric, text mining, and predictive modeling techniques toward a more complete analysis of the information captured by user-generated online reviews in order to estimate their socio-economic impact.
ACM Transactions on Management Information SystemsAnalyzing Online Review Helpfulness Using a Regressional ReliefF-Enhanced Text Mining Method
37 Citations2012Thomas Ngo-Ye, Atish P. Sinha
This study is the first to investigate and compare different dimension reduction techniques in the context of applying text regression for predicting online review helpfulness, and finds that RReliefF significantly outperforms two popular dimension reduction methods.
A Classification-based Review Recommender
22 Citations2009Michael P. O’Mahony, Barry Smyth
The paper presented at Twenty-ninth SGAI International Conference (AI-2009), Cambridge, UK, 15th-17th December 2009 presents a meta-anatomical simulation of the response of the immune system to TSPs.
HelpMeter: A Nonlinear Model for Predicting the Helpfulness of Online Reviews
17 Citations2008Yang Liu, Xiangji Huang +2 more
HelpMeter is proposed, a nonlinear regression model for helpfulness prediction that will automatically evaluate the "helpfulness" of reviews and consequently develop novel models to identify the most helpful reviews for a particular product.
A Model for Evaluating the Quality of User-Created Documents
16 Citations2009Linh Hoang, Jung‐Tae Lee +2 more