Illusions of truth—Experimental insights into human and algorithmic detections of fake online reviews
Journal of Business ResearchPublished 14 December 2018
Daria Plotkina, Andréas Munzel, Jessie Pallud
Citations122
SJR quartileQ1
SJR score3.50
SNIP3.35
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Independent analysis of reviewing websites confirms the presence of dubious content and, therefore, the need to introduce more sophisticated filtering approaches.
Abstract
International audience
Keywords
Computer ScienceSocial Sciences
Multivariate data analysis : a global perspective
11,765 Citations2010Joseph F. Hair
1 Introduction: Models and Model Building 2 Understanding and Preparing for Multivariate Analysis 3 Cleaning and Transforming Data 4 Simple and Multiple Regression Analysis 5 Canonical correlation 6 Conjoint analysis 7 Multiple Discriminant Analysis and Logistic Regression 8 ANOVA and MANOVA Analysis using Interdependence Techniques 9 Group data and Cluster Analysis
Journal of Interactive MarketingElectronic word-of-mouth via consumer-opinion platforms: What motivates consumers to articulate themselves on the Internet?
5,779 Citations2004Thorsten Hennig‐Thurau, Kevin P. Gwinner +2 more
Journal of Language and Social PsychologyThe Psychological Meaning of Words: LIWC and Computerized Text Analysis Methods
5,776 Citations2009Yla Tausczik, James W. Pennebaker
Empirical results using LIWC demonstrate its ability to detect meaning in a wide variety of experimental settings, including to show attentional focus, emotionality, social relationships, thinking styles, and individual differences.
Judgment and Decision MakingRunning experiments on Amazon Mechanical Turk
3,803 Citations2010Gabriele Paolacci, Jesse Chandler +1 more
New demographic data about the Mechanical Turk subject population is presented, the strengths of Mechanical Turk relative to other online and offline methods of recruiting subjects are reviewed, and the magnitude of effects obtained using Mechanical Turk and traditional subject pools are compared.
Journal of Consumer ResearchThe Persuasion Knowledge Model: How People Cope with Persuasion Attempts
3,575 Citations1994Marian Friestad, Peter Wright
Psychological BulletinCues to deception.
2,347 Citations2003Bella M. DePaulo, James J. Lindsay +4 more
Results show that in some ways, liars are less forthcoming than truth tellers, and they tell less compelling tales, and their stories include fewer ordinary imperfections and unusual contents.
International Journal of Electronic CommerceThe Effect of On-Line Consumer Reviews on Consumer Purchasing Intention: The Moderating Role of Involvement
2,065 Citations2007Do-Hyung Park, Jumin Lee +1 more
The elaboration likelihood model is used to explain how level of involvement with a product moderates these relationships, and the quality of on-line reviews has a positive effect on consumers' purchasing intention and purchasing intention increases as the number of reviews increases.
International Journal of AdvertisingDeterminants of consumer engagement in electronic word-of-mouth (eWOM) in social networking sites
1,983 Citations2011Shu‐Chuan Chu, Yoojung Kim
Personality and Social Psychology ReviewAccuracy of Deception Judgments
1,933 Citations2006Charles F. Bond, Bella M. DePaulo
It is proposed that people judge others' deceptions more harshly than their own and that this double standard in evaluating deceit can explain much of the accumulated literature.
Journal of MarketingImpact of Online Consumer Reviews on Sales: The Moderating Role of Product and Consumer Characteristics
1,652 Citations2010Feng Zhu, Xiaoquan Zhang
Opinion spam and analysis
1,520 Citations2008Nitin Jindal, Bing Liu
It is shown that opinion spam is quite different from Web spam and email spam, and thus requires different detection techniques, and therefore requires some novel techniques to detect them.
Personality and Social Psychology BulletinLying Words: Predicting Deception from Linguistic Styles
1,457 Citations2003Matthew L. Newman, James W. Pennebaker +2 more
Journal of MarketingImpact of Online Consumer Reviews on Sales: The Moderating Role of Product and Consumer Characteristics
1,454 Citations2010Feng Zhu, Xiaoquan Zhang
Detecting Lies and Deceit: Pitfalls and Opportunities
1,310 Citations2008Aldert Vrij
Communication TheoryInterpersonal Deception Theory
1,188 Citations1996David B. Buller, Judee K. Burgoon
Journal of Artificial Intelligence ResearchUsing Linguistic Cues for the Automatic Recognition of Personality in Conversation and Text
1,005 Citations2007François Mairesse, Marilyn Walker +2 more
Experimental results for recognition of all Big Five personality traits, in both conversation and text, utilising both self and observer ratings of personality are reported, confirming previous findings linking language and personality, while revealing many new linguistic markers.
Journal of Consumer PsychologyDevelopment of a Scale to Measure Consumer Skepticism Toward Advertising
985 Citations1998Carl Obermiller, Eric R. Spangenberg
Journal of Business ResearchInformation direction, website reputation and eWOM effect: A moderating role of product type
936 Citations2008Cheol Park, Thae Min Lee
The results support the moderating effects of product type on the eWOM information direction-website reputation-eWOM effect relationship and provide managerial implications for an Internet marketing strategy.
American Economic ReviewPromotional Reviews: An Empirical Investigation of Online Review Manipulation
898 Citations2014Dina Mayzlin, Yaniv Dover +1 more
Spotting fake reviewer groups in consumer reviews
747 Citations2012Arjun Mukherjee, Bing Liu +1 more
This paper studies spam detection in the collaborative setting, i.e., to discover fake reviewer groups by using several behavioral models derived from the collusion phenomenon among fake reviewers and relation models based on the relationships among groups, individual reviewers, and products they reviewed to detectfake reviewer groups.
Detecting product review spammers using rating behaviors
720 Citations2010Ee‐Peng Lim, Viet-An Nguyen +3 more
This paper identifies several characteristic behaviors of review spammers and model these behaviors so as to detect the spammers, and shows that the detected spammers have more significant impact on ratings compared with the unhelpful reviewers.
Educational ResearcherCoh-Metrix
612 Citations2011Arthur C. Graesser, Danielle S. McNamara +1 more
The authors discuss five major factors that account for most of the variance in texts across grade levels and text categories: word concreteness, syntactic simplicity, referential cohesion, causal cohesion, and narrativity.
IEEE Transactions on Systems Man and Cybernetics - Part A Systems and HumansPerils of Internet fraud: an empirical investigation of deception and trust with experienced Internet consumers
579 Citations2000Stefano Grazioli, Sirkka L. Järvenpää
Results show that most subjects failed to detect the fraud manipulations, albeit a few succeeded, and sheds light on consumers' vulnerability to attack by hackers posing as a legitimate site.
Proceedings of the International AAAI Conference on Web and Social MediaWhat Yelp Fake Review Filter Might Be Doing?
556 Citations2021Arjun Mukherjee, Vivek V. Venkataraman +2 more
This work attempts to find out what Yelp might be doing by analyzing its filtered reviews and postulates that Yelp’s filtering is reasonable and its filtering algorithm seems to be correlated with abnormal spamming behaviors.
Journal of Language and Social PsychologyTruth-Default Theory (TDT)
550 Citations2014Timothy R. Levine
Decision Support SystemsManipulation of online reviews: An analysis of ratings, readability, and sentiments
529 Citations2011Nan Hu, Indranil Bose +2 more
A simple statistical method is proposed to detect online reviews manipulation, and assess how consumers respond to products with manipulated reviews, and the effectiveness of manipulation through ratings, sentiments, and readability is investigated.
Discourse ProcessesOn Lying and Being Lied To: A Linguistic Analysis of Deception in Computer-Mediated Communication
514 Citations2007Jeffrey T. Hancock, Lauren E. Curry +2 more
Investigating changes in both the liar's and the conversational partner's linguistic style across truthful and deceptive dyadic communication in a synchronous text-based setting revealed that motivated liars avoided causal terms when lying, whereas unmotivated liars tended to increase their use of negations.
Psychological Science in the Public InterestPitfalls and Opportunities in Nonverbal and Verbal Lie Detection
508 Citations2010Aldert Vrij, Pär Anders Granhag +1 more
Whether people can detect lies when observing someone’s nonverbal behavior or analyzing someone‘s speech is discussed.
A comparison of machine learning techniques for phishing detection
498 Citations2007Saeed Abu‐Nimeh, Dario Nappa +2 more
This study compares the predictive accuracy of several machine learning methods including Logistic Regression (LR), Classification and Regression Trees (CART), Bayesian Additive Regression trees (BART), Support Vector Machines (SVM), Random Forests (RF), and Neural Networks (NNet) for predicting phishing emails.
Journal Of Big DataSurvey of review spam detection using machine learning techniques
495 Citations2015Mike Crawford, Taghi M. Khoshgoftaar +3 more
A strong and comprehensive comparative study of current research on detecting review spam using various machine learning techniques and to devise methodology for conducting further investigation is provided.
NeuroImageClassifying spatial patterns of brain activity with machine learning methods: Application to lie detection
475 Citations2005Christos Davatzikos, Kosha Ruparel +6 more
High-dimensional non-linear pattern classification methods applied to functional magnetic resonance images were used to discriminate between the spatial patterns of brain activity associated with lie and truth, and indicate that accurate clinical tests could be based on measurements of brain function with fMRI.
Review spam detection
447 Citations2007Nitin Jindal, Bing Liu
This paper makes an attempt to study review spam and spam detection.
Journal of Consumer ResearchIncorporating Choice into an Attitudinal Framework: Analyzing Models of Mental Comparison Processes
441 Citations1994Pratibha A. Dabholkar
Communication MonographsAccuracy in detecting truths and lies: Documenting the “veracity effect”
414 Citations1999Timothy R. Levine, Hee Sun Park +1 more
Syntactic Stylometry for Deception Detection
414 Citations2012Song Feng, Ritwik Banerjee +1 more
This paper investigates syntactic stylometry for deception detection, adding a somewhat unconventional angle to prior literature and demonstrating that features driven from Context Free Grammar (CFG) parse trees consistently improve the detection performance over several baselines that are based only on shallow lexico-syntactic features.
Proceedings of the International AAAI Conference on Web and Social MediaOpinion Fraud Detection in Online Reviews by Network Effects
400 Citations2021Leman Akoglu, Rishi Chandy +1 more
A fast and effective framework for spotting fraudsters and fake reviews in online review datasets, FRAUDEAGLE, which exploits the network effect among reviewers and products and is scalable to large datasets as its run time grows linearly with network size.
Review spam detection via temporal pattern discovery
400 Citations2012Sihong Xie, Guan Wang +2 more
It is discovered that singleton review is a significant source of spam reviews and largely affects the ratings of online stores and a hierarchical algorithm is proposed to robustly detect the time windows where such attacks are likely to have happened.
Review Graph Based Online Store Review Spammer Detection
382 Citations2011Guan Wang, Sihong Xie +2 more
This paper proposes a novel concept of a heterogeneous review graph to capture the relationships among reviewers, reviews and stores that the reviewers have reviewed, and explores how interactions between nodes in this graph can reveal the cause of spam.
Finding unusual review patterns using unexpected rules
339 Citations2010Nitin Jindal, Bing Liu +1 more
Using the technique, an Amazon.com review dataset is analyzed and many unexpected rules and rule groups which indicate spam activities are found.
The lie detector
339 Citations2009Rada Mihalcea, Carlo Strapparava
It is shown that automatic classification is a viable technique to distinguish between truth and falsehood as expressed in language and a method for class-based feature analysis is introduced, which sheds some light on the features that are characteristic for deceptive text.
Learning to identify review spam
332 Citations2011Fangtao Li, Minlie Huang +2 more
This paper exploits machine learning methods to identify review spam and provides a twoview semi-supervised method, co-training, to exploit the large amount of unlabeled data and shows that the proposed method is effective.
Experimental EconomicsWould I lie to you? On social preferences and lying aversion
315 Citations2008Sjaak Hurkens, Navin Kartik
Journal of Business ResearchProduct sales forecasting using online reviews and historical sales data: A method combining the Bass model and sentiment analysis
314 Citations2017Zhi‐Ping Fan, Yu-Jie Che +1 more
A novel method that combines the Bass/Norton model and sentiment analysis while using historical sales data and online review data is developed for product sales forecasting.
Journal of CommunicationWhat Lies Beneath: The Linguistic Traces of Deception in Online Dating Profiles
295 Citations2012Catalina L. Toma, Jeffrey T. Hancock
Negative Deceptive Opinion Spam
291 Citations2013Myle Ott, Claire Cardie +1 more
This work creates and study the first dataset of deceptive opinion spam with negative sentiment reviews, and finds that standard n-gram text categorization techniques can detect negative deceptive opinions spam with performance far surpassing that of human judges.
Law and Human BehaviorCues to deception and ability to detect lies as a function of police interview styles.
273 Citations2007Aldert Vrij, Samantha Mann +2 more
The results showed that accusatory interviews, which typically result in suspects making short denials, contained the fewest verbal cues to deceit, and RM distinguished between truth tellers and liars better than CBCA.
ACM Transactions on Management Information SystemsText mining and probabilistic language modeling for online review spam detection
225 Citations2011Raymond Y.K. Lau, Stephen Shaoyi Liao +4 more
The work discussed in this article represents the first successful attempt to apply text mining methods and semantic language models to the detection of fake consumer reviews.
Information Systems ResearchThe Impact of Fake Reviews on Online Visibility: A Vulnerability Assessment of the Hotel Industry
219 Citations2016Theodoros Lappas, Gaurav Sabnis +1 more
It is found that even limited injections of fake reviews can have a significant effect and the factors that contribute to this can be explored.
Comparison of Deceptive and Truthful Travel Reviews
217 Citations2009Kyung-Hyan Yoo, Ulrike Gretzel
Using findings from deception theory, a study was conducted to compare the language structure of deceptive and truthful hotel reviews, suggesting that it might be difficult to distinguish between deception and truthful reviews based on structural properties.
Proceedings of the International AAAI Conference on Web and Social MediaDistributional Footprints of Deceptive Product Reviews
217 Citations2021Song Feng, Longfei Xing +2 more
A range of experiments confirm the hypothesized connection between the distributional anomaly and deceptive reviews and provide novel quantitative insights into the characteristics of natural distributions of opinions in the TripAdvisor hotel review and the Amazon product review domains.
Journal of Marketing ResearchThe Differential Impact of Goal Congruency on Attitudes, Intentions, and the Transfer of Brand Equity
204 Citations2001Ingrid M. Martin, David W. Stewart
The Elementary School JournalCoh-Metrix Measures Text Characteristics at Multiple Levels of Language and Discourse
191 Citations2014Arthur C. Graesser, Danielle S. McNamara +4 more
How these five factors account for text variations are reviewed, which increases with low narrativity, syntactic complexity, word abstractness, and high cohesion, and a composite measure called formality are reviewed.
CyberPsychology & BehaviorOnline Deception: Prevalence, Motivation, and Emotion
188 Citations2006Avner Caspi, Paul Gorsky
It was found that, while most of the respondents believe that online deception is very widespread, only about one-third of them reported engaging in online deception.
Journal of Personality and Social PsychologyBehavioral roots of person perception: The deception judgments of customs inspectors and laymen.
181 Citations1980Robert E. Kraut, Donald B. Poe
Journal of Personality and Social PsychologyIndividual differences and cues to deception.
180 Citations1983Ronald E. Riggio, Howard S. Frıedman
Journal of Business ResearchWhen good WOM hurts and bad WOM gains: The effect of untrustworthy online reviews
178 Citations2016Thomas Reimer, Martin Benkenstein
Journal of Consumer PolicyTaking Fake Online Consumer Reviews Seriously
177 Citations2013Justin Malbon
International Journal of Operations & Production ManagementPredicting online product sales via online reviews, sentiments, and promotion strategies
175 Citations2016Alain Yee‐Loong Chong, Boying Li +3 more
It is found that although online reviews, online promotional strategies and online sentiments can all predict product sales, some variables are more important predictors than others.
Journal of Retailing and Consumer ServicesAssisting consumers in detecting fake reviews: The role of identity information disclosure and consensus
144 Citations2016Andréas Munzel
Public Relations ReviewIntention to comply with crisis messages communicated via social media
144 Citations2012Karen Freberg
Journal of Language and Social PsychologyPredicting Final Course Performance From Students’ Written Self-Introductions
136 Citations2013Rebecca Robinson, Reanelle Navea +1 more
Law and Human BehaviorThe effect of training in criteria-based content analysis on the ability to detect deception in adults.
97 Citations1992Kristine L. Landry, John C. Brigham
International Journal of Continuing Engineering Education and Life-Long LearningUnderstanding expert ratings of essay quality: Coh-Metrix analyses of first and second language writing
93 Citations2011Scott A. Crossley, Danielle S. McNamara
The results support the notion that human judgements of essay quality are best predicted by linguistic indices that correlate with measures of language sophistication such as lexical diversity, word frequency, and syntactic complexity.
Detecting Deceptive Opinions with Profile Compatibility
91 Citations2013Vanessa Wei Feng, Graeme Hirst
The recently proposed N-GRAM+SYN model of Feng et al. (2012a) is extended by incorporating profile compatibility features, showing such an addition significantly improves upon their state-ofart classification performance.
Expert Systems with ApplicationsAn investigation of data and text mining methods for real world deception detection
81 Citations2011Christie M. Fuller, David Biros +1 more
Data and text mining methods along with a sample of real-world data from a high-stakes situation is used to detect deception and the information fusion based classification models produced better than 74% classification accuracy on the holdout sample using a 10-fold cross validation methodology.
Communications of the ACMFollowing linguistic footprints
80 Citations2008Lina Zhou, Dongsong Zhang
Through a series of studies on deception in online communication, a collection of linguistic cues to deception and models for automatic deception detection are obtained and can be used to assist people in detecting online deception and to increase the public awareness of deception inOnline communication.
Detecting Deceptive Opinion Spam Using Human Computation
72 Citations2012Christopher G. Harris
This study pools deceptive reviews solicited through crowdsourcing with actual reviews obtained from product review websites to spot deceptive opinion spam and finds that the combination of human-based assessment methods with easily-obtained statistical information generated from the review text outperforms detection methods using human assessors alone.
Applied Natural Language Processing: Identification, Investigation and Resolution
71 Citations2011Martin Hassel, Hercules Dalianis
This chapter sets the focus on automatic summarization of text using as few direct human resources as possible, resulting in what can be perceived as an intermediary system, and presents the notion of taking a holistic view of the generation of summaries.
Computers in Human BehaviorDevelopment of a scale to measure skepticism toward electronic word-of-mouth
70 Citations2015Xiao Zhang, Myung Ko +1 more
A new measurement scales for eWOM skepticism were established using data from a preliminary survey and validated using a second survey dataset, suggesting that the reliability and validity of the new scales suggested that the new instrument is suitable for measuring eWom skepticism.
Journal of Retailing and Consumer ServicesDelight the experts, but never dissatisfy your customers! A multi-category study on the effects of online review source on intention to buy a new product
67 Citations2015Daria Plotkina, Andréas Munzel
Applied PsycholinguisticsThe linguistic correlates of conversational deception: Comparing natural language processing technologies
67 Citations2010Nicholas D. Duran, Charles Hall +2 more
The results from Coh-Metrix are compared to linguistic features reported in previous independent research, which used a natural language processing tool called Linguistic Inquiry and Word Count, and reveal converging and contrasting alignment for several linguistic features.
Computers in Human BehaviorLanguage dominance in interpersonal deception in computer-mediated communication
67 Citations2003Lina Zhou, Judee K. Burgoon +2 more
It is suggested that in CMC, deceivers not only adjust the level of language dominance more frequently, but also change it more remarkably than truthtellers.
Psychology Crime and LawEffects of preconceptions on deception detection and new answers to why lie-catchers often fail
62 Citations2000Pär Anders Granhag, Leif A. Strömwall
Lecture notes in computer scienceFake Reviews: The Malicious Perspective
56 Citations2012Theodoros Lappas
This work performs an analysis that emulates an actual attack on a real review corpus, and discusses different attack strategies, as well as the various contributing factors that determine the attack's impact.
Using PU-Learning to Detect Deceptive Opinion Spam
55 Citations2013Donato Hernández, Rafael Guzmán-Cabrera +2 more
This paper focuses on the detection of deceptive opinion spam, which consists of fictitious opinions that have been deliberately written to sound authentic, in order to deceive the consumers and proposes a method based on the PU-learning approach which learns only from a few positive examples and a set of unlabeled data.
Computer law & security reviewGaming the system: Fake online reviews v. consumer law
53 Citations2015Kate Mathews Hunt
Electronic Commerce ResearchThe influence of information cascades on online purchase behaviors of search and experience products
48 Citations2016Qihua Liu, Shan Huang +1 more
Identifying Manipulated Offerings on Review Portals
42 Citations2013Jiwei Li, Myle Ott +1 more
A semi-supervised manifold ranking algorithm is introduced for identifying offerings that contain fake reviews, and a novel evaluation procedure is introduced that ranks artificial instances of real offerings, where each artificial offering contains a known number of injected deceptive reviews.
In Search of a Gold Standard in Studies of Deception
40 Citations2012Stephanie Gokhman, Jeffrey T. Hancock +3 more
Crowd-sourcing is offered as a novel avenue toward achieving a gold standard corpus for deception research and an in-depth case study of online hotel reviews shows its applicability to a broad array of online reviews.
The Lie Detector: Explorations in the Automatic Recognition of Deceptive Language
39 Citations2009Rada Mihalcea
Group Decision and NegotiationDeception in the Case of One Sender and Multiple Receivers
37 Citations2004L. Kent Marett, Joey F. George
Journal of Business ResearchInvestigating the effect of quality of grammar and mechanics (QGAM) in online reviews: The mediating role of reviewer crediblity
34 Citations2017Seth Ketron
Psychology and MarketingUnderstanding the Impact of Online Reviews on Customer Choice: A Probability Discounting Approach
28 Citations2016Asle Fagerstrøm, Gheorghiță Ghinea +1 more
IGI Global eBooksUsing LIWC and Coh-Metrix to Investigate Gender Differences in Linguistic Styles
20 Citations2012Courtney M. Bell, Philip M. McCarthy +1 more
Psychology and MarketingeWOM Watchdogs: Ego‐Threatening Product Domains and the Policing of Positive Online Reviews
20 Citations2014Lindsay R.L. Larson, Luther Trey Denton
Scientometrics of Deception, Counter-deception, and Deception Detection in Cyber-space
17 Citations2011Frank J. Stech, Kristin E. Heckman +2 more
Observations suggest that cyber-deception is an emerging field and that various deceptive tactics are characterized more from the standpoint of technology than from their social, behavioral, or cognitive elements.
International Conference on Information SystemsAn Empirical Study of Online Consumer Review Spam: A Design Science Approach
13 Citations2010Raymond Y.K. Lau, Stephen Shaoyi Liao +1 more
The proposed methodology outperforms other well-known baseline methods for detecting untruthful reviews collected from amazon.com and enables us to conduct an econometric analysis to examine the impact of fake reviews on product sales.
arXiv (Cornell University)Automated Crowdturfing Attacks and Defenses in Online Review Systems
12 Citations2017Yuanshun Yao, Bimal Viswanath +3 more
Business Ethics A European ReviewDeception and defection from ethical norms in market relationships: a general analytic framework
5 Citations2009William W. Keep, Gary P. Schneider
…