Identifying comparative customer requirements from product online reviews for competitor analysis
Engineering Applications of Artificial IntelligencePublished 22 December 2015Open access
Jian Jin, Ping Ji, Rui Gu
Citations156
SJR quartileQ1
SJR score1.65
SNIP1.89
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A framework is illustrated to select pairs of opinionated representative yet comparative sentences with specific product features from reviews of competitive products, and three greedy algorithms are proposed to analyze this problem for suboptimal solutions.
Abstract
A large volume of product online reviews are generated from time to time, which contain rich information regarding customer requirements. These reviews help designers to make exhaustive analyses of competitors, which is one indispensable step in market-driven product design. How to extract critical opinionated sentences associated with some specific features from product online reviews has been investigated by some researchers. However, few of them examined how to employ these valuable resources for competitor analysis. Hence, in this research, a framework is illustrated to select pairs of opinionated representative yet comparative sentences with specific product features from reviews of competitive products. With the help of the techniques on sentiment analysis, opinionated sentences referring to a specific feature are first identified from product online reviews. Then, information representativeness, information comparativeness and information diversity are investigated for the selection of a small number of representative yet comparative opinionated sentences. Accordingly, an optimization problem is formulated, and three greedy algorithms are proposed to analyze this problem for suboptimal solutions. Finally, with a large amount of real data from Amazon.com, categories of extensive experiments are conducted and the final encouraging results are realized, which prove the effectiveness of the proposed approach.
Keywords
Computer ScienceSocial Sciences
Recognizing contextual polarity in phrase-level sentiment analysis
3,379 Citations2005Theresa Wilson, Janyce Wiebe +1 more
A new approach to phrase-level sentiment analysis is presented that first determines whether an expression is neutral or polar and then disambiguates the polarity of the polar expressions.
A sentimental education
3,343 Citations2004Bo Pang, Lillian Lee
A novel machine-learning method is proposed that applies text-categorization techniques to just the subjective portions of the document, which greatly facilitates incorporation of cross-sentence contextual constraints.
A holistic lexicon-based approach to opinion mining
1,388 Citations2008Xiaowen Ding, Bing Liu +1 more
This paper proposes a holistic lexicon-based approach to solving the problem of determining the semantic orientations (positive, negative or neutral) of opinions expressed on product features in reviews by exploiting external evidences and linguistic conventions of natural language expressions.
Joint sentiment/topic model for sentiment analysis
972 Citations2009Chenghua Lin, Yulan He
A novel probabilistic modeling framework based on Latent Dirichlet Allocation (LDA), called joint sentiment/topic model (JST), which detects sentiment and topic simultaneously from text is proposed, which is fully unsupervised.
Movie review mining and summarization
909 Citations2006Zhuang Li, Jing Feng +1 more
A multi-knowledge based approach is proposed, which integrates WordNet, statistical analysis and movie knowledge, and the experimental results show the effectiveness of the proposed approach in movie review mining and summarization.
ACM Transactions on Information SystemsSentiment analysis in multiple languages
894 Citations2008Ahmed Abbasi, Hsinchun Chen +1 more
Stylistic features significantly enhanced performance across all testbeds while EWGA also outperformed other feature selection methods, indicating the utility of these features and techniques for document-level classification of sentiments.
Marketing ScienceMine Your Own Business: Market-Structure Surveillance Through Text Mining
704 Citations2012Oded Netzer, Ronen Feldman +2 more
This paper proposes an approach for firms to explore online user-generated content and “listen” to what customers write about their and their competitors' products and demonstrates this approach using two cases---sedan cars and diabetes drugs---generating market-structure perceptual maps and meaningful insights without interviewing a single consumer.
TUbilio (Technical University of Darmstadt)Extracting Opinion Targets in a Single and Cross-Domain Setting with Conditional Random Fields
480 Citations2010Niklas Jakob, Iryna Gurevych
This paper model the problem as an information extraction task, which is addressed based on Conditional Random Fields (CRF), and employs the supervised algorithm by Zhuang et al. (2006), which represents the state-of-the-art on the employed data.
Identifying comparative sentences in text documents
445 Citations2006Nitin Jindal, Bing Liu
This paper first categorizes comparative sentences into different types, and then presents a novel integrated pattern discovery and supervised learning approach to identifying comparative sentences from text documents.
Rated aspect summarization of short comments
376 Citations2009Yue Lu, ChengXiang Zhai +1 more
The proposed methods are quite general and can be used to generate rated aspect summary automatically given any collection of short comments each associated with an overall rating.
Decision Support SystemsMining comparative opinions from customer reviews for Competitive Intelligence
302 Citations2010Kaiquan Xu, Stephen Shaoyi Liao +2 more
A novel graphical model is proposed to extract and visualize comparative relations between products from customer reviews, with the interdependencies among relations taken into consideration, to help enterprises discover potential risks and further design new products and marketing strategies.
Structure-Aware Review Mining and Summarization
284 Citations2010Fangtao Li, Chao Han +5 more
This paper proposes a new machine learning framework based on Conditional Random Fields that can employ rich features to jointly extract positive opinions, negative opinions and object features for review sentences and shows that structure-aware models outperform many state-of-the-art approaches to review mining.
National University of SingaporeAspect Ranking: Identifying Important Product Aspects from Online Consumer Reviews
236 Citations2011Jianxing Yu, Zheng-Jun Zha +2 more
This paper develops an aspect ranking algorithm, which aims to automatically identify important product aspects from online consumer reviews by simultaneously considering the aspect frequency and the influence of consumers' opinions given to each aspect on their overall opinions.
Automatic identification of pro and con reasons in online reviews
225 Citations2006Soo-Min Kim, Eduard Hovy
A maximum entropy model is trained on the resulting labeled set to subsequently extract pros and cons from online review sites that do not explicitly provide them, and the resulting system identifies pros andcons with 66% precision and 76% recall.
Computers in Human BehaviorDoes source matter? Examining source effects in online product reviews
209 Citations2012Xue Dou, Justin Walden +2 more
Evaluating the intentions of online reviewers is a critical antecedent to forming opinions about online reviews and products, and visible sources play a crucial role in helping people judge the credibility of online reviews.
The utility of linguistic rules in opinion mining
209 Citations2007Xiaowen Ding, Bing Liu
This paper proposes to use some linguistic rules to deal with the problem of determining the semantic orientations (positive or negative) of opinions expressed on product features in reviews together with a new opinion aggregation function.
Expert Systems with ApplicationsGather customer concerns from online product reviews – A text summarization approach
193 Citations2008Jiaming Zhan, Han Tong Loh +1 more
This work proposes an automatic summarization approach based on the analysis of review articles' internal topic structure to assemble customer concerns and shows that the proposed approach outperforms the peer approaches, i.e. opinion mining and clustering-summarization, in terms of users' responsiveness and its ability to discover the most important topics.
Summarizing Contrastive Viewpoints in Opinionated Text
179 Citations2010Michael J. Paul, ChengXiang Zhai +1 more
Experimental results show that the proposed approach can generate informative summaries of viewpoints in opinionatedText, with significant performance gains over bag-of-words feature sets.
Computer-Aided DesignIdentifying helpful online reviews: A product designer’s perspective
162 Citations2012Ying Liu, Jian Jin +3 more
This study proposes four categories of features that reflect designers' concerns in judging review helpfulness and argues that the study reported is able to improve designer's ability in business intelligence processing by offering more targeted customer opinions.
Generating comparative summaries of contradictory opinions in text
151 Citations2009Hyun Duk Kim, ChengXiang Zhai
This paper formally formulate the problem as an optimization problem and proposes two general methods for generating a comparative summary using the framework, both of which rely on measuring the content similarity and contrastive similarity of two sentences.
Extracting usability and user experience information from online user reviews
127 Citations2013Steffen Hedegaard, Jakob Grue Simonsen
The results suggest that a greater understanding of users' preoccupation with different dimensions of usability and UX may be inferred from the large volume of self-reported experiences online, and that research focused on identifying pertinent dimensions of UX may benefit further from empirical studies of user-generated experience reports.
Selecting a comprehensive set of reviews
124 Citations2011Panayiotis Tsaparas, Alexandros Ntoulas +1 more
This work focuses on the problem of selecting a comprehensive set of few high-quality reviews that cover many different aspects of the reviewed item, and formulate the problem as a maximum coverage problem, and presents a generic formalism that can model the different variants of review-set selection.
Grouping Product Features Using Semi-Supervised Learning with Soft-Constraints
119 Citations2010Zhongwu Zhai, Bing Liu +2 more
Experimental results using reviews from five different domains show that the proposed constrained semi-supervised learning method is competent for the task and outperforms the original EM and the state-of-the-art existing methods by a large margin.
Mining contrastive opinions on political texts using cross-perspective topic model
117 Citations2012Yi Fang, Luo Si +2 more
An extensive set of experiments have been conducted to evaluate the proposed unsupervised topic model for contrastive opinion modeling, which simulates the generative process of how opinion words occur in the documents of different collections.
Topic-driven reader comments summarization
104 Citations2012Zongyang Ma, Aixin Sun +2 more
The experimental results show that EXTM significantly outperforms MSTM by perplexity and through a user study, it is confirmed that the comment summary generated by EXTM achieves better intra-clusters topic cohesion and inter-cluster topic diversity.
Active Learning for Imbalanced Sentiment Classification
96 Citations2012Shoushan Li, Shengfeng Ju +2 more
This paper proposes a novel active learning approach, named co-selecting, that employs two feature subspace classifiers to collectively select most informative minority-class samples for manual annotation by leveraging a certainty measurement and an uncertainty measurement, to reduce human-annotation efforts.
ETF
95 Citations2012Samaneh Moghaddam, Mohsen Jamali +1 more
This paper proposes a series of increasingly sophisticated probabilistic graphical models, based on Matrix Factorization and Tensor Factorization, and evaluates the proposed models using a database of 1.5 million reviews and more than 13 million quality ratings obtained from Epinions.com.
Expert Systems with ApplicationsComparison of feature-level learning methods for mining online consumer reviews
90 Citations2012Li Chen, Luole Qi +1 more
The Conditional Random Fields (CRFs) model is adopted for feature-level review mining and the role of a self-tagging process is integrated, and the ideal combination of learning functions is identified to optimize its learning performance.
Mining contentions from discussions and debates
78 Citations2012Arjun Mukherjee, Bing Liu
Three models are proposed to solve the problem of fine-grained mining of contentions in discussion/debate forums and model the intrinsic nature of discussions/debates, i.e., interactions among discussants or debaters and topic sharing among posts through quoting and replying relations.
Discovery of significant emerging trends
71 Citations2010Saurabh Goorha, Lyle Ungar
A system that monitors social and mainstream media to determine shifts in what people are thinking about a product or company is described, which improves the signal-to-noise ratio and pinpoints precisely the opportunities and risks that matter most to communications professionals and their organizations.
ACM Transactions on Management Information SystemsProduct Comparison Networks for Competitive Analysis of Online Word-of-Mouth
71 Citations2013Zhang Zhu, Chenhui Guo +1 more
The results suggest that WOM in social media also constitutes a competitive landscape for firms to understand and manipulate, and provide important insights into the business impact of social media and user-generated content, an emerging problem in business intelligence research.
Selecting a characteristic set of reviews
68 Citations2012Theodoros Lappas, Mark Crovella +1 more
This paper fills the gap between existing review-summarization and review-selection methods by selecting a small subset of reviews that together preserve the statistical properties of the entire review corpus and formalize this task as a combinatorial optimization problem and show that it NP-hard both tosolve and approximate.
Predicting emerging product design trend by mining publicly available customer review data
59 Citations2011Conrad S. Tucker, Harrison Kim
A robust framework to enrich new product design process by dynamically capturing customer preference trends from publicly available product review data which is abundantly available but grossly underutilized is presented.
Product comparison using comparative relations
56 Citations2011Li Si, Zheng-Jun Zha +5 more
Experiments on popular electronic products show that the proposed approach outperforms the state-of-the-art methods.
World Wide WebSentiment analysis on microblog utilizing appraisal theory
53 Citations2013Peter Korenek, Marián Šimko
A novel method for sentiment analysis of a text that allows the recognition of opinions in microblogs which are connected to a particular target or an entity and is feasible even for such specific content as presented on microblogs is presented.
Essentials of Marketing
51 Citations1998Jim Blythe
Product review summarization from a deeper perspective
48 Citations2011Duy Khang Ly, Kazunari Sugiyama +2 more
A system that automatically summarizes a large collection of product reviews to generate a concise summary is built, which not only extracts the review sentiments but also the underlying justification for their opinion.
Journal of Engineering DesignPrioritising engineering characteristics based on customer online reviews for quality function deployment
40 Citations2014Jian Jin, Ping Ji +1 more
Topic-Based Bengali Opinion Summarization
40 Citations2010Amitava Das, Sivaji Bandyopadhyay
The development of an opinion summarization system that works on Bengali News corpus and building of annotated gold standard corpus and acquisition of linguistics tools for lexico-syntactic, syntactic and discourse level features extraction are described.
Customer-Driven Product Design Selection Using Web Based User-Generated Content
35 Citations2011Lei Wang, Byeng D. Youn +2 more
A systematic methodology for eliciting product attributes from UGC, constructing customer preference models and using these models in design selection is developed and it is shown that the proposed method can provide a reasonable estimation of customer preferences while being useful for product design selection.
Unsupervised discovery of opposing opinion networks from forum discussions
33 Citations2012Yue Lu, Hongning Wang +2 more
The experimental results show that the proposed optimization method outperforms several baselines and existing approaches, demonstrating the power of combining both text analysis and social network analysis in analyzing and generating the opposing opinion networks.
Review recommendation
25 Citations2011Samaneh Moghaddam, Mohsen Jamali +1 more
This paper employs latent factor models to address the problem of identifying high quality and helpful reviews automatically and demonstrates that the helpfulness of a review is indeed not the same for all users.
Affinity-driven prediction and ranking of products in online product review sites
15 Citations2010Hui Li, Sourav S. Bhowmick +1 more
This paper identifies and analyzes an array of features that exert effect on product affinity and proposes a novel model, called AffRank, that utilizes these features to predict the future rank of products according to their affinities.
Dual word and document seed selection for semi-supervised sentiment classification
11 Citations2012Shengfeng Ju, Shoushan Li +4 more
A novel selection strategy is proposed to simultaneously select good words and documents for manual annotation by considering both of their annotation costs and informativeness.