Chinese sentiment classification using a neural network tool — Word2vec
Published 1 September 2014
Zengcai Su, Hua Xu, Dongwen Zhang, Yunfeng Xu
Citations34
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The experimental results show that the accuracy of sentiment classification is over 90 percent, which proves the effectiveness of proposed method for Chinese sentiment classification.
Abstract
Sentiment classification is the main and popular task in the field of sentiment analysis. Most of the existing researches focus on how to extract the effective features, such as lexical features and syntactic features, while limited work has been done on the extraction of semantic features, which can make more contributions to sentiment classification. This paper presents a method for sentiment classification based on word2vec. Word2vec is a tool, which establishes the neural network models to learn the vector representations of words in the high dimensional vector space. So it can extract the deep semantic relationships between words. In this paper, firstly, we cluster the similar features together using word2vec. And then we use word2vec again to learn the word representations as candidate feature vectors. After feature selection, the SVM perf package is adopted to train and classify the comment texts. To conduct the experiments, we collect a large number of Chinese comments on clothing products as data set. The experimental results show that the accuracy of sentiment classification is over 90 percent, which proves the effectiveness of proposed method for Chinese sentiment classification.
Keywords
Computer Science
arXiv (Cornell University)Distributed Representations of Words and Phrases and their Compositionality
18,086 Citations2013Tomáš Mikolov, Ilya Sutskever +3 more
This paper presents a simple method for finding phrases in text, and shows that learning good vector representations for millions of phrases is possible and describes a simple alternative to the hierarchical softmax called negative sampling.
arXiv (Cornell University)Efficient Estimation of Word Representations in Vector Space
18,050 Citations2013Tomáš Mikolov, Kai Chen +2 more
Two novel model architectures for computing continuous vector representations of words from very large data sets are proposed and it is shown that these vectors provide state-of-the-art performance on the authors' test set for measuring syntactic and semantic word similarities.
Thumbs up?
6,987 Citations2002Bo Pang, Lillian Lee +1 more
This work considers the problem of classifying documents not by topic, but by overall sentiment, e.g., determining whether a review is positive or negative, and concludes by examining factors that make the sentiment classification problem more challenging.
now publishers, Inc. eBooksOpinion Mining and Sentiment Analysis
6,745 Citations2008Bo Pang, Lillian Lee
Foundations and Trends® in Information RetrievalOpinion Mining and Sentiment Analysis
6,204 Citations2008Bo Pang, Lillian Lee
This survey covers techniques and approaches that promise to directly enable opinion-oriented information-seeking systems and focuses on methods that seek to address the new challenges raised by sentiment-aware applications, as compared to those that are already present in more traditional fact-based analysis.
Encyclopedia of Machine Learning and Data MiningSentiment Analysis and Opinion Mining
3,319 Citations2017Lei Zhang, Bing Liu
Synthesis lectures on human language technologiesSentiment Analysis and Opinion Mining
3,241 Citations2012Bing Liu
This book is a comprehensive introductory and survey text that covers all important topics and the latest developments in the field with over 400 references and is suitable for students, researchers and practitioners who are interested in social media analysis in general and sentiment analysis in particular.
Linguistic Regularities in Continuous Space Word Representations
2,882 Citations2013Tomáš Mikolov, Wen-tau Yih +1 more
The vector-space word representations that are implicitly learned by the input-layer weights are found to be surprisingly good at capturing syntactic and semantic regularities in language, and that each relationship is characterized by a relation-specific vector offset.
arXiv (Cornell University)Thumbs up? Sentiment Classification using Machine Learning Techniques
2,208 Citations2002Bo Pang, Lillian Lee +1 more
Training linear SVMs in linear time
1,947 Citations2006Thorsten Joachims
A Cutting Plane Algorithm for training linear SVMs that provably has training time 0(s,n) for classification problems and o(sn log (n)) for ordinal regression problems and several orders of magnitude faster than decomposition methods like svm light for large datasets.
Sentiment Analysis and Subjectivity
1,594 Citations2010Liu Bing
An intraocular lens for implantation in an eye comprising an optic configured so that the optic can be deformed to permit the intraocular Lens to be passed through an incision into the eye is provided.
A Survey of Opinion Mining and Sentiment Analysis
1,331 Citations2012Bing Liu, Lei Zhang
Sentiment analysis or opinion mining is the computational study of people’s opinions, appraisals, attitudes, and emotions toward entities, individuals, issues, events, topics and their attributes.
A support vector method for multivariate performance measures
800 Citations2005Thorsten Joachims
An algorithm with which such multivariate SVMs can be trained in polynomial time for large classes of potentially non-linear performance measures, in particular ROCArea and all measures that can be computed from the contingency table are given.
Expert Systems with ApplicationsDocument-level sentiment classification: An empirical comparison between SVM and ANN
724 Citations2012Rodrigo Moraes, João Francisco Valiati +1 more
An empirical comparison between SVM and ANN regarding document-level sentiment analysis is presented and it is indicated that ANN produce superior or at least comparable results to SVM's, even on the context of unbalanced data.
Information SciencesEnsemble of feature sets and classification algorithms for sentiment classification
586 Citations2010Rui Xia, Chengqing Zong +1 more
This paper makes a comparative study of the effectiveness of ensemble technique for sentiment classification, with the aim of efficiently integrating different feature sets and classification algorithms to synthesize a more accurate classification procedure.
Expert Systems with ApplicationsA survey on sentiment detection of reviews
478 Citations2009Huifeng Tang, Songbo Tan +1 more
This survey discusses related issues and main approaches to these problems, namely, subjectivity classification, word sentiment classification, document sentiment classification and opinion extraction.
Expert Systems with ApplicationsAn empirical study of sentiment analysis for chinese documents
436 Citations2007S TAN, Jianyun Zhang
The experimental results indicate that IG performs the best for sentimental terms selection and SVM exhibits the best performance for sentiment classification, and it is found that sentiment classifiers are severely dependent on domains or topics.
Extracting and Ranking Product Features in Opinion Documents
267 Citations2010Lei Zhang, Bing Liu +2 more
The problem is formulated as a bipartite graph and the well-known web page ranking algorithm HITS is used to find important features and rank them high and demonstrates promising results on diverse real-life datasets.
Clustering product features for opinion mining
255 Citations2011Zhongwu Zhai, Bing Liu +2 more
This paper models the sentiment analysis of product reviews problem as a semi-supervised learning problem, and proposes a method to automatically identify some labeled examples that outperforms existing state-of-the-art methods.
CaltechAUTHORS (California Institute of Technology)Multi-Level Structured Models for Document-Level Sentiment Classification
207 Citations2010Ainur Yessenalina, Yisong Yue +1 more
A joint two-level approach for document-level sentiment classification that simultaneously extracts useful (i.e., subjective) sentences and predicts document- level sentiment based on the extracted sentences is proposed.
Semi-Supervised Learning for Imbalanced Sentiment Classification
192 Citations2012Shoushan Li, Zhongqing Wang +2 more
Expert Systems with ApplicationsA feature selection method based on improved fisher’s discriminant ratio for text sentiment classification
191 Citations2011Suge Wang, Deyu Li +3 more
Based on Fisher's discriminant ratio, an effective feature selection method is proposed for subjectivity text sentiment classification and is compared with the method based on Information Gain while Support Vector Machine is adopted as the classifier.
IEEE Transactions on Knowledge and Data EngineeringSelecting Attributes for Sentiment Classification Using Feature Relation Networks
184 Citations2010Ahmed Abbasi, Stephen L. France +2 more
A rule-based multivariate text feature selection method called Feature Relation Network (FRN) that considers semantic information and also leverages the syntactic relationships between n-gram features to efficiently enable the inclusion of extended sets of heterogeneous n- gram features for enhanced sentiment classification.
Machine LearningSparse kernel SVMs via cutting-plane training
132 Citations2009Thorsten Joachims, Chun-Nam Yu
An algorithm for training SVMs with Kernels that can represent the learned rule using arbitrary basis vectors, not just the support vectors from the training set is explored, which has the potential to make training of Kernel SVMs tractable for large training sets, where conventional methods scale quadratically due to the linear growth of the number of SVs.
Grouping Product Features Using Semi-Supervised Learning with Soft-Constraints
119 Citations2010Zhongwu Zhai, Bing Liu +2 more
Experimental results using reviews from five different domains show that the proposed constrained semi-supervised learning method is competent for the task and outperforms the original EM and the state-of-the-art existing methods by a large margin.
Active Learning for Imbalanced Sentiment Classification
96 Citations2012Shoushan Li, Shengfeng Ju +2 more
This paper proposes a novel active learning approach, named co-selecting, that employs two feature subspace classifiers to collectively select most informative minority-class samples for manual annotation by leveraging a certainty measurement and an uncertainty measurement, to reduce human-annotation efforts.
Exploring the Use of Word Relation Features for Sentiment Classification
96 Citations2010Rui Xia, Chengqing Zong
This work proposes a generalized word relation feature extraction method and an ensemble model to efficiently integrate unigrams and different type of word relation features to address the sparse-data problem and the lack of generalization performance.
Expert Systems with ApplicationsExploiting effective features for chinese sentiment classification
81 Citations2011Zhongwu Zhai, Hua Xu +2 more
The authors' statistical analysis of the experimental results indicate that character bigram features perform the best among the Ngram features; substring-group features have greater potential to improve the performance of sentiment classification by combining substrings of different lengths.
Experimental Study on Sentiment Classification of Chinese Review using Machine Learning Techniques
76 Citations2007Jun Li, Maosong Sun
It is drawn that Naive Bayes (NB) classifier obtains the best averaging performance when using WBB, CBT as features with bool weighting under different dimensionality to the task.
Proceedings of the International AAAI Conference on Web and Social MediaA Shallow Approach to Subjectivity Classification
63 Citations2021Stephan Raaijmakers, Wessel Kraaij
It is found that word-spanning character n-grams significantly reduce the bias of a classifier, and boost its accuracy.
Queensland's institutional digital repository (The University of Queensland)Dual training and dual prediction for polarity classification
52 Citations2013Rui Xia, Tao Wang +3 more
A novel approach, called dual training and dual prediction (DTDP), is proposed, to address the polarity shift problem, and experimental results demonstrate the effectiveness of the proposed approach for polarity classification.
Communications in computer and information scienceSentiment Feature Identification from Chinese Online Reviews
12 Citations2011Jiani Yao, Hongwei Wang +1 more
Using statistical machine learning methods to select features and reduce dimensionality for sentiment classification of Chinese online reviews based on hotels showed that sentiment classification will obtain the highest accuracy when taking adjectives, adverbs and verbs together as the feature.
Sentiment classification for Chinese reviews based on key substring features
12 Citations2009Zhongwu Zhai, Hua Xu +2 more
The proposed transductive learning based algorithm, “tfidf-c”, can avoid the messy and rather artificial problem of defining word boundaries in Chinese language and performs much better than other term weighting approaches in sentiment classification for large text corpus.