Deep Multi-Task Learning for Aspect Term Extraction with Memory Interaction
Published 1 January 2017Open access
Xin Li, Wai Lam
Citations260
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A novel LSTM-based deep multi-task learning framework for aspect term extraction from user review sentences designed for jointly handling the extraction tasks of aspects and opinions via memory interactions is proposed.
Abstract
We propose a novel LSTM-based deep multi-task learning framework for aspect term extraction from user review sentences. Two LSTMs equipped with extended memories and neural memory operations are designed for jointly handling the extraction tasks of aspects and opinions via memory interactions. Sentimental sentence constraint is also added for more accurate prediction via another LSTM. Experiment results over two benchmark datasets demonstrate the effectiveness of our framework.
Keywords
Computer Science
UvA-DARE (University of Amsterdam)Adam: A Method for Stochastic Optimization
84,783 Citations2014Diederik P. Kingma, Jimmy Ba
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)
50,318 Citations2021Mandi, Jayanta, Canoy, Rocsildes +2 more
A simple numeric simulation of DNA-co-polymerized hydrogel shape change and a genetic algorithm that generates and selects large batches of material designs that compete with one another to evolve and converge on optimal objective-matching designs are constructed.
arXiv (Cornell University)Distributed Representations of Words and Phrases and their Compositionality
18,086 Citations2013Tomáš Mikolov, Ilya Sutskever +3 more
This paper presents a simple method for finding phrases in text, and shows that learning good vector representations for millions of phrases is possible and describes a simple alternative to the hierarchical softmax called negative sampling.
Understanding the difficulty of training deep feedforward neural networks
12,692 Citations2010Xavier Glorot, Yoshua Bengio
The objective here is to understand better why standard gradient descent from random initialization is doing so poorly with deep neural networks, to better understand these recent relative successes and help design better algorithms in the future.
Mining and summarizing customer reviews
7,714 Citations2004Minqing Hu, Bing Liu
This research aims to mine and to summarize all the customer reviews of a product, and proposes several novel techniques to perform these tasks.
Encyclopedia of Machine Learning and Data MiningSentiment Analysis and Opinion Mining
3,319 Citations2017Lei Zhang, Bing Liu
SemEval-2014 Task 4: Aspect Based Sentiment Analysis
1,881 Citations2014Maria Pontiki, Dimitrios Galanis +4 more
SemEval2014 Task 4 aimed to foster research in the field of aspect-based sentiment analysis, where the goal is to identify the aspects of given target entities and the sentiment expressed for each aspect.
Extracting product features and opinions from reviews
1,720 Citations2005Ana-Maria Popescu, Oren Etzioni
Opine is introduced, an unsupervised information-extraction system which mines reviews in order to build a model of important product features, their evaluation by reviewers, and their relative quality across products.
An Empirical Exploration of Recurrent Network Architectures
1,402 Citations2015Rafał Józefowicz, Wojciech Zaremba +1 more
It is found that adding a bias of 1 to the LSTM's forget gate closes the gap between the L STM and the recently-introduced Gated Recurrent Unit (GRU) on some but not all tasks.
Mining opinion features in customer reviews
1,273 Citations2004Minqing Hu, Bing Liu
This project aims to summarize all the customer reviews of a product by mining opinion/product features that the reviewers have commented on and a number of techniques are presented to mine such features.
SemEval-2016 Task 5: Aspect Based Sentiment Analysis
1,224 Citations2016Maria Pontiki, Dimitrios Galanis +16 more
This paper describes the SemEval 2016 shared task on Aspect Based Sentiment Analysis (ABSA), a continuation of the respective tasks of 2014 and 2015, which attracted 245 submissions from 29 teams and provided 19 training and 20 testing datasets.
SemEval-2015 Task 12: Aspect Based Sentiment Analysis
1,152 Citations2015Maria Pontiki, Dimitrios Galanis +3 more
The task provided manually annotated reviews in three domains (restaurants, laptops and hotels), and a common evaluation procedure, to foster research beyond sentenceor text-level sentiment classification towards Aspect Based Sentiment Analysis.
Computational LinguisticsOpinion Word Expansion and Target Extraction through Double Propagation
1,100 Citations2011Guang Qiu, Bing Liu +2 more
This article study two important problems, namely, opinion lexicon expansion and opinion target extraction, and proposes a method based on bootstrapping that outperforms these existing methods significantly.
Movie review mining and summarization
909 Citations2006Zhuang Li, Jing Feng +1 more
A multi-knowledge based approach is proposed, which integrates WordNet, statistical analysis and movie knowledge, and the experimental results show the effectiveness of the proposed approach in movie review mining and summarization.
Knowledge-Based SystemsAspect extraction for opinion mining with a deep convolutional neural network
852 Citations2016Soujanya Poria, Erik Cambria +1 more
This paper used a 7-layer deep convolutional neural network to tag each word in opinionated sentences as either aspect or non-aspect word, and developed a set of linguistic patterns for the same purpose and combined them with the neural network.
Semi-Markov Conditional Random Fields for Information Extraction
617 Citations2004Sunita Sarawagi, William W. Cohen
Intuitively, a semi-CRF on an input sequence x outputs a "segmentation" of x, in which labels are assigned to segments rather than to individual elements of xi, and transitions within a segment can be non-Markovian.
Sentiment Analysis and Opinion Mining
532 Citations2023Lei Zhang, Bing Liu
Fine-grained Opinion Mining with Recurrent Neural Networks and Word Embeddings
497 Citations2015Pengfei Liu, Shafiq Joty +1 more
This work proposes a general class of discriminative models based on recurrent neural networks and word embeddings that can be successfully applied to fine-grained opinion mining tasks without any taskspecific feature engineering effort.
Extracting Product Features and Opinions from Reviews
490 Citations2007Ana-Maria Popescu, Orena Etzioni
TUbilio (Technical University of Darmstadt)Extracting Opinion Targets in a Single and Cross-Domain Setting with Conditional Random Fields
480 Citations2010Niklas Jakob, Iryna Gurevych
This paper model the problem as an information extraction task, which is addressed based on Conditional Random Fields (CRF), and employs the supervised algorithm by Zhuang et al. (2006), which represents the state-of-the-art on the employed data.
Proceedings of the AAAI Conference on Artificial IntelligenceCoupled Multi-Layer Attentions for Co-Extraction of Aspect and Opinion Terms
440 Citations2017Wenya Wang, Sinno Jialin Pan +2 more
A novel deep learning model, named coupled multi-layer attentions, where each layer consists of a couple of attentions with tensor operators that are learned interactively to dually propagate information between aspect terms and opinion terms.
Recursive Neural Conditional Random Fields for Aspect-based Sentiment Analysis
422 Citations2016Wenya Wang, Sinno Jialin Pan +2 more
A novel joint model that integrates recursive neural networks and conditional random fields into a unified framework for explicit aspect and opinion terms co-extraction and is flexible to incorporate hand-crafted features into the proposed model to further boost its information extraction performance.
<i>Retracted December 5, 2011:</i> A novel lexicalized HMM-based learning framework for web opinion mining
329 Citations2009Wei Jin, Hung Hay Ho
World Wide WebAspect term extraction for sentiment analysis in large movie reviews using Gini Index feature selection method and SVM classifier
310 Citations2016Asha S Manek, P. Deepa Shenoy +2 more
A Gini Index based feature selection method with Support Vector Machine (SVM) classifier is proposed for sentiment classification for large movie review data set and the results show that the Gini index method has better classification performance in terms of reduced error rate and accuracy.
DLIREC: Aspect Term Extraction and Term Polarity Classification System
147 Citations2014Zhiqiang Toh, Meng Wan
This paper describes the system used in the Aspect Based Sentiment Analysis Task 4 at the SemEval-2014, which consists of a Conditional Random Field based classifier for Aspect Term Extraction (ATE) and a linear classifiers for Aspects Term Polarity Classification (ATP).
Opinion Target Extraction Using Word-Based Translation Model
143 Citations2012Kang Liu, Liheng Xu +1 more
A graph-based algorithm is exploited to extract opinion targets based on word-based translation model, which can effectively alleviate the problem of error propagation in traditional bootstrap-based methods, such as Double Propagation.
NLANGP at SemEval-2016 Task 5: Improving Aspect Based Sentiment Analysis using Neural Network Features
118 Citations2016Zhiqiang Toh, Jian Su
This system consists of binary classifiers trained using single layer feedforward network for aspect category classification, and sequential labeling classifiers for opinion target extraction, which achieves the best performances on the English datasets.
Opinion target extraction using partially-supervised word alignment model
85 Citations2013Kang Liu, Liheng Xu +2 more
A novel approach to extract opinion targets by using partially-supervised word alignment model (PSWAM), which can capture opinion relations more precisely through partial supervision from partial alignment links and outperforms state-of-the-art methods.
arXiv (Cornell University)Unsupervised Word and Dependency Path Embeddings for Aspect Term\n Extraction
82 Citations2016Yichun Yin, Furu Wei +4 more
Syntactic Patterns versus Word Alignment: Extracting Opinion Targets from Online Reviews
80 Citations2013Kang Liu, Liheng Xu +1 more
This paper empirically studies how the performance of these two kinds of methods vary when changing the size, domain and language of the corpus, and combines syntactic patterns with alignment model by using a partially supervised framework and investigates whether this combination is useful or not.
Extracting Opinion Targets and Opinion Words from Online Reviews with Graph Co-ranking
57 Citations2014Kang Liu, Liheng Xu +1 more
This paper proposes a novel approach to collectively extract opinion targets and opinion words from online reviews with graph coranking, which constructs a heterogeneous graph to model two types of relations, including semantic relations and opinion relations.
Journal of Machine Learning ResearchConditional random field with high-order dependencies for sequence labeling and segmentation
54 Citations2014Cuong Viet Nguyen, Nan Ye +2 more
Effcient inference algorithms are given to handle high-order dependencies between labels or segments in conditional random fields, under the assumption that the number of distinct label patterns used in the features is small, which leads to effcient learning algorithms for these conditional Random fields.
EliXa: A Modular and Flexible ABSA Platform
51 Citations2015Iñaki San Vicente, Xabier Saralegi +1 more
A modular platform which allows to easily conduct experiments by replacing the modules or adding new features by means of a multiclass SVM algorithm which includes lexical based features such as the polarity values obtained from domain and open polarity lexicons is developed.
AUEB-ABSA at SemEval-2016 Task 5: Ensembles of Classifiers and Embeddings for Aspect Based Sentiment Analysis
36 Citations2016Dionysios P. Xenos, Panagiotis Theodorakakos +3 more
Their submissions to the Aspect Based Sentiment Analysis task of SemEval-2016 used multiple ensembles, based on Support Vector Machine classifiers, and were ranked in the top 6 positions in all the tasks the authors participated.
arXiv (Cornell University)EliXa: A Modular and Flexible ABSA Platform
7 Citations2017Iñaki San Vicente, Xabier Saralegi +1 more
arXiv (Cornell University)Multi-task Coupled Attentions for Category-specific Aspect and Opinion Terms Co-extraction.
4 Citations2017Wenya Wang, Sinno Jialin Pan +1 more
This work proposes an end-to-end multi-task attention model, where each task corresponds to aspect/opinion terms extraction for a specific category, and demonstrates its state-of-the-art performance on three benchmark datasets.