Joint Extraction of Entities and Overlapping Relations Using Position-Attentive Sequence Labeling
Proceedings of the AAAI Conference on Artificial IntelligencePublished 17 July 2019Open access
Dai Dai, Xinyan Xiao, Yajuan Lyu, Shan Dou, Qiaoqiao She, Haifeng Wang
Citations151
SJR score0.13
SNIP0.00
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A novel unified joint extraction model which directly tags entity and relation labels according to a query word position p, i.e., detecting entity at p, and identifying entities at other positions that have relationship with the former.
Abstract
Joint entity and relation extraction is to detect entity and relation using a single model. In this paper, we present a novel unified joint extraction model which directly tags entity and relation labels according to a query word position p, i.e., detecting entity at p, and identifying entities at other positions that have relationship with the former. To this end, we first design a tagging scheme to generate n tag sequences for an n-word sentence. Then a position-attention mechanism is introduced to produce different sentence representations for every query position to model these n tag sequences. In this way, our method can simultaneously extract all entities and their type, as well as all overlapping relations. Experiment results show that our framework performances significantly better on extracting overlapping relations as well as detecting long-range relation, and thus we achieve state-of-the-art performance on two public datasets.
Keywords
Computer Science
UvA-DARE (University of Amsterdam)Adam: A Method for Stochastic Optimization
84,783 Citations2014Diederik P. Kingma, Jimmy Ba
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)MizAR 60 for Mizar 50
76,311 Citations2023Jakubův, Jan, Chvalovský, Karel +7 more
arXiv (Cornell University)Neural Machine Translation by Jointly Learning to Align and Translate
14,565 Citations2014Dzmitry Bahdanau
End-to-end Sequence Labeling via Bi-directional LSTM-CNNs-CRF
2,589 Citations2016Xuezhe Ma, Eduard Hovy
A novel neutral network architecture is introduced that benefits from both word- and character-level representations automatically, by using combination of bidirectional LSTM, CNN and CRF, thus making it applicable to a wide range of sequence labeling tasks.
Attention-Based Bidirectional Long Short-Term Memory Networks for Relation Classification
2,033 Citations2016Peng Zhou, Wei Shi +5 more
The experimental results on the SemEval-2010 relation classification task show that the AttBLSTM method outperforms most of the existing methods, with only word vectors.
arXiv (Cornell University)A Structured Self-attentive Sentence Embedding
1,458 Citations2017Zhouhan Lin, Minwei Feng +5 more
Relation Classification via Convolutional Deep Neural Network
1,412 Citations2014Daojian Zeng, Kang Liu +3 more
This paper exploits a convolutional deep neural network (DNN) to extract lexical and sentence level features from the output of pre-existing natural language processing systems and significantly outperforms the state-of-the-art methods.
Lecture notes in computer scienceModeling Relations and Their Mentions without Labeled Text
1,331 Citations2010Sebastian Riedel, Limin Yao +1 more
A novel approach to distant supervision that can alleviate the problem of noisy patterns that hurt precision by using a factor graph and applying constraint-driven semi-supervision to train this model without any knowledge about which sentences express the relations in the authors' training KB.
End-to-End Relation Extraction using LSTMs on Sequences and Tree Structures
1,253 Citations2016Makoto Miwa, Mohit Bansal
A novel end-to-end neural model to extract entities and relations between them and compares favorably to the state-of-the-art CNN based model (in F1-score) on nominal relation classification (SemEval-2010 Task 8).
Distant Supervision for Relation Extraction via Piecewise Convolutional Neural Networks
1,215 Citations2015Daojian Zeng, Kang Liu +2 more
This paper proposes a novel model dubbed the Piecewise Convolutional Neural Networks (PCNNs) with multi-instance learning to address the problem of wrong label problem when using distant supervision for relation extraction and adopts convolutional architecture with piecewise max pooling to automatically learn relevant features.
Neural Relation Extraction with Selective Attention over Instances
1,097 Citations2016Yankai Lin, Shiqi Shen +3 more
A sentence-level attention-based model for relation extraction that achieves significant and consistent improvements on relation extraction as compared with baselines.
Long Short-Term Memory-Networks for Machine Reading
1,071 Citations2016Jianpeng Cheng, Li Dong +1 more
A machine reading simulator which processes text incrementally from left to right and performs shallow reasoning with memory and attention and extends the Long Short-Term Memory architecture with a memory network in place of a single memory cell, offering a way to weakly induce relations among tokens.
Knowledge-Based Weak Supervision for Information Extraction of Overlapping Relations
923 Citations2011Raphael Hoffmann, Congle Zhang +3 more
A novel approach for multi-instance learning with overlapping relations that combines a sentence-level extraction model with a simple, corpus-level component for aggregating the individual facts is presented.
Position-aware Attention and Supervised Data Improve Slot Filling
839 Citations2017Yuhao Zhang, Victor W. Zhong +3 more
An effective new model is proposed, which combines an LSTM sequence model with a form of entity position-aware attention that is better suited to relation extraction that builds TACRED, a large supervised relation extraction dataset obtained via crowdsourcing and targeted towards TAC KBP relations.
Joint Extraction of Entities and Relations Based on a Novel Tagging Scheme
735 Citations2017Suncong Zheng, Feng Wang +4 more
A novel tagging scheme is proposed that can convert the joint extraction task to a tagging problem, and different end-to-end models are studied to extract entities and their relations directly, without identifying entities and relations separately.
Gated Self-Matching Networks for Reading Comprehension and Question Answering
720 Citations2017Wenhui Wang, Nan Yang +3 more
The gated self-matching networks for reading comprehension style question answering, which aims to answer questions from a given passage, are presented and holds the first place on the SQuAD leaderboard for both single and ensemble model.
Incremental Joint Extraction of Entity Mentions and Relations
553 Citations2014Qi Li, Heng Ji
An incremental joint framework to simultaneously extract entity mentions and relations using structured perceptron with efficient beam-search is presented, which significantly outperforms a strong pipelined baseline, which attains better performance than the best-reported end-to-end system.
Extracting Relational Facts by an End-to-End Neural Model with Copy Mechanism
518 Citations2018Xiangrong Zeng, Daojian Zeng +3 more
This paper proposes an end-to-end model based on sequence- to-sequence learning with copy mechanism, which can jointly extract relational facts from sentences of any of these classes, including Normal, EntityPairOverlap and SingleEntiyOverlap.
Classifying Relations by Ranking with Convolutional Neural Networks
517 Citations2015Cícero dos Santos, Bing Xiang +1 more
This work proposes a new pairwise ranking loss function that makes it easy to reduce the impact of artificial classes and shows that it is more effective than CNN followed by a softmax classifier and using only word embeddings as input features is enough to achieve state-of-the-art results.
Proceedings of the AAAI Conference on Artificial IntelligenceFine-Grained Entity Recognition
516 Citations2021Xiao Ling, Daniel S. Weld
A fine-grained set of 112 tags is defined, the tagging problem is formulates as multi-class, multi-label classification, an unsupervised method for collecting training data is described, and the FIGER implementation is presented.
Modeling Joint Entity and Relation Extraction with Table Representation
388 Citations2014Makoto Miwa, Yutaka Sasaki
The experimental results demonstrate that a joint learning approach significantly outperforms a pipeline approach by incorporating global features and by selecting appropriate learning methods and search orders.
Proceedings of the AAAI Conference on Artificial IntelligenceDeep Semantic Role Labeling With Self-Attention
338 Citations2018Zhixing Tan, Mingxuan Wang +3 more
This paper presents a simple and effective architecture for SRL which is based on self-attention which can directly capture the relationships between two tokens regardless of their distance and is computationally efficient.
arXiv (Cornell University)Relation Classification via Recurrent Neural Network
283 Citations2015Dongxu Zhang, Dong Wang
Experiments strongly indicates that the RNN-based model can deliver better performance on relation classification, and it is particularly capable of learning long-distance relation patterns, which makes it suitable for real-world applications where complicated expressions are often involved.
Going out on a limb: Joint Extraction of Entity Mentions and Relations without Dependency Trees
281 Citations2017Arzoo Katiyar, Claire Cardie
It is shown that attention along with long short term memory (LSTM) network can extract semantic relations between entity mentions without having access to dependency trees.
NeurocomputingJoint entity and relation extraction based on a hybrid neural network
257 Citations2017Suncong Zheng, Yuexing Hao +5 more
A hybrid neural network model is proposed to extract entities and their relationships without any handcrafted features to achieve the state-of-the-art results on entity and relation extraction task.
UTD: Classifying Semantic Relations by Combining Lexical and Semantic Resources
219 Citations2010Bryan Rink, Sanda M. Harabagiu
This paper describes the system for SemEval-2010 Task 8 on multi-way classification of semantic relations between nominals using SVM classifiers and a number of features that capture the context, semantic role affiliation, and possible pre-existing relations of the nominals.
International Conference on Computational LinguisticsTable Filling Multi-Task Recurrent Neural Network for Joint Entity and Relation Extraction
188 Citations2016Pankaj Gupta, Hinrich Schütze +1 more
A Table Filling Multi-Task Recurrent Neural Network model that reduces the entity recognition and relation classification tasks to a table-filling problem and models their interdependencies and shows that a simple approach of piggybacking candidate entities to model the label dependencies from relations to entities improves performance.
End-to-End Neural Relation Extraction with Global Optimization
187 Citations2017Meishan Zhang, Yue Zhang +1 more
This work builds a globally optimized neural model for end-to-end relation extraction, proposing novel LSTM features in order to better learn context representations, and presents a novel method to integrate syntactic information to facilitate global learning.
Joint Extraction of Entities and Relations Based on a Novel Graph Scheme
107 Citations2018Shaolei Wang, Yue Zhang +2 more
This paper converts the joint task into a directed graph by designing a novel graph scheme and proposes a transition-based approach to generate the directed graph incrementally, which can achieve joint learning through joint decoding.
Joint inference of entities, relations, and coreference
101 Citations2013Sameer Singh, Sebastian Riedel +3 more
A single, joint graphical model is proposed that represents the various dependencies between the tasks, allowing flow of uncertainty across task boundaries, and presents a novel extension to belief propagation that sparsifies the domains of variables during inference.
Joint Entity and Relation Extraction Using Card-Pyramid Parsing
76 Citations2010Rohit J. Kate, Raymond J. Mooney
A new method for joint entity and relation extraction using a graph the authors call a "card-pyramid" that compactly encodes all possible entities and relations in a sentence, reducing the task of their joint extraction to jointly labeling its nodes.
arXiv (Cornell University)CoType: Joint Extraction of Typed Entities and Relations with Knowledge Bases
68 Citations2016Xiang Ren, Zeqiu Wu +6 more
Heterogeneous Supervision for Relation Extraction: A Representation Learning Approach
66 Citations2017Liyuan Liu, Xiang Ren +5 more
This work proposes a novel framework, REHession, to conduct relation extractor learning using annotations from heterogeneous information source, e.g., knowledge base and domain heuristics, and adopts embedding techniques to learn the distributed representations of context.
Theory and applications of categoriesLinguistic Resources for 2013 Knowledge Base Population Evaluations
24 Citations2013Joe Ellis, Jeremy Getman +5 more
This paper describes the resource creation efforts in support of TAC KBP 2013, with an emphasis on procedures and methodologies for query selection, annotation, and assessment.
Global Normalization of Convolutional Neural Networks for Joint Entity and Relation Classification
11 Citations2017Heike Adel, Hinrich Schütze
It is shown that global normalization outperforms a locally normalized softmax layer on a benchmark dataset and a linear-chain conditional random field output layer for predicting entity types and relations between entities at the same time.