Meta Relational Learning for Few-Shot Link Prediction in Knowledge Graphs
Published 1 January 2019Open access
Mingyang Chen, Wen Zhang, Wei Zhang, Qiang Chen, Huajun Chen
Citations208
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This work proposes a Meta Relational Learning (MetaR) framework to do the common but challenging few-shot link prediction in KGs, namely predicting new triples about a relation by only observing a few associative triples.
Abstract
Mingyang Chen, Wen Zhang, Wei Zhang, Qiang Chen, Huajun Chen. Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). 2019.
Keywords
Computer Science
UvA-DARE (University of Amsterdam)Adam: A Method for Stochastic Optimization
84,783 Citations2014Diederik P. Kingma, Jimmy Ba
DROPS (Schloss Dagstuhl – Leibniz Center for Informatics)
50,318 Citations2021Mandi, Jayanta, Canoy, Rocsildes +2 more
A simple numeric simulation of DNA-co-polymerized hydrogel shape change and a genetic algorithm that generates and selects large batches of material designs that compete with one another to evolve and converge on optimal objective-matching designs are constructed.
arXiv (Cornell University)Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks
5,755 Citations2017Chelsea Finn, Pieter Abbeel +1 more
Translating embeddings for modeling multi-relational data
5,178 Citations2015Antoine Bordes, Nicolas Usunier +2 more
TransE is proposed, a method which models relationships by interpreting them as translations operating on the low-dimensional embeddings of the entities, which proves to be powerful since extensive experiments show that TransE significantly outperforms state-of-the-art methods in link prediction on two knowledge bases.
arXiv (Cornell University)Prototypical Networks for Few-shot Learning
5,176 Citations2017Jake Snell, Kevin Swersky +1 more
This work proposes Prototypical Networks for few-shot classification, and provides an analysis showing that some simple design decisions can yield substantial improvements over recent approaches involving complicated architectural choices and meta-learning.
Freebase
4,892 Citations2008Kurt Bollacker, Colin Evans +3 more
MQL provides an easy-to-use object-oriented interface to the tuple data in Freebase and is designed to facilitate the creation of collaborative, Web-based data-oriented applications.
Proceedings of the AAAI Conference on Artificial IntelligenceKnowledge Graph Embedding by Translating on Hyperplanes
3,787 Citations2014Zhen Wang, Jianwen Zhang +2 more
This paper proposes TransH which models a relation as a hyperplane together with a translation operation on it and can well preserve the above mapping properties of relations with almost the same model complexity of TransE.
Proceedings of the AAAI Conference on Artificial IntelligenceLearning Entity and Relation Embeddings for Knowledge Graph Completion
3,648 Citations2015Yankai Lin, Zhiyuan Liu +3 more
TransR is proposed to build entity and relation embeddings in separate entity space and relation spaces by first projecting entities from entity space to corresponding relation space and then building translations between projected entities.
Siamese Neural Networks for One-shot Image Recognition
3,254 Citations2015Gregory Koch, Richard S. Zemel +1 more
IEEE Transactions on Knowledge and Data EngineeringKnowledge Graph Embedding: A Survey of Approaches and Applications
2,654 Citations2017Quan Wang, Zhendong Mao +2 more
This article provides a systematic review of existing techniques of Knowledge graph embedding, including not only the state-of-the-arts but also those with latest trends, based on the type of information used in the embedding task.
Proceedings of the AAAI Conference on Artificial IntelligenceConvolutional 2D Knowledge Graph Embeddings
2,413 Citations2018Tim Dettmers, Pasquale Minervini +2 more
ConvE, a multi-layer convolutional network model for link prediction, is introduced, and it is found that ConvE achieves state-of-the-art Mean Reciprocal Rank across all datasets.
arXiv (Cornell University)Embedding Entities and Relations for Learning and Inference in Knowledge Bases
2,051 Citations2014d'Amato, Claudia, Wen-tau Yih +2 more
It is found that embeddings learned from the bilinear objective are particularly good at capturing relational semantics and that the composition of relations is characterized by matrix multiplication.
Proceedings of the AAAI Conference on Artificial IntelligenceToward an Architecture for Never-Ending Language Learning
1,991 Citations2010J. Andrew Carlson, Justin Betteridge +4 more
Collaborative Knowledge Base Embedding for Recommender Systems
1,780 Citations2016Fuzheng Zhang, Nicholas Jing Yuan +3 more
A heterogeneous network embedding method is adopted, termed as TransR, to extract items' structural representations by considering the heterogeneity of both nodes and relationships and a final integrated framework, which is termed as Collaborative Knowledge Base Embedding (CKE), to jointly learn the latent representations in collaborative filtering.
A Three-Way Model for Collective Learning on Multi-Relational Data
1,647 Citations2011Maximilian Nickel, Volker Tresp +1 more
This work presents a novel approach to relational learning based on the factorization of a three-way tensor that is able to perform collective learning via the latent components of the model and provide an efficient algorithm to compute the factorizations.
International Conference on Machine LearningMeta-learning with memory-augmented neural networks
1,250 Citations2016Adam Santoro, Sergey Bartunov +3 more
The ability of a memory-augmented neural network to rapidly assimilate new data, and leverage this data to make accurate predictions after only a few samples is demonstrated.
arXiv (Cornell University)Complex Embeddings for Simple Link Prediction
1,126 Citations2016Théo Trouillon, Johannes Welbl +3 more
This work makes use of complex valued embeddings to solve the link prediction problem through latent factorization, and uses the Hermitian dot product, the complex counterpart of the standard dot product between real vectors.
arXiv (Cornell University)A Simple Neural Attentive Meta-Learner
758 Citations2017Nikhil Mishra, Mostafa Rohaninejad +2 more
This work proposes a class of simple and generic meta-learner architectures that use a novel combination of temporal convolutions and soft attention; the former to aggregate information from past experience and the latter to pinpoint specific pieces of information.
Zenodo (CERN European Organization for Nuclear Research)Convolutional 2D Knowledge Graph Embeddings
733 Citations2017Tim Dettmers, Pasquale Minervini +2 more
Modeling Relation Paths for Representation Learning of Knowledge Bases
588 Citations2015Yankai Lin, Zhiyuan Liu +4 more
This model considers relation paths as translations between entities for representation learning, and addresses two key challenges: (1) Since not all relation paths are reliable, it design a path-constraint resource allocation algorithm to measure the reliability of relation paths and (2) represents relation paths via semantic composition of relation embeddings.
Lecture notes in computer scienceOpen Question Answering with Weakly Supervised Embedding Models
301 Citations2014Antoine Bordes, Jason Weston +1 more
This paper empirically demonstrate that the model can capture meaningful signals from its noisy supervision leading to major improvements over paralex, the only existing method able to be trained on similar weakly labeled data.
Long-tail Relation Extraction via Knowledge Graph Embeddings and Graph Convolution Networks
258 Citations2019Ningyu Zhang, Shumin Deng +5 more
This work proposes to leverage implicit relational knowledge among class labels from knowledge graph embeddings and learn explicit relational knowledge using graph convolution networks and integrates that relational knowledge into relation extraction model by coarse-to-fine knowledge-aware attention mechanism.
International Joint Conference on Artificial IntelligenceRepresentation learning of knowledge graphs with hierarchical types
258 Citations2016Ruobing Xie, Zhiyuan Liu +1 more
Experimental results show that the proposed Type-embodied Knowledge Representation Learning models significantly outperform all baselines on both tasks, especially with long-tail distribution, and indicates that the models are capable of capturing hierarchical type information which is significant when constructing representations of knowledge graphs.
One-Shot Relational Learning for Knowledge Graphs
255 Citations2018Wenhan Xiong, Mo Yu +3 more
This work proposes a one-shot relational learning framework, which utilizes the knowledge distilled by embedding models and learns a matching metric by considering both the learned embeddings and one-hop graph structures.
International Conference on Machine LearningMeta networks
197 Citations2017Tsendsuren Munkhdalai, Hong Yu
Iteratively Learning Embeddings and Rules for Knowledge Graph Reasoning
160 Citations2019Wen Zhang, Bibek Paudel +6 more
A novel framework IterE iteratively learning embeddings and rules is proposed, in which rules are learned fromembeddings with proper pruning strategy and embeddins are learning from existing triples and new triples inferred by rules.
arXiv (Cornell University)Open Question Answering with Weakly Supervised Embedding Models
86 Citations2014Antoine Bordes, Jason Weston +1 more
Zurich Open Repository and Archive (University of Zurich)Interaction Embeddings for Prediction and Explanation in Knowledge Graphs
83 Citations2019Wen Zhang, Bibek Paudel +3 more