Graph-based semi-supervised learning with multiple labels
Journal of Visual Communication and Image RepresentationPublished 25 December 2008
Zheng-Jun Zha, Tao Mei, Jingdong Wang, Zengfu Wang, Xian‐Sheng Hua
Citations162
SJR quartileQ1
SJR score0.59
SNIP1.06
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A novel graph-based learning framework in the setting of semi-supervised learning with multiple labels is proposed, characterized by simultaneously exploiting the inherent correlations among multiple labels and the label consistency over the graph.
Abstract
Conventional graph-based semi-supervised learning methods predominantly focus on single label problem. However, it is more popular in real-world applications that an example is associated with multiple labels simultaneously. In this paper, we propose a novel graph-based learning framework in the setting of semi-supervised learning with multiple labels. This framework is characterized by simultaneously exploiting the inherent correlations among multiple labels and the label consistency over the graph. Based on the proposed framework, we further develop two novel graph-based algorithms. We apply the proposed methods to video concept detection over TRECVID 2006 corpus and report superior performance compared to the state-of-the-art graph-based approaches and the representative semi-supervised multi-label learning methods.
Keywords
Computer ScienceBiochemistry, Genetics and Molecular Biology
The Theory of Matrices
8,577 Citations1984Felix R. Gantmacher
Combining labeled and unlabeled data with co-training
5,604 Citations1998Avrim Blum, Tom M. Mitchell
Minds at UW (University of Wisconsin)Semi-Supervised Learning Literature Survey
3,868 Citations2005Xiaojin Zhu
The study clearly indicates that the common practice of stripwise precommercial thinning is unjustified, and the justification of heavy 'chessboard' thinning (with pruning) depends on whether the potential reduction in rotation length and the improvement in wood quality outweigh the discounted costs of pre-commercial thinning and selection and pruning of crop trees.
MPG.PuRe (Max Planck Society)Learning with Local and Global Consistency
3,750 Citations2003Dengyong Zhou, Olivier Bousquet +3 more
A principled approach to semi-supervised learning is to design a classifying function which is sufficiently smooth with respect to the intrinsic structure collectively revealed by known labeled and unlabeled points.
Semi-supervised learning using Gaussian fields and harmonic functions
3,377 Citations2003Xiaojin Zhu, Zoubin Ghahramani +1 more
Machine LearningText Classification from Labeled and Unlabeled Documents using EM
2,749 Citations2000Kamal Nigam, Andrew Kachites McCallum +2 more
This paper shows that the accuracy of learned text classifiers can be improved by augmenting a small number of labeled training documents with a large pool of unlabeled documents, and presents two extensions to the algorithm that improve classification accuracy under these conditions.
Transductive Inference for Text Classification using Support Vector Machines
2,717 Citations1999Thorsten Joachims
An analysis of why TSVMs are well suited for text classi(cid:12)cation is presented, and an algorithm for training TSVMs e(cid:14)-ciently, handling 10,000 examples and more is proposed.
Pattern RecognitionLearning multi-label scene classification
2,255 Citations2004Matthew Boutell, Jiebo Luo +2 more
A framework to handle semantic scene classification, where a natural scene may contain multiple objects such that the scene can be described by multiple class labels, is presented and appears to generalize to other classification problems of the same nature.
The MIT Press eBooksA Kernel Method for Multi-Labelled Classification
1,336 Citations2002André Elisseeff, Jason Weston
This article presents a Support Vector Machine like learning system to handle multi-label problems, based on a large margin ranking system that shares a lot of common properties with SVMs.
Semi-Supervised Self-Training of Object Detection Models
791 Citations2005Charles Rosenberg, Martial Hebert +1 more
The key contributions of this empirical study are to demonstrate that a model trained in this manner can achieve results comparable to a modeltrained in the traditional manner using a much larger set of fully labeled data, and that a training data selection metric that is defined independently of the detector greatly outperforms a selection metric based on the detection confidence generated by the detector.
Lecture notes in computer scienceDiscriminative Methods for Multi-labeled Classification
744 Citations2004Shantanu Godbole, Sunita Sarawagi
A new technique for combining text features and features indicating relationships between classes, which can be used with any discriminative algorithm is presented, which beat accuracy of existing methods with statistically significant improvements.
Lecture notes in computer scienceRegularization and Semi-supervised Learning on Large Graphs
543 Citations2004Mikhail Belkin, Irina Matveeva +1 more
This work considers the problem of labeling a partially labeled graph, which may arise in a number of situations from survey sampling to information retrieval to pattern recognition in manifold settings.
Correlative multi-label video annotation
476 Citations2007Guo-Jun Qi, Xian‐Sheng Hua +4 more
A third paradigm is proposed which simultaneously classifies concepts and models correlations between them in a single step by using a novel Correlative Multi-Label (CML) framework and is compared with the state-of-the-art approaches in the first and second paradigms on the widely used TRECVID data set.
Collective multi-label classification
416 Citations2005Nadia Ghamrawi, Andrew McCallum
This paper explores multi-label conditional random field (CRF) classification models that directly parameterize label co-occurrences in multi-label classification.
Correlated Label Propagation with Application to Multi-label Learning
231 Citations2006Kang Feng, Rong Jin +1 more
A novel framework for multi-label learning termed Correlated Label Propagation (CLP) that explicitly models interactions between labels in an efficient manner and leads to significant gains in precision/recall against standard techniques on two real-world computer vision tasks involving several hundred labels.
Linear Algebra and its ApplicationsKrylov-subspace methods for the Sylvester equation
218 Citations1992D.Y. Hu, Lothar Reichel
Galerkin and minimal residual algorithms for the solution of Sylvester's equation AX – XB = C using Krylov subspaces for which orthogonal bases are generated by the Arnoldi process are suitable for implementation on parallel computers.
Semi-supervised Multi-label Learning by Solving a Sylvester Equation
193 Citations2008Gang Chen, Yangqiu Song +2 more
It is shown that the labels of unlabeled data finally can be obtained by solving a Sylvester Equation, and a regularization framework combining two regularization terms for the two graphs is suggested.
Columbia University’s Baseline Detectors for 374 LSCOM Semantic Visual Concepts
188 Citations2007Akira Yanagawa, Shih‐Fu Chang
Development of effective concept detectors and systematic evaluation ethods has become an active research topic in recent years and a major video retrieval enchmarking event, NIST TRECVID, has contributed to this emerging area through the rovision of large sets of common data and the organization of common benchmark tasks to form over this data.
Semi-supervised multi-label learning by constrained non-negative matrix factorization
175 Citations2006Yi Liu, Rong Jin +1 more
This work presents a novel framework for multi-label learning that explicitly addresses the challenge arising from the large number of classes and a small size of training data, and an algorithm is presented to efficiently find the solution.
Maximal Margin Labeling for Multi-Topic Text Categorization
113 Citations2004Hideto Kazawa, Tomonori Izumitani +2 more
The proposed algorithm, Maximal Margin Labeling (MML), treats all possible labels as independent classes and learns a multi- class classifier on the induced multi-class categorization problem.
Building a comprehensive ontology to refine video concept detection
51 Citations2007Zheng-Jun Zha, Tao Mei +2 more
This paper presents a comprehensive representation scheme for video semantic ontology in which all the three components are well studied, and leverage LSCOM to construct the concept lexicon, describe concept property as the weights of different modalities which are obtained manually or by data-driven approach.
Structure-sensitive manifold ranking for video concept detection
49 Citations2007Jinhui Tang, Xian‐Sheng Hua +4 more
This paper proposes a novel graph-based learning approach, named Structure-Sensitive Manifold Ranking (SSMR), based on a structure-sensitive similarity measure, which takes local distribution differences into account to more accurately measure pairwise similarity.
TRECVIDMSRA-USTC-SJTU AT TRECVID 2007: HIGH-LEVEL FEATURE EXTRACTION AND SEARCH
49 Citations2007Tao Mei, Xian‐Sheng Hua +11 more
The most significant findings are reported confirming at immunohistochemical and clinical level the correlation between poor prognosis and expression of CEACAM1 on the cell surface of tumors.
Graph-based semi-supervised learning with multi-label
48 Citations2008Zheng-Jun Zha, Tao Mei +3 more
This paper proposes a novel graph-based learning framework in the setting of semi-supervised learning with multi-label and applies it to video annotation and reports superior performance compared to key existing approaches over the TRECVID 2006 corpus.
IEEE Transactions on MultimediaVideo Annotation Based on Kernel Linear Neighborhood Propagation
43 Citations2008Jinhui Tang, Xian‐Sheng Hua +3 more
KLNP improves a recently proposed method linear neighborhood propagation by tackling the limitation of its local linear assumption on the distribution of semantics by combining the consistency assumption and the local linear embedding method in a nonlinear kernel-mapped space.
Video annotation by graph-based learning with neighborhood similarity
23 Citations2007Meng Wang, Tao Mei +3 more
A novel neighborhood similarity measure, which simultaneously takes into account both the distance between samples and the difference between the structures around the corresponding samples, which demonstrates that the neighborhood similarity is superior to existing distance based similarity.
Research Showcase @ Carnegie Mellon University (Carnegie Mellon University)Discriminative fields for modeling semantic concepts in video
13 Citations2007Mingyu Chen, Alexander G. Hauptmann
This paper presents a discriminative learning framework called Multi-concept Discriminative Random Field (MDRF) for building probabilistic models of video semantic concept detectors by incorporating related concepts as well as the low-level observations.