Large margin vs. large volume in transductive learning
Machine LearningPublished 7 July 2008Open access
Ran El‐Yaniv, Dmitry Pechyony, Vladimir Vapnik
Citations20
SJR quartileQ1
SJR score1.15
SNIP2.14
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
Abstract
We consider a large volume principle for transductive learning that prioritizes the transductive equivalence classes according to the volume they occupy in hypothesis space. We approximate volume maximization using a geometric interpretation of the hypothesis space. The resulting algorithm is defined via a non-convex optimization problem that can still be solved exactly and efficiently. We provide a bound on the test error of the algorithm and compare it to transductive SVM (TSVM) using 31 datasets.
Keywords
Computer Science
TechnometricsStatistical Learning Theory
26,913 Citations1999Yuhai Wu, Vladimir Vapnik
Presenting a method for determining the necessary and sufficient conditions for consistency of learning process, the author covers function estimates from small data pools, applying these estimations to real-life problems, and much more.
Matrix Analysis
22,234 Citations1985Roger A. Horn, Charles R. Johnson
The MIT Press eBooksSemi-Supervised Learning
4,308 Citations2006Olivier Chapelle, Schölkopf, B. +1 more
This first comprehensive overview of semi-supervised learning presents state-of-the-art algorithms, a taxonomy of the field, selected applications, benchmark experiments, and perspectives on ongoing and future research.
Journal of Symbolic ComputationMatrix multiplication via arithmetic progressions
2,303 Citations1990Don Coppersmith, S. Winograd
Information science and statisticsEstimation of Dependences Based on Empirical Data
2,238 Citations2006Vladimir Vapnik
Research Showcase @ Carnegie Mellon University (Carnegie Mellon University)Learning from Labeled and Unlabeled Data using Graph Mincuts
947 Citations2018Avrim Blum, Shuchi Chawla
An algorithm based on finding minimum cuts in graphs, that uses pairwise relationships among the examples in order to learn from both labeled and unlabeled data is considered.
MPG.PuRe (Max Planck Society)Stability and Generalization
495 Citations2001Bousquet, O., Elisseeff, A.
Large Scale Transductive SVMs
463 Citations2006Ronan Collobert, Fabian H. Sinz +2 more
It is shown how the concave-convex procedure can be applied to transductive SVMs, which traditionally require solving a combinatorial search problem, and provides for the first time a highly scalable algorithm in the nonlinear case.
Journal of Computer and System SciencesSimulated annealing in convex bodies and an <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" altimg="si1.gif" overflow="scroll"><mml:msup><mml:mrow><mml:mi>O</mml:mi></mml:mrow><mml:mrow><mml:mo>*</mml:mo></mml:mrow></mml:msup><mml:mo stretchy="false">(</mml:mo><mml:msup><mml:mrow><mml:mi>n</mml:mi></mml:mrow><mml:mrow><mml:mn>4</mml:mn></mml:mrow></mml:msup><mml:mo stretchy="false">)</mml:mo></mml:math> volume algorithm
250 Citations2005László Lovász, Santosh Vempala
A new algorithm for computing the volume of a convex body in R^n is presented, improving on the previous best algorithm by a factor of n and using a ''morphing'' technique that can be viewed as a variant of simulated annealing.
Inference with the Universum
208 Citations2006Jason Weston, Ronan Collobert +3 more
An algorithm is described to leverage the Universum by maximizing the number of observed contradictions, and it is shown experimentally that this approach delivers accuracy improvements over using labeled data alone.
Linear Algebra and its ApplicationsA constrained eigenvalue problem
152 Citations1989Walter Gander, Gene H. Golub +1 more
A Constrained Eigenvalue Problem
134 Citations1991Walter Gander, Gene H. Golub +1 more
Journal of the Society for Industrial and Applied MathematicsOn the Stationary Values of a Second-Degree Polynomial on the Unit Sphere
105 Citations1965George E. Forsythe, Gene H. Golub
Lecture notes in computer scienceTransductive Rademacher Complexity and Its Applications
82 Citations2007Ran El‐Yaniv, Dmitry Pechyony
Journal of Artificial Intelligence ResearchExplicit Learning Curves for Transduction and Application to Clustering and Compression Algorithms
55 Citations2004Philip Derbeko, Ran El‐Yaniv +1 more
This work derives error bounds for compression schemes such as (transductive) support vector machines and for transduction algorithms based on clustering from the main observation used for deriving these new error bounds and algorithms is that the unlabeled test points in the transductive setting can be used in order to construct useful data dependent prior distributions over the hypothesis space.
Bayesian Transduction
27 Citations1999Thore Graepel, Ralf Herbrich +1 more
Experimental results on real world data indicate that Bayesian Transduction compares favourably to the well-known Support Vector Machine, in particular if the posterior probability of labellings is used as a confidence measure to exclude test points of low confidence.
An analysis of graph cut size for transductive learning
13 Citations2006Steve Hanneke
Data-dependent bounds on the fraction of mislabeled vertices are derived, based on the number (or total weight) of edges between vertices differing in predicted label (i.e., the size of the cut).
