Content-based image retrieval
Published 10 November 2005
Ritendra Datta, Jia Li, James Z. Wang
Citations432
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Some of the key contributions in the current decade related to image retrieval and automated image annotation are discussed, spanning 120 references, and a study on the trends in volume and impact of publications in the field with respect to venues/journals and sub-topics is concluded.
Abstract
The last decade has witnessed great interest in research on content-based image retrieval. This has paved the way for a large number of new techniques and systems, and a growing interest in associated fields to support such systems. Likewise, digital imagery has expanded its horizon in many directions, resulting in an explosion in the volume of image data required to be organized. In this paper, we discuss some of the key contributions in the current decade related to image retrieval and automated image annotation, spanning 120 references. We also discuss some of the key challenges involved in the adaptation of existing image retrieval techniques to build useful systems that can handle real-world data. We conclude with a study on the trends in volume and impact of publications in the field with respect to venues/journals and sub-topics.
Keywords
Computer Science
IEEE Transactions on Pattern Analysis and Machine IntelligenceNormalized cuts and image segmentation
15,696 Citations2000Jianbo Shi, Jitendra Malik
IEEE Transactions on Pattern Analysis and Machine IntelligenceMean shift: a robust approach toward feature space analysis
11,282 Citations2002Dorin Comaniciu, Peter Meer
It is proved the convergence of a recursive mean shift procedure to the nearest stationary point of the underlying density function and, thus, its utility in detecting the modes of the density.
Journal of Machine Learning ResearchAn introduction to variable and feature selection
7,831 Citations2003GuyonIsabelle, ElisseeffAndré
IEEE Transactions on Medical ImagingSegmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm
7,346 Citations2001Y. Zhang, Michael Brady +1 more
The authors propose a novel hidden Markov random field (HMRF) model, which is a stochastic process generated by a MRF whose state sequence cannot be observed directly but which can be indirectly estimated through observations.
IEEE Transactions on Pattern Analysis and Machine IntelligenceShape matching and object recognition using shape contexts
6,289 Citations2002Serge Belongie, Jitendra Malik +1 more
A novel approach to measuring similarity between shapes and exploiting it for object recognition by treating recognition in a nearest-neighbor classification framework as the problem of finding the stored prototype shape that is maximally similar to that in the image.
IEEE Transactions on Pattern Analysis and Machine IntelligenceContent-based image retrieval at the end of the early years
6,023 Citations2000A.W.M. Smeulders, Marcel Worring +3 more
The working conditions of content-based retrieval: patterns of use, types of pictures, the role of semantics, and the sensory gap are discussed, as well as aspects of system engineering: databases, system architecture, and evaluation.
2008 IEEE Conference on Computer Vision and Pattern Recognition
4,219 Citations2008
This work proposes a discriminative model cascade for non-blind deblurring, which consists of a Gaussian CRF at each stage, based on the recently introduced regression tree fields, and trains the model by loss minimization and uses synthetically generated blur kernels to generate training data.
International Journal of Computer VisionScale & Affine Invariant Interest Point Detectors
3,395 Citations2004Krystian Mikolajczyk, Cordelia Schmid
A comparative evaluation of different detectors is presented and it is shown that the proposed approach for detecting interest points invariant to scale and affine transformations provides better results than existing methods.
Labeling images with a computer game
2,222 Citations2004Luis von Ahn, Laura Dabbish
A new interactive system: a game that is fun and can be used to create valuable output that addresses the image-labeling problem and encourages people to do the work by taking advantage of their desire to be entertained.
IEEE Transactions on Pattern Analysis and Machine IntelligenceSIMPLIcity: semantics-sensitive integrated matching for picture libraries
2,181 Citations2001James Z. Wang, Jia Li +1 more
SIMPLIcity (semantics-sensitive integrated matching for picture libraries), an image retrieval system, which uses semantics classification methods, a wavelet-based approach for feature extraction, and integrated region matching based upon image segmentation to improve retrieval.
IEEE Transactions on Circuits and Systems for Video TechnologyRelevance feedback: a power tool for interactive content-based image retrieval
1,764 Citations1998Yong Rui, Thomas S. Huang +2 more
A relevance feedback based interactive retrieval approach that effectively takes into account the subjectivity of human perception of visual content and the gap between high-level concepts and low-level features in CBIR.
IEEE Transactions on Circuits and Systems for Video TechnologyColor and texture descriptors
1,650 Citations2001B.S. Manjunath, J.-R. Ohm +2 more
An overview of color and texture descriptors that have been approved for the Final Committee Draft of the MPEG-7 standard is presented, explained in detail by their semantics, extraction and usage.
Lecture notes in computer scienceObject Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary
1,608 Citations2002Pınar Duygulu, Kobus Barnard +2 more
This work shows how to cluster words that individually are difficult to predict into clusters that can be predicted well, and cannot predict the distinction between train and locomotive using the current set of features, but can predict the underlying concept.
Journal of Visual Communication and Image RepresentationImage Retrieval: Current Techniques, Promising Directions, and Open Issues
1,588 Citations1999Yong Rui, Thomas S. Huang +1 more
The survey includes 100+ papers covering the research aspects of image feature representation and extraction, multidimensional indexing, and system design, three of the fundamental bases of content-based image retrieval.
International Journal of Medical InformaticsA review of content-based image retrieval systems in medical applications—clinical benefits and future directions
1,485 Citations2004Henning Müller, Nicolas Michoux +2 more
The goal is not, in general, to replace text-based retrieval methods as they exist at the moment but to complement them with visual search tools.
IEEE Transactions on Pattern Analysis and Machine IntelligenceUnsupervised feature selection using feature similarity
1,460 Citations2002Pabitra Mitra, C.A. Murthy +1 more
An unsupervised feature selection algorithm suitable for data sets, large in both dimension and size, based on measuring similarity between features whereby redundancy therein is removed, which does not need any search and is fast.
IEEE Transactions on Pattern Analysis and Machine IntelligenceBlobworld: image segmentation using expectation-maximization and its application to image querying
1,407 Citations2002Chad Carson, Serge Belongie +2 more
Results indicating that querying for images using Blobworld produces higher precision than does querying using color and texture histograms of the entire image in cases where the image contains distinctive objects are presented.
Support vector machine active learning for image retrieval
1,333 Citations2001Simon Tong, Edward Yi Chang
This work proposes the use of a support vector machine active learning algorithm for conducting effective relevance feedback for image retrieval and achieves significantly higher search accuracy than traditional query refinement schemes after just three to four rounds of relevance feedback.
Automatic image annotation and retrieval using cross-media relevance models
1,146 Citations2003Jiwoon Jeon, Victor Lavrenko +1 more
The approach shows the usefulness of using formal information retrieval models for the task of image annotation and retrieval by assuming that regions in an image can be described using a small vocabulary of blobs.
IEEE Transactions on Image ProcessingWavelet-based texture retrieval using generalized Gaussian density and Kullback-Leibler distance
1,141 Citations2002N. Minh, Martin Vetterli
A statistical view of the texture retrieval problem is presented by combining the two related tasks, namely feature extraction (FE) and similarity measurement (SM), into a joint modeling and classification scheme that leads to a new wavelet-based texture retrieval method that is based on the accurate modeling of the marginal distribution of wavelet coefficients using generalized Gaussian density (GGD).
International Journal of Computer VisionContour and Texture Analysis for Image Segmentation
1,091 Citations2001Jitendra Malik, Serge Belongie +2 more
This paper provides an algorithm for partitioning grayscale images into disjoint regions of coherent brightness and texture, and introduces a gating operator based on the texturedness of the neighborhood at a pixel to facilitate cue combination.
IEEE Transactions on Pattern Analysis and Machine IntelligenceAutomatic linguistic indexing of pictures by a statistical modeling approach
1,087 Citations2003Jia Li, James Z. Wang
This paper implemented and tested the ALIP (Automatic Linguistic Indexing of Pictures) system on a photographic image database of 600 different concepts, each with about 40 training images and demonstrated the good accuracy of the system and its high potential in linguistic indexing of photographic images.
Modeling annotated data
1,070 Citations2003David M. Blei, Michael I. Jordan
Three hierarchical probabilistic mixture models which aim to describe annotated data with multiple types, culminating in correspondence latent Dirichlet allocation, a latent variable model that is effective at modeling the joint distribution of both types and the conditional distribution of the annotation given the primary type.
Feature Selection for SVMs
977 Citations2000Jason Weston, Sayan Mukherjee +4 more
The resulting algorithms are shown to be superior to some standard feature selection algorithms on both toy data and real-life problems of face recognition, pedestrian detection and analyzing DNA microarray data.
A performance evaluation of local descriptors
952 Citations2003Krystian Mikolajczyk, C. Schmid
It is observed that the ranking of the descriptors does not depend on the point detector and that SIFT descriptors perform best and steerable filters can be considered a good choice given the low dimensionality.
Faceted metadata for image search and browsing
904 Citations2003Ka-Ping Yee, Kirsten Swearingen +2 more
An alternative based on enabling users to navigate along conceptual dimensions that describe the images is presented, which makes use of hierarchical faceted metadata and dynamically generated query previews.
ACM Computing SurveysSearching in high-dimensional spaces
827 Citations2001Christian Böhm, Stefan Berchtold +1 more
An overview of the current state of the art in querying multimedia databases is provided, describing the index structures and algorithms for an efficient query processing in high-dimensional spaces.
Multimedia SystemsRelevance feedback in image retrieval: A comprehensive review
823 Citations2003Xiang Sean Zhou, Thomas S. Huang
The nature of the relevance feedback problem in a continuous representation space in the context of content-based image retrieval is analyzed and a list of critical issues to consider when designing a relevance feedback algorithm is compiled.
IEEE Transactions on Image ProcessingImage classification for content-based indexing
758 Citations2001Aditya Vailaya, Mário A. T. Figueiredo +2 more
The goal is to combine multiple two-class classifiers into a single hierarchical classifier, and it is demonstrated that a small vector quantizer can be used to model the class-conditional densities of the features, required by the Bayesian methodology.
IEEE Transactions on Image ProcessingThe Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments
721 Citations2000Ingemar J. Cox, Matthew L. Miller +3 more
The theory, design principles, implementation and performance results of PicHunter are presented, two experimental paradigms to quantitatively evaluate the performance of the system are introduced, and psychophysical experiments are presented that support the theoretical claims.
ScholarWorks@UMassAmherst (University of Massachusetts Amherst)A Model for Learning the Semantics of Pictures
681 Citations2003Victor Lavrenko, R. Manmatha +1 more
An approach to learning the semantics of images which allows us to automatically annotate an image with keywords and to retrieve images based on text queries using a formalism that models the generation of annotated images.
Journal of Machine Learning ResearchImage Categorization by Learning and Reasoning with Regions
633 Citations2004Yixin Chen, James Z. Wang
This paper presents a new learning technique, which extends Multiple-Instance Learning (MIL), and its application to the problem of region-based image categorization, and provides experimental results on an image categorizing problem and a drug activity prediction problem.
IEEE Transactions on Pattern Analysis and Machine IntelligenceImage segmentation by data-driven markov chain monte carlo
567 Citations2002Zhuowen Tu, Song-Chun Zhu
The DDMCMC paradigm provides a unifying framework in which the role of many existing segmentation algorithms are revealed as either realizing Markov chain dynamics or computing importance proposal probabilities and generalizes these segmentation methods in a principled way.
Pattern Recognition LettersPerformance evaluation in content-based image retrieval: overview and proposals
551 Citations2001Henning Müller, Wolfgang Müller +3 more
The advantages and shortcomings of the performance measures currently used in CBIR are discussed and proposals for a standard test suite similar to that used in IR at the annual Text REtrieval Conference (TREC), are presented.
IEEE Transactions on Pattern Analysis and Machine IntelligenceShape similarity measure based on correspondence of visual parts
459 Citations2000Longin Jan Latecki, Rolf Lakämper
This work applied a cognitively motivated similarity measure to shape matching of object contours in various image databases and compared it to well-known approaches in the literature, justifying that the shape matching procedure gives an intuitive shape correspondence and is stable with respect to noise distortions.
Content-based Image Retrieval
456 Citations2000John Eakins, Margaret Graham
IEEE Transactions on Circuits and Systems for Video TechnologyCBSA: content-based soft annotation for multimodal image retrieval using bayes point machines
452 Citations2003Edward Yi Chang, King-Shy Goh +2 more
This work proposes a content-based soft annotation procedure for providing images with semantical labels, and experiments with two learning methods, support vector machines (SVMs) and Bayes point machines (BPMs), to select a base binary-classifier for CBSA.
IEEE Transactions on Pattern Analysis and Machine IntelligenceA region-based fuzzy feature matching approach to content-based image retrieval
412 Citations2002Yixin Chen, James Z. Wang
A fuzzy logic approach, UFM (unified feature matching), for region-based image retrieval, which greatly reduces the influence of inaccurate segmentation and provides a very intuitive quantification.
How do people manage their digital photographs?
404 Citations2003Kerry Rodden, Kenneth R. Wood
The results suggest that participants found their digital photos much easier to manage than their non-digital ones, but that this advantage was almost entirely due to the simple browsing features of Shoebox.
Optimizing learning in image retrieval
377 Citations2002Yong Rui, Thomas S. Huang
A vigorous optimization formulation of the learning process is presented and explicit solutions, which are both optimal and fast to compute, are derived by using Lagrange multipliers are derived.
Remote Sensing of EnvironmentRetrieval of subpixel snow-covered area and grain size from imaging spectrometer data
368 Citations2003T. H. Painter, Jeff Dozier +3 more
IEEE Transactions on Image ProcessingCLUE: cluster-based retrieval of images by unsupervised learning
322 Citations2005Yixin Chen, James Z. Wang +1 more
Results on images returned by Google's Image Search reveal the potential of applying CLUE to real-world image data and integrating CLUE as a part of the interface for keyword-based image retrieval systems.
IEEE Transactions on Image ProcessingAn efficient color representation for image retrieval
314 Citations2001Yining Deng, B.S. Manjunath +3 more
Experimental results show that this compact color descriptor is effective and compares favorably with the traditional color histogram in terms of overall computational complexity.
Feature selection in unsupervised learning via evolutionary search
290 Citations2000YeongSeog Kim, W. Nick Street +1 more
ELSA is used, an evolutionary local selection algorithm that maintains a diverse population of solutions that approximate the Pareto front in a multidimensional objectiv espace and shows promise in identifying the right features and the correct number of clusters.
International Journal of Computer VisionBoosting Image Retrieval
278 Citations2003Kinh Tieu, Paul Viola
This work proposes a mechanism for computing a very large number of highly selective features which capture some aspects of this causal structure and shows results on a wide variety of image queries.
IEEE Transactions on Pattern Analysis and Machine IntelligenceSegmentation given partial grouping constraints
254 Citations2004Stella X. Yu, Jianbo Shi
It is demonstrated not only that it is possible to integrate both image structures and priors in a single grouping process, but also that objects can be segregated from the background without specific object knowledge.
IEEE Transactions on Pattern Analysis and Machine IntelligenceMultiresolution histograms and their use for recognition
252 Citations2004E. Hadjidemetriou, Michael Grossberg +1 more
A simple yet novel matching algorithm based on the multiresolution histogram that uses the differences between histograms of consecutive image resolutions to achieve or exceed the performance obtained with more complicated features.
Content-Based Image Retrieval Using Multiple-Instance Learning
245 Citations2002Qi Zhang, Sally A. Goldman +2 more
The multiple-instance (MI) learning model is applied to use a small number of training images to learn what images from the database are of interest to the user.
A unified framework for semantics and feature based relevance feedback in image retrieval systems
240 Citations2000Ye Lü, Chunhui Hu +3 more
iFind is a relevance feedback technique to take advantage of the semantic contents of the images in addition to the low-level features to accurately deduce and utilize the images' semantic contents for retrieval purposes.
On image auto-annotation with latent space models
236 Citations2003Florent Monay, Daniel Gática-Pérez
This paper applies and compares two simple latent space models commonly used in text analysis, namely Latent Semantic Analysis (LSA) and Probabilistic LSA (PLSA), and found that, on a 8000-image dataset, a classic LSA model defined on keywords and a very basic image representation performed as well as much more complex, state-of-the-art methods.
Does organisation by similarity assist image browsing?
214 Citations2001Kerry Rodden, Wojciech Basalaj +2 more
Two experiments are described, both involving designers as the participants, examining whether similarity-based arrangements of the candidate images are helpful for a picture selection task, and an arrangement based on visual similarity was more formally compared with a control of a random arrangement.
IEEE Transactions on Pattern Analysis and Machine IntelligenceMatching and retrieval of distorted and occluded shapes using dynamic programming
211 Citations2002Euripides G. M. Petrakis, A. Diplaros +1 more
The algorithm treats noise and shape distortions by allowing matching of merged sequences of consecutive small segments in a shape with larger segments of another shape, while being invariant to translation, scale, orientation, and starting point selection.
IEEE Transactions on Image ProcessingRelevance feedback in content-based image retrieval: bayesian framework, feature subspaces, and progressive learning
208 Citations2003Zhong Su, Hao Zhang +2 more
A new feedback approach with progressive learning capability combined with a novel method for the feature subspace extraction based on a Bayesian classifier that treats positive and negative feedback examples with different strategies to improve the retrieval accuracy.
IEEE Transactions on Image ProcessingAn Efficient and Effective Region-Based Image Retrieval Framework
207 Citations2004Jing Feng, Mingjing Li +2 more
An image retrieval framework that integrates efficient region-based representation in terms of storage and complexity and effective on-line learning capability and a region weighting strategy is introduced to optimally weight the regions and enable the system to self-improve.
IEEE Transactions on Pattern Analysis and Machine IntelligenceWARP: accurate retrieval of shapes using phase of Fourier descriptors and time warping distance
198 Citations2004Ilaria Bartolini, Paolo Ciaccia +1 more
This work proposes a novel Fourier-based approach, called WARP, for matching and retrieving similar shapes, which exploits the phase of Fourier coefficients and the use of the dynamic time warping distance to compare shape descriptors.
IEEE Transactions on Neural NetworksPicSOM-self-organizing image retrieval with MPEG-7 content descriptors
193 Citations2002Jorma Laaksonen, Markus Koskela +1 more
The results of the experiments show that the MPEG-7-defined content descriptors can be used as such in thePicSOM system even though Euclidean distance calculation, inherently used in the PicSom system, is not optimal for all of them.
Discriminant-EM algorithm with application to image retrieval
179 Citations2002Ying Wu, Qi Tian +1 more
The possibility of including an unlabeled data set to make up the insufficiency of labeled data is investigated and the proposed algorithm, Discriminant EM (D-EM) not only estimates the parameters of a generative model but also finds a linear transformation to relax the assumption of probabilistic structure of data distributions as well as select good features automatically.
IEEE MultimediaUnifying keywords and visual contents in image retrieval
179 Citations2002Xiang Sean Zhou, Thomas S. Huang
A seamless joint querying and relevance feedback scheme based on keywords and lowlevel visual content, incorporating keyword similarities, is used based on a developed algorithm for a learned word similarity matrix.
Learning an image manifold for retrieval
178 Citations2004Xiaofei He, Wei‐Ying Ma +1 more
A relevance feedback scheme which is naturally conducted only on the image manifold in question rather than the total ambient space, and an algorithmic framework to approximate the optimal mapping function by a Radial Basis Function (RBF) neural network.
IEEE Transactions on Medical ImagingNormalized Cuts in 3-D for Spinal MRI Segmentation
177 Citations2004Julio Carballido‐Gamio, Serge Belongie +1 more
The application of NCut with the Nystro/spl uml/m approximation method to segment vertebral bodies from sagittal T1-weighted magnetic resonance images of the spine is discussed.
IEEE Transactions on Knowledge and Data EngineeringWALRUS: a similarity retrieval algorithm for image databases
158 Citations2004Apostol Natsev, Rajeev Rastogi +1 more
IEEE Transactions on Pattern Analysis and Machine IntelligenceUnsupervised multiresolution segmentation for images with low depth of field
153 Citations2001James Z. Wang, Jia Li +2 more
A novel multiresolution image segmentation algorithm designed to separate a sharply focused object-of-interest from other foreground or background objects and provides better accuracy at higher speed.
IEEE Transactions on Systems Man and Cybernetics - Part A Systems and HumansSketch-Based Image Matching Using Angular Partitioning
147 Citations2004Abdolah Chalechale, Golshah Naghdy +1 more
This work presents a novel method for image similarity measure, where a hand-drawn rough black and white sketch is compared with an existing data base of full color images (art works and photographs) to create ambient intelligence in terms of the evaluation of nonprecise, easy to input sketched information.
Learning from User Feedback in Image Retrieval Systems
137 Citations1999Nuno Vasconcelos, Andrew Lippman
A new learning algorithm is presented that relies on belief propagation to account for both positive and negative examples of the user's interests in order to solve two of the most challenging issues in the design of a retrieval system.
Effective automatic image annotation via a coherent language model and active learning
134 Citations2004Rong Jin, Joyce Chai +1 more
A coherent language model for automatic image annotation is proposed that takes into account the word-to-word correlation by estimating a coherent language models for an image to significantly reduce the required number of annotated image examples.
IEEE Transactions on Geoscience and Remote SensingInteractive learning and probabilistic retrieval in remote sensing image archives
129 Citations2000Michael Schröder, Hubert Rehrauer +2 more
This work presents a concept of interactive learning and probabilistic retrieval of user-specific cover types in a content-based remote sensing image archive, which provides instantaneous feedback to the user in the form of an immediate update of the posterior map, and a very fast, approximate search in the archive.
IEEE Transactions on Information TheoryMultiresolution image classification by hierarchical modeling with two-dimensional hidden Markov models
125 Citations2000Jia Li, Robert M. Gray +1 more
Suboptimal algorithms based on the model provide progressive classification that is much faster than the algorithm based on single-resolution hidden Markov models.
Computer Vision and Image UnderstandingImage retrieval using color histograms generated by Gauss mixture vector quantization
112 Citations2003Sangoh Jeong, Chee Sun Won +1 more
Results show that the histograms made by GMVQ with a penalized log-likelihood (LL) distortion yield better retrieval performance for color images than the conventional methods of uniform quantization and VQ with squared error distortion.
IEEE Transactions on Image ProcessingA memory learning framework for effective image retrieval
110 Citations2005Jifeng Han, King Ngi Ngan +2 more
A framework for effective image retrieval is reported by employing a novel idea of memory learning that forms a knowledge memory model to store the semantic information by simply accumulating user-provided interactions.
IEEE Transactions on Circuits and Systems for Video TechnologyRelevance Feedback in Region-Based Image Retrieval
106 Citations2004Jing Feng, Mingjing Li +2 more
This work argues that integrating these two approaches and allowing them to benefit from each other will yield better performance than using either of them alone.
A probabilistic architecture for content-based image retrieval
106 Citations2002Nuno Vasconcelos, Andrew Lippman
A solution where all the modules strive to optimize the same performance criteria: the probability of retrieval error is presented, which consists of a Bayesian retrieval criteria and an embedded mixture representation over a multiresolution feature space.
Comparing discriminating transformations and SVM for learning during multimedia retrieval
101 Citations2001Xiang Sean Zhou, Thomas S. Huang
It is argued that relevance feedback problem is best represented as a biased classification problem, or a (1+x-class classification problem), and Biased Discriminant Transform (BDT) is shown to outperform all the others.
A novel log-based relevance feedback technique in content-based image retrieval
96 Citations2004Chu-Hong Hoi, Michael R. Lyu
A novel scheme to study the log-based relevance feedback technique for improving retrieval performance and reducing the semantic gap in CBIR is proposed and it is demonstrated that the proposed scheme can significantly improve the retrieval performance of semantic image retrieval from detailed experiments.
QCluster
96 Citations2003Deok‐Hwan Kim, Chin‐Wan Chung
This paper proposes a new content-based image retrieval method using adaptive classification and cluster-merging to find multiple clusters of a complex image query when the measures of a retrieval method are invariant under linear transformations, and the method can achieve the same retrieval quality regardless of the shapes of clusters of the query.
IEEE Transactions on Information TheoryOn the Efficient Evaluation of Probabilistic Similarity Functions for Image Retrieval
88 Citations2004Nuno Vasconcelos
This work shows that the divergence can be computed exactly for vector quantizers (VQs) and has an approximate solution for Gauss mixtures (GMs) that, in high-dimensional feature spaces, introduces no significant degradation of the resulting similarity judgments.
Incremental semi-supervised subspace learning for image retrieval
87 Citations2004Xiaofei He
A semi-supervised subspace learning algorithm which incrementally learns an adaptive subspace by preserving the semantic structure of the image space, based on user interactions in a relevance feedback driven query-by-example system is proposed.
Locality preserving clustering for image database
86 Citations2004Xin Zheng, Deng Cai +3 more
This paper proposes a clustering algorithm named Locality Preserving Clustering (LPC), which shares many of the data representation properties of nonlinear spectral method, yet provides an explicit mapping function which is defined everywhere, both on training data points and testing points.
Pattern Analysis and ApplicationsSelf-Organising Maps as a Relevance Feedback Technique in Content-Based Image Retrieval
85 Citations2001Jorma Laaksonen, Markus Koskela +2 more
The PicSOM CBIR system is introduced, and the use of self-Organising Maps as a relevance feedback technique in it is described, analysed qualitatively, and visualised.
Pattern RecognitionRetrieval by classification of images containing large manmade objects using perceptual grouping
84 Citations2002Iqbal Qasim, J.K. Aggarwal
This paper applies perceptual grouping rules to the retrieval of images containing large manmade objects such as buildings, towers, bridges, and other architectural objects by employing a K -nearest neighbor framework.
Multimodal concept-dependent active learning for image retrieval
81 Citations2004King-Shy Goh, Edward Yi Chang +1 more
This work first characterize a concept's complexity using three measures: hit-rate, isolation and diversity, and proposes a multimodal learning approach that uses images' semantic labels to guide a concept-dependent, active-learning process.
Time quilt
79 Citations2005David Huynh, Steven M. Drucker +2 more
A novel layout called time quilt is proposed that trades off screenspace usage for better presentation of temporal order and is found to have a subjective preference for the use of representative photos to provide an overview for visual searches in place of the diminishing thumbnails.
Object-based image retrieval using the statistical structure of images
78 Citations2004Derek Hoiem, Rahul Sukthankar +2 more
A new Bayesian approach to object-based image retrieval with relevance feedback is proposed, able to approximate the object posterior probability density by exploiting statistics of the image database domain.
Keyblock
67 Citations2000Lei Zhu, Aidong Zhang +2 more
By comparing the performance of the proposed framework, Keyblock for content-based image retrieval, with the existing techniques using color feature and wavelet texture feature, the experimental results demonstrate the effectiveness of the framework in image retrieval.
Proceedings - International Conference on Image ProcessingAdaptive image segmentation based on color and texture
66 Citations2003Junqing Chen, Thrasyvoulos N. Pappas +2 more
This work combines a previously proposed adaptive clustering algorithm for color segmentation with a simple but effective texture segmentation approach to obtain an overall image segmentation algorithm in the domain of photographic images with an essentially unlimited range of topics.
Confidence-based dynamic ensemble for image annotation and semantics discovery
62 Citations2003Beitao Li, King-Shy Goh
This paper proposes a confidence-based dynamic ensemble (CDE) to overcome the shortcomings of the traditional static classifiers and demonstrates that CDE is effective in annotating large-scale, real-world image datasets.
Visual structures for image browsing
62 Citations2003Ricardo Silva Torres, Celmar Guimarães da Silva +2 more
This paper presents two visualization techniques based on Spiral and Concentric Rings implemented in a CBIR system to explore query results, centered on keeping user focus on both the query image, and the most similar retrieved images.
International Journal on Digital LibrariesDigital imagery for significant cultural and historical materials
60 Citations2005Ching-chih Chen, Howard D. Wactlar +2 more
This paper discusses the great importance of this field of digital imagery for significant cultural and historical materials, and focuses on its four interrelated subareas: creation and preservation, retrieval, presentation and usability, and applications and use.
IEE Proceedings - Circuits Devices and SystemsColour histogram content-based image retrieval and hardware implementation
60 Citations2003L. Kotoulas, Ioannis Andreadis
A novel pipelined hardware structure has been designed and implemented on an FPGA, to increase the operation speed and make the technique suitable for real-time applications.
Adaptive nearest neighbor search for relevance feedback in large image databases
51 Citations2001Peng Wu, B.S. Manjunath
A novel algorithm for adaptive nearest neigbor computations for high dimensional feature vectors and when the number of items in the databse is large, which exploits the correlations between two consecutive nearest neighbor searches when the underlying similarity metric is changing.
Learning user interest for image browsing on small-form-factor devices
49 Citations2005Xing Xie, Hao Liu +2 more
A new method to detect user interest maps and extract user attention objects from the image browsing log is designed, which is more efficient than image-analysis based methods and can better represent users' actual interest.
IEEE Transactions on MultimediaA multiresolution manifold distance for invariant image similarity
48 Citations2005Nuno Vasconcelos, Andrew Lippman
A transformation invariant metric recently proposed in the machine learning literature to measure the distance between image manifolds - the tangent distance (TD) - is analyzed and shows that it is closely related to alignment techniques from the motion analysis literature.
How people describe their image information needs
47 Citations2004Sally Jo Cunningham, David Bainbridge +1 more
A set of 404 queries is analyzed to identify the attributes that people provide to the Google Answers /spl trade/ 'ask an expert' online reference system and the results suggest directions to take in developing an effective organization and features for an image digital library.
Fuzzy integral for leaf image retrieval
44 Citations2003Zhiyong Wang, Zheru Chi +1 more
Experimental results show that the fuzzy integral approach can achieve a comparable retrieval performance with the best case of the weighted summation combination, and results indicate that the approach can achieved a better retrieval performance than both the curvature scale space (CSS) method and the modified Fourier descriptor (MFD) method.
IEEE Transactions on Knowledge and Data EngineeringA generic scheme for color image retrieval based on the multivariate Wald-Wolfowitz test
44 Citations2005Ch. Theoharatos, Nikolaos Laskaris +2 more
It is shown that a powerful measure of similarity between two color images can emerge from the statistical comparison of their representations in a properly formed feature space, and sets an upper limit to the computational demands and reminds of performance plateaus reached by novel approaches in information retrieval.
The story picturing engine
40 Citations2004Dhiraj Joshi, James Z. Wang +1 more
A human behavior model based on a discrete state Markov process which captures the intuition for the technique is presented and experimental results have demonstrated the effectiveness of the scheme.
IEEE Transactions on MultimediaImage retrieval based on histogram of fractal parameters
39 Citations2005Minghong Pi, Mrinal Mandal +1 more
It is proved that range block mean and contrast scaling parameters are independent, and four statistical indices for efficient image retrieval are proposed, including an efficient hierarchical indexing strategy based on the de and ac component analysis.
Unsupervised robust clustering for image database categorization
39 Citations2003Bertrand Le Saux, Nozha Boujemaa
An adaptive robust competition relies on a non-supervised database categorization, coupled with a selection of prototypes in each resulting category, and a principal component analysis is performed for every feature to reduce dimensionality.
Mean version space
36 Citations2004Jingrui He, Hanghang Tong +3 more
This paper proposes a novel active learning method named mean version space, aiming to select the optimal image in each round of relevance feedback, and proposes a new criterion which will lead to the fastest shrinkage of the version space in all cases.
Boosting contextual information in content-based image retrieval
35 Citations2004Jaume Amores, Nicu Sebe +3 more
A new framework for characterizing and retrieving objects in cluttered scenes based on a new representation describing every object taking into account the local properties of its parts and their mutual spatial relations, without relying on accurate segmentation.
…