MSRA-MM 2.0: A Large-Scale Web Multimedia Dataset
Published 1 December 2009
Hao Li, Meng Wang, Xian‐Sheng Hua
Citations103
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The second version of Microsoft Research Asia Multimedia (MSRA-MM) is introduced, a dataset that aims to facilitate research in multimedia information retrieval and related areas and defines six standard tasks on the dataset.
Abstract
In this paper, we introduce the second version of Microsoft Research Asia Multimedia (MSRA-MM), a dataset that aims to facilitate research in multimedia information retrieval and related areas. The images and videos in the dataset are collected from a commercial search engine with more than 1000 queries. It contains about 1 million images and 20,000 videos. We also provide the surrounding texts that are obtained from more than 1 million Web pages. The images and videos have been comprehensively annotated, including their relevance levels to corresponding queries, semantic concepts of images, and category and quality information of videos. We define six standard tasks on the dataset: (1) image search reranking; (2) image annotation; (3) query-by-example image search; (4) video search reranking; (5) video categorization; and (6) video quality assessment.
Keywords
Computer Science
2009 IEEE Conference on Computer Vision and Pattern RecognitionImageNet: A large-scale hierarchical image database
61,841 Citations2009Jia Deng, Wei Dong +4 more
A new database called “ImageNet” is introduced, a large-scale ontology of images built upon the backbone of the WordNet structure, much larger in scale and diversity and much more accurate than the current image datasets.
Language<b>WordNet: An electronic lexical database</b> . Ed. by Christiane Fellbaum. Cambridge, MA: MIT Press, 1998. Pp. xxii, 423.
11,687 Citations2000Adam Kilgarriff
The lexical database: nouns in WordNet, George A. Miller modifiers in WordNet, Katherine J. Miller a semantic network of English verbs, and applications of WordNet: building semantic concordances are presented.
International Journal of Computer VisionLabelMe: A Database and Web-Based Tool for Image Annotation
4,205 Citations2007Bryan Russell, Antonio Torralba +2 more
A web-based tool that allows easy image annotation and instant sharing of such annotations is developed and a large dataset that spans many object categories, often containing multiple instances over a wide variety of images is collected.
IEEE Transactions on Pattern Analysis and Machine IntelligenceTexture features for browsing and retrieval of image data
3,720 Citations1996B.S. Manjunath, Weixin Ma
Comparisons with other multiresolution texture features using the Brodatz texture database indicate that the Gabor features provide the best pattern retrieval accuracy.
NUS-WIDE
3,045 Citations2009Tat‐Seng Chua, Jinhui Tang +4 more
The benchmark results indicate that it is possible to learn effective models from sufficiently large image dataset to facilitate general image retrieval and four research issues on web image annotation and retrieval are identified.
The Caltech Institute Archives (California Institute of Technology)Caltech-256 Object Category Dataset
2,388 Citations2007G. S. Griffin, Alex Holub +1 more
A challenging set of 256 object categories containing a total of 30607 images is introduced and the clutter category is used to train an interest detector which rejects uninformative background regions.
IEEE Transactions on Pattern Analysis and Machine Intelligence80 Million Tiny Images: A Large Data Set for Nonparametric Object and Scene Recognition
1,976 Citations2008Antonio Torralba, Rob Fergus +1 more
For certain classes that are particularly prevalent in the dataset, such as people, this work is able to demonstrate a recognition performance comparable to class-specific Viola-Jones style detectors.
The MIR flickr retrieval evaluation
1,811 Citations2008Mark J. Huiskes, Michael S. Lew
This paper presents a collection for the MIR community comprising 25000 images from the Flickr website which are redistributable for research purposes and represent a real community of users both in the image content and image tags.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIESimilarity of color images
1,744 Citations1995Markus Stricker, Markus Orengo
Two new color indexing techniques are described, one of which is a more robust version of the commonly used color histogram indexing and the other which is an example of a new approach tocolor indexing that contains only their dominant features.
Image indexing using color correlograms
1,658 Citations2002Jing Huang, S. Ravi Kumar +3 more
Experimental evidence suggests that this new image feature called the color correlogram outperforms not only the traditional color histogram method but also the recently proposed histogram refinement methods for image indexing/retrieval.
Evaluation campaigns and TRECVid
1,224 Citations2006Alan F. Smeaton, Paul Over +1 more
An introduction to information retrieval (IR) evaluation from both a user and a system perspective is given, high-lighting that system evaluation is by far the most prevalent type of evaluation carried out.
IEEE Transactions on Circuits and Systems for Video TechnologyUnified Video Annotation via Multigraph Learning
441 Citations2009Meng Wang, Xian-Sheng Hua +4 more
This paper shows that various crucial factors in video annotation, including multiple modalities, multiple distance functions, and temporal consistency, all correspond to different relationships among video units, and hence they can be represented by different graphs, and proposes optimized multigraph-based semi-supervised learning (OMG-SSL), which aims to simultaneously tackle these difficulties in a unified scheme.
IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews)Automatic Video Classification: A Survey of the Literature
299 Citations2008Darin Brezeale, Diane J. Cook
This paper surveys the video classification literature and finds that features are drawn from three modalities - text, audio, and visual - and that a large variety of combinations of features and classification have been explored.
IEEE Transactions on MultimediaBeyond Distance Measurement: Constructing Neighborhood Similarity for Video Annotation
288 Citations2009Meng Wang, Xian-Sheng Hua +2 more
This work proposes a novel neighborhood similarity measure, which explores the local sample and label distributions and shows that the neighborhood similarity between two samples simultaneously takes into account three characteristics: their distance; the distribution difference of the surrounding samples; and the distribution different of surrounding labels.
Efficient use of local edge histogram descriptor
253 Citations2000Dong Kwon Park, Yoon Seok Jeon +1 more
Experiments on test images for MPEG-7 core experiment show that the proposed method yields better retrieval performance especially for semantic similarity, considered to be a more image content-based retrieval.
Video search reranking via information bottleneck principle
216 Citations2006Winston H. Hsu, Lyndon S. Kennedy +1 more
A novel and generic video/image reranking algorithm, IB reranking, which reorders results from text-only searches by discovering the salient visual patterns of relevant and irrelevant shots from the approximate relevance provided by text results is proposed.
Lecture notes in computer scienceMultimedia Search with Pseudo-relevance Feedback
208 Citations2003Rong Yan, Alexander G. Hauptmann +1 more
The results are encouraging, indicating that pseudo-relevance feedback shows great promise for multimedia retrieval with very varied and errorful data.
Harvesting Image Databases from the Web
194 Citations2007Florian Schroff, Antonio Criminisi +1 more
A multi-modal approach employing both text, meta data and visual features is used to gather many, high-quality images from the Web to automatically generate a large number of images for a specified object class.
Block-based web search
166 Citations2004Deng Cai, Shipeng Yu +2 more
The experimental results show that such a semantic partitioning of web pages effectively deals with the problem of multiple drifting topics and mixed lengths, and thus has great potential to boost up the performance of current web search engines.
Lecture notes in computer scienceThe Truth about Corel - Evaluation in Image Retrieval
160 Citations2002Henning Müller, Stéphane Marchand‐Maillet +1 more
This article compares different ways of evaluating the performance of content-based image retrieval systems using a subset of the Corel images with the same CBIRSan d the same set of evaluation measures to show how easy it is to get differing results, even when using the same image collection, thesame CBIRS and the same performance measures.
Bayesian video search reranking
134 Citations2008Xinmei Tian, Linjun Yang +4 more
Two new methods are proposed in this paper to measure the ranking distance based on the disagreement in terms of pair-wise orders, which represents the disagreement between the objective ranking list and the initial text-based.
Kodak's consumer video benchmark data set
118 Citations2007Alexander C. Loui, Jiebo Luo +6 more
This work developed Kodak's consumer video benchmark data set, which includes a significant number of videos from actual users, a rich lexicon that accommodates consumers, and the annotation of a subset of concepts over the entire video data set.
Robust Learning-Based TV Commercial Detection
77 Citations2005Xian‐Sheng Hua, Lie Lu +1 more
Experiments show that the proposed robust learning-based TV commercial detection approach is able to identify commercial blocks with relatively high detection accuracy.
MSRA-MM: Bridging Research and Industrial Societies for Multimedia Information Retrieval
66 Citations2009Meng Wang, Linjun Yang +1 more
A dataset named Microsoft Research Asia Multimedia (MSRA-MM) is introduced that aims to en- courage research in multimedia information retrieval and the related areas and the performance of state-of-the-art industrial techniques can be evaluated accordingly.
IEEE Transactions on Circuits and Systems for Video TechnologyHome Video Visual Quality Assessment With Spatiotemporal Factors
55 Citations2007Tao Mei, Xian-Sheng Hua +3 more
This paper presents a scalable quality-based home video summarization system from a novel perspective-achieving the best visual quality while simultaneously preserving the most informative content.
Image annotation
28 Citations2007Nicolas Hervé, Nozha Boujemaa
An efficient approach to image annotation is described that ranked first on the recent scene categorization track of the ImagEVAL1 benchmark and was used on several well known object recognition databases to emphasize two main aspects of this research domain.
Lecture notes in computer scienceLearning Concepts by Modeling Relationships
2 Citations2007Yong Rui, Guo-Jun Qi