How flickr helps us make sense of the world
Published 29 September 2007
Lyndon Kennedy, Mor Naaman, Shane Ahern, Rahul R. Nair, Tye Rattenbury
Citations385
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A location-tag-vision-based approach to retrieving images of geography-related landmarks and features from the Flickr dataset is demonstrated, suggesting that community-contributed media and annotation can enhance and improve access to multimedia resources - and the understanding of the world.
Abstract
The advent of media-sharing sites like Flickr and YouTube has drastically increased the volume of community-contributed multimedia resources available on the web. These collections have a previously unimagined depth and breadth, and have generated new opportunities - and new challenges - to multimedia research. How do we analyze, understand and extract patterns from these new collections? How can we use these unstructured, unrestricted community contributions of media (and annotation) to generate "knowledge".
Keywords
Computer Science
International Journal of Computer VisionDistinctive Image Features from Scale-Invariant Keypoints
55,266 Citations2004David Lowe
This paper presents a method for extracting distinctive invariant features from images that can be used to perform reliable matching between different views of an object or scene and can robustly identify objects among clutter and occlusion while achieving near real-time performance.
ACM Transactions on Intelligent Systems and TechnologyLIBSVM
41,340 Citations2011Chih-Chung Chang, Chih‐Jen Lin
Issues such as solving SVM optimization problems theoretical convergence multiclass classification probability estimates and parameter selection are discussed in detail.
The Nature of Statistical Learning Theory
39,279 Citations1995Vladimir Vapnik
IEEE Transactions on Pattern Analysis and Machine IntelligenceContent-based image retrieval at the end of the early years
6,023 Citations2000A.W.M. Smeulders, Marcel Worring +3 more
The working conditions of content-based retrieval: patterns of use, types of pictures, the role of semantics, and the sensory gap are discussed, as well as aspects of system engineering: databases, system architecture, and evaluation.
IEEE Transactions on Pattern Analysis and Machine IntelligenceTexture features for browsing and retrieval of image data
3,720 Citations1996B.S. Manjunath, Weixin Ma
Comparisons with other multiresolution texture features using the Brodatz texture database indicate that the Gabor features provide the best pattern retrieval accuracy.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIESimilarity of color images
1,744 Citations1995Markus Stricker, Markus Orengo
Two new color indexing techniques are described, one of which is a more robust version of the commonly used color histogram indexing and the other which is an example of a new approach tocolor indexing that contains only their dominant features.
Why we tag
838 Citations2007Morgan G. Ames, Mor Naaman
The incentives for annotation in Flickr, a popular web-based photo-sharing system, and ZoneTag, a cameraphone photo capture and annotation tool that uploads images to Flickr are investigated to offer a taxonomy of motivations for annotation along two dimensions (sociality and function).
Towards automatic extraction of event and place semantics from flickr tags
475 Citations2007Tye Rattenbury, Nathaniel Good +1 more
An approach for extracting semantics of tags, unstructured text-labels assigned to resources on the Web, based on each tag's usage patterns, and shows that the Scale-structure Identification method outperforms the existing techniques.
Geographic location tags on digital images
253 Citations2003Kentaro Toyama, Ron Logan +1 more
An end-to-end system that capitalizes on geographic location tags for digital photographs, a lightweight travelogue-authoring tool that automatically creates appropriate context maps for a slideshow of location- tagged photographs, and an intuitive UI for browsing a massive location-tagged image database are described.
Lecture notes in computer scienceA Visual Category Filter for Google Images
253 Citations2004Robert Fergus, Pietro Perona +1 more
The constellation model is extended to include heterogeneous parts which may represent either the appearance or the geometry of a region of the object and their spatial configuration are learnt simultaneously and automatically, without supervision, from cluttered images.
World explorer
247 Citations2007Shane Ahern, Mor Naaman +2 more
This work analyzes the tags associated with the geo-referenced Flickr images to generate aggregate knowledge in the form of "representative tags" for arbitrary areas in the world, and uses these tags to create a visualization tool, World Explorer, that can help expose the content of the data, using a map interface to display the derived tags and the original photo items.
Video search reranking via information bottleneck principle
216 Citations2006Winston H. Hsu, Lyndon S. Kennedy +1 more
A novel and generic video/image reranking algorithm, IB reranking, which reorders results from text-only searches by discovering the salient visual patterns of relevant and irrelevant shots from the approximate relevance provided by text results is proposed.
Visualizing tags over time
214 Citations2006Micah Dubinko, Ravi Kumar +4 more
This work combines a novel solution to an interval covering problem with extensions to previous work on score aggregation in order to create an efficient backend system capable of producing visualizations at arbitrary scales on this large dataset in real time.
Generating summaries and visualization for large collections of geo-referenced photographs
206 Citations2006Alexandar Jaffe, Mor Naaman +2 more
A framework for automatically selecting a summary set of photos from a large collection of geo-referenced photographs, based on spa-tial patterns in photo sets, as well as textual-topical patterns and user (photographer) identity cues, which can be expanded to support social, temporal, and other factors.
Automatic organization for digital photographs with geographic coordinates
183 Citations2004Mor Naaman, Yee Jiun Song +2 more
PhotoCompas is a system that utilizes the time and location information embedded in digital photographs to automatically organize a personal photo collection and produces browseable location and event hierarchies that mimics the way people think about their photo collections.
To search or to label?
177 Citations2006Lyndon S. Kennedy, Shih‐Fu Chang +1 more
This work proposes a system for predicting which visual concepts will show the greatest increase in performance from investing human effort in obtaining annotations, and proposes to build this system as an estimation of the absolute gain in average precision experienced from using human annotations instead of web search.
Learning the semantics of multimedia queries and concepts from a small number of examples
146 Citations2005Apostol Natsev, Milind Naphade +1 more
In both tasks, applying the combination hypothesis across both modeling techniques and a variety of features results in enhanced performance over any of the baseline models, as well as in improved robustness with respect to training examples and visual features.
Metadata creation system for mobile images
119 Citations2004Risto Sarvas, Erick Herrarte +2 more
The main findings were that the creation process could be implemented with current technology and it facilitated the creation of semantic metadata at the time of image capture.
A reranking approach for context-based concept fusion in video indexing and retrieval
90 Citations2007Lyndon S. Kennedy, Shih‐Fu Chang
This work proposes to incorporate hundreds of pre-trained concept detectors to provide contextual information for improving the performance of multimodal video search and finds that the method is adept at discovering contextual relationships that are unique to news stories occurring in the search set.
Lecture notes in computer scienceFrom Where to What: Metadata Sharing for Digital Photographs with Geographic Coordinates
74 Citations2003Mor Naaman, Andreas Paepcke +1 more
The results show that the LOCALE system performs search tasks with surprising accuracy, even when searching for specific landmarks.
Combination of content analysis and context features for digital photograph retrieval
42 Citations2005Neil O’Hare, Cathal Gurrin +2 more
This retrieval scenario, where a user is searching for photos of a known building or monument in a large shared collection, content-based techniques can offer a significant improvement over ranking based on context (specifically location) alone.
Multimodal metadata fusion using causal strength
32 Citations2005Yi Wu, Edward Yi Chang +1 more
This work proposes a probabilistic framework that uses influence diagrams to fuse metadata of multiple modalities for photo annotation, and uses causal strengths to encode causalities between variables, and between variables and semantic labels.
Automatic Ranking of Iconic Images
31 Citations2007Tamara L. Berg, David Forsyth
It is shown how to rank these images according to how well they represent a visual category and argues that for a variety of objects such iconic images exist and argue that these are the images most relevant to that category.
Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIEUsing context and similarity for face and location identification
26 Citations2006Marc Davis, Michael Smith +6 more
New methods for determining image similarity are combined with analysis of automatically acquired contextual metadata to substantially improve the performance of face and place recognition algorithms, indicating the possibilities of a new context-aware paradigm for image analysis.
Extent: Inferring Image Metadata from Context and Content
20 Citations2005Chang-Ming Tsai, Arun Qamra +2 more
An image annotation system that combines the context and content information to annotate images with metadata that cannot be reliably inferred from either the context or the content alone, which shows that effectively combining content with context information can infer metadata with high accuracy.
Journal of Visual Communication and Image RepresentationOrganizing a personal image collection with statistical model-based ICL clustering on spatio-temporal camera phone meta-data
18 Citations2004Antoine Pigeau, Marc Gelgon
This paper addresses the issue of automated organization of a personal image collection, in particular to respond to the emerging needs from a mobile camera phones, and proposes a collection organization technique based on picture geolocation and timestamps.