ANVIL: a system for the retrieval of captioned images using NLP techniques

Goldsmiths (University of London)Published 1 January 2000Open access

Tony Russell‐Rose, David Elworthy, A.C.W. Kotcheff, Amanda Clare, Petros Tsonis

Citations20

TL;DR

Both the research aspects and the design and evaluation issues of ANVIL are examined, which was designed to operate as part of a publicly accessible, WWW-based image retrieval server.

Abstract

ANVIL is a system designed for the retrieval of images annotated with short captions. It uses NLP techniques to extract dependency structures from captions and queries, and then applies a robust matching algorithm to recursively explore and compare them. There are currently two main interfaces to ANVIL: a list-based display and a 2D spatial layout that allows users to interact with and navigate between similar images. ANVIL was designed to operate as part of a publicly accessible, WWW-based image retrieval server. Consequently, product-level engineering standards were required. This paper examines both the research aspects of the system and also looks at some of the design and evaluation issues.

Keywords

Computer Science

Language<b>WordNet: An electronic lexical database</b> . Ed. by Christiane Fellbaum. Cambridge, MA: MIT Press, 1998. Pp. xxii, 423.

11,687 Citations2000Adam Kilgarriff

The lexical database: nouns in WordNet, George A. Miller modifiers in WordNet, Katherine J. Miller a semantic network of English verbs, and applications of WordNet: building semantic concordances are presented.

Text REtrieval ConferenceOkapi at TREC

2,229 Citations1994Stephen Robertson, Steve Walker +3 more

Much of the work involved investigating plausible methods of applying Okapi-style weighting to phrases, and expansion using terms from the top documents retrieved by a pilot search on topic terms was used.

arXiv (Cornell University)Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy

2,224 Citations1997Jay J. Jiang, David W. Conrath

View PDF

A metric for distributions with applications to image databases

1,743 Citations2002Yossi Rubner, Carlo Tomasi +1 more

This paper uses the Earth Mover's Distance to exhibit the structure of color-distribution and texture spaces by means of Multi-Dimensional Scaling displays, and proposes a novel approach to the problem of navigating through a collection of color images, which leads to a new paradigm for image database search.

Experiments on using semantic distances between words in image caption retrieval

188 Citations1996Alan F. Smeaton, Ian K. Quigley

The first successful application of semantically-based word-word similarities and polysemous words in captions to an information retrieval application, describing the indexing and retrieval of captions describing the content of images, is described.

View PDF

Text, speech and language technologyWhat is the Role of NLP in Text Retrieval?

91 Citations1999Karen Spärck Jones

It is concluded that LMI is not needed for effective retrieval, but has other important roles within information-selection systems.

Communications of the ACMIn search of information in visual media

73 Citations1997Amarnath Gupta, Simone Santini +1 more

View PDF

Evaluating a visualisation of image similarity as a tool for image browsing

72 Citations2003Kerry Rodden, Wojciech Basalaj +2 more

An algorithm is described with which the best aspects of the two layout types can be combined, and the results show that the subjects were faster with the visualisation, although in post-experiment interviews many of them said that they preferred the clarity and regularity of the grid.

A layered approach to NLP-based information retrieval

33 Citations1998Sharon Flank

A layered approach to information retrieval permits the inclusion of multiple search engines as well as multiple databases, with a natural language layer to convert English queries for use by the various search engines.

View PDF

Interactive Dynamic Maps for Visualisation and Retrieval from Hypertext Systems

2 Citations1996Mountaz Zizi

This book presents a meta-modelling framework for hypermedia systems that automates the very labor-intensive and therefore time-heavy and expensive process of manually cataloging and locating information in a hypermedia system.