VIPS: a Vision-based Page Segmentation Algorithm
Published 1 November 2003
Deng Cai, Shipeng Yu, Ji-Rong Wen, Wei‐Ying Ma
Citations507
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
An automatic top-down, tag-tree independent approach to detect web content structure that simulates how a user understands web layout structure based on his visual perception.
Abstract
A new web content structure analysis based on visual representation is proposed in this paper. Many web applications such as information retrieval, information extraction and automatic page adaptation can benefit from this structure. This paper presents an automatic top-down, tag-tree independent approach to detect web content structure. It simulates how a user understands web layout structure based on his visual perception. Comparing to other existing techniques, our approach is independent to underlying documentation representation such as HTML and works well even when the HTML structure is far different from layout structure. Experiments show satisfactory results. 1
Keywords
Computer Science
The PageRank Citation Ranking : Bringing Order to the Web
12,645 Citations1999Lawrence M. Page, Sergey Brin +2 more
This paper describes PageRank, a mathod for rating Web pages objectively and mechanically, effectively measuring the human interest and attention devoted to them, and shows how to efficiently compute PageRank for large numbers of pages.
Journal of the ACMAuthoritative sources in a hyperlinked environment
9,060 Citations1999Jon Kleinberg
This work proposes and test an algorithmic formulation of the notion of authority, based on the relationship between a set of relevant authoritative pages and the set of “hub pages” that join them together in the link structure, and has connections to the eigenvectors of certain matrices associated with the link graph.
ACM SIGIR ForumImproved Algorithms for Topic Distillation in a Hyperlinked Environment
677 Citations2017Krishna Bharat, Monika Henzinger
This paper addresses the problem of topic distillation on the World Wide Web, namely, given a typical user query to find quality documents related to the query topic, by augmenting a previous connectivity analysis based algorithm with content analysis.
Discovering informative content blocks from Web documents
321 Citations2002Shian-Hua Lin, Jan-Ming Ho
By adopting InfoDiscoverer as the preprocessor of information retrieval and extraction applications, the retrieval and extracting precision will be increased, and the indexing size and extracting complexity will also be reduced.
Extracting Semistructured Information from the Web.
304 Citations1997J. Hammer, Héctor García-Molina +3 more
A configurable tool for extracting semistructured data from a set of HTML pages and for converting the extracted information into database objects and various ways of improving the functionality of the current prototype are described.
NoDoSE—a tool for semi-automatically extracting structured and semistructured data from text documents
303 Citations1998Brad Adelberg
NoDoSE, the Northwestern Document Structure Extractor, is described, which is an interactive tool for semi-automatically determining the structure of such documents and then extracting their data.
ACM SIGMOD RecordWrapper generation for semi-structured Internet sources
280 Citations1997Naveen Ashish, Craig A. Knoblock
The key idea is to exploit the formatting information in pages from the source to hypothesize the underlying structure of a page and generate a wrapper that facilitates querying of a source and possibly integrating it with other sources.
Template detection via data mining and its applications
271 Citations2002Ziv Bar-Yossef, Sridhar Rajagopalan
It is shown that the use of templates is pervasive on the web, and basic "pure" implementations of simple search algorithms coupled with template detection and elimination show surprising increases in precision at all levels of recall.
Accelerated focused crawling through online relevance feedback
236 Citations2002Soumen Chakrabarti, Kunal Punera +1 more
Can an automatic program emulate this human behavior and thereby learn to predict the relevance of an unseen HREF target page w.r.t. an information need, based on information limited to the HREF source page?
ACM SIGMOD RecordRecord-boundary discovery in Web documents
234 Citations1999David W. Embley, Yi Jiang +1 more
A fully automated object extraction system for the World Wide Web
217 Citations2002David Buttler, Ling Liu +1 more
A fully automated object extraction system Omini, which achieves 100% precision (returns only correct objects) and excellent recall (between 99% and 98%, with very few significant objects left out).
Journal of DocumentationOverview of the Okapi projects
181 Citations1997Stephen Robertson
This paper gives a brief description of the Okapi projects and the work of the Centre for Interactive Systems research, as an introduction to this special issue of the Journal of Documentation.
Information Processing & ManagementEngineering a multi-purpose test collection for Web retrieval experiments
174 Citations2003Peter Bailey, Nick Craswell +1 more
It is confirmed that WT10g contains exploitable link information using a site (homepage) finding experiment and the results show that, on this task, Okapi BM25 works better on propagated link anchor text than on full text.
Function-based object model towards website adaptation
159 Citations2001Jinlin Chen, Baoyao Zhou +3 more
A Function-based Object Model (FOM) is presented that attempts to understand authors’ intention by identifying Object function instead of semantic understanding and a system for web content adaptation over Wireless Application Protocol (WAP) is developed.
Integrating the document object model with hyperlinks for enhanced topic distillation and information extraction
157 Citations2001Soumen Chakrabarti
A uniform fine-grained model for the Web in which pages are represented by their tag trees (also called their Document Object Models or DOMs) and these DOM trees are interconnected by ordinary hyperlinks is proposed.
Semi-automatic wrapper generation for Internet information sources
156 Citations2002Naveen Ashish, Craig A. Knoblock
The key idea is to exploit formatting information in Web pages to hypothesize the underlying structure of a page and generate a wrapper that facilitates querying of a source and possibly integrating it with other sources.
Accordion summarization for end-game browsing on PDAs and cellular phones
141 Citations2001Orkut Buyukkokten, Héctor García-Molina +1 more
A new browsing technique for devices with small displays such as PDAs or cellular phones that makes browsing more efficient and easier by Accordion Summarization, in which the Web page is first represented as a short summary and the user can drill down to discover relevant parts of the page.
Computer NetworksTwo approaches to bringing Internet services to WAP devices
132 Citations2000Eija Kaasinen, Matti Aaltonen +3 more
An HTML/WML conversion proxy server, which converts HTML-based Web contents automatically and on-line to WML and adapted to the client device is developed, which gives the mobile users transparent access to their familiar Web pages from their mobile phones and other mobile devices.
Enhanced topic distillation using text, markup tags, and hyperlinks
126 Citations2001Soumen Chakrabarti, Mukul M. Joshi +1 more
An enhanced topic distillation algorithm is presented which analyzes text, the markup tag trees that constitute HTML pages, and hyperlinks between pages and identifies subtrees which have high text- and hyperlink-based coherence w.r.t. the query.
Text REtrieval ConferenceAutomatic Retrieval With Locality Information Using SMART.
120 Citations1992Chris Buckley, Gerard Salton +1 more
The Smart project at Cornell University, using a completely automatic approach for both routing and ad-hoc experiments, performed extremely well in the first Text Retrieval Conference.
Content Extraction from HTML Documents
69 Citations2001Fuad Rahman, H. Alam
The small display form factor of these portable devices greatly diminishes the rate at which these sites can be browsed, showing the requirement of efficient algorithms to extract the content of web pages and build a faithful reproduction of the original pages with the important content intact.
Criteria for optimal web design (designing for usability)
41 Citations2003Michael L. Bernard
The questions below are meant to address some of the more important human factors concerns in the design and building of usable websites.
Finding Structure and Characteristics of Web Documents for Classification.
32 Citations2000Wai-ching Wong, Ada Wai-Chee Fu
This paper introduced a labels discovery algorithm that uses the hierarchical structure extracted from the web pages to discover similar labels which describe the same kind of information.
Toward Learning Based Web Query Processing
23 Citations2000Yanlei Diao, Hongjun Lü +2 more
The preliminary experimental results indicate that the approach can process a range of Web queries with satisfactory performance and learn both the information required by the user and the way that the user navigates through hyperlinks to locate such information.