DEByE – Data Extraction By Example
Data & Knowledge EngineeringPublished 1 February 2002
Alberto H. F. Laender, Berthier Ribeiro‐Neto, Altigran S. da Silva
Citations166
SJR quartileQ2
SJR score0.68
SNIP1.41
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This paper presents DEByE (Data Extraction By Example), an approach to extracting data from Web sources, based on a small set of examples specified by the user, which adopts nested tables as its visual paradigm.
Abstract
In this paper we present DEByE (Data Extraction By Example), an approach to extracting data from Web sources, based on a small set of examples specified by the user. The novelty is in the fact that the user specifies examples according to a structure of his liking and that this structure is described at example specification time. For the specification of the examples, the user interacts with a tool we developed which adopts nested tables as its visual paradigm. Nested tables are simple, intuitive, and allow shielding the user from technical details (such as HTML tags, formatting operators, and learning automata) related to the extraction problem. The examples provided by the user are then used to generate patterns which allow extracting data from new documents. For the extraction, DEByE adopts a new bottom-up procedure we proposed which is very effective with various Web sources, as demonstrated by our experiments.
Keywords
Computer Science
Modern Information Retrieval
11,544 Citations1999Ricardo Baeza‐Yates, Berthier Ribeiro‐Neto
Foundations of databases
3,400 Citations1994Serge Abiteboul, Richard Hull +1 more
Storing and querying ordered XML using a relational database system
2,248 Citations2002Igor Tatarinov, Stratis D. Viglas +4 more
This paper shows that XML's ordered data model can indeed be efficiently supported by a relational database system, and proposes three order encoding methods that can be used to represent XML order in the relational data model, and also proposes algorithms for translating ordered XPath expressions into SQL using these encoding methods.
Data on the Web: From Relations to Semistructured Data and XML
1,064 Citations1999Serge Abiteboul, Peter Buneman +1 more
A Syntax for Data: Typing semistructured data and the Lore system and database products supporting XML are explained.
Wrapper induction for information extraction
1,044 Citations1997Nicholas Kushmerick, Daniel S. Weld
This work introduces wrapper induction, a method for automatically constructing wrappers, and identifies hlrt, a wrapper class that is e(cid:14)ciently learnable, yet expressive enough to handle 48% of a recently surveyed sample of Internet resources.
Lecture notes in computer scienceExtracting Patterns and Relations from the World Wide Web
1,007 Citations1999Sergey Brin
This paper presents a technique which exploits the duality between sets of patterns and relations to grow the target relation starting from a small sample and uses it to extract a relation of (author,title) pairs from the World Wide Web.
Machine LearningLearning Information Extraction Rules for Semi-Structured and Free Text
928 Citations1999Stephen Soderland
WHISK is designed to handle text styles ranging from highly structured to free text, including text that is neither rigidly formatted nor composed of grammatical sentences, and can also handle extraction from free text such as news stories.
IBM Systems JournalQuery-by-Example: A data base language
874 Citations1977Moshé M. Zloof
Discussed is a high-level data base management language that provides the user with a convenient and unified interface to query, update, define, and control a data base.
Object exchange across heterogeneous information sources
756 Citations2002Yannis Papakonstantinou, Héctor García-Molina +1 more
An object-based information exchange model and a corresponding query language are defined that are well suited for integration of diverse information sources and used to integrate heterogeneous bibliographic information sources.
ACM SIGMOD RecordDatabase techniques for the World-Wide Web
560 Citations1998Daniela Florescu, Alon Y. Levy +1 more
The primary goal of this survey is to classify the different tasks to which database concepts have been applied, and to emphasize the technical innovations that were required to do so.
Artificial IntelligenceWrapper induction: Efficiency and expressiveness
558 Citations2000Nicholas Kushmerick
This article describes six wrapper classes, and uses a combination of empirical and analytical techniques to evaluate the computational tradeoffs among them, finding that most of their wrapper classes are reasonably useful, yet can rapidly learned.
A query language and optimization techniques for unstructured data
535 Citations1996Peter Buneman, Susan B. Davidson +2 more
Here a simple language UnQL is proposed for querying data organized as a rooted, edge-labeled graph and it is shown that known optimization techniques for operators on flat relations apply to the "horizontal" dimension of UnQL.
A scalable comparison-shopping agent for the World-Wide Web
507 Citations1997Robert B. Doorenbos, Oren Etzioni +1 more
ShopBot, a fully-implemented, domainindependent comparison-shopping agent that relies on a combination of heuristic search, pattern matching, and inductive learning techniques, enables users to both find superior prices and substantially reduce Web shopping time.
Relational Learning of Pattern-Match Rules for Information Extraction.
494 Citations1997Mary Elaine Califf, Raymond J. Mooney
Semistructured data
443 Citations1997Peter Buneman
A number of issues surrounding semi-structured data are covered: finding a concise formulation, building a sufficiently expressive language for querying and transformation, and opti-mizat,ion problems.
XWRAP: an XML-enabled wrapper construction system for Web information sources
427 Citations2002Liu Liu, Calton Pu +1 more
The paper describes the methodology and the software development of XWRAP, an XML-enabled wrapper construction system for semi-automatic generation of wrapper programs, and introduces and develops a two-phase code generation framework.
Information SystemsGenerating finite-state transducers for semi-structured data extraction from the Web
414 Citations1998Chun‐Nan Hsu, Ming-Tzung Dung
This paper presents SoftMealy, a novel wrapper representation formalism based on a finite-state transducer and contextual rules that can wrap a wide range of semistructured Web pages because FSTs can encode each different attribute permutation as a path.
A hierarchical approach to wrapper induction
376 Citations1999Ion Muslea, Steve Minton +1 more
This work introduces an inductive algorithm, STALKER, that generates high accuracy extraction rules based on user-labeled training examples that can handle information sources that could not be wrapped by existing techniques.
Autonomous Agents and Multi-Agent SystemsHierarchical Wrapper Induction for Semistructured Information Sources
368 Citations2001Ion Muslea, Steven Minton +1 more
This work introduces an inductive algorithm, STALKER, that generates high accuracy extraction rules based on user-labeled training examples that can wrap information sources that could not be wrapped by existing inductive techniques.
Machine LearningMachine Learning for Information Extraction in Informal Domains
355 Citations2000Dayne Freitag
A multistrategy approach which combines these learners and yields performance competitive with or better than the best of them is described, which is modular and flexible, and could find application in other machine learning problems.
Data & Knowledge EngineeringConceptual-model-based data extraction from multiple-record Web pages
311 Citations1999David W. Embley, Douglas M. Campbell +5 more
Experiments show that it is possible to achieve good recall and precision ratios for documents that are rich in recognizable constants and narrow in ontological breadth in a conceptual-modeling approach.
NoDoSE—a tool for semi-automatically extracting structured and semistructured data from text documents
303 Citations1998Brad Adelberg
NoDoSE, the Northwestern Document Structure Extractor, is described, which is an interactive tool for semi-automatically determining the structure of such documents and then extracting their data.
ACM SIGMOD RecordWrapper generation for semi-structured Internet sources
280 Citations1997Naveen Ashish, Craig A. Knoblock
The key idea is to exploit the formatting information in pages from the source to hypothesize the underlying structure of a page and generate a wrapper that facilitates querying of a source and possibly integrating it with other sources.
Passage retrieval revisited
246 Citations1997Marcin Kaszkiel, Justin Zobel
This paper compares their scheme of arbitrary passage retrieval to several other document retrieval and passage retrieval methods and shows experimentally that, compared to these methods,ranking via fixed-length passages is robust and effective.
ACM SIGMOD RecordRecord-boundary discovery in Web documents
234 Citations1999David W. Embley, Yi Jiang +1 more
Extraction Patterns for Information Extraction Tasks: A Survey
227 Citations1999Ion Muslea
This paper surveys the various types of extraction patterns that are generated by machine learning algorithms and identifies three main categories of patterns, which cover a variety of application domains, and compares and contrast the patterns from each category.
Template-based wrappers in the TSIMMIS system
216 Citations1997Joachim Hammer, Héctor García-Molina +4 more
A wrapper implementation toolkit for quickly building wrappers that can quickly design a simple wrapper with a few templates that cover some of the desired functionality, probably the one that is most urgently needed.
Cut and paste
182 Citations1997Paolo Atzeni, Giansalvatore Mecca
The paper develops Editor, a language for manipulating semistructured documents, such as those typically available on the Web, that is computationally complete, in the sense that any computable document restructuring can be expressed in Editor.
Ontology-based extraction and structuring of information from data-rich unstructured documents
150 Citations1998David W. Embley, Douglas M. Campbell +2 more
A new approach to extracting information from unstructured documents based on an application ontology that describes a domain of interest is presented, which attained recall ratios in the 80% and 90% range and precision ratios near 98%.
Electronic workshops in computingSemistructured Data: The TSIMMIS Experience
123 Citations1997Joachim Hammer, Jason McHugh +1 more
Communications of the ACMCONVERT
111 Citations1975Nan C. Shu, Barron C. Housel +1 more
A high level and nonprocedural translation definition language, CONVERT, which provides very powerful and highly flexible data restructuring capabilities and is based on the simple underlying concept of a form which enables the users to visualize the translation processes, and thus makes data translation a much simpler task.
Wrapper generation for Web accessible data sources
85 Citations1998Jean-Robert Gruser, Louiqa Raschid +2 more
This work presents technology to define and (automatically) generate wrappers for Web accessible sources and develops a wrapper generation toolkit of graphical interfaces and specification languages to specify the capability of sources and the functionality of the wrapper.
Lecture notes in computer scienceA Conceptual-Modeling Approach to Extracting Data from the Web
66 Citations1998David W. Embley, Douglas M. Campbell +5 more
Experiments show that it is possible to achieve good recall and precision ratios for documents that are rich in recognizable constants and narrow in ontological breadth.
Extracting semi-structured data through examples
58 Citations1999Berthier Ribeiro‐Neto, Alberto H. F. Laender +1 more
An innovative approach to extracting semi-structured data from Web sources by introducing a bottom-up extration strategy and demonstrating that it works quite effectively with distinct Web sources, even if only a few examples are provided by the user.
Form operation by example
47 Citations1981Da-Wei Luo, S. Bing Yao
This paper introduces a high level nonprocedural language Form Operation by Example (FOBE) to manipulate forms in office systems and believes that it is user-friendly and sufficiently powerful for office environments.
Lecture notes in computer scienceA relational algebra for complex objects based on partial information
29 Citations1991Leonid Libkin
An extension of this model is described which admits a set constructor and is therefore useful for the study of higher-order relations and their generalizations.
Lecture notes in computer scienceRepresenting Web Data as Complex Objects
14 Citations2000Alberto H. F. Laender, Berthier Ribeiro‐Neto +2 more
It is shown how data-rich objects can be represented by nested tables, which are simple, intuitive, and quite convenient for expressing their implicit structure.
Top-down extraction of semi-structured data
6 Citations2003Berthier Ribeiro‐Neto, Alberto H. F. Laender +1 more
It is demonstrated that with a small number of given examples, this strategy is able to extract most of the objects present in a Web source given as input.