Pay-as-you-go user feedback for dataspace systems
Published 9 June 2008
Shawn R. Jeffery, Michael J. Franklin, Alon Halevy
Citations216
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A decision-theoretic framework for ordering candidate matches for user confirmation using the concept of the value of perfect information (VPI) and a utility function that quantifies the desirability of a given state is devised, based on query result quality.
Abstract
A primary challenge to large-scale data integration is creating semantic equivalences between elements from different data sources that correspond to the same real-world entity or concept. Dataspaces propose a pay-as-you-go approach: automated mechanisms such as schema matching and reference reconciliation provide initial correspondences, termed candidate matches, and then user feedback is used to incrementally confirm these matches. The key to this approach is to determine in what order to solicit user feedback for confirming candidate matches.
Keywords
Computer ScienceDecision Sciences
Choice Reviews OnlineArtificial intelligence: a modern approach
22,205 Citations1995Stuart Russell, Peter Norvig +2 more
American Mathematical Society eBooksTheory of games and economic behavior
16,943 Citations2019Stephan Ramon Garcia, Steven J. Miller
Statistical Inference
5,368 Citations1993George Casella, Roger L. Berger
The VLDB JournalA survey of approaches to automatic schema matching
3,322 Citations2001Erhard Rahm, Philip A. Bernstein
A taxonomy is presented that distinguishes between schema-level and instance-level, element- level and structure- level, and language-based and constraint-based matchers and is intended to be useful when comparing different approaches to schema matching, when developing a new match algorithm, and when implementing a schema matching component.
Labeling images with a computer game
2,222 Citations2004Luis von Ahn, Laura Dabbish
A new interactive system: a game that is fun and can be used to create valuable output that addresses the image-labeling problem and encourages people to do the work by taking advantage of their desire to be entertained.
Accurately interpreting clickthrough data as implicit feedback
1,383 Citations2005Thorsten Joachims, Laura Granka +3 more
It is concluded that clicks are informative but biased, and while this makes the interpretation of clicks as absolute relevance judgments difficult, it is shown that relative preferences derived from clicks are reasonably accurate on average.
A comparison of string distance metrics for name-matching tasks
1,375 Citations2003William W. Cohen, Pradeep Ravikumar +1 more
This work investigates a number of different metrics proposed by different communities, including edit-distance metrics, fast heuristic string comparators, token-based distance metrics, and hybrid methods, and finds the best-performing method is a hybrid scheme combining a TFIDF weighting scheme with the Jaro-Winkler string-distance scheme.
The State of Record Linkage and Current Research Problems
817 Citations1999William E. Winkler
This paper provides an overview of methods and systems developed for record linkage based on the formal mathematical model of Fellegi and Sunter, and highlights the work of Larsen and Rubin.
A macroscope in the redwoods
775 Citations2005Gilman Tolle, Joseph Polastre +9 more
A case study of a wireless sensor network that recorded 44 days in the life of a 70-meter tall redwood tree, at a density of every 5 minutes in time and every 2 meters in space is presented.
ACM SIGMOD RecordFrom databases to dataspaces
745 Citations2005Michael J. Franklin, Alon Halevy +1 more
This paper proposes dataspaces and their support systems as a new agenda for data management, which encompasses much of the work going on in data management today, while posing additional research objectives.
Reconciling schemas of disparate data sources
733 Citations2001AnHai Doan, Pedro Domingos +1 more
LSD is a system that employs and extends current machine-learning techniques to semi-automatically find semantic mappings between the source schemas and the mediated schema, and its architecture is extensible to additional learners that may exploit new kinds of information.
Interactive deduplication using active learning
693 Citations2002Sunita Sarawagi, Anuradha Bhamidipaty
This work presents the design of a learning-based deduplication system that uses a novel method of interactively discovering challenging training pairs using active learning and investigates various design issues that arise in building a system to provide interactive response, fast convergence, and interpretable output.
Implicit interest indicators
672 Citations2001Mark Claypool, Phong Le +2 more
It was found that the time spent on a pages, the amount of scrolling on a page and the combination of time and scrolling had a strong correlation with explicit interest, while individual scrolling methods and mouse-clicks were ineffective in predicting explicit interest.
Query chains
478 Citations2005Filip Radlinski, Thorsten Joachims
A novel approach for using clickthrough data to learn ranked retrieval functions for web search results by using query chains to generate new types of preference judgments from search engine logs, thus taking advantage of user intelligence in reformulating queries.
Elsevier eBooksThe History of Histograms (abridged)
408 Citations2003Yannis Ioannidis
This paper compress their entire history (including their "future history" as currently anticipated) in the given/fixed space budget, mostly recording details for the periods, events, and results with the highest (personally-biased) interest.
Communications of the ACMModels of attention in computing and communication
310 Citations2003Eric Horvitz, Carl Kadie +2 more
Creating computing and communication systems that sense and reason about human attention by fusing together information from multiple streams is a challenge.
Web-scale Data Integration: You can only afford to Pay As You Go
301 Citations2007Jayant Madhavan, Shawn R. Jeffery +5 more
This paper proposes a new data integration architecture, PAYGO, which is inspired by the concept of dataspaces and emphasizes pay-as-you-go data management as means for achieving web-scale data integration.
An interactive clustering-based approach to integrating source query interfaces on the deep Web
275 Citations2004Wensheng Wu, Clement Yu +2 more
An interactive, clustering-based approach to matching query interfaces, which puts the human integrator back in the loop and proposes several novel approaches to the interactive learning of parameters and the resolution of uncertain mappings.
Bootstrapping pay-as-you-go data integration systems
254 Citations2008Anish Das Sarma, Xin Luna Dong +1 more
This paper describes the first completely self-configuring data integration system based on the new concept of a probabilistic mediated schema that is automatically created from the data sources that is able to produce high-quality answers with no human intervention.
AI MagazineSemantic-integration research in the database community
202 Citations2005AnHai Doan, Alon Halevy
Semantic integration has been a long-standing challenge for the database community and has received steady attention over the past two decades, and has now become a prominent area of database resea...
CERN Document Server (European Organization for Nuclear Research)The Large Hadron Collider (LHC)
171 Citations2007Lyndon R Evans
Decision Making in Health Care: Theory, Psychology, and Applications
164 Citations2003Gretchen B. Chapman, Frank A. Sonnenberg
This work focuses on psychological theory and decision modeling techniques used in medical decision making, and their applications in health policy modeling and health policy formation and implementation.
Information retrieval
141 Citations1965P. J. Gleason
This system was conceived with the user in mind and attempts to demonstrate how each user may contribute to the effectiveness of information searching, to effect new insights into the synthesis of knowledge.
International Joint Conference on Artificial IntelligenceSelective supervision: guiding supervised learning with decision-theoretic active learning
121 Citations2007Ashish Kapoor, Eric Horvitz +1 more
This work looks at methods that guide the allocation of human effort for labeling data so as to get the greatest boosts in discriminatory power with increasing amounts of work and focuses on the application of value of information to Gaussian Process classifiers.
Effective use of block-level sampling in statistics estimation
116 Citations2004Surajit Chaudhuri, Gautam Das +1 more
This paper develops principled approaches to overcome the limitation of block-level sampling for histograms as well as distinct-value estimations, and presents a key technique that computes an appropriate subset of a block- level sample that is suitable for use with most existing estimators.
Community Information Management.
90 Citations2006AnHai Doan, Raghu Ramakrishnan +6 more
This work describes the envisioned working of a software platform that can be rapidly deployed and customized to manage data-rich online communities and its prototype, DBLife, which is a community portal being developed for the database research community.
Least expected cost query optimization
62 Citations1999Francis C. Chu, Joseph Y. Halpern +1 more
This work identifies two unreasonable, though standard, assumptions made by database query optimizers that can adversely affect the quality of the chosen evaluation plans and presents an algorithm based on the ``System R''-style query optimization algorithm that does not rely on these assumptions.
Structured Data Meets the Web: A Few Observations
49 Citations2006Jayant Madhavan, Alon Halevy +5 more
Challenges based on the experience with addressing heterogeneity on the web-scale at Google are articulated, and some principles for addressing them in a general fashion are offered.
Generic Entity Resolution in the SERF Project
34 Citations2006Omar Benjelloun, Héctor García-Molina +6 more
The approach is ``generic'', in the sense that the specific functions used to match and merge records are viewed as black boxes, which permits efficient, expressive and extensible ER solutions.
Building data integration systems: a mass collaboration approach
33 Citations2003AnHai Doan, Robert McCann
This paper describes a conceptually new solution to this problem: that of mass collaboration: that of mass collaboration to the problem of schema matching in the context of data integration.
Building Data Integration Systems via Mass Collaboration
28 Citations2003Robert McCann, AnHai Doan +2 more
This paper describes a conceptually new solution to the problem of schema matching in the context of data integration: that of mass collaboration with the aim of lifting the enormous burden of system development from the administrators and spread "thinly" over a multitude of users.