Mining product reputations on the Web
Published 23 July 2002
Satoshi Morinaga, Kenji Yamanishi, Kenji Tateishi, Toshikazu Fukushima
Citations413
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A new framework for mining product reputations on the Internet is presented, which offers a drastic reduction in the overall cost of reputation analysis over that of conventional survey approaches and supports the discovery of knowledge from the pool of opinions on the web.
Abstract
Knowing the reputations of your own and/or competitors' products is important for marketing and customer relationship management. It is, however, very costly to collect and analyze survey data manually. This paper presents a new framework for mining product reputations on the Internet. It automatically collects people's opinions about target products from Web pages, and it uses text mining techniques to obtain the reputations of those products. On the basis of human-test samples, we generate in advance syntactic and linguistic rules to determine whether any given statement is an opinion or not, as well as whether such any opinion is positive or negative in nature. We first collect statements regarding target products using a general search engine, and then, using the rules, extract opinions
Keywords
Computer Science
Fast algorithms for mining association rules
10,739 Citations1998Rakesh Agrawal, Ramakrishnan Srikant
Programs for Machine Learning
5,794 Citations1994Steven L. Salzberg, Alberto M. Segre
In his new book, C4.5: Programs for Machine Learning, Quinlan has put together a definitive, much needed description of his complete system, including the latest developments, which will be a welcome addition to the library of many researchers and students.
IEEE Transactions on Information TheoryFisher information and stochastic complexity
841 Citations1996J. Rissanen
A sharper code length is obtained as the stochastic complexity and the associated universal process are derived for a class of parametric processes by taking into account the Fisher information and removing an inherent redundancy in earlier two-part codes.
ACM SIGMOD RecordDatabase techniques for the World-Wide Web
560 Citations1998Daniela Florescu, Alon Y. Levy +1 more
The primary goal of this survey is to classify the different tasks to which database concepts have been applied, and to emphasize the technical innovations that were required to do so.
A scalable comparison-shopping agent for the World-Wide Web
507 Citations1997Robert B. Doorenbos, Oren Etzioni +1 more
ShopBot, a fully-implemented, domainindependent comparison-shopping agent that relies on a combination of heuristic search, pattern matching, and inductive learning techniques, enables users to both find superior prices and substantially reduce Web shopping time.
Artificial IntelligenceLearning to construct knowledge bases from the World Wide Web
472 Citations2000Mark Craven, Dan DiPasquo +5 more
The goal of the research described here is to automatically create a computer understandable knowledge base whose content mirrors that of the World Wide Web, and several machine learning algorithms for this task are described, and promising initial results with a prototype system that has created a knowledge base describing university people, courses, and research projects.
Building a question answering test collection
448 Citations2000Ellen M. Voorhees, Dawn M. Tice
The TREC-8 Question Answering (QA) Track was the first large-scale evaluation of domain-independent question answering systems and was used to investigate whether the evaluation methodology used for document retrieval is appropriate for a different natural language processing task.
NoDoSE—a tool for semi-automatically extracting structured and semistructured data from text documents
303 Citations1998Brad Adelberg
NoDoSE, the Northwestern Document Structure Extractor, is described, which is an interactive tool for semi-automatically determining the structure of such documents and then extracting their data.
ACM SIGMOD RecordWrapper generation for semi-structured Internet sources
280 Citations1997Naveen Ashish, Craig A. Knoblock
The key idea is to exploit the formatting information in pages from the source to hypothesize the underlying structure of a page and generate a wrapper that facilitates querying of a source and possibly integrating it with other sources.
Question-answering by predictive annotation
214 Citations2000John Prager, Eric W. Brown +2 more
Predictive Annotation identifies potential answers to questions in text, annotates them accordingly and indexes them, and produces a system effective at answering natural-language fact-seeking questions posed against large document collections.
The structure and performance of an open-domain question answering system
187 Citations2000Dan Moldovan, Sanda M. Harabagiu +5 more
The LASSO Question Answering system developed in the Natural Language Processing Laboratory at SMU relies on a combination of syntactic and semantic techniques and a novel form of indexing called paragraph indexing to find answers.
Experiments with open-domain textual Question Answering
157 Citations2000Sanda M. Harabagiu, Marius Paşca +1 more
This paper describes the integration of several knowledge-based natural language processing techniques into a Question Answering system, capable of mining textual answers from large collections of texts.
Information Extraction Supported Question Answering
139 Citations1999Rohini K. Srihari, Wei Li
This study shows that information extraction system, Textract, can provide solid support for QA, and low-level IE like Named Entity tagging is often a necessary component in handling most types of questions.
From Sentence Processing to Information Access on the World Wide Web
96 Citations1997Boris Katz
How annotating information segments with collections of English sentences makes it possible to use the power of sentence-level natural language processing in the service of multi-media information access is explained.
IEEE Transactions on Information TheoryA decision-theoretic extension of stochastic complexity and its applications to learning
92 Citations1998Kenji Yamanishi
Through the ESC, the notion of extended stochastic complexity is introduced and its effectiveness in design and analysis of learning algorithms in on-line prediction and batch-learning scenarios is demonstrated, giving a unifying view of the most effective learning algorithms that have been explored in computational learning theory.
Conference on Learning TheoryA learning criterion for stochastic rules
85 Citations1990Kenji Yamanishi
The Use of Predictive Annotation for Question Answering in TREC8.
83 Citations1999John Prager, Dragomir Radev +3 more
This paper introduces the technique of Predictive Annotation, a methodology for indexing texts for retrieval aimed at answering fact-seeking questions by establishing about 20 classes of objects that can be identified in text by shallow parsing, and by annotating and indexing the text with labels, which are called QA-Tokens.
Question-Answering Using Semantic Relation Triples.
47 Citations1999Kenneth C. Litkowski
This paper describes the development of a prototype system to answer questions by selecting sentences from the documents in which the answers occur, and demonstrates the viability of using structural information about the sentences in a document toanswer questions.
Machine LearningA learning criterion for stochastic rules
46 Citations1992Kenji Yamanishi
This paper derives target-dependent upper bounds and worst-case upper bounds on the sample size required by the MDL algorithm to learn stochastic rules with given accuracy and confidence.
Mining from open answers in questionnaire data
44 Citations2001Hang Li, Kenji Yamanishi
A text mining system that provides a new way for analyzing open answers in questionnaire data, which has been put into use by a number of large corporations in Japan in the performance of text mining on various types of survey data.
Information Processing & ManagementText classification using ESC-based stochastic decision lists
29 Citations2002Hang Li, Kenji Yamanishi