Knowledge discovery and data mining: towards a unifying framework

Published 2 August 1996

Usama M. Fayyad, Gregory Piatetsky-Shapiro, Padhraic Smyth

Citations847

TL;DR

The KDD process and basic data mining algorithms are defined, links between data mining, knowledge discovery, and other related fields are described, and an analysis of challenges facing practitioners in the field is analyzed.

Abstract

This paper presents a first step towards a unifying framework for Knowledge Discovery in Databases. We describe links between data mining, knowledge discovery, and other related fields. We then define the KDD process and basic data mining algorithms, discuss application issues and conclude with an analysis of challenges facing practitioners in the field. keywords: Knowledge Discovery in Databases (KDD), Data mining, overview article, large databases, automated analysis, issues and challenges in data mining. To appear: Proceedings of the Second International Conference on Knowledge Discovery and Data Mining (KDD-96), Portland, Oregon, August 2-4, 1996, AAAI Press. http://wwwaig. jpl.nasa.gov/kdd96 Knowledge Discovery and Data Mining: Towards a Unifying Framework Usama Fayyad Microsoft Research One Microsoft Way Redmond, WA 98052, USA [email protected] Gregory Piatetsky-Shapiro GTE Laboratories, MS 44 Waltham, MA 02154, USA [email protected] Padhraic Smyth Information and Computer S...

Keywords

Computer Science

Knowledge Discovery and Data MiningDiscovering Frequent Episodes in Sequences.

593 Citations1995Heikki Mannila, Hannu Toivonen +1 more

These two cases represent the only melanocytic neoplasms in Rhinoceridae reported in detail in the literature and are thought to be the first of their kind diagnosed in captivity.

Communications of the ACMApplications of machine learning and rule induction

504 Citations1995Pat Langley, Herbert A. Simon

This paper aims to provide increasing levels of automation in the knowledge engineering process, replacing much time-consuming human activity with automatic techniques that improve accuracy or efficiency by discovering and exploiting regularities in training data.

On subjective measures of interestingness in knowledge discovery

357 Citations1995Avi Silberschatz, Alexander Tuzhilin

The purpose of this paper is to lay the groundwork for a comprehensive study of subjective measures of interestingness and classify these measures into actionable and unexpected, and examine the relationship between them.

The interestingness of deviations

214 Citations1994Gregory Piatetsky-Shapiro, Christopher J. Matheus

It is argued that related deviations should be grouped together in a finding and that the interestingness of a finding is the estimated benefit from a possible action connected to it, and methods for determining the Estimated benefit from the impact of the deviations and the success probability of an action are discussed.

Journal of the Royal Statistical Society Series A (Statistics in Society)Deconstructing Statistical Questions

149 Citations1994David J. Hand

It is clear that establishing the mapping from the client's domain to a statistical question is one of the most difficult parts of a statistical analysis.

AI MagazineKnowledge discovery in real databases: A report on the IJCAI-89 Workshop

129 Citations1991Gregory Piatetsky-Shapiro

The growth in the amount of available databases far outstrips the growth of corresponding knowledge, which creates both a need and an opportunity for extracting knowledge from databases.

Knowledge Discovery and Data MiningActive data mining

113 Citations1995Rakesh Agrawal, Giuseppe Psaila

Journal of Intelligent Information SystemsSelecting among rules induced from a hurricane database

109 Citations1995John A. Major, John J. Mangano

A rule refinement strategy is presented, partly implemented in a Prolog program, that operationalizes “interestingness” into performance, simplicity, novelty, and significance and yielded 10 “genuinely interesting” rules.

KDD for science data analysis: issues and examples

94 Citations1996Usama M. Fayyad, David Haussler +1 more

An overview of the main issues in the exploitation of scientific datasets is given, five case studies where KDD tools play important and enabling roles are presented, and future challenges for data mining and KDD techniques in science data analysis are concluded.

An overview of issues in developing industrial data mining and knowledge discovery applications

72 Citations1996Gregory Piatetsky-Shapiro, Ron Brachman +3 more

This paper surveys the growing number of industrial applications of data mining and knowledge discovery, and describes some representative applications, and examines how to assess the potential of a knowledge discovery application.