Hypothesis generation and data quality assessment through association mining
Published 1 July 2010
Ping Chen, Walter Baluja García
Citations9
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This paper presents a semantic network based association analysis model including three spreading activation methods, and applies this model to assess the quality of a dataset, and generate semantically valid new hypotheses for further investigation.
Abstract
Association mining aims to find valid correlations among data attributes, and has been widely applied to many areas of data analysis. In this paper we present a semantic network based association analysis model including three spreading activation methods, and apply this model to assess the quality of a dataset, and generate semantically valid new hypotheses for further investigation. We evaluate our approach on a real public health dataset, the Heartfelt study, and the experiment shows promising results.
Keywords
Computer ScienceDecision SciencesHealth Professions
Communications of the ACMData quality assessment
1,643 Citations2002Leo L. Pipino, Yang W. Lee +1 more
In this article, principles that can help organizations develop usable data quality metrics are described that are suitable for use in practice.
Selecting the right interestingness measure for association patterns
861 Citations2002Pang‐Ning Tan, Vipin Kumar +1 more
An overview of various measures proposed in the statistics, machine learning and data mining literature is presented and it is shown that each measure has different properties which make them useful for some application domains, but not for others.
Mining the most interesting rules
651 Citations1999Roberto J. Bayardo, Rakesh Agrawal
It is argued that by returning a broader set of rules than previous algorithms, these techniques allow for improved insight into the data and support more user-interaction in the optimized rule-mining process.
American Journal of Human BiologyIs obesity associated with poor sleep quality in adolescents?
435 Citations2002Neeraj Gupta, William H. Mueller +2 more
Inadequate and poor sleep quality in adolescents may be important factors to consider in the prevention of childhood obesity.
Mining top-k frequent closed patterns without minimum support
254 Citations2003Jiawei Han, Jianyong Wang +2 more
TFP outperforms CLOSET and CHARM, two efficient frequent closed pattern mining algorithms, even when both are running with the best tuned min-support, and can be extended to generate association rules and to incorporate user-specified constraints.
A belief-driven method for discovering unexpected patterns
243 Citations1998Balaji Padmanabhan
This paper proposes a new method of discovering unexpected patterns that takes into consideration prior background knowledge of decision makers and uses these beliefs to seed the search for patterns in data that contradict the beliefs.
Small is beautiful
146 Citations2000Balaji Padmanabhan, Alexander Tuzhilin
New methods for discovering a minimal set of unexpected patterns that discover orders of magnitude fewer patterns and yet retain most of the truly interesting ones are proposed.
Extracting redundancy-aware top-k patterns
117 Citations2006Dong Xin, Hong Cheng +2 more
This paper examines the evaluation functions for measuring the combined significance of a pattern set and proposes the MMS (Maximal Marginal Significance) as the problem formulation and presents a greedy algorithm which approximates the optimal solution with performance bound O(log k) (with conditions on redundancy), where k is the number of reported patterns.
Discovering significant rules
104 Citations2006Geoffrey I. Webb
Generic techniques that allow definitions of true and false discoveries to be specified in terms of arbitrary statistical hypothesis tests and which provide strict control over the experiment wise risk of false discoveries are presented.
Rule interestingness analysis using OLAP operations
42 Citations2006Bing Liu, Kaidi Zhao +2 more
A novel approach to deal with interestingness of discovered rules is proposed, which casts rule analysis as OLAP operations and general impression mining, which enables the user to explore the knowledge space to find useful knowledge easily and systematically.
Mining unexpected rules by pushing user dynamics
40 Citations2003Ke Wang, Yuelong Jiang +1 more
This paper develops an approach that addresses all three problems above and evaluates it by means of experiments focusing on finding interesting rules.
Annals of Behavioral MedicineDevelopmental, gender, and ethnic group differences in moods and ambulatory blood pressure in adolescents
34 Citations2004Janet C. Meininger, Patricia Liehr +3 more
Moods differed significantly by gender, ethnic group, and maturation, and there were significant interaction effects of moods with physical maturity, gender, and ethnic group on ambulatory SBP and DBP.
Blood Pressure MonitoringStress-induced alterations of blood pressure and 24 h ambulatory blood pressure in adolescents
26 Citations1999Janet C. Meininger, Patricia Liehr +4 more
Blood pressure measured during laboratory tasks that require talking might be useful as a screening device to identify adolescents with high blood pressures, according to the sensitivity of the laboratory protocol as an indicator of high blood pressure compared with casual measurement of blood pressures.
On incorporating subjective interestingness into the mining process
25 Citations2003Sigal Sahar
How an approach that requires very little domain knowledge and interaction to eliminate the majority of the rules that are subjectively not interesting can be incorporated into the mining process is investigated, and the results of its application to real databases are examined.
American Journal of HypertensionThe Relationship of Ambulatory Blood Pressure to Physical Activity in a Tri-Ethnic Population of Obese and Nonobese Adolescents
12 Citations2007Mona A. Eissa, Janet C. Meininger +2 more
It is found that PA is associated with ABP measurements, and these associations are modified by obesity status and other variables.
Mining unexpected rules by pushing user dynamics
11 Citations2003Ke Wang, Yuelong Jiang +1 more
Semantic Analysis of Association Rules
10 Citations2008Ping Chen, Rakesh Verma +2 more
This paper semantically divides association rules into five categories and can be efficiently integrated with existing rule reduction techniques to construct a concise, high-quality, and user-specific association rule set.