Data and Information Quality Research
Published 1 May 2014
Hongwei Zhu, Stuart Madnick, Yang Lee, Richard Wang
Citations28
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
An overview of the evolution and current landscape of data and information quality research is presented and an integrative framework to characterize the research along two dimensions: topics and methods is introduced.
Abstract
Awareness of data and information quality issues has grown rapidly in light of the critical role played by the quality of information in our data-intensive, knowledge-based economy. Research in the past two decades has produced a large body of data quality knowledge and has expanded our ability to solve many data and information quality problems. We present an overview of the evolution and current landscape of data and information quality research. We introduce an integrative framework to characterize the research along two dimensions: topics and methods. Representative papers are cited for purposes of illustrating the issues addressed and the methods used. We also identify and discuss challenges to be addressed in future research.
Keywords
Computer ScienceDecision SciencesBusiness, Management and Accounting
Case Study Research: Design and Methods
74,912 Citations1984Robert K. Yin
Case Study Research
15,171 Citations2004Jean Hartley
MIS QuarterlyDesign Science in Information Systems Research1
9,923 Citations2004Alan R. Hevner, March March +2 more
The objective is to describe the performance of design-science research in Information Systems via a concise conceptual framework and clear guidelines for understanding, executing, and evaluating the research.
MIS QuarterlyDesign science in information systems research
7,723 Citations2004Alan R. Hevner, Salvatore T. March +2 more
The Entity Relationship Model — Toward a Unified View of Data
5,769 Citations2002Peter Pin-Shan Chen
A data model, called the entity-relationship model, is proposed that incorporates some of the important semantic information about the real world and can be used as a basis for unification of different views of data: the network model, the relational model, and the entity set model.
ACM Transactions on Database SystemsThe entity-relationship model—toward a unified view of data
4,648 Citations1976Peter Pin-Shan Chen
Journal of Management Information SystemsBeyond Accuracy: What Data Quality Means to Data Consumers
4,330 Citations1996Richard Y. Wang, Diane M. Strong
Using this framework, IS managers were able to better understand and meet their data consumers' data quality needs and this research provides a basis for future studies that measure data quality along the dimensions of this framework.
The VLDB JournalA survey of approaches to automatic schema matching
3,322 Citations2001Erhard Rahm, Philip A. Bernstein
A taxonomy is presented that distinguishes between schema-level and instance-level, element- level and structure- level, and language-based and constraint-based matchers and is intended to be useful when comparing different approaches to schema matching, when developing a new match algorithm, and when implementing a schema matching component.
IBM Systems JournalA framework for information systems architecture
3,198 Citations1987John A. Zachman
Information systems architecture is defined by creating a descriptive framework from disciplines quite independent of information systems, then by analogy specifies information systems architecture based upon the neutral, objective framework.
MIS QuarterlyQualitative Research in Information Systems
2,378 Citations1997Michael Myers
This example of "living scholarship" within MISQ Discovery's worldwide web archive provides an overview of qualitative research for the newcomer and a set of resources for those more experienced.
ACM Computing SurveysA comparative analysis of methodologies for database schema integration
1,743 Citations1986Carlo Batini, Maurizio Lenzerini +1 more
The aim of the paper is to provide first a unifying framework for the problem of schema integration, then a comparative review of the work done thus far in this area, providing a basis for identifying strengths and weaknesses of individual methodologies, as well as general guidelines for future improvements and extensions.
Communications of the ACMData quality assessment
1,643 Citations2002Leo L. Pipino, Yang W. Lee +1 more
In this article, principles that can help organizations develop usable data quality metrics are described that are suitable for use in practice.
Information & ManagementAIMQ: a methodology for information quality assessment
1,574 Citations2002Yang W. Lee, Diane M. Strong +2 more
The methodology encompasses a model of IQ, a questionnaire to measure IQ, and analysis techniques for interpreting the IQ measures, which are applied to analyze the gap between an organization and best practices.
Lecture notes in computer scienceWhy and Where: A Characterization of Data Provenance
1,310 Citations2001Peter Buneman, Sanjeev Khanna +1 more
An approach to computing provenance when the data of interest has been created by a database query is described, adopting a syntactic approach and present results for a general data model that applies to relational databases as well as to hierarchical data such as XML.
Finding high-quality content in social media
1,237 Citations2008Eugene Agichtein, Carlos Castillo +3 more
This paper introduces a general classification framework for combining the evidence from different sources of information, that can be tuned automatically for a given social media type and quality definition, and shows that its system is able to separate high-quality items from the rest with an accuracy close to that of humans.
Communications of the ACMData quality in context
1,232 Citations1997Diane M. Strong, Yang W. Lee +1 more
A new study reveals businesses are defining data quality with the consumer in mind, and within this larger context of information systems, data is collected from multiple data sources and stored in databases.
Theoretical Computer ScienceData exchange: semantics and query answering
1,203 Citations2004Ronald Fagin, Phokion G. Kolaitis +2 more
Juran's quality handbook
1,138 Citations1999Joseph M. Juran, A. Blanton Godfrey +2 more
This book discusses Quality in a High Tech Industry, Quality in the People's Republic of China, and Quality in Latin America.
Journal of Information TechnologyA critical perspective on action research as a method for information systems research
1,082 Citations1996Richard Baskerville, A. Trevor Wood‐Harper
Communications of the ACMA product perspective on total data quality management
898 Citations1998Richard Y. Wang
The purpose of this TDQM methodology is to deliver highquality information products (IP) to information consumers and aims to facilitate the implementation of an organization’s overall data quality policy formally expressed by top management.
Data Mining and Knowledge DiscoveryReal-world Data is Dirty: Data Cleansing and The Merge/Purge Problem
813 Citations1998Mauricio A. Hernández, Salvatore J. Stolfo
This paper develops a system for accomplishing this Data Cleansing task and demonstrates its use for cleansing lists of names of potential customers in a direct marketing-type application and reports on the successful implementation for a real-world database that conclusively validates results previously achieved for statistically generated data.
Columbia Academic Commons (Columbia University)Uncertainty, Industrial Structure, and the Speed of R and D
784 Citations1980Partha Dasgupta, Joseph E. Stiglitz
Reconciling schemas of disparate data sources
733 Citations2001AnHai Doan, Pedro Domingos +1 more
LSD is a system that employs and extends current machine-learning techniques to semi-automatically find semantic mappings between the source schemas and the mediated schema, and its architecture is extensible to additional learners that may exploit new kinds of information.
Communications of the ACMThe impact of poor data quality on the typical enterprise
721 Citations1998Thomas C. Redman
The typical executive is already besieged by too many problems, low customer satisfaction, high costs, a data warehouse project that is late, and so forth, so this article aims to increase awareness by providing a summary of the impacts of poor data quality on a typical enterprise.
IEEE Transactions on Knowledge and Data EngineeringA framework for analysis of data quality research
678 Citations1995R.Y. Wang, Veda C. Storey +1 more
Using an analogy between product manufacturing and data manufacturing, this paper develops a framework for analyzing data quality research, and uses it as the basis for organizing the data quality literature.
Data Quality : Concepts, Methodologies and Techniques
666 Citations2006Carlo Batini, Monica Scannapieco
Personalized privacy preservation
666 Citations2006Xiaokui Xiao, Yufei Tao
The authors' technique performs the minimum generalization for satisfying everybody's requirements, and thus, retains the largest amount of information from the microdata, and establishes the superiority of the proposed solutions.
Very Large Data BasesAnatomy: simple and effective privacy preservation
646 Citations2006Xiaokui Xiao, Yufei Tao
A linear-time algorithm is developed for computing anatomized tables that obey the l-diversity privacy requirement, and minimize the error of reconstructing the microdata.
Streaming-data algorithms for high-quality clustering
579 Citations2003Liadan O'Callaghan, Nita Mishra +3 more
This work describes a streaming algorithm that effectively clusters large data streams and provides empirical evidence of the algorithm's performance on synthetic and real data streams.
The Bell Journal of EconomicsUncertainty, Industrial Structure, and the Speed of R&D
576 Citations1980Partha Dasgupta, Joseph E. Stiglitz
Management ScienceModeling Information Manufacturing Systems to Determine Information Product Quality
552 Citations1998Donald P. Ballou, Richard Wang +2 more
A set of ideas, concepts, models, and procedures appropriate to information manufacturing systems that can be used to determine the quality of information products delivered, or transferred, to information customers are presented.
Trio: A System for Integrated Management of Data, Accuracy, and Lineage
477 Citations2004Jennifer Widom
This paper provides numerous motivating applications for Trio and lays out preliminary plans for the data model, query language, and prototype system.
Very Large Data BasesULDBs: databases with uncertainty and lineage
459 Citations2006Omar Benjelloun, Anish Das Sarma +2 more
It is shown that the ULDB representation is complete, and that it permits straightforward implementation of many relational operations, and how ULDBs enable a new approach to query processing in probabilistic databases.
AI MagazineSemantic-integration research in the database community: A brief survey
426 Citations2005AnHai Doan, Alon Halevy
This article first reviews database applications that require semantic integration and discusses the difficulties underlying the integration process, then describes recent progress and identifies open research issues.
Communications of the ACMDo electronic marketplaces lower the price of goods?
419 Citations1998Ho-Guen Lee
An industry case study is presented to demonstrate that the prices of goods traded through electronic marketplaces can actually be higher than those of products sold in traditional markets.
Journal of Data and Information QualityOne Size Does Not Fit All---A Contingency Approach to Data Governance
335 Citations2009Kristin Weber, Boris Otto +1 more
The article presents the first results of a community action research project on data governance comprising six international companies from various industries and outlines a data governance model that consists of three components (data quality roles, decision areas, and responsibilities), which together form a responsibility assignment matrix.
ACM Transactions on Information SystemsContext interchange
333 Citations1999Cheng Hian Goh, Stéphane Bressan +2 more
It is shown that queries formulated on shared views, export schema, and shared “ontologies” can be mediated in the same way using the Context Interchange framework.
Declarative Data Cleaning: Language, Model, and Algorithms
317 Citations2001Héléna Galhardas, Daniela Florescu +3 more
This paper presents a language, an execution model and algorithms that enable users to express data cleaning specifications declaratively and perform the cleaning efficiently and experimental results report on the assessement of the proposed framework for data cleaning.
Information SystemsLearning object identification rules for information integration
315 Citations2001Sheila Tejada, Craig A. Knoblock +1 more
An object identification system called Active Atlas, which compares the objects' shared attributes in order to identify matching objects using exact text match, and achieves higher accuracy and require less user involvement than previous methods across various application domains.
Provenance management in curated databases
296 Citations2006Peter Buneman, Adriane Chapman +1 more
This paper describes an approach in which the user's actions are tracked while browsing source databases and copying data into a curated database, in order to record theuser's actions in a convenient, queryable form and uses it to evaluate the feasibility of database support for provenance management.
Management of probabilistic data
293 Citations2007Nilesh Dalvi, Dan Suciu
The foundations of managing data where the uncertainties are quantified as probabilities are described, and some fundamental theoretical result for query evaluation on probabilistic databases is presented.
Communications of the ACMEnhancing data quality in data warehouse environments
268 Citations1999Donald P. Ballou, Giri Kumar Tayi
A conceptual framework for enhancing data quality in data warehouse environments is offered and the factors that should be considered, such as the current level of data quality, the levels of quality needed by the relevant decision processes, and the potential benefits of projects designed to enhance data quality are explored.
Sloan management reviewManage Your Information as a Product
253 Citations1998Richard Y. Wang, Yang W. Lee +2 more
Decision Support SystemsToward quality data: An attribute-based approach
249 Citations1995Richard Y. Wang, M. P. Reddy +1 more
An attribute-based data model, query algebra, and integrity rules that facilitate cell-level tagging as well as the processing of application data that is augmented with quality indicators are proposed.
Lecture notes in computer scienceQuality-Driven Query Answering for Integrated Information Systems
248 Citations2002Felix Naumann
This paper presents a meta-modelling framework that automates the very labor-intensive and therefore time-heavy and therefore expensive and expensive process of planning and executing quality-driven queries.
Lecture notes in computer scienceOn the Many-to-One Transport Capacity of a Dense Wireless Sensor Network and the Compressibility of Its Data
242 Citations2003Daniel De Marco, Enrique J. Duarte‐Melo +2 more
This paper investigates the capability of large-scale sensor networks to measure and transport a two-dimensional field in which densely deployed sensors take periodic samples of the sensed field, and then scalar quantize, encode and transmit them to a single receiver/central controller where snapshot images of the sensing field are reconstructed.
Information & ManagementCriticality of data quality as exemplified in two disasters
229 Citations2001Craig W. Fisher, Bruce R. Kingma
It is shown that there were visible data-quality problems in the systems of the Challenger and Vincennes disasters, and it is believed that management should pursue an aggressive plan of treating information as a critical product.
The MIT Press eBooksJourney to Data Quality
222 Citations2006Yang W. Lee, Leo L. Pipino +2 more
The authors discuss how to make the economic case for data quality and the importance of getting an organization's leaders on board, and outline different approaches for assessing data, both subjectively and objectively.
Information Systems ResearchThe Impact of Experience and Time on the Use of Data Quality Information in Decision Making
218 Citations2003Craig W. Fisher, InduShobha Chengalur‐Smith +1 more
The overall conclusion is that DQI should be made available to managers without domain-specific experience and incorporated into data warehouses used on an ad hoc basis by managers.
Decision Support SystemsImpact of information quality and decision-maker quality on decision quality: a theoretical model and simulation analysis
214 Citations1999Srinivasan Raghunathan
The analysis shows that, depending on the decision-making quality, decision quality may improve or degrade when information quality improves, and underscores the need for including decision-maker quality in the investigation of the IT-performance relationship and the importance of developing quality decision support tools.
Data quality requirements analysis and modeling
206 Citations2002R.Y. Wang, H. Kon +1 more
A set or premises, terms, and definitions for data quality management are established, and a step-by-step methodology for defining and documenting data quality parameters important to users is developed, demonstrating that data quality can be an integral part of the database design process.
Information Systems ResearchDesigning Information Systems to Optimize the Accuracy-Timeliness Tradeoff
201 Citations1995Donald P. Ballou, Harold L. Pazer
Through analysis of a generic family of environments, procedures are suggested for reducing the negative consequences of this accuracy-timeliness tradeoff.
Journal of Management Information SystemsKnowing-Why About Data Processes and Data Quality
197 Citations2003Yang W. Lee, Diane M. Strong
It is found that work roles and the mode of knowledge do matter and data collectors with why-knowledge about the data production process contribute to producing better quality data.
Querying data provenance
196 Citations2010Grigoris Karvounarakis, Zachary G. Ives +1 more
A query language for provenance is developed, which can express all of the aforementioned types of queries, as well as many more, and the feasibility of provenance querying and the benefits of the indexing techniques across a variety of application classes and queries are experimentally validated.
Information SystemsArchitecture and quality in data warehouses: An extended repository approach
192 Citations1999Matthias Jarke, Manfred A. Jeusfeld +2 more
This paper adapts the Goal-Question-Metric approach from software quality management to a meta data management environment in order to link these special techniques to a generic conceptual framework of DW quality.
IEEE Transactions on Knowledge and Data EngineeringThe impact of data quality information on decision making: an exploratory analysis
186 Citations1999InduShobha Chengalur‐Smith, Donald P. Ballou +1 more
It is found that in a situation where subjects are confronted with clearly differentiated alternatives, the inclusion of data-quality information impacted the selection of the preferred alternative while maintaining group consensus.
Industrial Management & Data SystemsData quality issues in implementing an ERP
181 Citations2002Hongjiang Xu, Jeretta Horn Nord +2 more
The study explores data quality problems with existing systems, and identifies critical success factors that impact data quality, which resulted in the development of a framework for understanding data quality issues in implementing an ERP and application in a case study in two large Australian organisations.
RePEc: Research Papers in EconomicsA Polygen Model for Heterogeneous Database Systems: The Source Tagging Perspective
172 Citations1990Y. Richard Wang, Stuart Madnick
A polygen model for resolving the Data Source Tagging and Intermediate source Tagging problems is presented and a data-driven query translation mechanism for mapping a polygen query into a set of local queries dynamically is presented.
The inter-database instance identification problem in integrating autonomous systems
156 Citations2003J.R. Wang, Stuart Madnick
A technique called interdatabase instance identification is presented that is a combination of database management systems and artificial intelligence techniques to identify the same instance across disparate databases in a composite information system (CIS) environment.
Journal of Database ManagementManaging Data Quality in Dynamic Decision Environments
151 Citations2003G. Shankaranarayan, Mostafa Ziad +1 more
This paper presents a framework for managing data quality in such environments using the information product approach and posits the notion of a virtual business environment to support dynamic decision-making and describes the role of the data quality framework.
On Matching Schemas Automatically
128 Citations2001Erhard Rahm, Philip A. Bernstein
A taxonomy that covers many of the existing approaches to schema matching, and distinguishes betweenschema- and instance- level, element- and structure-level, and language- and constraint-based match-ers, is presented.
Journal of Information SystemsDoes the Year 2000 XBRL Taxonomy Accommodate Current Business Financial-Reporting Practice?
121 Citations2002Matthew Bovee, Michael Ettredge +2 more
XBRL (eXtensible Business Reporting Language) is an application of XML intended for use in digital business reporting and observers predict XBRL will provide benefits to financial services companies.
Journal of Political EconomyThe Economics of Quality
114 Citations1983A. S. De Vany, Thomas R. Saving
Information SystemsArktos: towards the modeling, design, control and execution of ETL processes
92 Citations2001Panos Vassiliadis, Zografoula Vagena +3 more
The ETL tool, namely Arktos, is capable of modeling and executing practical ETL scenarios by providing explicit primitives for the capturing of common tasks and provides three ways to describe an ETL scenario: a graphical point-and-click front end and two declarative languages.
Journal of Database ManagementProcess-Embedded Data Integrity
91 Citations2004Yang W. Lee, Leo L. Pipino +2 more
This research merges data integrity theory with management theories about quality improvement using a data quality lens, and it demonstrates the usefulness of the combined theory for data quality improvement.
Programming and Computer SoftwareOutlier Detection Algorithms in Data Mining Systems
89 Citations2003Mikhail Petrovskiy
A new outlier detection algorithm is suggested, based on methods of fuzzy set theory and the use of kernel functions and possesses a number of advantages compared to the existing methods.
Data & Knowledge EngineeringImproving data quality through effective use of data semantics
88 Citations2005Stuart Madnick, Hongwei Zhu
This paper identifies semantic heterogeneities that, when not resolved, often cause data quality problems and illustrates how COntext INterchange (COIN) technology can be used to capture data semantics and reconcile semantic heterogeneousities, thereby improving data quality.
Journal of Data and Information QualityA Procedure to Develop Metrics for Currency and its Application in CRM
86 Citations2009Bernd Heinrich, Mathias Klier +1 more
A procedure to develop probability-based metrics for currency which can be adjusted to the specific characteristics of data attribute values is designed and applied in the field of campaign management in order to improve both success rates and profits.
ACM SIGMOD RecordReport on the Dagstuhl Seminar
85 Citations2004Michael Gertz, M. TAMER ÖZSU +2 more
The objective of the Dagstuhl Seminar was to foster collaboration among researchers that deal with DQ in different areas, assess existing results in managing the quality of data, and establish a framework for future research in the area of DQ.
Journal of Management Information SystemsCrafting Rules: Context-Reflective Data Quality Problem Solving
81 Citations2003Yang W. Lee
A conceptual model of data quality problem solving is built that finds that experienced practitioners solve data quality problems by reflecting on and explicating knowledge about contexts embedded in, or missing from, data.
Information SystemsDiscovering and reconciling value conflicts for numerical data integration
76 Citations2001Weiguo Fan, Hongjun Lü +2 more
To facilitate data integration, data value Conversion rules are proposed to describe the quantitative relationships among data values involving context dependent conflicts and a general approach is proposed to discover data value conversion rules from the data.
Software Quality JournalA proposal for a set of attributes relevant for Web portal data quality
71 Citations2008L Caro, Coral Calero +2 more
A set of 33 attributes which are relevant for portal data quality are proposed which have been obtained from a revision of literature and a validation process carried out by means of a survey and it is thought that it might be considered as a good starting point for constructing one.
Information Systems ResearchAn Economic Model of Product Quality and IT Value
68 Citations2004Matt E. Thatcher, David E. Pingry
An economic model is used to formalize the complex relationships among IT investments, intermediate performance measures, and economic performance and demonstrates that these relationships are robust to the socially optimal case in which a social planner chooses price and quality to maximize social welfare.
MIS QuarterlyThe Economics of Software Quality Assurance: A Simulation-Based Case Study
64 Citations1988Tarek K. Abdel‐Hamid
A comprehensive system dynamics model of the software development process was developed that serves as an experimentation vehicle for QA policy and was used to identify the optimal QA expenditure level and its distribution throughout the project's lifecycle.
Information Systems ResearchPrivacy Protection in Data Mining: A Perturbation Approach for Categorical Data
63 Citations2006Xiao‐Bai Li, Sumit Sarkar
It is demonstrated that many records in a data set could be uniquely identified even after identity-related attributes are removed and shown that the problem can be solved in two phases, with a linear programming formulation in Phase I (to preserve the first-order marginal distribution), followed by a simple Bayes-based swapping procedure in Phase II.
Communications of the ACMAssessing data quality with control matrices
60 Citations2004Elizabeth M. Pierce
The control matrix, long used by IS auditors to evaluate information integrity, can be modified to assess the reliability of information products.
Electronic MarketsQuality of data standards: framework and illustration using XBRL taxonomy and instances
60 Citations2011Hongwei Zhu, Harris Wu
A set of metrics and a framework for assessing data standard quality are developed and shown to be useful and effective and to help improve the quality of financial data and the efficiency of the data supply chain in a networked business environment.
International Journal of Health Care Quality AssuranceThe economics of quality – a practical approach
59 Citations2000John Øvretveit
Examples of the cost of poor quality are given, a simple method for quality costing is described, and the economics of quality is discussed, which proposes how managers and clinicians can take a more economically-informed approach to quality in public healthcare.
OmegaData quality in neural network models: effect of error rate and magnitude of error on predictive accuracy
55 Citations1999Barbara Klein, Donald F. Rossin
The article uses a real-world example, the prediction of the net asset values of mutual funds, to investigate the effect of data quality on neural network models, and shows that the error rate and magnitude of error in data used to build the model affect the predictive accuracy of neural networks.
Measuring Data Believability: A Provenance Approach
49 Citations2008Nicolas Prat, Stuart Madnick
To the knowledge, this is the first work to develop a precise approach to measuring data believability and making explicit use of provenance-based measurements.
IEEE Transactions on Knowledge and Data EngineeringSample-based quality estimation of query results in relational database environments
37 Citations2006Donald P. Ballou, InduShobha Chengalur‐Smith +1 more
This research uses the relational algebra framework to develop estimates for the quality of query results based on the quality estimates of samples taken from the base tables, using the reference-table procedure which can be used for quality estimation in general.
Journal of Data and Information QualityEditorial for the Inaugural Issue of the ACM Journal of Data and Information Quality (JDIQ)
34 Citations2009Stuart Madnick, Yang W. Lee
This journal has chosen to name this journal Data and Information Quality to cover the full range of issues and will generally use these terms interchangeably.
Decision Support SystemsViews of mathematical programming models and their instances
34 Citations1995Harvey J. Greenberg, Frederic H. Murphy
This paper addresses the issue of multiview architecture by presenting a formal framework for the design of a view creation and management system and specific views the authors consider include algebraic, block schematic, graphic, and textual.
International Journal of Medical InformaticsConsequences of impaired data quality on information retrieval in electronic patient records
30 Citations2004Gustav Mikkelsen, Jan Aasly
Data attributes central for automated document retrieval in electronic patient records showed variable accuracy, with potentially negative consequences for basic record navigation.
ACM SIGMOD RecordBIO-AJAX
29 Citations2004Katherine G. Herbert, Narain Gehani +3 more
This paper proposes a framework, called BIO-AJAX, which uses principles from data cleaning to improve data quality in biological information systems, specifically in TreeBASE.
International Journal of Healthcare Technology and ManagementDeveloping data production maps: meeting patient discharge data submission requirements
27 Citations2004Bruce N. Davidson, Yang W. Lee +1 more
These data production maps have enabled this hospital to model, analyse, and improve the quality of patient-level data that must be submitted to the State Department of Health Services annually.
Journal of Data and Information QualityA Bayesian Approach for Estimating and Replacing Missing Categorical Data
26 Citations2009Xiao‐Bai Li
The effectiveness of the proposed approach for estimating and replacing missing categorical data is evaluated based on some important data quality measures for data warehousing and data mining.
Journal of the Association for Information SystemsTowards Quality of Data Standards: Empirical Findings from XBRL
25 Citations2009Hongwei Zhu, Liuliu Fu
An experimental study of the effects of contextual data quality and task complexity on decision performance
23 Citations2005Wonjin Jung, Lorne Olfman +2 more
The findings suggest that decision makers can expect to improve their decision performance by enhancing contextual DQ, and a body of research examining the effects of factors that can be tied to human decision-making performance is extended.
Improving the Quality of Corporate Household Data: Current Practices and Research Directions
22 Citations2001Stuart Madnick, Richard Y. Wang +2 more
International Journal of E-Business ResearchInteroperability of XBRL Financial Statements in the U.S.
20 Citations2011Hongwei Zhu, Harris Wu
This question is addressed by analyzing all of the annual XBRL financial statements filed to the SEC and finding that on average, 63% of data elements are not comparable between a pair of statements.
Edinburgh Research Explorer (University of Edinburgh)SQL's Three-Valued Logic and Certain Answers
20 Citations2015Leonid Libkin
SSRN Electronic JournalQuality of Data Standards: Empirical Findings from XBRL
19 Citations2009Hongwei Zhu, Liuliu Fu
The notion of “quality of data standards” is introduced and it is argued that quality of data is affected by the quality of the standards used, and metrics for assessing quality ofData Standards are developed.
AIS Electronic Library (AISeL) (Association for Information Systems)A Curriculum for a Master of Science in Information Quality
19 Citations2007Yang W. Lee, Elizabeth M. Pierce +3 more
The first Master of Science in Information Quality (IQ) degree is designed and being offered to prepare students for careers in industry and government as well as advanced graduate studies to educate students who can lead the effort to solve current and future information quality problems.
SSRN Electronic JournalImproving the Quality of Corporate Household Data: Current Practices and Research Directions
15 Citations2003Stuart Madnick, Richard Y. Wang +2 more
This work proposes conceptual definitions for corporate household, corporate household knowledge, and corporate Household knowledge processor and applies the context interchange theory to represent the corporate household data and underlying knowledge and enable the context mediation technology to correctly understand and reason about both the contexts of the sources and the context of the user's query about corporate house data.
The institutionalisation of data quality in the New Zealand health sector.
11 Citations2006Karolyn Kerr
This thesis explores the issues that define and control data quality in the national health data collections and the mechanisms and frameworks that can be developed to achieve and sustain good data quality.
Mining complex matchings across Web query interfaces
11 Citations2004Bin He, Kevin Chen–Chuan Chang +1 more
This paper views schema matching as correlation mining as a data mining problem for the task of matching Web query interfaces to integrate the myriad databases on the Internet, and shows that the correlation mining approach does discover semantically meaningful matchings among attributes.
SSRN Electronic JournalImproving Data Quality Through Effective Use of Data Semantics (DKE)
10 Citations2005Stuart Madnick, Hongwei Zhu
This paper identifies semantic heterogeneities that, when not resolved, often cause data quality problems and illustrates how COntext INterchange (COIN) technology can be used to capture data semantics and reconcile semantic heterogeneousities, thereby improving data quality.
…