What is big data? A consensual definition and a review of key research topics
AIP conference proceedingsPublished 1 January 2015
Andrea De Mauro, Marco Greco, Michele Grimaldi
Citations527
SJR score0.15
SNIP0.20
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This paper has reviewed the existing literature on Big Data and analyzed its previous definitions in order to provide a summary of the key research areas related to the phenomenon, identifying emerging trends and suggesting opportunities for future development.
Abstract
Although Big Data is a trending buzzword in both academia and the industry, its meaning is still shrouded by much conceptual vagueness. The term is used to describe a wide range of concepts: from the technological ability to store, aggregate, and process data, to the cultural shift that is pervasively invading business and society, both drowning in information overload. The lack of a formal definition has led research to evolve into multiple and inconsistent paths. Furthermore, the existing ambiguity among researchers and practitioners undermines an efficient development of the subject. In this paper we have reviewed the existing literature on Big Data and analyzed its previous definitions in order to pursue two results: first, to provide a summary of the key research areas related to the phenomenon, identifying emerging trends and suggesting opportunities for future development; second, to provide a consensual definition for Big Data, by synthesizing common themes of existing works and patterns in previous definitions.
Keywords
Decision SciencesBusiness, Management and Accounting
Communications of the ACMMapReduce
18,538 Citations2008Jay B. Dean, Sanjay Ghemawat
This presentation explains how the underlying runtime system automatically parallelizes the computation across large-scale clusters of machines, handles machine failures, and schedules inter-machine communication to make efficient use of the network and disks.
Computer NetworksThe Internet of Things: A survey
15,290 Citations2010Luigi Atzori, Antonio Iera +1 more
This survey is directed to those who want to approach this complex discipline and contribute to its development, and finds that still major issues shall be faced by the research community.
MIS QuarterlyBusiness Intelligence and Analytics: From Big Data to Big Impact
6,044 Citations2012Hsinchun Chen, Roger H.L. Chiang +1 more
This introduction to the MIS Quarterly Special Issue on Business Intelligence Research first provides a framework that identifies the evolution, applications, and emerging research areas of BI&A, and introduces and characterized the six articles that comprise this special issue in terms of the proposed BI &A research framework.
Proceedings of the IEEECramming More Components Onto Integrated Circuits
5,743 Citations1998Gordon E. Moore
The future of integrated electronics is the future of electronics itself, and the advantages of integration will bring about a proliferation of electronics, pushing this science into many new areas.
Information Communication & SocietyCRITICAL QUESTIONS FOR BIG DATA
5,321 Citations2012danah boyd, Kate Crawford
Six provocations are offered to spark conversations about the issues of Big Data: a cultural, technological, and scholarly phenomenon that rests on the interplay of technology, analysis, and mythology that provokes extensive utopian and dystopian rhetoric.
Big data: The next frontier for innovation, competition, and productivity
5,228 Citations2011James Manyika
The amount of data in the authors' world has been exploding, and analyzing large data sets will become a key basis of competition, underpinning new waves of productivity growth, innovation, and consumer surplus, according to research by MGI and McKinsey.
ACM SIGOPS Operating Systems ReviewThe Google file system
5,003 Citations2003Sanjay Ghemawat, Howard Gobioff +1 more
The Hadoop Distributed File System
4,780 Citations2010Konstantin V. Shvachko, Hairong Kuang +2 more
The architecture of HDFS is described and experience using HDFS to manage 25 petabytes of enterprise data at Yahoo! is reported on.
NatureDetecting influenza epidemics using search engine query data
4,406 Citations2008Jeremy Ginsberg, Matthew H. Mohebbi +4 more
A method of analysing large numbers of Google search queries to track influenza-like illness in a population and accurately estimate the current level of weekly influenza activity in each region of the United States with a reporting lag of about one day is presented.
Choice Reviews OnlineBig data: a revolution that will transform how we live, work, and think
3,674 Citations2013
Big data improves health care, advances better education, and helps predict societal change from urban sprawl to the spread of the flu, and is roaring through all sectors of the economy and all areas of life.
ScienceQuantitative Analysis of Culture Using Millions of Digitized Books
3,107 Citations2010Jean-Baptiste Michel, Yuan Shen +12 more
This work surveys the vast terrain of ‘culturomics,’ focusing on linguistic and cultural phenomena that were reflected in the English language between 1800 and 2000, and shows how this approach can provide insights about fields as diverse as lexicography, the evolution of grammar, collective memory, the adoption of technology and the pursuit of fame.
Proceedings - IEEE Symposium on Security and Privacy/Proceedings of the ... IEEE Symposium on Security and PrivacyRobust De-anonymization of Large Sparse Datasets
2,298 Citations2008Arvind Narayanan, Vitaly Shmatikov
This work applies the de-anonymization methodology to the Netflix Prize dataset, which contains anonymous movie ratings of 500,000 subscribers of Netflix, the world's largest online movie rental service, and demonstrates that an adversary who knows only a little bit about an individual subscriber can easily identify this subscriber's record in the dataset.
ScienceThe World’s Technological Capacity to Store, Communicate, and Compute Information
1,612 Citations2011Martin Hilbert, Priscila López
An inventory of the world’s technological capacity from 1986 to 2007 reveals the evolution from analog to digital technologies, and the majority of the authors' technological memory has been in digital format since the early 2000s.
IEEE Pervasive ComputingConnecting the physical world with pervasive networks
837 Citations2002Deborah Estrin, David Culler +2 more
This article addresses the challenges and opportunities of instrumenting the physical world with pervasive networks of sensor-rich, embedded computation with a taxonomy of emerging systems and outlines the enabling technological developments.
Big Data analytics
762 Citations2012Sachchidanand Singh, Nirmala Singh
This analysis illustrates that the Big Data analytics is a fast-growing, influential practice and a key enabler for the social business and is critical for success in the age of social media.
IEEE Transactions on Visualization and Computer GraphicsManyEyes: a Site for Visualization at Internet Scale
718 Citations2007Fernanda Viégas, Martin Wattenberg +3 more
The design and deployment of Many Eyes is described, a public Web site where users may upload data, create interactive visualizations, and carry on discussions to support collaboration around visualizations at a large scale by fostering a social style of data analysis.
University of Minnesota Press eBooksTrending: The Promises and the Challenges of Big Social Data
675 Citations2012Лев Манович
Since its formation in 2008, NEH Office of Digital Humanities has been systematically creating grant opportunities to help humanists work with large data sets to address how "big data" changes the research landscape for the humanities and social sciences.
PubMedMotivating salespeople: what really works.
520 Citations2012Thomas J. Steenburgh, Michael Ahearne
The key is to treat sales compensation not as an expense to rein in but as a portfolio of investments to manage, and companies that do this will be rewarded with much higher returns.
Strategic Management JournalDynamics of the evolution of the strategy concept 1962–2008: a co‐word analysis
432 Citations2011Guillermo Armando Ronda‐Pupo, Luis Ángel Guerras Martín
It is shown how the concept of strategy has formed the backbone of the development of strategic management as an academic field and how consensus regarding it has evolved in the academic community during the stages of its historical development.
Applied Economics QuarterlyGoogle Econometrics and Unemployment Forecasting
432 Citations2009Nikos Askitas, Klaus F. Zimmermann
Swinburne Research Bank (Swinburne University of Technology)Sensing as a Service and Big Data
406 Citations2013Arkady Zaslavsky, Charith Perera +1 more
Emerging Internet of Things architecture, large scale sensor network applications, federating sensor networks, sensor data and related context capturing techniques, challenges in cloud-based management, storing, archiving and processing of sensor data are discussed.
interactionsInteractions with big data analytics
360 Citations2012Danyel Fisher, Rob DeLine +2 more
It is no surprise today that big data is useful for HCI researchers and user interface design, and A/B testing is a standard practice in the usability community to help determine relative differences in user performance using different interfaces.
arXiv (Cornell University)Undefined By Data: A Survey of Big Data Definitions
356 Citations2013Jonathan S. Ward, Adam Barker
This short paper attempts to collate the various definitions of big data which have gained some degree of traction and to furnish a clear and concise definition of an otherwise ambiguous term.
DOAJ (DOAJ: Directory of Open Access Journals)Viktor Mayer-Schonberger and Kenneth Cukier, Big Data: A Revolution That Will Transform How We Live, Work and Think
318 Citations2013Yadira Espinal
The authors explain the importance of this data-driven approach, how messiness trumps exactitude and the unlimited potential for many of data completeness, and how searches on Google open new possibilities, but caution of the dark future of shattered privacy is illustrated.
ACM SIGMETRICS Performance Evaluation ReviewBig data classification
315 Citations2014Shan Suthaharan
The issues related to combining supervised learning techniques, representation-learning techniques, machine lifelong learning techniques and Big Data technologies for solving network traffic classification problems are discussed.
The Journal of Academic LibrarianshipMass Digitization of Books
120 Citations2006Karen Coyle
The Open Content Alliance, a library initiative formed after Google announced its library book digitization project, has brought library digitization projects into the public eye, even though libraries were experimenting with digitization for at least a decade.
Extreme visualization
92 Citations2008Ben Shneiderman
Current and proposed solutions (atomic, aggregated, and density plots) that facilitate sense-making for interactive visual exploration of billion record data sets are described.
A characterization of big data benchmarks
36 Citations2013Wen Xiong, Zhibin Yu +7 more
The redundancy among benchmarks from ICTBench, HiBench and typical workloads from real world applications are analyzed to present an initial idea of a big data benchmark suite for spatio-temporal data.