The rise of “big data” on cloud computing: Review and open research issues
Information SystemsPublished 10 August 2014
Mohamed Hashem, Ibrar Yaqoob, Nor Badrul Anuar, Salimah Mokhtar, Abdullah Gani, Samee U. Khan
Citations2,604
SJR quartileQ1
SJR score0.89
SNIP1.96
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The definition, characteristics, and classification of big data along with some discussions on cloud computing are introduced, and research challenges are investigated, with focus on scalability, availability, data integrity, data transformation, data quality, data heterogeneity, privacy, legal and regulatory issues, and governance.
Abstract
Cloud computing is a powerful technology to perform massive-scale and complex computing. It eliminates the need to maintain expensive computing hardware, dedicated space, and software. Massive growth in the scale of data or big data generated through cloud computing has been observed. Addressing big data is a challenging and time-demanding task that requires a large computational infrastructure to ensure successful data processing and analysis. The rise of big data in cloud computing is reviewed in this study. The definition, characteristics, and classification of big data along with some discussions on cloud computing are introduced. The relationship between big data and cloud computing, big data storage systems, and Hadoop technology are also discussed. Furthermore, research challenges are investigated, with focus on scalability, availability, data integrity, data transformation, data quality, data heterogeneity, privacy, legal and regulatory issues, and governance. Lastly, open research issues that require substantial research efforts are summarized.
Keywords
Computer ScienceDecision Sciences
Communications of the ACMMapReduce
18,538 Citations2008Jay B. Dean, Sanjay Ghemawat
This presentation explains how the underlying runtime system automatically parallelizes the computation across large-scale clusters of machines, handles machine failures, and schedules inter-machine communication to make efficient use of the network and disks.
Bell System Technical JournalCommunication Theory of Secrecy Systems*
9,330 Citations1949Claude E. Shannon
A theory of secrecy systems is developed on a theoretical level and is intended to complement the treatment found in standard works on cryptography.
Communications of the ACMA view of cloud computing
8,997 Citations2010Michael Armbrust, Armando Fox +9 more
The clouds are clearing the clouds away from the true potential and obstacles posed by this computing capability.
Big data: The next frontier for innovation, competition, and productivity
5,228 Citations2011James Manyika
The amount of data in the authors' world has been exploding, and analyzing large data sets will become a key basis of competition, underpinning new waves of productivity growth, innovation, and consumer surplus, according to research by MGI and McKinsey.
ACM SIGOPS Operating Systems ReviewThe Google file system
5,003 Citations2003Sanjay Ghemawat, Howard Gobioff +1 more
The Hadoop Distributed File System
4,780 Citations2010Konstantin V. Shvachko, Hairong Kuang +2 more
The architecture of HDFS is described and experience using HDFS to manage 25 petabytes of enterprise data at Yahoo! is reported on.
Spark: cluster computing with working sets
4,236 Citations2010Matei Zaharia, Mosharaf Chowdhury +3 more
Spark can outperform Hadoop by 10x in iterative machine learning jobs, and can be used to interactively query a 39 GB dataset with sub-second response time.
Dynamo
3,454 Citations2007Giuseppe DeCandia, Deniz Hastorun +7 more
D Dynamo is presented, a highly available key-value storage system that some of Amazon's core services use to provide an "always-on" experience and makes extensive use of object versioning and application-assisted conflict resolution in a manner that provides a novel interface for developers to use.
ACM Transactions on Computer SystemsBigtable
3,432 Citations2008Fay W. Chang, Jay B. Dean +7 more
The simple data model provided by Bigtable is described, which gives clients dynamic control over data layout and format, and the design and implementation of Bigtable are described.
Mobile Networks and ApplicationsBig Data: A Survey
2,836 Citations2014Min Chen, Shiwen Mao +1 more
The background and state-of-the-art of big data are reviewed, including enterprise management, Internet of Things, online social networks, medial applications, collective intelligence, and smart grid, as well as related technologies.
Nature GeneticsMicroarray data normalization and transformation
2,007 Citations2002John Quackenbush
This review focuses on the much more mundane but indispensable tasks of 'normalizing' data from individual hybridizations to make meaningful comparisons of expression levels, and of 'transforming' them to select genes for further analysis and data mining.
Future Generation Computer SystemsAddressing cloud computing security issues
1,818 Citations2010Dimitris Zissis, Dimitrios Lekkas
This paper proposes introducing a Trusted Third Party, tasked with assuring specific security characteristics within a cloud environment, and presents a horizontal level of service, available to all implicated entities, that realizes a security mesh, within which essential trust is maintained.
Pig latin
1,744 Citations2008Christopher Olston, Benjamin Reed +3 more
A new language called Pig Latin is described, designed to fit in a sweet spot between the declarative style of SQL, and the low-level, procedural style of map-reduce, which is an open-source, Apache-incubator project, and available for general use.
Future Generation Computer SystemsMobile cloud computing: A survey
1,656 Citations2012Niroshinie Fernando, Seng W. Loke +1 more
This paper provides an extensive survey of mobile cloud computing research, while highlighting the specific concerns in mobile cloud Computing, and presents a taxonomy based on the key issues in this area, and discusses the different approaches taken to tackle these issues.
Proceedings of the VLDB EndowmentHive
1,539 Citations2009Ashish Thusoo, Joydeep Sen Sarma +7 more
Hadoop is a popular open-source map-reduce implementation which is being used as an alternative to store and process extremely large data sets on commodity hardware.
Qucosa (Saxon State and University Library Dresden)Data Cleaning: Problems and Current Approaches.
1,441 Citations2000Erhard Rahm, Hai Hong
This work classifies data quality problems that are addressed by data cleaning and provides an overview of the main solution approaches and discusses current tool support for data cleaning.
ACM SIGMOD RecordScalable SQL and NoSQL data stores
1,345 Citations2011R. G. G. Cattell
This paper examines a number of SQL and socalled "NoSQL" data stores designed to scale simple OLTP-style application loads over many servers, and contrasts the new systems on their data model, consistency mechanisms, storage mechanisms, durability guarantees, availability, query support, and other dimensions.
Elsevier eBooksDatabase Management Systems
1,336 Citations2014
New to this edition are the early coverage of the ER model, new chapters on Internet databases, data mining, and spatial databases, and a new supplement on practical SQL assignments (with solutions for instructors' use).
ZooKeeper: wait-free coordination for internet-scale systems
1,312 Citations2010P. G. Hunt, Mahadev Konar +2 more
ZooKeeper provides a per client guarantee of FIFO execution of requests and linearizability for all requests that change the ZooKeeper state to enable the implementation of a high performance processing pipeline with read requests being satisfied by local servers.
IEEE Transactions on Parallel and Distributed SystemsPrivacy-Preserving Multi-Keyword Ranked Search over Encrypted Cloud Data
1,239 Citations2013Ning Cao, Cong Wang +3 more
This paper proposes a basic idea for the MRSE based on secure inner product computation, and gives two significantly improved MRSE schemes to achieve various stringent privacy requirements in two different threat models and further extends these two schemes to support more search semantics.
Communications of the ACMData quality in context
1,232 Citations1997Diane M. Strong, Yang W. Lee +1 more
A new study reveals businesses are defining data quality with the consumer in mind, and within this larger context of information systems, data is collected from multiple data sources and stored in databases.
On the design and quantification of privacy preserving data mining algorithms
1,018 Citations2001Dakshi Agrawal, Charų C. Aggarwal
It is proved that the EM algorithm converges to the maximum likelihood estimate of the original distribution based on the perturbed data, and proposed metrics for quantification and measurement of privacy-preserving data mining algorithms are proposed.
Big Data: Issues and Challenges Moving Forward
925 Citations2013Stephen H. Kaisler, Frank Armour +2 more
The issues and challenges are analyzed as a collaborative research program into methodologies for big data analysis and design are begun.
S4: Distributed Stream Computing Platform
905 Citations2010Leonardo Neumeyer, Bruce Robbins +2 more
The architecture resembles the Actors model, providing semantics of encapsulation and location transparency, thus allowing applications to be massively concurrent while exposing a simple programming interface to application developers.
Proceedings of the VLDB EndowmentHadoopDB
856 Citations2009A. A. ABOUZEID, Kamil Bajda-Pawlikowski +3 more
This paper explores the feasibility of building a hybrid system that takes the best features from both technologies; the prototype built approaches parallel databases in performance and efficiency, yet still yields the scalability, fault tolerance, and flexibility of MapReduce-based systems.
Journal of Parallel and Distributed ComputingBig Data computing and clouds: Trends and future directions
833 Citations2014Marcos Dias de Assunção, Rodrigo N. Calheiros +3 more
This paper discusses approaches and environments for carrying out analytics on Clouds for Big Data applications, and identifies possible gaps in technology and provides recommendations for the research community on future directions on Cloud-supported Big Data computing and analytics solutions.
Twister
777 Citations2010Jaliya Ekanayake, Hui Li +5 more
This paper presents the programming model and the architecture of Twister an enhanced MapReduce runtime that supports iterative Map Reduce computations efficiently and shows performance comparisons of Twisters with other similar runtimes such as Hadoop and DryadLINQ for large scale data parallel applications.
Data Quality For The Information Age
696 Citations1997Thomas C. Redman, A. Blanton Godfrey
This comprehensive book provides business leaders, process owners, and information professionals with the background and methods necessary to set up a data quality program, make and sustain order of magnitude improvements, and create a unique and important business advantage.
International Journal of Information ManagementData quality management, data usage experience and acquisition intention of big data analytics
691 Citations2014Ohbyung Kwon, Namyeon Lee +1 more
Scientific ProgrammingInterpreting the Data: Parallel Analysis with Sawzall
616 Citations2005Rob Pike, Sean Dorward +2 more
The design -- including the separation into two phases, the form of the programming language, and the properties of the aggregators -- exploits the parallelism inherent in having data and computation distributed across many machines.
Decision Support SystemsLeveraging the capabilities of service-oriented decision support systems: Putting analytics and big data in cloud
600 Citations2012Haluk Demirkan, Dursun Delen
A conceptual framework for DSS in cloud is proposed, a unique contribution of this paper is its perspective on how to servitize the product oriented DSS environment, and the opportunities and challenges of engineering service oriented D SS in cloud are demonstrated.
IEEE Communications Surveys & TutorialsHeterogeneity in Mobile Cloud Computing: Taxonomy and Open Challenges
593 Citations2013Zohreh Sanaei, Saeid Abolfazli +2 more
This paper defines MCC, explains its major challenges, discusses heterogeneity in convergent computing and networking, and divides it into two dimensions, namely vertical and horizontal.
IEEE Communications Surveys & TutorialsSecurity and Privacy in Cloud Computing
588 Citations2012Zhifeng Xiao, Yang Xiao
The authors obtain a common goal to provide a comprehensive review of the existing security and privacy issues in cloud environments to present the relationships among them, the vulnerabilities that may be exploited by attackers, the threat models, as well as existing defense strategies in a cloud scenario.
Computer NetworksCloud monitoring: A survey
546 Citations2013Giuseppe Aceto, Alessio Botta +2 more
This paper carefully analyzed and discussed the properties of a monitoring system for the Cloud, the issues arising from such properties and how such issues have been tackled in literature, and identifies open issues, main challenges and future directions in the field of Cloud monitoring.
Privacy-preserving multi-keyword ranked search over encrypted cloud data
496 Citations2011Ning Cao, Cong Wang +3 more
This paper defines and solves the challenging problem of privacy-preserving multi-keyword ranked search over encrypted cloud data (MRSE), and gives two significantly improved MRSE schemes to achieve various stringent privacy requirements in two different threat models.
IEEE Intelligent SystemsArtificial Intelligence and Big Data
487 Citations2013Daniel E. O’Leary
AI Innovation in Industry is a new department for IEEE Intelligent Systems, and this paper examines some of the basic concerns and uses of AI for big data.
Proceedings of the VLDB EndowmentInteractive analytical processing in big data systems
467 Citations2012Yanpei Chen, Sara Alspaugh +1 more
This work provides an empirical analysis of MapReduce traces from six separate business-critical deployments inside Facebook and at Cloudera customers in e-commerce, telecommunications, media, and retail, and characterization of new Map Reduce workloads which are driven in part by interactive analysis, and which make heavy use of query-like programming frameworks on top of mapReduce.
BMC BioinformaticsAn overview of the Hadoop/MapReduce/HBase framework and its current applications in bioinformatics
442 Citations2010Ronald C. Taylor
Hadoop and the MapReduce programming paradigm already have a substantial base in the bioinformatics community, especially in the field of next-generation sequencing analysis, and such use is increasing, due to the cost-effectiveness of Hadoop-based analysis on commodity Linux clusters, and in the cloud via data upload to cloud vendors who have implemented Hadooper/HBase.
Journal of Biomedical Informatics‘Big data’, Hadoop and cloud computing in genomics
439 Citations2013Aisling O’Driscoll, Jurate Daugelaite +1 more
An overview of cloud computing and big data technologies, and how such expertise can be used to deal with biology's big data sets is discussed, together with an overview of the current usage of Hadoop within the bioinformatics community.
TUbilio (Technical University of Darmstadt)The Mobile Data Challenge: Big Data for Mobile Computing Research
423 Citations2012J. Laurila, Daniel Gática-Pérez +7 more
An overview of the Mobile Data Challenge (MDC), a large-scale research initiative aimed at generating innovations around smartphone-based research, as well as community-based evaluation of related mobile data analysis methodologies, is presented.
HBase: The Definitive Guide
373 Citations2011Lars George
This book will show you how Apache HBase can fulfill your needs, as the open source implementation of Google's BigTable architecture scales to billions of rows and millions of columns, while ensuring that write and read performance remain constant.
Graph Databases
362 Citations2013Ian Robinson, Jim Webber +1 more
Big Data Processing in Cloud Computing Environments
298 Citations2012Changqing Ji, Yu Li +3 more
This paper presents the key issues of big data processing, including cloud computing platform, cloud architecture, cloud database and data storage scheme, and introduces Map Reduce optimization strategies and applications reported in the literature.
Mahout in Action
275 Citations2011Sean Owen, Robin Anil +2 more
This book presents practical use cases and illustrates how Mahout can be applied to solve them and places particular focus on issues of scalability and how to apply these techniques against large data sets using the Apache Hadoop framework.
Cloud computing for Internet of Things & sensing based applications
274 Citations2012B.B. Prahlada Rao, P. Saluia +3 more
How Internet of Things and Cloud computing can work together can address the Big Data issues is described and a prototype model for providing sensing as a service on cloud is proposed.
Privacy as a Service: Privacy-Aware Data Storage and Processing in Cloud Computing Architectures
273 Citations2009Wassim Itani, Ayman Kayssi +1 more
PasS (Privacy as a Service) is the first practical cloud computing privacy solution that utilizes previous research on cryptographic coprocessors to solve the problem of securely processing sensitive data in cloud computing infrastructures.
Information SciencesBig Data Analytics framework for Peer-to-Peer Botnet detection using Random Forests
263 Citations2014Kamaldeep Singh, Sharath Chandra Guntuku +2 more
The authors build up on the progress of open source tools like Hadoop, Hive and Mahout to provide a scalable implementation of quasi-real-time intrusion detection system used to detect Peer-to-Peer Botnet attacks using machine learning approach.
BMC BioinformaticsLaunching genomics into the cloud: deployment of Mercury, a next generation sequence analysis pipeline
234 Citations2014Jeffrey G. Reid, Andrew Carroll +14 more
The Mercury analysis pipeline is developed and deployed in local hardware and the Amazon Web Services cloud via the DNAnexus platform, and is demonstrated a powerful combination of a robust and fully validated software pipeline and a scalable computational resource that has applied to more than 10,000 whole genome and whole exome samples.
G-Store
233 Citations2010Sudipto Das, Divyakant Agrawal +1 more
G-Store is designed and implemented which uses a key-value store as an underlying substrate to provide efficient, scalable, and transactional multi key access, and preserves the desired properties of key- Value stores.
Proceedings of the VLDB EndowmentColumn-oriented database systems
233 Citations2009Daniel J. Abadi, Peter Boncz +1 more
This tutorial presents an overview of column-oriented database system technology and addresses questions about how easily a major row-based system achieve column-store performance and the new applications that can be potentially enabled by column-stores.
IEEE Transactions on Parallel and Distributed SystemsA Secure Erasure Code-Based Cloud Storage System with Secure Data Forwarding
231 Citations2011Hsiao-Ying Lin, Wen-Guey Tzeng
This work proposes a threshold proxy re-encryption scheme and integrates it with a decentralized erasure code such that a secure distributed storage system is formulated and fully integrates encrypting, encoding, and forwarding.
ComputerCorporate Governance of Big Data: Perspectives on Value, Risk, and Cost
219 Citations2013Paul P. Tallon
A video in which author Paul Tallon discusses the supplementary material to his article "Corporate Governance of Big Data: Perspectives on Value, Risk, and Cost" and how projection models can help individuals responsible for data handling plan for and understand big data storage issues.
Proceedings of the VLDB EndowmentJaql
216 Citations2011Kevin Beyer, Vuk Ercegovac +6 more
Jaql, a declarative scripting language for analyzing large semistructured datasets in parallel using Hadoop's MapReduce framework, is described and the results of scale-up experiments on Hadoop running Jaql scripts for intranet data analysis and log processing are presented.
Lecture notes in computer scienceFrom Big Data to Big Data Mining: Challenges, Issues, and Opportunities
214 Citations2013Dunren Che, Mejdl Safran +1 more
This paper provides an overview of big data mining and discusses the related challenges and the new opportunities, including a review of state-of-the-art frameworks and platforms for processing and managing big data as well as the efforts expected onbig data mining.
ComputerClouds for Scalable Big Data Analytics
204 Citations2013Domenico Talia
Extracting useful knowledge from huge digital datasets requires smart and scalable analytics services, programming tools, and applications.
Physics Letters ALogistic map as a block encryption algorithm
201 Citations2001Ljupčo Kocarev, Goce Jakimoski
The relationship between cryptography and chaos theory, and similarities of their crucial concepts such as mixing property and sensitivity to changes in initial conditions and parameters are discussed.
FigsharePower Iteration Clustering
198 Citations2018Frank Lin, William W. Cohen
PIC finds a very low-dimensional embedding of a dataset using truncated power iteration on a normalized pair-wise similarity matrix of the data and turns out to be an effective cluster indicator, consistently outperforming widely used spectral methods such as NCut on real datasets.
Network SecurityBig data security
174 Citations2012Colin Tankard
Controls need to be placed around the data itself, rather than the applications and systems that store the data, to ensure it's secure in the process, says Colin Tankard of Digital Pathways.
ACM Computing SurveysThe family of mapreduce and large-scale data processing systems
168 Citations2013Sherif Sakr, Anna Liu +1 more
This article provides a comprehensive survey for a family of approaches and mechanisms of large-scale data processing mechanisms that have been implemented based on the original idea of the MapReduce framework and are currently gaining a lot of momentum in both research and industrial communities.
MapReduce in the Clouds for Science
151 Citations2010Thilina Gunarathne, Tak‐Lon Wu +2 more
Azure MapReduce architecture successfully leverages the high latency, eventually consistent, yet highly scalable Azure infrastructure services to provide an efficient, on demand alternative to traditional Map Reduce clusters.
Big Data for Dummies
147 Citations2013Judith Hurwitz, Alan Nugent +2 more
Big Data For Dummies cuts through the confusion and helps you take charge of big data solutions for your organization.
IEEE Journal on Selected Areas in CommunicationsMoving Big Data to The Cloud: An Online Cost-Minimizing Approach
146 Citations2013Linquan Zhang, Chuan Wu +4 more
This work studies timely, cost-minimizing upload of massive, dynamically-generated, geo-dispersed data into the cloud, for processing using a MapReduce-like framework, and proposes two online algorithms: an online lazy migration (OLM) algorithm and a randomized fixed horizon control (RFHC) algorithm.
Taming The Big Data Tidal Wave: Finding Opportunities in Huge Data Streams with Advanced Analytics
140 Citations2012Bill Franks
Taming the Big Data Tidal Wave isnt just the title of this book, but rather an activity that will determine which businesses win and which lose in the next decade.
Proceedings of the VLDB EndowmentTenzing a SQL implementation on the MapReduce framework
134 Citations2011Biswapesh Chattopadhyay, Lin Liang +6 more
The architecture and implementation of Tenzing are described, benchmarking of typical analytical queries are presented, and several key characteristics of the Tenzing system are presented.
IEEE Transactions on Parallel and Distributed SystemsA Privacy Leakage Upper Bound Constraint-Based Approach for Cost-Effective Privacy Preserving of Intermediate Data Sets in Cloud
131 Citations2012Xuyun Zhang, Chang Liu +3 more
A novel upper bound privacy leakage constraint-based approach to identify which intermediate data sets need to be encrypted and which do not, so that privacy-preserving cost can be saved while the privacy requirements of data holders can still be satisfied.
Proceedings of the VLDB EndowmentSQL/MapReduce
127 Citations2009Eric Friedman, Peter M. Pawlowski +1 more
This paper presents a new approach to implementing a UDF, which it is called SQL/MapReduce (SQL/MR), that overcomes many of these limitations of present UDFs and facilitates highly scalable computation within the database.
Future Generation Computer SystemsAdapting scientific computing problems to clouds using MapReduce
124 Citations2011Satish Narayana Srirama, Pelle Jakovits +1 more
This work shows how to adapt algorithms from each class into the MapReduce model, what affects the efficiency and scalability of algorithms in each class and allows the judge which framework is more efficient for each of them, by mapping the advantages and disadvantages of the two frameworks.
Managing Big Data for Scientific Visualization
119 Citations2015Michael Cox, David Ellsworth
This section offers some structure to understand what has been done to manage big data for engineering and scientific visualization, and to understand and go forward in areas that may prove fruitful.
Data integrity proofs in cloud storage
116 Citations2011Rajiv Kumar, Ashutosh Saxena
This paper provides a scheme which gives a proof of data integrity in the cloud which the customer can employ to check the correctness of his data in thecloud and can be incorporated in the Service level agreement (SLA).
Computers Environment and Urban SystemsMERRA Analytic Services: Meeting the Big Data challenges of climate science through cloud-enabled Climate Analytics-as-a-Service
115 Citations2014John L. Schnase, Daniel Q. Duffy +6 more
Nephele
112 Citations2009Daniel Warneke, Odej Kao
Nephele is the first data processing framework to explicitly exploit the dynamic resource allocation offered by today's compute clouds for both, task scheduling and execution and is presented as an ongoing research project.
Big Data Computing
107 Citations2013Rajendra Akerkar
Presenting a mix of industry cases and theory, Big Data Computing discusses the technical and practical issues related to Big Data in intelligent information management, and introduces a broad range of Big Data concepts, tools, and techniques.
IBM Journal of Research and DevelopmentGoverning Big Data: Principles and practices
105 Citations2013Piyush Malik
Drawing upon implementation experiences of early adopters of Big Data technologies across multiple industries, the issues and challenges involved in the management of Big data are explored, highlighting the principles and best practices for effective Big Data governance.
Future Generation Computer SystemsEfficient multi-keyword ranked query over encrypted data in cloud computing
104 Citations2013Ruixuan Li, Zhiyong Xu +3 more
The Journal of SupercomputingIncremental proxy re-encryption scheme for mobile cloud computing environment
99 Citations2013Abdul Nasir Khan, Miss Laiha Mat Kiah +6 more
An incremental version of proxy re-encryption scheme for improving the file modification operation is proposed and shows significant improvement in results while performing file modification operations using limited processing capability of mobile devices.
Computer law & security reviewIs “Big Data” creepy?
92 Citations2013Richard Cumbley, Peter Church
If current and proposed regulation strikes the right balance between the risks and benefits of Big Data is considered, which cuts across the whole of the Big Data lifecycle: collection, combination, analysis and use.
Nature Reviews GeneticsCloud and heterogeneous computing solutions exist today for the emerging big data problems in biology
87 Citations2011Eric E. Schadt, Michael D. Linderman +3 more
Cloud and heterogeneous computing solutions exist today for the emerging big data problems in biology and the challenges posed by these problems need to be considered in a more holistic manner.
Chukwa: a system for reliable large-scale log collection
85 Citations2010Ariel Rabkin, Randy H. Katz
This work presents a system, called Chukwa, that embodies the unified approach to failure handling of MapReduce, and uses an end-to-end delivery model that can leverage local on-disk log files for reliability and eases integration with legacy systems.
Public Auditing for Big Data Storage in Cloud Computing -- A Survey
75 Citations2013Chang Liu, Rajiv Ranjan +4 more
This paper provides an analysis on authenticator-based efficient data integrity verification, summarizes the research motivations, methodologies as well as main achievements of several of the representative approaches, and tries to bring forth a blueprint for possible future developments.
Computers & Electrical EngineeringSystem of Systems and Big Data analytics – Bridging the gap
71 Citations2013Barnabas K. Tannahill, Mo Jamshidi
This paper demonstrates how to construct a bridge between SoS and Data Analytics to develop reliable models for such systems, using data analytics to generate a model to forecast produced photovoltaic energy to assist in the optimization of a micro grid SoS.
The Journal of SupercomputingBSS: block-based sharing scheme for secure data storage services in mobile cloud environment
71 Citations2014Abdul Nasir Khan, Miss Laiha Mat Kiah +4 more
The experimental results show that the block-based sharing scheme consumes less energy, reduces the resources utilization, improves response time, and provides better security services to the mobile users in the presence of fully untrusted cloud server(s) as compared to the existing security schemes.
Preventing Information Leakage from Indexing in the Cloud
71 Citations2010Anna Squicciarini, Smitha Sundareswaran +1 more
A three-tier data protection architecture is designed to accommodate various levels of privacy concerns by users and a novel portable data binding technique is developed to ensure strong enforcement of users' privacy requirements at server side.
Privacy in dynamic social networks
55 Citations2010Smriti Bhagat, Graham Cormode +2 more
This work proposes methods to anonymize a dynamic network such that the privacy of users is preserved when new nodes and edges are added to the published network, and uses link prediction algorithms to model the evolution of the social network.
Future Generation Computer SystemsScalable parallel computing on clouds using Twister4Azure iterative MapReduce
53 Citations2012Thilina Gunarathne, Bingjing Zhang +2 more
The Twister4Azure iterative MapReduce runtime is presented and a study of four real world data-intensive scientific applications implemented using Twister3Azure-two iterative applications, Multi-Dimensional Scaling and KMeans Clustering; and two pleasingly parallel applications, BLAST+ sequence searching and SmithWaterman sequence alignment.
Journal of Parallel and Distributed Computing<mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML" altimg="si28.gif" display="inline" overflow="scroll"><mml:mi>p</mml:mi></mml:math>-PIC: Parallel power iteration clustering for big data
50 Citations2012Weizhong Yan, Umang Brahmakshatriya +3 more
This paper attempts to expand PIC's data scalability by implementing a parallel power iteration clustering (p-PIC) algorithm that works well on low-end commodity computers (COTS-based clusters and general purpose servers found at most commercial cloud providers).
Mining Twitter in the Cloud: A Case Study
46 Citations2010Pieter Noordhuis, Michiel Heijkoop +1 more
Computation of PageRank on Twitter’s social graph is used to investigate whether or not cloud computing, and Amazon cloud services1 in particular, can make these tasks more feasible and, as a side effect,Whether or not PageRank provides a good ranking of Twitter users.
Physics Letters BEvidence for BS0 meson production in Z0 decays
44 Citations1992P. Abreu, W. Adam +554 more
IEEE Internet ComputingBig Data Drives Cloud Adoption in Enterprise
42 Citations2013Huan Liu
The need to store, process, and analyze large amounts of data is finally driving enterprise customers to adopt cloud computing at scale.
Network SecuritySmarter fraud investigations with big data analytics
39 Citations2013Shaun Hipgrave
Shaun Hipgrave of IBM explores three aspects of smarter fraud investigations: smarter technology, improved data visualisation and better internal communication using big data analytics to detect fraud fast and share critical investigative information.
Lecture notes in computer scienceCase Study of Scientific Data Processing on a Cloud Using Hadoop
35 Citations2010Chen Zhang, Hans De Sterck +3 more
A simple extension to Hadoop’s MapReduce is described which allows it to handle scientific data processing problems with arbitrary input formats and explicit control over how the input is split.
Failure scenario as a service (FSaaS) for Hadoop clusters
35 Citations2012Faraz Faghri, Sobir Bazarbayev +4 more
This work proposes a new model called Failure Scenario as a Service (FSaaS), which will be utilized across the cloud for testing the resilience of cloud applications and focuses its efforts on the Hadoop platform.
Big Data Computing and Clouds: Challenges, Solutions, and Future Directions
35 Citations2013Marcos D. Assun, Rodrigo N. Calheiros +3 more
Through a detailed survey, possible gaps in technology are identified and recommendations for the research community on future directions on Cloud-supported Big Data computing and analytics solutions are provided.
Future Generation Computer SystemsControllable privacy preserving search based on symmetric predicate encryption in cloud storage
35 Citations2012Chun‐I Fan, Shiyuan Huang
An Improvement to Data Service in Cloud Computing with Content Sensitive Transaction Analysis and Adaptation
31 Citations2013Chih-Wei Lu, Chih-Ming Hsieh +2 more
An improvement to data Service in cloud computing with content sensitive transaction analysis and adaptation is proposed, named ADSC (Adaptive Data Service Coordinator), which manages and monitors the query sequence consisting of data requirement transactions collected from clients/users to the data service virtual machines with big data.
Future Generation Computer SystemsCloud Computing and Scientific Applications — Big Data, Scalable Analytics, and Beyond
23 Citations2013Suraj Pandey, Surya Nepal
Communications in computer and information scienceCloud Computing Availability: Multi-clouds for Big Data Service
23 Citations2012Sangdo Lee, Hyoungyill Park +1 more
The use of cloud computing has increased rapidly in many organizations and general firms have already adopted the cloud computing and successfully applied to ‘smart working’ for security & remote-services.
ComputerStorage Challenge: Where Will All That Big Data Go?
22 Citations2013Neal Leavitt
Big data creates numerous exciting possibilities for organizations, but first they must figure out where they're going to store all that information.
Big Data Governance
19 Citations2015Vincenzo Morabito
This chapter reviews the common definitions of big data Governance and its core components, followed by three case studies to establishing a business case for big data governance.
Privacy-Preserving Layer over MapReduce on Cloud
19 Citations2012Xuyun Zhang, Chang Liu +3 more
A flexible, scalable, dynamical and costeffective privacy-preserving layer over the MapReduce framework is proposed that ensures data privacy preservation and data utility under the given privacy requirements before data are further processed by subsequent Map Reduce tasks.
The study and design on secure-cloud storage system
18 Citations2011Hao Liu, Dezhi Han
The CSSS integrates information isolation, accessing control, virus detection, metadata safeguard of crucial data and fast-speed retrieval, and with the help of connect control interface, the authorized users can safely access the data in the CSSS.
…