Big Data computing and clouds: Trends and future directions
Journal of Parallel and Distributed ComputingPublished 26 August 2014Open access
Marcos Dias de Assunção, Rodrigo N. Calheiros, Silvia Bianchi, Marco A. S. Netto, Rajkumar Buyya
Citations833
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This paper discusses approaches and environments for carrying out analytics on Clouds for Big Data applications, and identifies possible gaps in technology and provides recommendations for the research community on future directions on Cloud-supported Big Data computing and analytics solutions.
Abstract
This paper discusses approaches and environments for carrying out analytics on Clouds for Big Data applications. It revolves around four important areas of analytics and Big Data, namely (i) data management and supporting architectures; (ii) model development and scoring; (iii) visualisation and user interaction; and (iv) business models. Through a detailed survey, we identify possible gaps in technology and provide recommendations for the research community on future directions on Cloud-supported Big Data computing and analytics solutions. Keywords:
Keywords
Computer ScienceDecision SciencesBusiness, Management and Accounting
Elsevier eBooksData Mining: Practical Machine Learning Tools and Techniques
25,718 Citations2011Ian H. Witten, Eibe Frank
Communications of the ACMMapReduce
18,538 Citations2008Jay B. Dean, Sanjay Ghemawat
This presentation explains how the underlying runtime system automatically parallelizes the computation across large-scale clusters of machines, handles machine failures, and schedules inter-machine communication to make efficient use of the network and disks.
MIS QuarterlyBusiness Intelligence and Analytics: From Big Data to Big Impact
6,044 Citations2012Hsinchun Chen, Roger H.L. Chiang +1 more
This introduction to the MIS Quarterly Special Issue on Business Intelligence Research first provides a framework that identifies the evolution, applications, and emerging research areas of BI&A, and introduces and characterized the six articles that comprise this special issue in terms of the proposed BI &A research framework.
Future Generation Computer SystemsCloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility
5,870 Citations2008Rajkumar Buyya, Chee Shin Yeo +3 more
This paper defines Cloud computing and provides the architecture for creating Clouds with market-oriented resource allocation by leveraging technologies such as Virtual Machines (VMs), and provides insights on market-based resource management strategies that encompass both customer-driven service management and computational risk management to sustain Service Level Agreement (SLA)-oriented resource allocation.
Above the Clouds: A Berkeley View of Cloud Computing
5,742 Citations2009Michael Armbrust, Armando Fox +9 more
This work focuses on SaaS Providers (Cloud Users) and Cloud Providers, which have received less attention than SAAS Users, and uses the term Private Cloud to refer to internal datacenters of a business or other organization, not made available to the general public.
ACM SIGOPS Operating Systems ReviewThe Google file system
5,003 Citations2003Sanjay Ghemawat, Howard Gobioff +1 more
Dynamo
3,454 Citations2007Giuseppe DeCandia, Deniz Hastorun +7 more
D Dynamo is presented, a highly available key-value storage system that some of Amazon's core services use to provide an "always-on" experience and makes extensive use of object versioning and application-assisted conflict resolution in a manner that provides a novel interface for developers to use.
ScienceThe Parable of Google Flu: Traps in Big Data Analysis
2,520 Citations2014David Lazer, Ryan Kennedy +2 more
Large errors in flu prediction were largely avoidable, which offers lessons for the use of big data.
Communications of the ACMThe KDD process for extracting useful knowledge from volumes of data
1,899 Citations1996Usama M. Fayyad, Gregory Piatetsky-Shapiro +1 more
A new generation of computational techniques and tools is required to support the extraction of useful knowledge from the rapidly growing volumes of data, the subject of the emerging field of knowledge discovery in databases (KDD) and data mining.
ACM Computing SurveysA survey of research and practices of Network-on-chip
1,634 Citations2006T. Bjerregaard, Shankar Mahadevan
The research shows that NoC constitutes a unification of current trends of intrachip communication rather than an explicit new alternative.
Communications of the ACMTechniques and applications for sentiment analysis
1,494 Citations2013Ronen Feldman
The main applications and challenges of one of the hottest research areas in computer science are revealed.
Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data
1,485 Citations2011Paul Zikopoulos, Chris Eaton
This book reveals how IBM is leveraging open source Big Data technology, infused with IBM technologies, to deliver a robust, secure, highly available, enterprise-class Big Data platform.
ScienceNext Steps for Citizen Science
1,240 Citations2014Rick Bonney, Jennifer Shirk +5 more
Around the globe, thousands of research projects are engaging millions of individuals—many of whom are not trained as scientists—in collecting, categorizing, transcribing, or analyzing scientific data, known as citizen science.
GPFS: A Shared-Disk File System for Large Computing Clusters
1,224 Citations2002Frank Schmuck, Roger Haskin
ACM SIGOPS Operating Systems ReviewDynamo
1,109 Citations2007Giuseppe DeCandia, Deniz Hastorun +7 more
Competing on Analytics: The New Science of Winning
920 Citations2007Thomas H. Davenport, Jeanne G. Harris
OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information)PVFS : a parallel file system for linux clusters
843 Citations2000Philip Carns, W.B. Ligon +2 more
The design and implementation of PVFS are described and performance results on the Chiba City cluster at Argonne are presented, both for a concurrent read/write workload and for the BTIO benchmark.
Windows Azure Storage
799 Citations2011Brad Calder, Wang Ju +25 more
The WAS architecture, global namespace, and data model is described, as well as its resource provisioning, load balancing, and replication systems.
Big Data analytics
762 Citations2012Sachchidanand Singh, Nirmala Singh
This analysis illustrates that the Big Data analytics is a fast-growing, influential practice and a key enabler for the social business and is critical for success in the age of social media.
IEEE Transactions on Visualization and Computer GraphicsManyEyes: a Site for Visualization at Internet Scale
718 Citations2007Fernanda Viégas, Martin Wattenberg +3 more
The design and deployment of Many Eyes is described, a public Web site where users may upload data, create interactive visualizations, and carry on discussions to support collaboration around visualizations at a large scale by fostering a social style of data analysis.
Proceedings of the VLDB EndowmentDremel
709 Citations2010Sergey Melnik, Andrey Gubarev +5 more
This paper describes the architecture and implementation of Dremel, and explains how it complements MapReduce-based computing, and presents a novel columnar storage representation for nested records.
Data Quality For The Information Age
696 Citations1997Thomas C. Redman, A. Blanton Godfrey
This comprehensive book provides business leaders, process owners, and information professionals with the background and methods necessary to set up a data quality program, make and sustain order of magnitude improvements, and create a unique and important business advantage.
Survey on NoSQL database
593 Citations2011Jing Han, E Haihong +2 more
The background, basic characteristics, data model of NoSQL, and the mainstream NoSQL databases are separately described in detail, and some properties are extracted to help enterprises to choose NoSQL.
Starfish: A Self-tuning System for Big Data Analytics.
572 Citations2011Herodotos Herodotou, Harold Lim +5 more
Starfish is introduced, a self-tuning system for big data analytics that builds on Hadoop while adapting to user needs and system workloads to provide good performance automatically, without any need for users to understand and manipulate the many tuning knobs in Hadoops.
ACM SIGMOD RecordParallel data processing with MapReduce
555 Citations2012Kyong-Ha Lee, Yoon-Joon Lee +3 more
In this survey, the MapReduce framework is characterized and its inherent pros and cons are discussed, and its optimization strategies reported in the recent literature are introduced.
Analytics at Work: Smarter Decisions, Better Results
521 Citations2009Thomas H. Davenport, Jeanne G. Harris +1 more
The Analytical Journey: Meeting Challenges Along the Way Toward More Analytical Decisions and Better Results is a step-by-step guide to building an Analytical Culture and facing challenges along the way.
ComputerWill NoSQL Databases Live Up to Their Promise?
499 Citations2010Neal Leavitt
Issues such as limitations, advantages, concerns and doubts regarding NoSQL databases are discussed.
Proceedings of the VLDB EndowmentInteractive analytical processing in big data systems
467 Citations2012Yanpei Chen, Sara Alspaugh +1 more
This work provides an empirical analysis of MapReduce traces from six separate business-critical deployments inside Facebook and at Cloudera customers in e-commerce, telecommunications, media, and retail, and characterization of new Map Reduce workloads which are driven in part by interactive analysis, and which make heavy use of query-like programming frameworks on top of mapReduce.
Proceedings of the VLDB EndowmentMAD skills
467 Citations2009Jeffrey P. Cohen, Brian Dolan +3 more
This paper highlights the emerging practice of Magnetic, Agile, Deep (MAD) data analysis as a radical departure from traditional Enterprise Data Warehouses and Business Intelligence, and describes database design methodologies that support the agile working style of analysts in these settings.
IEEE Data(base) Engineering BulletinData Management in the Cloud: Limitations and Opportunities.
459 Citations2009Daniel J. Abadi
There exist an increasing number of large companies that are offering cloud computing infrastructure products and services that do not entirely resemble the visions of these individual compo- firms.
Data warehousing and analytics infrastructure at facebook
433 Citations2010Ashish Thusoo, Zheng Shao +6 more
This paper presents how Scribe, Hadoop and Hive together form the cornerstones of the log collection, storage and analytics infrastructure at Facebook and enabled us to implement a data warehouse that stores more than 15PB of data and loads more than 60TB of new data every day.
Apache hadoop goes realtime at Facebook
432 Citations2011Dhruba Borthakur, Jonathan David Gray +10 more
The reasons why Facebook chose Hadoop and HBase over other systems such as Apache Cassandra and Voldemort are described and the application's requirements for consistency, availability, partition tolerance, data model and scalability are discussed.
ComputerStorytelling: The Next Step for Visualization
425 Citations2013Robert Kosara, Jock D. Mackinlay
Presentation-specifically, its use of elements from storytelling-is the next logical step in visualization research and should be a focus of at least equal importance with exploration and analysis.
TUbilio (Technical University of Darmstadt)The Mobile Data Challenge: Big Data for Mobile Computing Research
423 Citations2012J. Laurila, Daniel Gática-Pérez +7 more
An overview of the Mobile Data Challenge (MDC), a large-scale research initiative aimed at generating innovations around smartphone-based research, as well as community-based evaluation of related mobile data analysis methodologies, is presented.
IEEE Communications Surveys & TutorialsA Survey of Large Scale Data Management Approaches in Cloud Environments
418 Citations2011Sherif Sakr, Anna Liu +2 more
This paper gives a comprehensive survey of numerous approaches and mechanisms of deploying data-intensive applications in the cloud and analyzes the various design decisions of each approach and its suitability to support certain classes of applications and end-users.
Proceedings of the VLDB EndowmentProfiling, what-if analysis, and cost-based optimization of MapReduce programs
370 Citations2011Herodotos Herodotou, Shivnath Babu
This work introduces, to its knowledge, the first Cost-based Optimizer for simple to arbitrarily complex MapReduce programs, which focuses on the optimization opportunities presented by the large space of configuration parameters for these programs.
interactionsInteractions with big data analytics
360 Citations2012Danyel Fisher, Rob DeLine +2 more
It is no surprise today that big data is useful for HCI researchers and user interface design, and A/B testing is a standard practice in the usability community to help determine relative differences in user performance using different interfaces.
ACM Computing SurveysA taxonomy of Data Grids for distributed data sharing, management, and processing
348 Citations2006Srikumar Venugopal, Rajkumar Buyya +1 more
This article discusses the key concepts behind Data Grids and compares them with other data sharing and distribution paradigms such as content delivery networks, peer-to-peer networks, and distributed databases, and provides comprehensive taxonomies that cover various aspects of architecture, data transportation, data replication and resource allocation, and scheduling.
Analytics over large-scale multidimensional data
299 Citations2011Alfredo Cuzzocrea, Il‐Yeol Song +1 more
This paper provides an overview of state-of-the-art research issues and achievements in the field of analytics over big data, and extends the discussion to Analytics over big multidimensional data as well, by highlighting open problems and actual research trends.
NoSQL evaluation: A use case oriented survey
282 Citations2011Robin Hecht, Stefan Jablonski
These systems are compared by their data models, query possibilities, concurrency controls, partitioning and replication opportunities, and the underlying techniques of NoSQL databases considering their applicability for certain requirements.
ACM SIGKDD Explorations NewsletterVisual analytics tools for analysis of movement data
278 Citations2007Gennady Andrienko, Natalia Andrienko +1 more
It is argued that by using the right visual analytics tools for the analysis of massive collections of movement data, it is possible to effectively support human analysts in understanding movement behaviors and mobility patterns.
Proceedings of the 2016 International Conference on Management of Data
275 Citations2016
This year's SIGMOD conference will feature one keynote, from the inimitable Jeff Dean (Google, USA), who will talk about how deep learning and software systems can support each other, with particular thoughts on the implications for data management.
Communications of the ACMThe provenance of electronic data
224 Citations2008Luc Moreau, Paul Groth +9 more
It would include details of the processes that produced electronic data as far back as the beginning of time or at least the epoch of provenance awareness.
ComputerInteractive data analysis: the Control project
202 Citations1999J.M. Hellerstein, Ron Avnur +6 more
The authors are working with collaborators at IBM, Informix, and elsewhere to explore ways to improve human-computer interaction during data analysis to develop interactive, intuitive techniques for analyzing massive data sets.
IEEE International Conference on Cloud Computing Technology and ScienceHeterogeneity-aware resource allocation and scheduling in the cloud
202 Citations2011Gunho Lee, Byung-Gon Chun +1 more
This paper rethink resource allocation and job scheduling on a data analytics system in the cloud to embrace the heterogeneity of the underlying platforms and workloads and proposes a metric of share in a heterogeneous cluster to realize a scheduling scheme that achieves high performance and fairness.
Trust me, i'm partially right
180 Citations2012Danyel Fisher, И. О. Попов +2 more
With sampleAction, it is suggested that interaction techniques to present query results running over only incremental samples can be presented as sufficiently trustworthy for analysts both to make closer to real time decisions about their queries and to be more exploratory in their questions of the data.
Data Management Challenges of Data-Intensive Scientific Workflows
175 Citations2008Ewa Deelman, Ann Chervenak
This paper examines some of the issues in the area of data management related to workflow creation, execution, and result management in the context of the entire workflow lifecycle.
Energy efficiency for large-scale MapReduce workloads with significant interactive analysis
174 Citations2012Yanpei Chen, Sara Alspaugh +2 more
The key insight is that although MIA clusters host huge data volumes, the interactive jobs operate on a small fraction of the data, and thus can be served by a small pool of dedicated machines; the less time-sensitive jobs can run on the rest of the cluster in a batch fashion.
Future Generation Computer SystemsThe Aneka platform and QoS-driven resource provisioning for elastic applications on hybrid Clouds
171 Citations2011Rodrigo N. Calheiros, Christian Vecchiola +2 more
The R JournalPMML: An Open Standard for Sharing Models
159 Citations2009Alex Guazzelli, M. Zeller +2 more
The PMML package exports a variety of predictive and descriptive models from R to the Predictive Model Markup Language, an XML-based language that allows for the interchange of models among different tools and environments, mostly avoiding proprietary issues and incompatibilities.
Taming The Big Data Tidal Wave: Finding Opportunities in Huge Data Streams with Advanced Analytics
140 Citations2012Bill Franks
Taming the Big Data Tidal Wave isnt just the title of this book, but rather an activity that will determine which businesses win and which lose in the next decade.
IEEE SoftwareSoftware Analytics: So What?
139 Citations2013Tim Menzies, Thomas Zimmermann
This special issue of IEEE Software invited submissions that reflected the benefits (and drawbacks) of software analytics, an area of explosive growth, and so many excellent submissions that they had to split this special issue into two volumes.
Lecture notes in computer scienceThe Future Internet
124 Citations2011John Domingue
This book is based on the research carried out within the Future Internet Assembly (FIA) and contains a sample of representative results from the recent FIA meetings spanning a broad range of topics, all of crucial importance for the future Internet.
ACM SIGMOD RecordMarketplaces for data
120 Citations2013Fabian Schomm, Florian Stahl +1 more
This work identifies several categories and dimensions of data marketplaces and data vendors and provides a snapshot of the situation as of Summer 2012.
Building LinkedIn's Real-time Activity Data Pipeline.
97 Citations2012Ken Goodhope, Joel Koshy +5 more
The design and engineering problems the authors encountered in moving LinkedIn’s data pipeline from a batch-oriented file aggregation mechanism to a real-time publish-subscribe system called Kafka are discussed.
IEEE Computer Graphics and ApplicationsVisualizing Large, Heterogeneous Data in Hybrid-Reality Environments
83 Citations2013Khairi Reda, Alessandro Febretti +6 more
A flexible architecture integrating monitoring and analytics for managing large-scale data centers
80 Citations2011Chengwei Wang, Karsten Schwan +4 more
A novel, flexible architecture for Monalytics is presented in which such trade-offs are easily made by dynamically constructing software overlays called Distributed Computation Graphs (DCGs) to implement desired analytics functions.
Cumulon
79 Citations2013Botong Huang, Shivnath Babu +1 more
A suite of benchmarking, simulation, modeling, and search techniques are applied to support effective cost-based optimization over this rich space of deployment plans to help users rapidly develop and intelligently deploy matrix-based big-data analysis programs in the cloud.
Journal of Parallel and Distributed ComputingParallel approaches to machine learning—A comprehensive survey
78 Citations2012Sujatha R Upadhyaya
Map reduce is another important technique that has evolved during this period and as the literature has it, it has been proved to be an important aid in delivering performance of machine learning algorithms on GPUs.
On the duality of data-intensive file system design
75 Citations2011Wittawat Tantisiriroj, Seung Woo Son +4 more
This paper integrates PVFS into Hadoop and compares its performance to HDFS using a set of data-intensive computing benchmarks and shows how to embed multiple replicas into a PVFS file, including a mapping with a complete copy local to the writing client to emulate HDFS's file layout policies.
arXiv (Cornell University)Interactive Analytical Processing in Big Data Systems: A Cross-Industry Study of MapReduce Workloads
71 Citations2012Yanpei Chen, Sara Alspaugh +1 more
Interactive Data Visualization for the Web
70 Citations2013Scott A Murray
This step-by-step guide is ideal whether youre a designer or visual artist with no programming experience, a reporter exploring the new frontier of data journalism, or anyone who wants to visualize and share data.
Cloud analytics: do we really need to reinvent the storage stack?
67 Citations2009R. Ananthanarayanan, Karan Gupta +5 more
This paper revisits the debate on the need of a new non-POSIX storage stack for cloud analytics and argues, based on an initial evaluation, that it can be built on traditional POSIX-based cluster filesystems.
Improving MapReduce Performance in Heterogeneous Network Environments and Resource Utilization
64 Citations2012Zhenhua Guo, Geoffrey Fox
The goal is to enhance Hadoop to cope with significant network heterogeneity and improve resource utilization by proposing resource stealing which enables running tasks to steal the unutilized resources and return them when new tasks are assigned.
Hybrid Heuristic for Scheduling Data Analytics Workflow Applications in Hybrid Cloud Environment
64 Citations2011Mustafizur Rahman, Xiaorong Li +1 more
This paper proposes an Adaptive Hybrid Heuristic for user constrained data-analytics workflow scheduling in hybrid Cloud environment by integrating the dynamic nature of heuristic based approaches as well as workflow-level optimization capability of meta-heuristics.
Experience in Continuous analytics as a Service (CaaaS)
60 Citations2011Qiming Chen, Meichun Hsu +1 more
This work proposes a continuous query model over both static relations and dynamic streaming data, which allows a long-standing SQL query instance to run cycle by cycle, each cycle for a chunk of data from the data stream, using a cut-and-rewind mechanism.
IEEE Computer Graphics and ApplicationsCustomizing Computational Methods for Visual Analytics with Big Data
60 Citations2013Jaegul Choo, Haesun Park
These approaches, which include low-precision computation and iteration-level interactive visualization, ensure real-time interactive VA for big data.
Synchronous Parallel Processing of Big-Data Analytics Services to Optimize Performance in Federated Clouds
57 Citations2012Gueyoung Jung, Nathan Gnanasambandam +1 more
An opportunistic apportioning of big-data to these computing nodes in federated clouds in a way to enable synchronized completion at best-effort performance is proposed, which improve the performance by up to 60% against existing approaches.
An Evaluation of Distributed Datastores Using the AppScale Cloud Platform
53 Citations2010Chris Bunch, Navraj Chohan +6 more
New cloud support that employs a single API -- the Datastore API from Google App Engine (GAE) -- to interface to different open source distributed database technologies to plug in to the API so that they can be used by web applications and services without modification.
ACM SIGKDD Explorations NewsletterEfficient deployment of predictive analytics through open standards and cloud computing
43 Citations2009Alex Guazzelli, Kostantinos Stathatos +1 more
A predictive analytics scoring engine platform that leverages the benefits of open standards and cloud computing to deliver an efficient deployment process for statistical models and discusses emerging trends in cloud computing and Software as a Service.
Analytics Ecosystem Transformation: A Force for Business Model Innovation
42 Citations2011Ying Chen, Jeffrey Kreulen +2 more
An evolution of business models around the analytics ecosystem is described and the emerging business models that are enabled by the new ecosystem are highlighted, many of which have an open, collaboration, and co-developing spirit.
Lecture notes in computer scienceScientific and Statistical Database Management
41 Citations2010Michael Gertz, Bertram Ludäscher
Online Risk Analytics on the Cloud
37 Citations2009Hyunjoo Kim, Shivangi Chaudhari +2 more
This paper demonstrates how the CometCloud autonomic computing engine can support online multi-resolution VaR analytics using and integration of private and Internet cloud resources.
A Framework for Cloud-Based Large-Scale Data Analytics and Visualization: Case Study on Multiscale Climate Data
36 Citations2011Sifei Lu, Reuben Mingguang Li +5 more
A cloud framework to provide cloud clustering, workflow scheduling and management, fault tolerance and distributed data storage, data analytics and visualisation services demonstrates great flexibility and simplicity for end users intending to perform data analysis by aiding the integration of data and tools and enabling interactive visualization on-the-fly.
Project Daytona: Data Analytics as a Cloud Service
32 Citations2012Roger Barga, Jaliya Ekanayake +1 more
Any analyst can use the data analytics service to discover and import data from the cloud, invoke cloud scale data analytics algorithms to extract information from large datasets, invoke data visualization, and then store the data back to the cloud all through a client application they are already familiar with.
A Cost-Effective Approach to Delivering Analytics as a Service
30 Citations2012Xi Sun, Bo Gao +2 more
The feasibility of leveraging SaaS (Software-as-a-Service) delivery model to provide analytics capabilities as services in a cost-effective way is explored and a prototype system has been developed to evaluate the feasibility of this approach.
Proceedings of the VLDB EndowmentCloudVista
23 Citations2012Huiqi Xu, Zhen Li +2 more
This demonstration presents the CloudVista prototype system to address the problems with big data caused by using existing data reduction approaches and promotes a whole-big-data visualization approach that preserves the details of clustering structure.
Enabling analysts in managed services for CRM analytics
20 Citations2009Indrajit Bhattacharya, Shantanu Godbole +4 more
New areas that open up for KDD research in terms of 'time-to-insight' and repeatability for analysts are identified in the form of a managed service offering for CRM analytics.
CAMEO: Enabling social networks for Massively Multiplayer Online Games through Continuous Analytics and cloud computing
19 Citations2010Alexandru Iosup, Adrian Lăscăteu +1 more
This work implements and deploy CAMEO, an architecture for Continuous Analytics for Massively multiplayEr Online games on cloud resources, and shows evidence that CAMEO can support the social networks built around MMOGs.
Workload diversity and dynamics in big data analytics
18 Citations2012Jichuan Chang, Kevin Lim +3 more
This paper examines four workloads representing big data analytics trends for fast decisions, total integration, deep analysis and fresh insights, and suggests several directions to design balanced data analytics systems, including tight integration of heterogeneous, active data stores, support for efficient communication and data-centric load balancing.
IEEE Computer Graphics and ApplicationsFeature Tracking and Visualization of the Madden-Julian Oscillation in Climate Simulation
15 Citations2013Teng‐Yok Lee, Xin Tong +4 more
An integrated analysis and visualization tool for MJO episodes simulated by a high-resolution regional model that lets scientists more easily identify cloud and environmental processes associated with the MJO's onset and eastward propagation.
IBM InfoSphere streams
14 Citations2009Howard Nasgaard, Buğra Gedik +2 more
In the face of exploding data volumes and shrinking batch time windows, these organizations are struggling to make 'true' real-time decisions and gain a competitive advantage.
ACM SIGKDD Explorations NewsletterWhat is analytic infrastructure and why should you care?
12 Citations2009Robert L. Grossman
This article discusses the importance of analytic infrastructure and some of the standards that can be used to support analytic infrastructure, including applications that can manage very large datasets and build models over them and cloud based analytic services.
IBM Journal of Research and DevelopmentVisual analysis of large-scale network anomalies
12 Citations2013Qi Liao, Lei Shi +1 more
This paper provides a brief overview of several useful visualization techniques for the analysis of spatiotemporal anomalies in large-scale networks, making use of community-based similarity graphs, temporal expansion model graphs, TEMGs, correlation graphs, high-dimension projection graphs (HDPGs), and topology-preserving compressed graphs (TPCGs).
Using Cloud Technologies to Optimize Data-Intensive Service Applications
12 Citations2010Dirk Habich, Wolfgang Lehner +2 more
This paper proposes a novel SOA-aware approach with a special focus on the data flow to optimize the execution of data-intensive service applications by reducing the data exchange tasks to a minimum through the tight interaction of new cloud technologies with SOA technologies.
Econstor (Econstor)Marketplaces for Data: An Initial Survey
11 Citations2012Florian Stahl, Fabian Schomm +1 more
Cloud-based platform for personalization in a wellness management ecosystem: Why, what, and how
11 Citations2010Pei-Yun Hsueh, Raymund J. Lin +4 more
This paper presents the design of a cloud-enabled platform to facilitate the collection and delivery of evidence for personalization in a multi-provider ecosystem environment and provides essential building blocks of personalization services: smarter analytics for active personalization and dynamic provisioning.
QueueHazy: Making it Easier to Build and Maintain Big-data Analytics
11 Citations2013Arun Kumar, Feng Niu +1 more
The rise of big data presents both big opportunities and big challenges in domains ranging from enterprises to sciences, with opportunities including better-informed business decisions, more efficient supply-chain management and resource allocation, and faster turnaround of scientific discoveries.
Network and System Support for GamesCAMEO: enabling social networks for massively multiplayer online games through continuous analytics and cloud computing
11 Citations2010Alexandru Iosup, Adrian Lăscăteu +1 more
Towards Delivering Analytical Solutions in Cloud: Business Models and Technical Challenges
10 Citations2011Xi Sun, Bo Gao +5 more
This paper proposes the idea of "analytical cloud", which is designed to provide on-demand decision support, analytical capabilities, and computational resources in a manageable cloud environment and summarizes the potential business models supported by this new delivery model.
Configurable and Extensible Multi-flows for Providing Analytics as a Service on the Cloud
10 Citations2012P Deepak, Prasad Deshpande +1 more
This paper proposes pre-packaged configurable workflows for analytics as a means of endearing cloud-based analytics to customers, with a special focus on small and medium businesses in developing regions.
IBM Journal of Research and DevelopmentA platform for eXtreme Analytics
10 Citations2013Andrey Balmin, K. Beyer +8 more
The overall design principles and technology of XAP are described, which provides Jaql, a scripting language to specify data flows, tools, and techniques to optimize the runtime execution of these flows, and connectors to data warehouses, and libraries for advanced analytics.
Lecture notes in computer scienceCloudVista: Visual Cluster Exploration for Extreme Scale Data in the Cloud
10 Citations2011Keke Chen, Huiqi Xu +2 more
The proposed Cloud-Vista framework aims to explore the entire large data stored in the cloud with the help of the data structure visual frame and the previously developed VISTA visualization model and is effective and efficient for visually exploring clustering structures for extreme scale datasets stored inThe cloud.
Design and Development of an Adaptive Workflow-Enabled Spatial-Temporal Analytics Framework
9 Citations2012Xiaorong Li, Rodrigo N. Calheiros +5 more
This paper presents a highly-scalable workflow-enabled analytics system that manages inter-dependable analytics tasks adaptively with varying operational requirements on a common platform and enables visualization of multidimensional datasets of real world phenomena.
…