Big Data: A Survey
Mobile Networks and ApplicationsPublished 21 January 2014
Min Chen, Shiwen Mao, Yunhao Liu
Citations2,836
SJR quartileQ2
SJR score0.56
SNIP0.87
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The background and state-of-the-art of big data are reviewed, including enterprise management, Internet of Things, online social networks, medial applications, collective intelligence, and smart grid, as well as related technologies.
Abstract
In this paper, we review the background and state-of-the-art of big data. We first introduce the general background of big data and review related technologies, such as could computing, Internet of Things, data centers, and Hadoop. We then focus on the four phases of the value chain of big data, i.e., data generation, data acquisition, data storage, and data analysis. For each phase, we introduce the general background, discuss the technical challenges, and review the latest advances. We finally examine the several representative applications of big data, including enterprise management, Internet of Things, online social networks, medial applications, collective intelligence, and smart grid. These discussions aim to provide a comprehensive overview and big-picture to readers of this exciting area. This survey is concluded with a discussion of open problems and future directions.
Keywords
Computer ScienceBusiness, Management and Accounting
Communications of the ACMMapReduce
18,538 Citations2008Jay B. Dean, Sanjay Ghemawat
This presentation explains how the underlying runtime system automatically parallelizes the computation across large-scale clusters of machines, handles machine failures, and schedules inter-machine communication to make efficient use of the network and disks.
Computer Networks and ISDN SystemsThe anatomy of a large-scale hypertextual Web search engine
15,828 Citations1998Sergey Brin, Lawrence M. Page
This paper provides an in-depth description of Google, a prototype of a large-scale search engine which makes heavy use of the structure present in hypertext and looks at the problem of how to effectively deal with uncontrolled hypertext collections where anyone can publish anything they want.
Proceedings of the National Academy of SciencesAn index to quantify an individual's scientific research output
11,535 Citations2005J. E. Hirsch
The index hbar, defined as the number of papers of an individual that have citation count larger than or equal to the citation count of all coauthors of each paper, is proposed as a useful index to characterize the scientific output of a researcher that takes into account the effect of multiple authorship.
Foundations of statistical natural language processing
9,996 Citations1999Christopher D. Manning, Hinrich Schütze
Journal of Business and Economic StatisticsAn Introduction to Multivariate Statistical Analysis
9,232 Citations1986Robb J. Muirhead, T. W. Anderson
Knowledge and Information SystemsTop 10 algorithms in data mining
5,685 Citations2007Xindong Wu, Vipin Kumar +12 more
This paper presents the top 10 data mining algorithms identified by the IEEE International Conference on Data Mining (ICDM) in December 2006: C4.5, k-Means, SVM, Apriori, EM, PageRank, AdaBoost, kNN, Naive Bayes, and CART.
Big data: The next frontier for innovation, competition, and productivity
5,228 Citations2011James Manyika
The amount of data in the authors' world has been exploding, and analyzing large data sets will become a key basis of competition, underpinning new waves of productivity growth, innovation, and consumer surplus, according to research by MGI and McKinsey.
ACM SIGOPS Operating Systems ReviewThe Google file system
5,003 Citations2003Sanjay Ghemawat, Howard Gobioff +1 more
NatureDetecting influenza epidemics using search engine query data
4,406 Citations2008Jeremy Ginsberg, Matthew H. Mohebbi +4 more
A method of analysing large numbers of Google search queries to track influenza-like illness in a population and accurately estimate the current level of weekly influenza activity in each region of the United States with a reporting lag of about one day is presented.
Choice Reviews OnlineBig data: a revolution that will transform how we live, work, and think
3,674 Citations2013
Big data improves health care, advances better education, and helps predict societal change from urban sprawl to the spread of the flu, and is roaring through all sectors of the economy and all areas of life.
Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing
3,577 Citations2012Matei Zaharia, Mosharaf Chowdhury +7 more
Resilient Distributed Datasets is presented, a distributed memory abstraction that lets programmers perform in-memory computations on large clusters in a fault-tolerant manner and is implemented in a system called Spark, which is evaluated through a variety of user applications and benchmarks.
Pregel
3,534 Citations2010Grzegorz Malewicz, Matthew H. Austern +5 more
A model for processing large graphs that has been designed for efficient, scalable and fault-tolerant implementation on clusters of thousands of commodity computers, and its implied synchronicity makes reasoning about programs easier.
Dynamo
3,454 Citations2007Giuseppe DeCandia, Deniz Hastorun +7 more
D Dynamo is presented, a highly available key-value storage system that some of Amazon's core services use to provide an "always-on" experience and makes extensive use of object versioning and application-assisted conflict resolution in a manner that provides a novel interface for developers to use.
ACM Transactions on Computer SystemsBigtable
3,432 Citations2008Fay W. Chang, Jay B. Dean +7 more
The simple data model provided by Bigtable is described, which gives clients dynamic control over data layout and format, and the design and implementation of Bigtable are described.
Data integration
2,463 Citations2002Maurizio Lenzerini
The tutorial is focused on some of the theoretical issues that are relevant for data integration: modeling a data integration application, processing queries in data integration, dealing with inconsistent data sources, and reasoning on queries.
Dryad
2,460 Citations2007Michael Isard, Mihai Budiu +3 more
The Dryad execution engine handles all the difficult problems of creating a large distributed, concurrent application: scheduling the use of computers and their CPUs, recovering from communication or computer failures, and transporting data between vertices.
VL2
2,089 Citations2009Albert Greenberg, James R. Hamilton +7 more
VL2 is a practical network architecture that scales to support huge data centers with uniform high capacity between servers, performance isolation between services, and Ethernet layer-2 semantics, and is built on a working prototype.
Journal of Lightwave TechnologyOFDM for Optical Communications
2,061 Citations2009Jean Armstrong
This paper gives a tutorial overview of OFDM highlighting the aspects that are likely to be important in optical applications and the constraints imposed by single mode optical fiber, multimode optical fiber and optical wireless.
Consistent hashing and random trees
1,935 Citations1997David R. Karger, Eric Lehman +4 more
A family of caching protocols for distrib-uted networks that can be used to decrease or eliminate the occurrence of hot spots in the network, based on a special kind of hashing that is called consistent hashing.
ACM Computing SurveysData fusion
1,829 Citations2009Jens Bleiholder, Felix Naumann
This article places data fusion into the greater context of data integration, precisely defines the goals of data fusion, namely, complete, concise, and consistent data, and highlights the challenges of data Fusion.
Synthesis lectures on computer architectureThe Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines
1,746 Citations2009Luiz André Barroso, Urs Hölzle
The architecture of WSCs is described, the main factors influencing their design, operation, and cost structure, and the characteristics of their software base are described.
ACM SIGACT NewsBrewer's conjecture and the feasibility of consistent, available, partition-tolerant web services
1,693 Citations2002Seth Gilbert, Nancy Lynch
This conjecture is proved in the asynchronous network model that it is impossible to achieve all three properties of a distributed web service: consistency, availability, and partition tolerance.
Six Degrees: The Science of a Connected Age
1,639 Citations2003Duncan J. Watts
Communications in computer and information scienceThe Fourth Paradigm – Data-Intensive Scientific Discovery
1,599 Citations2012Tony Hey
Proceedings of the VLDB EndowmentHive
1,539 Citations2009Ashish Thusoo, Joydeep Sen Sarma +7 more
Hadoop is a popular open-source map-reduce implementation which is being used as an alternative to store and process extremely large data sets on commodity hardware.
ACM Transactions on Multimedia Computing Communications and ApplicationsContent-based multimedia information retrieval
1,524 Citations2006Michael S. Lew, Nicu Sebe +2 more
This survey reviews 100+ recent articles on content-based multimedia information retrieval and discusses their role in current research directions which include browsing and search paradigms, user studies, affective computing, learning, semantic queries, new features and media types, high performance indexing, and evaluation techniques.
Computer NetworksFocused crawling: a new approach to topic-specific Web resource discovery
1,492 Citations1999Soumen Chakrabarti, Martin van den Berg +1 more
A new hypertext resource discovery system called a Focused Crawler that is robust against large perturbations in the starting set of URLs, and capable of exploring out and discovering valuable resources that are dozens of links away from the start set, while carefully pruning the millions of pages that may lie within this same radius.
Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data
1,485 Citations2011Paul Zikopoulos, Chris Eaton
This book reveals how IBM is leveraging open source Big Data technology, infused with IBM technologies, to deliver a robust, secure, highly available, enterprise-class Big Data platform.
ACM Transactions on Computer SystemsScale and performance in a distributed file system
1,412 Citations1988John H. Howard, Michael L. Kazar +5 more
This paper examines the consequences of the design decision to transfer whole files between servers and workstations rather than some smaller unit such as records or blocks, as almost all other distributed file systems do, and compares the whole file transfer strategy with that of a block-oriented file system, Sun Microsystems' NFS.
The Google file system
1,366 Citations2003Sanjay Ghemawat, Howard Gobioff +1 more
This paper presents file system interface extensions designed to support distributed applications, discusses many aspects of the design, and reports measurements from both micro-benchmarks and real world use.
ACM SIGMOD RecordScalable SQL and NoSQL data stores
1,345 Citations2011R. G. G. Cattell
This paper examines a number of SQL and socalled "NoSQL" data stores designed to scale simple OLTP-style application loads over many servers, and contrasts the new systems on their data model, consistency mechanisms, storage mechanisms, durability guarantees, availability, query support, and other dimensions.
Communications of the ACMParallel database systems
1,281 Citations1992David J. DeWitt, Jim Gray
Over the last decade 'Eradata, Tandem, and a host of startup companies have successfully developed and marketed highly parallel machines that refutes a 1983 paper predicting the demise of database machines.
Studies in classification, data analysis, and knowledge organizationKNIME: The Konstanz Information Miner
1,266 Citations2008Michael R. Berthold, Nicolas Cebron +8 more
Some of the design aspects of the underlying architecture of the Konstanz Information Miner are described and briefly sketch how new nodes can be incorporated.
Proceedings of the VLDB EndowmentChallenges and opportunities with big data
1,056 Citations2012Alexandros Labrinidis, H. V. Jagadish
The controversies and myths surrounding Big Data are explored, to try to explore the controversies and debunk the myths around Big Data.
The application/json Media Type for JavaScript Object Notation (JSON)
953 Citations2006Douglas Crockford
This memo provides information for the Internet community on JSON, a lightweight, text-based, language-independent data interchange format derived from the ECMAScript Programming Language Standard.
Empirical comparison of algorithms for network community detection
933 Citations2010Jure Leskovec, Kevin Lang +1 more
Considering community quality as a function of its size provides a much finer lens with which to examine community detection algorithms, since objective functions and approximation algorithms often have non-obvious size-dependent behavior.
Health monitoring of civil infrastructures using wireless sensor networks
928 Citations2007Sukun Kim, Shamim N. Pakzad +5 more
A Wireless Sensor Network for Structural Health Monitoring is designed, implemented, deployed and tested on the 4200 ft long main span and the south tower of the Golden Gate Bridge and the collected data agrees with theoretical models and previous studies of the bridge.
Social influence analysis in large-scale networks
909 Citations2009Jie Tang, Jimeng Sun +2 more
Topical Affinity Propagation (TAP) is designed with efficient distributed learning algorithms that is implemented and tested under the Map-Reduce framework and can take results of any topic modeling and the existing network structure to perform topic-level influence propagation.
Helios
909 Citations2010Nathan Farrington, George Porter +6 more
This work presents Helios, a hybrid electrical/optical switch architecture that can deliver significant reductions in the number of switching elements, cabling, cost, and power consumption relative to recently proposed data center network architectures.
Operating Systems Design and ImplementationThe Chubby lock service for loosely-coupled distributed systems
899 Citations2006Mike Burrows
The paper describes the initial design and expected use, compares it with actual use, and explains how the design had to be modified to accommodate the differences.
ACM SIGMOD RecordMining data streams
887 Citations2005Mohamed Medhat Gaber, Arkady Zaslavsky +1 more
This review paper presents the state-of-the-art in data stream mining, concerned with extracting knowledge structures represented in models and patterns in non stopping streams of information.
ACM SIGMOD RecordState-of-the-art in privacy preserving data mining
813 Citations2004Vassilios S. Verykios, Elisa Bertino +4 more
An overview of the new and rapidly emerging research area of privacy preserving data mining is provided, and a classification hierarchy that sets the basis for analyzing the work which has been performed in this context is proposed.
Towards robust distributed systems (abstract)
784 Citations2000Eric A. Brewer
Several issues in an attempt to clean up the way the authors think about distributed systems, including the fault model, high availability, graceful degradation, data consistency, evolution, composition, and autonomy are looked at.
Social Network Data Analytics
779 Citations2011Charu C. Aggarwal
This edited volume is unique in focussing on the data analytical aspects of social networks in the internet scenario, rather than the traditional sociology-driven emphasis prevalent in the existing books, which do not focus on the unique data-intensive characteristics of online social networks.
Twister
777 Citations2010Jaliya Ekanayake, Hui Li +5 more
This paper presents the programming model and the architecture of Twister an enhanced MapReduce runtime that supports iterative Map Reduce computations efficiently and shows performance comparisons of Twisters with other similar runtimes such as Hadoop and DryadLINQ for large scale data parallel applications.
A macroscope in the redwoods
775 Citations2005Gilman Tolle, Joseph Polastre +9 more
A case study of a wireless sensor network that recorded 44 days in the life of a 70-meter tall redwood tree, at a density of every 5 minutes in time and every 2 meters in space is presented.
Communications of the ACMAn overview of business intelligence technology
745 Citations2011Surajit Chaudhuri, Umeshwar Dayal +1 more
BI technologies are essential to running today's businesses and this technology is going through sea changes, so how do you protect yourself against these changes?
Proceedings of the VLDB EndowmentSCOPE
731 Citations2008Ronnie Chaiken, B. Keith Jenkins +5 more
A new declarative and extensible scripting language, SCOPE (Structured Computations Optimized for Parallel Execution), targeted for this type of massive data analysis, designed for ease of use with no explicit parallelism, while being amenable to efficient parallel execution on large clusters.
Operating Systems Design and ImplementationDryadLINQ: a system for general-purpose distributed data-parallel computing using a high-level language
699 Citations2008Yuan Yu, Michael Isard +5 more
Interactive deduplication using active learning
693 Citations2002Sunita Sarawagi, Anuradha Bhamidipaty
This work presents the design of a learning-based deduplication system that uses a novel method of interactively discovering challenging training pairs using active learning and investigates various design issues that arise in building a system to provide interactive response, fast convergence, and interpretable output.
Proceedings of the VLDB EndowmentHaLoop
688 Citations2010Yingyi Bu, Bill Howe +2 more
HaLoop is presented, a modified version of the Hadoop MapReduce framework that is designed to serve iterative applications and dramatically improves their efficiency by making the task scheduler loop-aware and by adding various caching mechanisms.
c-Through
651 Citations2010Guohui Wang, David G. Andersen +5 more
This work proposes a hybrid packet and circuit switched data center network architecture (or HyPaC) which augments the traditional hierarchy of packet switches with a high speed, low complexity, rack-to-rack optical circuit-switched network to supply high bandwidth to applications.
IEEE MultimediaLarge-Scale Concept Ontology for Multimedia
648 Citations2006Milind Naphade, John R. Smith +6 more
The large-scale concept ontology for multimedia (LSCOM) is the first of its kind designed to simultaneously optimize utility to facilitate end-user access, cover a large semantic space, make automated extraction feasible, and increase observability in diverse broadcast news video data sets.
Scientific ProgrammingInterpreting the Data: Parallel Analysis with Sawzall
616 Citations2005Rob Pike, Sean Dorward +2 more
The design -- including the separation into two phases, the form of the programming language, and the properties of the aggregators -- exploits the parallelism inherent in having data and computation distributed across many machines.
IEEE Transactions on Systems Man and Cybernetics Part C (Applications and Reviews)A Survey on Visual Content-Based Video Indexing and Retrieval
582 Citations2011Weiming Hu, Nianhua Xie +3 more
Methods for video structure analysis, including shot boundary detection, key frame extraction and scene segmentation, extraction of features including static key frame features, object features and motion features, video data mining, video annotation, and video retrieval including query interfaces are analyzed.
Exploiting place features in link prediction on location-based social networks
528 Citations2011Salvatore Scellato, Anastasios Noulas +1 more
A supervised learning framework is described which exploits new prediction features based on the properties of the places visited by users which are able to discriminate potential future links among them and which exploits these prediction features to predict new links among friends-of-friends and place-friends.
ACM Transactions on Management Information SystemsProcess Mining
468 Citations2012Wil M. P. van der Aalst
This article introduces process mining as a new research field and summarizes the guiding principles and challenges described in the manifesto.
Frontiers in Plant ScienceThe iPlant Collaborative: Cyberinfrastructure for Plant Biology
459 Citations2011Stephen A. Goff, Matthew Vaughn +63 more
These workshops teach researchers how to add bioinformatics tools and/or datasets into the iPlant cyberinfrastructure enabling plant scientists to perform complex analyses on large datasets without the need to master the command-line or high-performance computational services.
CERN Document Server (European Organization for Nuclear Research)MongoDB: The Definitive Guide
456 Citations2010Kristina Chodorow, Michael Dirolf
This authoritative introduction to MongoDB will learn the many advantages of using document-oriented databases, and discover why MongoDB is a reliable, high-performance system that allows for almost infinite horizontal scalability.
Finding a needle in Haystack: facebook's photo storage
431 Citations2010Doug Beaver, Sanjeev Kumar +3 more
This paper describes Haystack, an object storage system optimized for Facebook's Photos application, which provides a less expensive and higher performing solution than the previous approach, which leveraged network attached storage appliances over NFS.
Proceedings of the VLDB EndowmentBuilding a high-level dataflow system on top of Map-Reduce
413 Citations2009Alan Gates, Olga Natkovich +7 more
Pig is a high-level dataflow system that aims at a sweet spot between SQL and Map-Reduce, and performance comparisons between Pig execution and raw Map- Reduce execution are reported.
A comparison of join algorithms for log processing in MaPreduce
410 Citations2010Spyros Blanas, Jignesh M. Patel +4 more
Key implementation details of a number of well-known join strategies in MapReduce are described and a comprehensive experimental comparison of these join techniques on a 100-node Hadoop cluster is presented.
HBase: The Definitive Guide
373 Citations2011Lars George
This book will show you how Apache HBase can fulfill your needs, as the open source implementation of Google's BigTable architecture scales to billions of rows and millions of columns, while ensuring that write and read performance remain constant.
Health Monitoring of Civil Infrastructures Using Wireless Sensor Networks
366 Citations2007Sukun Kim, Shamim N. Pakzad +5 more
ACM SIGCOMM Computer Communication ReviewHelios
351 Citations2010Nathan Farrington, George Porter +6 more
Information SciencesA hybrid content-based and item-based collaborative filtering approach to recommend TV programs enhanced with singular value decomposition
349 Citations2010Ana Belén Barragáns Martínez, Enrique Costa‐Montenegro +4 more
The proposed hybrid approach (which combines content-filtering techniques with those based on collaborative filtering) also provides all typical advantages of any social network, such as supporting communication among users as well as allowing users to add and tag contents, rate and comment the items, etc.
IEEE Transactions on Neural NetworksWeb mining in soft computing framework: relevance, state of the art and future directions
348 Citations2002Sankar K. Pal, V.G. Talwar +1 more
The paper summarizes the different characteristics of Web data, the basic components of Web mining and its different types, and the current state of the art.
Parallel crawlers
314 Citations2002Junghoo Cho, Héctor García-Molina
This paper proposes multiple architectures for a parallel crawller, identifies fundamental issues related to parallel crawling, and proposes metrics to evaluate a parallel crawler, and compares the proposed architectures using 40 million pages collected from the Web.
The Age of Big Data
306 Citations2015Reynold Cheng
An Introduction to Social Network Data Analytics
305 Citations2011Charų C. Aggarwal
This book provides a data-centric view of online social networks; a topic which has been missing from much of the literature.
Monitoring heritage buildings with wireless sensor networks: The Torre Aquila deployment
302 Citations2009Matteo Ceriotti, Luca Mottola +7 more
It is shown that the system deployed in Torre Aquila, a medieval tower in Trento, is an effective tool for assessing the tower's stability, as it delivers data reliably and has an estimated lifetime beyond one year.
Incoop
298 Citations2011Pramod Bhatotia, Alexander Wieder +3 more
This paper describes the architecture, implementation, and evaluation of Incoop, a generic MapReduce framework for incremental computations that detects changes to the input and automatically updates the output by employing an efficient, fine-grained result reuse mechanism.
ACM SIGKDD Explorations NewsletterData mining for hypertext
291 Citations2000Soumen Chakrabarti
Recent advances in learning and mining problems related to hypertext in general and the Web in particular are surveyed and the continuum of supervised to semi-supervised to unsupervised learning problems is reviewed.
SensorScope: Out-of-the-Box Environmental Monitoring
275 Citations2008Guillermo Barrenetxea, F. Ingelrest +4 more
SensorScope, a collaborative project between environmental and network researchers, aims at providing an efficient and inexpensive out-of-the-box environmental monitoring system, based on a wireless sensor network, and presents the hardware and network architecture of SensorScope.
IEEE Communications Surveys & TutorialsNetworked Wireless Sensor Data Collection: Issues, Challenges, and Approaches
271 Citations2010Feng Wang, Jiangchuan Liu
The basic taxonomy is described and it is proposed to break down the networked wireless sensor data collection into three major stages, namely, the deployment stage, the control message dissemination stage and the data delivery stage.
Mirror mirror on the ceiling
267 Citations2012Xia Zhou, Zengbin Zhang +6 more
A new wireless primitive for data centers, 3D beamforming, where 60 GHz signals bounce off data center ceilings, thus establishing indirect line-of-sight between any two racks in a data center, is proposed and evaluated.
Translated Learning: Transfer Learning across Different Feature Spaces
266 Citations2008Wenyuan Dai, Yuqiang Chen +3 more
Through experiments on the text-aided image classification and cross-language classification tasks, it is demonstrated that the translated learning framework can greatly outperform many state-of-the-art baseline methods.
W3QS: A Query System for the World-Wide Web
258 Citations1995David Konopnicki, Oded Shmueli
This work designed and is now implementing a high level SQL-like language to support effective and flexible query processing, which addresses the structure and content of WWW nodes and their varied sorts of data.
Proceedings of the 7th symposium on Operating systems design and implementation
242 Citations2006Brian N. Bershad, Jeff Mogul
The program chairs nudged the OSDI reviewers to favor "exciting but flawed" submissions over "boring but correct" ones, as long as the flaws were minor and likely fixable.
Proceedings of the VLDB EndowmentData integration for the relational web
238 Citations2009Michael Cafarella, Alon Halevy +1 more
Octopus is a system that combines search, extraction, data cleaning and integration, and enables users to create new data sets from those found on the Web, to offer the user a set of best-effort operators that automate the most labor-intensive tasks.
LUSTER
238 Citations2007Leo Selavo, Adrienne Wood +9 more
LUSTER---Light Under Shrub Thicket for Environmental Research---is a system that meets the challenges of EWSNs using a hierarchical architecture that includes distributed reliable storage, delay-tolerant networking, and deployment time validation techniques.
Community detection in large-scale social networks
236 Citations2007Nan Du, Bin Wu +3 more
The algorithm ComTector (Community DeTector) is presented which is more efficient for the community detection in large-scale social networks based on the nature of overlapping communities in the real world and a general naming method is proposed by combining the topological information with the entity attributes to define the discovered communities.
CIEL: a universal execution engine for distributed data-flow computing
230 Citations2011Derek G. Murray, Malte Schwarzkopf +4 more
The execution engine provides transparent fault tolerance and distribution to Skywriting scripts and high-performance code written in other programming languages, and achieves scalable performance for both iterative and non-iterative algorithms.
Cassandra
229 Citations2009Avinash Lakshman, Prashant Malik
IEEE Communications MagazineOn IP-over-WDM integration
227 Citations2000Nasir Ghani, Sudhir Dixit +1 more
IP over WDM has been envisioned as the winning combination due to the ability of the IP to be the common revenue-generating convergence sublayer and WDM as a bandwidth-rich transport sublayer.
Proteus
225 Citations2010Ankit Singla, Atul Singh +3 more
Proteus is proposed, an all-optical architecture targeting unprecedented topology-flexibility, lower complexity and higher energy efficiency, that is, an oversubscribed network architectures that can adapt the topology to meet traffic demands.
ACM SIGCOMM Computer Communication Reviewc-Through
223 Citations2010Guohui Wang, David G. Andersen +5 more
DOS
221 Citations2010Xiaohui Ye, Yawei Yin +4 more
The architecture and performance studies of Datacenter Optical Switch designed for scalable and high-throughput interconnections within a data center are discussed and it is shown that even with 2 to 4 wavelengths, the performance of DOS is significantly better than an electrical switch network based on state-of-the-art flattened butterfly topology.
Symbiotic routing in future data centers
219 Citations2010Hussam Abu-Libdeh, Paolo Costa +3 more
This paper designs an extended routing service allowing easy implementation of application-specific routing protocols on CamCube, and demonstrates the benefits and network-level impact of running multiple routing protocols.
IEEE Communications MagazineFiber optic communication technologies: What's needed for datacenter network operations
214 Citations2010Cedric F. Lam, Hong Liu +4 more
The growing trend of warehouse-scale mega- datacenter computing, the Internet transformation driven by mega-datacenter applications, and the opportunities and challenges for fiber optic communication technologies to support the growth of mega- Datacentre computing in the next three to four years are reviewed.
Influence diffusion dynamics and influence maximization in social networks with friend and foe relationships
196 Citations2013Yanhua Li, Wei Chen +2 more
This paper extends the classic voter model to signed networks and analyzes the dynamics of influence diffusion of two opposite opinions, which are modeled using positive and negative edges on signed networks to solve the influence maximization problem.
CouchDB: the definitive guide
178 Citations2010Jocelynn Anderson, Jan Lehnardt +1 more
This book introduces you to Apache CouchDB, a document-oriented database that offers a different way to model your data, and explains basic document CRUD, advanced MapReduce, and deployment tuning for performance and reliability.
Data Cleansing: Beyond Integrity Analysis 1
176 Citations2000Jonathan I. Maletic, Andrian Marcus
Evolution of social-attribute networks
175 Citations2012Neil Zhenqiang Gong, Wenchang Xu +5 more
A new generative model is developed to jointly reproduce the social structure and the node attributes of real social networks and it is demonstrated that the model provides more accurate predictions for practical application contexts.
NAWMS
154 Citations2008Younghun Kim, Thomas Schmid +3 more
An adaptive auto-calibration procedure is devised, which attempts to solve a two phase linear programming and mixed linear geometric programming problem and shows an accuracy, over likely domestic flow-rate scenarios, with long-term stability and a mean absolute error of 7%.
Journal of Lightwave TechnologyOFDM for Flexible High-Speed Optical Networks
146 Citations2011William Shieh
This tutorial provides a review of optical OFDM fundamentals from its basic mathematical formation to its salient disadvantages and advantages, and to reveal the unique characteristics of the fiber optical channel and identify the challenges and opportunities in the application of optical OfDM.
…