Fast and Interactive Analytics over Hadoop Data with Spark
login Usenix Mag.Published 1 January 2012
Michael J. Franklin, Thomas Siebel, Ma T Ei Zaharia, Mosharaf Chowdhury, Haga Ta, Justin Ma
Citations162
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Matei Zaharia is a fifth year PhD student at UC Berkeley, working with Scott Shenker and Ion Stoica on topics in computer systems, networks, cloud computing, and big data.
Abstract
Matei Zaharia is a fifth year PhD student at UC Berkeley, working with Scott Shenker and Ion Stoica on topics in computer systems, networks, cloud computing, and big data. He is also a committer on Apache Hadoop and Apache
Keywords
Computer Science
Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing
3,577 Citations2012Matei Zaharia, Mosharaf Chowdhury +7 more
Resilient Distributed Datasets is presented, a distributed memory abstraction that lets programmers perform in-memory computations on large clusters in a fault-tolerant manner and is implemented in a system called Spark, which is evaluated through a variety of user applications and benchmarks.
Operating Systems Design and ImplementationDryadLINQ: a system for general-purpose distributed data-parallel computing using a high-level language
699 Citations2008Yuan Yu, Michael Isard +5 more
Discretized streams: an efficient and fault-tolerant model for stream processing on large clusters
424 Citations2012Matei Zaharia, Tathagata Das +3 more
D-Streams support a new recovery mechanism that improves efficiency over the traditional replication and upstream backup solutions in streaming databases: parallel recovery of lost state across the cluster.
Shark
132 Citations2012Cliff Engle, Antonio Lupher +5 more
Shark marries query processing with deep data analysis, providing a unified system for easy data manipulation using SQL and pushing sophisticated analysis closer to data.