The case for RAMClouds
ACM SIGOPS Operating Systems ReviewPublished 27 January 2010
John K. Ousterhout, Parag Agrawal, David Erickson, Christos Kozyrakis, Jacob Leverich, David Mazières
Citations451
SJR quartileQ3
SJR score0.32
SNIP0.48
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This paper argues for a new approach to datacenter storage called RAMCloud, where information is kept entirely in DRAM and large-scale systems are created by aggregating the main memories of thousands of commodity servers.
Abstract
Disk-oriented approaches to online storage are becoming increasingly problematic: they do not scale gracefully to meet the needs of large-scale Web applications, and improvements in disk capacity have far outstripped improvements in access latency and bandwidth. This paper argues for a new approach to datacenter storage called RAMCloud, where information is kept entirely in DRAM and large-scale systems are created by aggregating the main memories of thousands of commodity servers. We believe that RAMClouds can provide durable and available storage with 100-1000x the throughput of disk-based systems and 100-1000x lower access latency. The combination of low latency and large scale will enable a new breed of dataintensive applications.
Keywords
Computer Science
Communications of the ACMMapReduce
18,538 Citations2008Jay B. Dean, Sanjay Ghemawat
This presentation explains how the underlying runtime system automatically parallelizes the computation across large-scale clusters of machines, handles machine failures, and schedules inter-machine communication to make efficient use of the network and disks.
Above the Clouds: A Berkeley View of Cloud Computing
5,742 Citations2009Michael Armbrust, Armando Fox +9 more
This work focuses on SaaS Providers (Cloud Users) and Cloud Providers, which have received less attention than SAAS Users, and uses the term Private Cloud to refer to internal datacenters of a business or other organization, not made available to the general public.
Dynamo
3,454 Citations2007Giuseppe DeCandia, Deniz Hastorun +7 more
D Dynamo is presented, a highly available key-value storage system that some of Amazon's core services use to provide an "always-on" experience and makes extensive use of object versioning and application-assisted conflict resolution in a manner that provides a novel interface for developers to use.
ACM Transactions on Computer SystemsBigtable
3,432 Citations2008Fay W. Chang, Jay B. Dean +7 more
The simple data model provided by Bigtable is described, which gives clients dynamic control over data layout and format, and the design and implementation of Bigtable are described.
ACM SIGMOD RecordA case for redundant arrays of inexpensive disks (RAID)
2,301 Citations1988David A. Patterson, Garth A. Gibson +1 more
A case for redundant arrays of inexpensive disks (RAID)
1,427 Citations1988David A. Patterson, Garth A. Gibson +1 more
Five levels of RAIDs are introduced, giving their relative cost/performance, and a comparison to an IBM 3380 and a Fujitsu Super Eagle is compared.
Elsevier eBooksDatabase Management Systems
1,336 Citations2014
New to this edition are the early coverage of the ER model, new chapters on Internet databases, data mining, and spatial databases, and a new supplement on practical SQL assignments (with solutions for instructors' use).
ACM Transactions on Computer SystemsThe design and implementation of a log-structured file system
1,267 Citations1992Mendel Rosenblum, John K. Ousterhout
ACM Computing SurveysPrinciples of transaction-oriented database recovery
1,212 Citations1983Theo Haerder, Andreas Reuter
A terminological framework is provided for describing different transactionoriented recovery schemes for database systems in a conceptual rather than an implementation-dependent way by introducing the terms materialized database, propagation strategy, and checkpoint, and a means for classifying arbitrary implementations from a unified viewpoint.
The design and implementation of a log-structured file system
975 Citations1991Mendel Rosenblum, John K. Ousterhout
A prototype log-structured file system called Sprite LFS is implemented; it outperforms current Unix file systems by an order of magnitude for small-file writes while matching or exceeding Unix performance for reads and large writes.
Proceedings of the VLDB EndowmentPNUTS
960 Citations2008Brian F. Cooper, Raghu Ramakrishnan +7 more
PNUTS provides data storage organized as hashed or ordered tables, low latency for large numbers of concurrent requests including updates and queries, and novel per-record consistency guarantees and utilizes automated load-balancing and failover to reduce operational complexity.
Implementation techniques for main memory database systems
817 Citations1984David J. DeWitt, Randy H. Katz +4 more
This paper considers the changes necessary to permit a relational database system to take advantage of large amounts of main memory, and evaluates AVL vs B+-tree access methods, hash-based query processing strategies vs sort-merge, and study recovery issues when most or all of the database fits in main memory.
Very Large Data BasesThe end of an architectural era: (it's time for a complete rewrite)
575 Citations2007Michael Stonebraker, Samuel Madden +4 more
FAWN
563 Citations2009David G. Andersen, Jason Franklin +4 more
This paper presents a new cluster architecture for low-power data-intensive computing that couples low-power embedded CPUs to small amounts of local flash storage, and balances computation and I/O capabilities to enable efficient, massively parallel access to data.
DRAM errors in the wild
555 Citations2009Bianca Schroeder, Eduardo Pinheiro +1 more
Measurements of memory errors in a large fleet of commodity servers over a period of 2.5 years provide strong evidence that memory errors are dominated by hard errors, rather than soft errors, which previous work suspects to be the dominant error mode.
Proceedings of the VLDB EndowmentH-store
525 Citations2008Robert R. Kallman, Hideaki Kimura +10 more
The demonstration presented here provides insight on the development of a distributed main memory OLTP database and allows for the further study of the challenges inherent in this operating environment.
IEEE Transactions on Knowledge and Data EngineeringMain memory database systems: an overview
488 Citations1992Héctor García-Molina, Kenneth Salem
The authors survey the major memory residence optimizations and briefly discuss some of the MMDBs that have been designed or implemented.
Free transactions with Rio Vista
159 Citations1997David E. Lowell, Peter M. Chen
A system that improves transaction overhead by a factor of 2000 for working sets that fit in main memory and lowers transaction overhead to 5 μsec by using no redo log, no system calls, and only one memory-to-memory copy is presented.
The 5 minute rule for trading memory for disc accesses and the 10 byte rule for trading memory for CPU time
128 Citations1987Jim Gray, Franco Putzolu
If an item is accessed frequently enough, it should be main memory resident, and the results depend on current price ratios of processors, memory and disc accesses, and hence the constants in the rules are changing.
IEEE MicroVirtual network transport protocols for Myrinet
83 Citations1998Brent Chun, Alan Mainwaring +1 more
The AM-II API extends traditional active messages with support for client-server computing and facilitates the construction of parallel clients and distributed servers, and a virtual network segment driver enables a large number of arbitrary sequential and parallel applications to access network interface resources directly in a concurrent but fully protected manner.
Integrated hardware/software design of a high performance network interface
3 Citations2001Zubin Dittia, Gurudatta M. Parulkar
This thesis describes the design and implementation of a high performance network interface chip called the APIC (ATM Port Interconnect Controller) and describes architectural enhancements to operating system (OS) software that are necessary to exploit some of the novel features that have been integrated into this chip.