Globally distributed content delivery

IEEE Internet ComputingPublished 1 September 2002Open access

John Dilley, Bruce M. Maggs, Jagdish Parikh, Harald Prokop, Ramesh K. Sitaraman, B. Weihl

DOI10.1109/mic.2002.1036038

Citations693

TL;DR

The Akamai system has since evolved to distribute dynamically generated pages and even applications to the network's edge, providing customers with on-demand bandwidth and computing capacity and lets content providers' infrastructure requirements be reduced, and lets them deploy or expand services more quickly and easily.

Abstract

When we launched the Akamai system in early 1999, it initially delivered only Web objects (images and documents). It has since evolved to distribute dynamically generated pages and even applications to the network's edge, providing customers with on-demand bandwidth and computing capacity. This reduces content providers' infrastructure requirements, and lets them deploy or expand services more quickly and easily. Our current system has more than 12,000 servers in over 1,000 networks. Operating servers in many locations poses many technical challenges, including how to direct user requests to appropriate servers, how to handle failures, how to monitor and control the servers, and how to update software across the system. We describe our system and how we've managed these challenges.

Keywords

Computer Science

Concurrency Control and Recovery in Database Systems

4,310 Citations1987Philip A. Bernstein, Vassco Hadzilacos +1 more

Consistent hashing and random trees

1,935 Citations1997David R. Karger, Eric Lehman +4 more

A family of caching protocols for distrib-uted networks that can be used to decrease or eliminate the occurrence of hot spots in the network, based on a special kind of hashing that is called consistent hashing.

IEEE Journal on Selected Areas in CommunicationsAutonet: a high-speed, self-configuring local area network using point-to-point links

655 Citations1991Michael Schroeder, Andrew Birrell +6 more

Autonet is a self-configuring local area network composed of switches interconnected by 100 Mb/s, full-duplex, point-to-point links, allowing many pairs of hosts to communicate simultaneously at full link bandwidth.

Rate of change and other metrics: a live study of the world wide web

318 Citations1997Fred Douglis, Anja Feldmann +2 more

The potential benefit of a shared proxy-caching server in a large environment is quantified by using traces that were collected at the Internet connection points for two large corporations, representing significant numbers of references.

Computer CommunicationsWeb caching and content distribution: a view from the interior

100 Citations2001Syam Gadde, Jeffrey S. Chase +1 more

This paper shows how the Wolman model is applied to large-scale caching systems in which the interior nodes belong to third-party content distribution services and correlates the model's predictions of interior cache behavior with empirical observations from the root caches of the NLANR cache hierarchy.

Annual Review of Computer ScienceA Survey of Distributed File Systems

99 Citations1990Mahadev Satyanarayanan

An overview of background material, case studies of a number of contemporary file systems, identification of key design techniques, and an examination of current research issues are presented.

Traceroute Using an IP Option

64 Citations1993G. Malkin

Traceroute serves as a valuable network debugging tool and the way in which it is currently implemented has the advantage of being automatically supported by all of the routers.

A Survey of Proxy Cache Evaluation Techniques

27 Citations1999Brian D. Davison

A space of proxy evaluation methodologies based on source of workload used and form of algorithm implementation is defined and their locations are surveyed.