Dynamics and evolution of Web sites: analysis, metrics and design issues
Published 13 November 2002
Ludmila Cherkasova, Magnus Karlsson
Citations23
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The main questions addressed are the new access patterns of today's WWW, how to characterize dynamics or evolution of Web sites, and how to measure the rate of changes.
Abstract
Our goal is to develop a Web server log analysis tool that produces a Web site profile and its system resource usage in a way useful to service providers. Understanding the nature of traffic to the Web site is crucial in properly designing site support infrastructure, especially for large, busy sites. The main questions we address are the new access patterns of today's WWW, how to characterize dynamics or evolution of Web sites, and how to measure the rate of changes. We propose a set of new metrics to characterize the site dynamics, and we illustrate them with analysis of three different Web sites.
Keywords
Computer Science
IEEE NetworkA workload characterization study of the 1998 World Cup Web site
765 Citations2000Martin Arlitt, Tai Jin
It is found that improvements in the caching architecture of the World Wide Web are changing the workloads of Web servers, but major improvements to that architecture are still necessary.
ACM SIGMETRICS Performance Evaluation ReviewWeb server workload characterization
753 Citations1996Martin Arlitt, Carey Williamson
ACM SIGPLAN NoticesLocality-aware request distribution in cluster-based network servers
503 Citations1998Vivek S. Pai, Mohit Aron +5 more
Characterizing reference locality in the WWW
465 Citations2002Virgı́lio Almeida, Azer Bestavros +2 more
The authors propose models for both temporal and spatial locality of reference in streams of requests arriving at Web servers and show that temporal locality can be characterized by the marginal distribution of the stack distance trace, and proposed models for typical distributions and compare their cache performance to the traces.
World Wide WebChanges in Web client access patterns: Characteristics and caching implications
377 Citations1999Paul Barford, Azer Bestavros +2 more
This study compares two measurements of Web client workloads separated in time by three years, both captured from the same computing facility at Boston University and finds that for the computing facility represented by traces between 1995 and 1998, the benefits of using size‐based caching policies have diminished and the potential for caching requested files in the network has declined.
Rate of change and other metrics: a live study of the world wide web
318 Citations1997Fred Douglis, Anja Feldmann +2 more
The potential benefit of a shared proxy-caching server in a large environment is quantified by using traces that were collected at the Internet connection points for two large corporations, representing significant numbers of references.
Computer NetworksHow dynamic is the Web?
290 Citations2000Brian Brewington, George Cybenko
Using empirical models and a novel analytic metric of `up-to-dateness', the rate at which Web search engines must re-index the Web to remain current is estimated.
Locality-aware request distribution in cluster-based network servers
280 Citations1998Vivek S. Pai, Mohit Aron +5 more
A simple, practical strategy for locality-aware request distribution (LARD), in which the front-end distributes incoming requests in a manner that achieves high locality in the back-ends' main memory caches as well as load balancing.
ACM SIGCOMM Computer Communication ReviewThe content and access dynamics of a busy Web site
219 Citations2000Venkata N. Padmanabhan, Lili Qiu
The dynamics of the MSNBC news site are studied, finding that files tend to change little when they are modified, a small set of files tends to get modified repeatedly, and file popularity follows a Zipf-like distribution with a parameter &agr that is much larger than reported in previous, proxy-based studies.
Application-level document caching in the Internet
150 Citations2002Azer Bestavros, R.L. Carter +4 more
The results suggest that distinguishing between documents produced locally and those produced remotely can provide useful leverage in designing caching policies, because of differences in the potential for sharing these two document types among multiple users.
Web facts and fantasy
80 Citations1997Stephen Manley, Margo Seltzer
A taxonomy of the different types of Web sites is presented and it is shown that, as expected, persistent connections are generally useful, but that dynamic time-out intervals may be unnecessarily complex and that allowing multiple persistent connections per client may actually hinder resource utilization compared to allowing only a single persistent connection.
Changes in Web Client Access Patterns - Characteristics and Caching Implications
55 Citations1998Paul Barford, Azer Bestavros +2 more
OpenGrey (Institut de l'Information Scientifique et Technique)Workload Characterization of the 1998 World Cup Web Site
43 Citations1999Martin Arlitt, Tai Jin
FLEX: load balancing and management strategy for scalable Web hosting service
35 Citations2002Ludmila Cherkasova
This work uses a simulation model and a synthetic trace generator to compare the Round-Robin based solutions and FLEX over the range of different workloads and finds that FLEE outperforms Round- Robin based solutions 2-5 times on the basis of generated traces.