Home / Papers / Development of Web Crawler for Archiving Web Resources

Development of Web Crawler for Archiving Web Resources

5 Citations2011
The Journal of the Korea Contents Association

From the collection of Web resources to be used for archiving existing web crawlers to analyze the strengths and weaknesses, web archiving systems for the best collection of web resources are developed.

Abstract

There are no way of collection, preservation and utilization for web resources after the service is terminated and is gone. However, these Web resources, regardless of the importance of periodically or aperiodically updated or have been destroyed. Therefore, to collect and preserve Web resources Web archive is being emphasized. Web resources collected periodically in order to develop Web archiving crawlers only was required. In this study, from the collection of Web resources to be used for archiving existing web crawlers to analyze the strengths and weaknesses. We have developed web archiving systems for the best collection of web resources.