Application of automatic topic identification on Excite Web search engine data logs

The reasons underlying the inconsistent performance of automatic topic identification are investigated with statistical analysis and experimental design techniques, and the topic identification algorithm's performance becomes doubtful in various cases.

Abstract

The analysis of contextual information in search engine query logs enhances the understanding of Web users’ search patterns. Obtaining contextual information on Web search engine logs is a difficult task, since users submit few number of queries, and search multiple topics. Identification of topic changes within a search session is an important branch of search engine user behavior analysis. The purpose of this study is to investigate the properties of a specific topic identification methodology in detail, and to test its validity. The topic identification algorithm’s performance becomes doubtful in various cases. These cases are explored and the reasons underlying the inconsistent performance of automatic topic identification are investigated with statistical analysis and experimental design techniques.