Ranking Approaches for Microblog Search

Published 1 August 2010Open access

Rinkesh Nagmoti, Ankur Teredesai, Martine De Cock

DOI10.1109/wi-iat.2010.170

Citations119

TL;DR

This paper describes several new strategies for ranking microblogs in a real-time search engine and develops a framework to obtain such validation data, as well as evaluation measures to assess the accuracy of the proposed ranking strategies.

Abstract

Ranking microblogs, such as tweets, as search results for a query is challenging, among other things because of the sheer amount of microblogs that are being generated in real time, as well as the short length of each individual microblog. In this paper, we describe several new strategies for ranking microblogs in a real-time search engine. Evaluating these ranking strategies is non-trivial due to the lack of a publicly available ground truth validation dataset. We have therefore developed a framework to obtain such validation data, as well as evaluation measures to assess the accuracy of the proposed ranking strategies. Our experiments demonstrate that it is beneficial for microblog search engines to take into account social network properties of the authors of microblogs in addition to properties of the microblog itself.

Keywords

Computer SciencePhysics and Astronomy

Optimizing search engines using clickthrough data

3,898 Citations2002Thorsten Joachims

The goal of this paper is to develop a method that utilizes clickthrough data for training, namely the query-log of the search engine in connection with the log of links the users clicked on in the presented ranking.

Why we twitter

2,639 Citations2007Akshay Java, Xiaodan Song +2 more

It is found that people use microblogging to talk about their daily activities and to seek or share information and the user intentions associated at a community level are analyzed to show how users with similar intentions connect with each other.

TwitterRank

1,734 Citations2010Jianshu Weng, Ee‐Peng Lim +2 more

Experimental results show that TwitterRank outperforms the one Twitter currently uses and other related algorithms, including the original PageRank and Topic-sensitive PageRank, which is proposed to measure the influence of users in Twitter.

View PDF

Retrieval evaluation with incomplete information

733 Citations2004Chris Buckley, Ellen M. Voorhees

It is shown that current evaluation measures are not robust to substantially incomplete relevance judgments, and a new measure is introduced that is both highly correlated with existing measures when complete judgments are available and more robust to incomplete judgment sets.

Ranking mechanisms in twitter-like forums

81 Citations2010Anish Das Sarma, Atish Das Sarma +2 more

It is shown that for many reasonable probability models, there is no thumb (or star) based ranking mechanism that can produce approximately accurate rankings with bounded number of reviews per item.

A Test Collection of Preference Judgments

12 Citations2008Ben Carterette, Paul N. Bennett +1 more

An initial release of a set of binary preference judgments over a subset of the LETOR data is described, meant to serve as a starting point for research into questions of evaluation and learning over non-binary, multi-item assessments.