Time is of the essence
Published 26 April 2010
Anlei Dong, Ruiqiang Zhang, Pranam Kolari, Jing Bai, Fernando Díaz, Yi Chang
Citations200
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A method to use the micro-blogging data stream to detect fresh URLs and to compute novel and effective features for ranking fresh URLs is proposed and demonstrated to improve effective of the portal web search engine for realtime web search.
Abstract
Realtime web search refers to the retrieval of very fresh content which is in high demand. An effective portal web search engine must support a variety of search needs, including realtime web search. However, supporting realtime web search introduces two challenges not encountered in non-realtime web search: quickly crawling relevant content and ranking documents with impoverished link and click information. In this paper, we advocate the use of realtime micro-blogging data for addressing both of these problems. We propose a method to use the micro-blogging data stream to detect fresh URLs. We also use micro-blogging data to compute novel and effective features for ranking fresh URLs. We demonstrate these methods improve effective of the portal web search engine for realtime web search.
Keywords
Computer Science
The Annals of StatisticsGreedy function approximation: A gradient boosting machine.
28,973 Citations2001Jerome H. Friedman
A general gradient descent boosting paradigm is developed for additive expansions based on any fitting criterion, and specific algorithms are presented for least-squares, least absolute deviation, and Huber-M loss functions for regression, and multiclass logistic likelihood for classification.
Computer Networks and ISDN SystemsThe anatomy of a large-scale hypertextual Web search engine
15,828 Citations1998Sergey Brin, Lawrence M. Page
This paper provides an in-depth description of Google, a prototype of a large-scale search engine which makes heavy use of the structure present in hypertext and looks at the problem of how to effectively deal with uncontrolled hypertext collections where anyone can publish anything they want.
ACM Transactions on Information SystemsCumulated gain-based evaluation of IR techniques
4,634 Citations2002Kalervo Järvelin, Jaana Kekäläinen
This article proposes several novel measures that compute the cumulative gain the user obtains by examining the retrieval result up to a given ranked position, and test results indicate that the proposed measures credit IR methods for their ability to retrieve highly relevant documents and allow testing of statistical significance of effectiveness differences.
Optimizing search engines using clickthrough data
3,898 Citations2002Thorsten Joachims
The goal of this paper is to develop a method that utilizes clickthrough data for training, namely the query-log of the search engine in connection with the log of links the users clicked on in the presented ranking.
Journal of Mathematical SociologyFactoring and weighting approaches to status scores and clique identification
3,129 Citations1972Phillip Bonacich
Learning to rank using gradient descent
2,759 Citations2005Chris Burges, Tal Shaked +5 more
RankNet is introduced, an implementation of these ideas using a neural network to model the underlying ranking function, and test results on toy data and on data from a commercial internet search engine are presented.
Why we twitter
2,639 Citations2007Akshay Java, Xiaodan Song +2 more
It is found that people use microblogging to talk about their daily activities and to seek or share information and the user intentions associated at a community level are analyzed to show how users with similar intentions connect with each other.
Learning to rank for information retrieval
1,946 Citations2010Tie‐Yan Liu
ACM SIGIR ForumA taxonomy of web search
1,923 Citations2002Andrei Broder
This taxonomy of web searches is explored and how global search engines evolved to deal with web-specific needs is discussed.
Learning to rank
1,917 Citations2007Zhe Cao, Tao Qin +3 more
It is proposed that learning to rank should adopt the listwise approach in which lists of objects are used as 'instances' in learning, and introduces two probability models, respectively referred to as permutation probability and top k probability, to define a listwise loss function for learning.
Improving web search ranking by incorporating user behavior information
1,041 Citations2006Eugene Agichtein, Eric Brill +1 more
It is shown that incorporating user behavior data can significantly improve ordering of top results in real web search setting, improving the accuracy of a competitive web search ranking algorithms by as much as 31% relative to the original performance.
International Journal of Emergency ManagementTwitter adoption and use in mass convergence and emergency events
992 Citations2009Amanda Hughes, Leysia Palen
The findings suggest that Twitter messages sent during these types of events contain more displays of information broadcasting and brokerage, and that general Twitter use seems to have evolved over time to offer more of an information-sharing purpose.
Beyond Microblogging: Conversation and Collaboration via Twitter
956 Citations2009C. Honey, Susan C. Herring
A corpus of naturally-occurring public Twitter messages reveals a surprising degree of conversationality, facilitated especially by the use of @ as a marker of addressivity, and shed light on the limitations of Twitter's current design for collaborative use.
How and why people Twitter
873 Citations2009Dejin Zhao, Mary Beth Rosson
This exploratory research project is aimed at gaining an in-depth understanding of how and why people use Twitter and exploring micro-blog's impacts on informal communication at work.
An Efficient Boosting Algorithm for Combining Preferences
814 Citations1998Yoav Freund, Raj D. Iyer +2 more
This work describes and analyze an efficient algorithm called RankBoost for combining preferences based on the boosting approach to machine learning, and gives theoretical results describing the algorithm’s behavior both on the training data, and on new test data not seen during training.
A few chirps about twitter
711 Citations2008Balachander Krishnamurthy, Phillipa Gill +1 more
A detailed characterization of Twitter, an application that allows users to send short messages, is presented, which identifies distinct classes of Twitter users and their behaviors, geographic growth patterns and current size of the network.
AIS Electronic Library (AISeL) (Association for Information Systems)Tweeting the Night Away: Using Twitter to Enhance Social Presence
621 Citations2009Joanna C. Dunlap, Patrick R. Lowenthal
This teaching tip describes the use of Twitter to encourage freeflowing just-in-time interactions and how these interactions can enhance social presence in online courses and describes instructional benefits of Twitter.
SSRN Electronic JournalSocial Networks that Matter: Twitter Under the Microscope
520 Citations2008Bernardo A. Huberman, Daniel M. Romero +1 more
A study of social interactions within Twitter reveals that the driver of usage is a sparse and hidden network of connections underlying the “declared” set of friends and followers.
Lecture notes in computer scienceSimilarity Measures for Short Segments of Text
304 Citations2007Donald Metzler, Susan Dumais +1 more
This work formally evaluate and analyze the methods on a query-query similarity task using 363,822 queries from a web search log, and provides insights into the strengths and weaknesses of each method, including important tradeoffs between effectiveness and efficiency.
Tweet the debates
303 Citations2009David A. Shamma, Lyndon Kennedy +1 more
It is found that the level of Twitter activity serves as a predictor of changes in topics in the media event and conversational cues can identify the key players in theMedia object and that the content of the Twitter posts can somewhat reflect the topics of discussion in the Media object, but are mostly evaluative, in that they express the poster's reaction to the media.
Lecture notes in computer scienceMicroblogging for Language Learning: Using Twitter to Train Communicative and Cultural Competence
261 Citations2009Kerstin Borau, Carsten Ullrich +2 more
This work analyzes the usefulness of microblogging in second language learning using the example of the social network Twitter and describes how it was used with students of English at the Distant College of Shanghai Jiao Tong University.
A regression framework for learning ranking functions using relative relevance judgments
206 Citations2007Zhaohui Zheng, Keke Chen +2 more
This work focuses on developing a regression framework for learning ranking functions for improving relevance of search engines serving diverse streams of user queries, and proposes a novel optimization framework emphasizing the use of relative relevance judgments.
Learn from web search logs to organize search results
186 Citations2007Xuanhui Wang, ChengXiang Zhai
This paper proposes to address two deficiencies of clustering search results by learning "interesting aspects" of a topic from Web search logs and organizing search results accordingly; and generating more meaningful cluster labels using past query words entered by users.
A General Boosting Method and its Application to Learning Ranking Functions for Web Search
185 Citations2007Zhaohui Zheng, Hongyuan Zha +4 more
This work presents a general boosting method extending functional gradient boosting to optimize complex loss functions that are encountered in many machine learning problems, based on optimization of quadratic upper bounds of the loss functions.
Towards recency ranking in web search
157 Citations2010Anlei Dong, Yi Chang +7 more
This paper proposes a retrieval system which automatically detects and responds to recency sensitive queries, and proposes several training methodologies important for training recencysensitive rankers.
Integration of news content into web results
130 Citations2009Fernando Díaz
This paper addresses the issue of integrating search results from a news vertical into web search results, and defines several click-based metrics which allow a system to be monitored and tuned without annotator effort.
Click-through prediction for news queries
66 Citations2009Arnd Christian König, Michael Gamon +1 more
A supervised model is proposed that offers accurate prediction of news click-through rates and satisfies the requirement of adapting quickly to emerging news events.