The wisdom of the few
Published 19 July 2009Open access
Xavier Amatriain, Neal Lathia, Josep M. Pujol, Haewoon Kwak, Nuria Oliver
Citations143
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This work presents a novel method for recommending items to users based on expert opinions, which is a variation of traditional collaborative filtering: rather than applying a nearest neighbor algorithm to the user-rating data, predictions are computed using a set of expert neighbors from an independent dataset, whose opinions are weighted according to their similarity to the users.
Abstract
Nearest-neighbor collaborative filtering provides a successful means of generating recommendations for web users. However, this approach suffers from several shortcomings, including data sparsity and noise, the cold-start problem, and scalability. In this work, we present a novel method for recommending items to users based on expert opinions. Our method is a variation of traditional collaborative filtering: rather than applying a nearest neighbor algorithm to the user-rating data, predictions are computed using a set of expert neighbors from an independent dataset, whose opinions are weighted according to their similarity to the user. This method promises to address some of the weaknesses in traditional collaborative filtering, while maintaining comparable accuracy. We validate our approach by predicting a subset of the Netflix data set. We use ratings crawled from a web portal of expert reviews, measuring results both in terms of prediction accuracy and recommendation list precision. Finally, we explore the ability of our method to generate useful recommendations, by reporting the results of a user-study where users prefer the recommendations generated by our approach.
Keywords
Computer ScienceSocial Sciences
IEEE Transactions on Knowledge and Data EngineeringToward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions
10,115 Citations2005Gediminas Adomavičius, Alexander Tuzhilin
This paper presents an overview of the field of recommender systems and describes the current generation of recommendation methods that are usually classified into the following three main categories: content-based, collaborative, and hybrid recommendation approaches.
Item-based collaborative filtering recommendation algorithms
9,017 Citations2001Badrul Sarwar, George Karypis +2 more
This paper analyzes item-based collaborative ltering techniques and suggests that item- based algorithms provide dramatically better performance than user-based algorithms, while at the same time providing better quality than the best available userbased algorithms.
ACM Transactions on Information SystemsItem-based top-<i>N</i>recommendation algorithms
2,189 Citations2004Mukund Deshpande, George Karypis
This article presents one class of model-based recommendation algorithms that first determines the similarities between the various items and then uses them to identify the set of items to be recommended, and shows that these item-based algorithms are up to two orders of magnitude faster than the traditional user-neighborhood based recommender systems and provide recommendations with comparable or better quality.
Improving recommendation lists through topic diversification
1,839 Citations2005Cai-Nicolas Ziegler, Sean M. McNee +2 more
This work presents topic diversification, a novel method designed to balance and diversify personalized recommendation lists in order to reflect the user's complete spectrum of interests, and introduces the intra-list similarity metric to assess the topical diversity of recommendation lists.
Recommendation as classification: using social and content-based information in recommendation
955 Citations1998Chumki Basu, Haym Hirsh +1 more
These sulfoxides and sulfones are useful as analgesics, non-addicting narcotic antagonists and anti-diarrheal agents and having agonist activity at opiate receptors are disclosed herein.
Trust in recommender systems
860 Citations2005John O’Donovan, Barry Smyth
This paper proposes that the trustworthiness of users must be an important consideration in guiding recommendation and presents two computational models of trust and shows how they can be readily incorporated into standard collaborative filtering frameworks in a variety of ways.
Modeling online reviews with multi-grain topic models
792 Citations2008Ivan Titov, Ryan McDonald
This paper presents a novel framework for extracting ratable aspects of objects from online user reviews and argues that multi-grain models are more appropriate for this task since standard models tend to produce topics that correspond to global properties of objects rather than aspects of an object that tend to be rated by a user.
Scalable collaborative filtering using cluster-based smoothing
665 Citations2005Gui-Rong Xue, Chenxi Lin +5 more
In this paper, clusters generated from the training data provide the basis for data smoothing and neighborhood selection and show that the new proposed approach consistently outperforms other state-of-art collaborative filtering algorithms.
Information RetrievalAn Empirical Analysis of Design Choices in Neighborhood-Based Collaborative Filtering Algorithms
657 Citations2002Jon Herlocker, Joseph A. Konstan +1 more
An analysis framework is applied that divides the neighborhood-based prediction approach into three components and then examines variants of the key parameters in each component, and identifies the three components identified are similarity computation, neighbor selection, and rating combination.
Evaluation of Item-Based Top- <i>N</i> Recommendation Algorithms
585 Citations2001George Karypis
The experimental evaluation on five different datasets show that the proposed item-based algorithms are up to 28 times faster than the traditional user-neighborhood based recommender systems and provide recommendations whose quality is up to 27% better.
Scalable Collaborative Filtering with Jointly Derived Neighborhood Interpolation Weights
503 Citations2007Robert M. Bell, Yehuda Koren
This work enhances the neighborhood-based approach leading to substantial improvement of prediction accuracy, without a meaningful increase in running time, and suggests a novel scheme for low dimensional embedding of the users.
Effective missing data prediction for collaborative filtering
428 Citations2007Hao Ma, Irwin King +1 more
This paper uses the enhanced Pearson Correlation Coefficient (PCC) algorithm by adding one parameter which overcomes the potential decrease of accuracy when computing the similarity of users or items and proposes an effective missing data prediction algorithm, in which information of both users and items is taken into account.
Addressing cold-start problem in recommendation systems
383 Citations2008Xuan Nhat Lam, Thuc Vu +2 more
A hybrid model based on the analysis of two probabilistic aspect models using pure collaborative filtering to combine with users' information is developed to address cold-start - that is, giving recommendations to novel users who have no preference on any items.
A collaborative filtering algorithm and evaluation metric that accurately model the user experience
336 Citations2004Matthew R. McLaughlin, Jonathan L. Herlocker
It is empirically demonstrated that two of the most acclaimed CF recommendation algorithms have flaws that result in a dramatically unacceptable user experience, and a new Belief Distribution Algorithm is introduced that overcomes these flaws and provides substantially richer user modeling.
Lecture notes in computer scienceI Like It... I Like It Not: Evaluating User Ratings Noise in Recommender Systems
195 Citations2009Xavier Amatriain, Josep M. Pujol +1 more
This paper presents a user study aimed at quantifying the noise in user ratings that is due to inconsistencies, and analyzes how factors such as item sorting and time of rating affect this noise.
Broad expertise retrieval in sparse data environments
133 Citations2007Krisztian Balog, Toine Bogers +3 more
Two main expertise retrieval tasks are presented, along with a set of baseline approaches based on generative language modeling, aimed at finding expertise relations between topics and people, and current techniques appear to be generalizable to other settings.
Detecting noise in recommender system databases
133 Citations2006Michael P. O’Mahony, Neil Hurley +1 more
A framework that enables the detection of noise in recommender system databases and devise techniques that enable system administrators to identify and remove from the recommendation process any such noise that is present in the data.
Attack resistant collaborative filtering
99 Citations2008Bhaskar Mehta, Wolfgang Nejdl
A new collaborative algorithm based on SVD which is accurate as well as highly stable to shilling, and combines it with SVD based-CF is described, which offers significant improvement over previous Robust Collaborative Filtering frameworks.
Lecture notes in computer scienceAn Economic Model of User Rating in an Online Recommender System
79 Citations2005F. Maxwell Harper, Xin Li +2 more
It is found that while economic modeling in this domain requires an initial understanding of user behavior and access to an uncommonly broad set of user survey and behavioral data, it returns significant formal understanding of the activity being modeled.
Analysis of a low-dimensional linear model under recommendation attacks
79 Citations2006Sheng Zhang, Yi Ouyang +2 more
This work examines the effectiveness of two popular shilling attacks on a model-based algorithm that uses Singular Value Decomposition (SVD) to learn a low-dimensional linear model and develops an attack detection method directly built on the SVD- based algorithm.
IEEE Intelligent SystemsCollaborative Filtering Using Dual Information Sources
62 Citations2007Jinhyung Cho, Kwiseok Kwon +1 more
Recommendation techniques such as a hybrid approach combining CF with content-based filtering with a focus on e-commerce Web sites for e-learning might be practical to overcome limitations by improving the CF method itself.
A privacy preserving web recommender system
17 Citations2006Ranieri Baraglia, Claudio Lucchese +3 more
πSUGGEST is a privacy enhanced recommender system that allows for creating serendipity recommendations without breaching users privacy, and it is shown that the system does not provide malicious users with any mean to track or detect users activity or preferences.