Using SVD and demographic data for the enhancement of generalized Collaborative Filtering
Information SciencesPublished 16 March 2007
Manolis G. Vozalis, Konstantinos G. Margaritis
Citations224
SJR quartileQ1
SJR score1.80
SNIP1.98
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The results show that the combined utilization of SVD with demographic data is promising, since it does not only tackle some of the recorded problems of Recommender Systems, but also assists in increasing the accuracy of systems employing it.
Abstract
In this paper we examine how Singular Value Decomposition (SVD) along with demographic information can enhance plain Collaborative Filtering (CF) algorithms. After a brief introduction to SVD, where some of its previous applications in Recommender Systems are revisited, we proceed with a full description of our proposed method which utilizes SVD and demographic data at various points of the filtering procedure in order to improve the quality of the generated predictions. We test the efficiency of the resulting approach on two commonly used CF approaches (User-based and Item-based CF). The experimental part of this work involves a number of variations of the proposed approach. The results show that the combined utilization of SVD with demographic data is promising, since it does not only tackle some of the recorded problems of Recommender Systems, but also assists in increasing the accuracy of systems employing it.
Keywords
Computer Science
Journal of the American Society for Information ScienceIndexing by latent semantic analysis
12,677 Citations1990Scott Deerwester, Susan Dumais +3 more
Item-based collaborative filtering recommendation algorithms
9,017 Citations2001Badrul Sarwar, George Karypis +2 more
This paper analyzes item-based collaborative ltering techniques and suggests that item- based algorithms provide dramatically better performance than user-based algorithms, while at the same time providing better quality than the best available userbased algorithms.
ACM Transactions on Information SystemsEvaluating collaborative filtering recommender systems
5,762 Citations2004Jonathan L. Herlocker, Joseph A. Konstan +2 more
The key decisions in evaluating collaborative filtering recommender systems are reviewed: the user tasks being evaluated, the types of analysis and datasets being used, the ways in which prediction quality is measured, the evaluation of prediction attributes other than quality, and the user-based evaluation of the system as a whole.
arXiv (Cornell University)Empirical Analysis of Predictive Algorithms for Collaborative Filtering
4,515 Citations2013John S. Breese, David Heckerman +1 more
Social information filtering
2,800 Citations1995Upendra Shardanand, Pattie Maes
The implementation of a networked system called Ringo, which makes personalized recommendations for music albums and artists, and four different algorithms for making recommendations by using social information filtering were tested and compared.
Analysis of recommendation algorithms for e-commerce
1,835 Citations2000Badrul Sarwar, George Karypis +2 more
This paper investigates several te hniques for analyzing large-s ale pur hase and preferen e data for the purpose of producing useful re ommendations to ustomers and devise and apply their ombinations on the authors' data sets to ompare for re Ommendation quality and performan e.
Methods and metrics for cold-start recommendations
1,707 Citations2002Andrew I. Schein, Alexandrin Popescul +2 more
Application of Dimensionality Reduction in Recommender System - A Case Study
1,493 Citations2000Badrul Sarwar, George Karypis +2 more
This paper presents two different experiments where one technology called Singular Value Decomposition (SVD) is explored to reduce the dimensionality of recommender system databases and suggests that SVD has the potential to meet many of the challenges ofRecommender systems, under certain conditions.
SIAM ReviewUsing Linear Algebra for Intelligent Information Retrieval
1,484 Citations1995Michael W. Berry, Susan Dumais +1 more
A lexical match between words in users’ requests and those in or assigned to documents in a database helps retrieve textual materials from scientific databases.
Information RetrievalEigentaste: A Constant Time Collaborative Filtering Algorithm
1,434 Citations2001Ken Goldberg, Theresa Roeder +2 more
This work compares Eigentaste to alternative algorithms using data from Jester, an online joke recommending system, and uses the Normalized Mean Absolute Error (NMAE) measure to compare performance of different algorithms.
Kluwer Academic Publishers eBooksSingular Value Decomposition and Principal Component Analysis
1,180 Citations2005Michael E. Wall, Andreas Rechtsteiner +1 more
This chapter describes gene expression analysis by Singular Value Decomposition (SVD), emphasizing initial characterization of the data, and describes the precise relation between SVD analysis and Principal Component Analysis (PCA) when PCA is calculated using the covariance matrix.
Content-boosted collaborative filtering for improved recommendations
1,095 Citations2002Prem Melville, Raymod J. Mooney +1 more
This paper presents an elegant and effective framework for combining content and collaboration, which uses a content-based predictor to enhance existing user data, and then provides personalized suggestions through collaborative filtering.
Learning Collaborative Information Filters
1,015 Citations1998Daniel Billsus, Michael J. Pazzani
This work proposes a representation for collaborative filtering tasks that allows the application of virtually any machine learning algorithm, and identifies the shortcomings of current collaborative filtering techniques and proposes the use of learning algorithms paired with feature extraction techniques that specifically address the limitations of previous approaches.
Combining Content-Based and Collaborative Filters in an Online Newspaper
782 Citations1999Mark Claypool, Anuja Gokhale +4 more
A new ltering approach is presented that combines the coverage and speed of content-lters with the depth of collaborative ltering, and is applied to an online newspaper, an as yet untapped opportunity for lters useful to the widespread news reading populace.
Spectral analysis of data
292 Citations2001Yossi Azar, Amos Fiat +3 more
A model for framing data mining tasks and a unified approach to solving the resulting data mining problems using spectral analysis are presented, which give strong justification to the use of spectral techniques for latent semantic indexing, collaborative filtering, and web site ranking.
Journal of the American Society for Information SciencePictures of relevance: A geometric analysis of similarity measures
254 Citations1987William Jones, George W. Furnas
A geometric analysis is advanced and its utility demonstrated through its application to six conventional information retrieval similarity measures and a seventh spreading activation measure, intended to complement, and perhaps to guide, the empirical analysis of similarity measures.
Information SciencesWeb page feature selection and classification using neural networks
145 Citations2003Ali Selamat
The WPCM uses a neural network with inputs obtained by both the principal components and class profile-based features to classify news web page features.
Particle swarm optimization recommender system
124 Citations2004Supiya Ujjin, Peter J. Bentley
A new recommender system is described, which employs a particle swarm optimization (PSO) algorithm to learn personal preferences of users and provide tailored suggestions.
Sparsity, scalability, and distribution in recommender systems
68 Citations2001John Riedl, Badrul Sarwar
This dissertation presents the approaches to address three research challenges—sparsity, scalability, and distribution, and presents a taxonomy of recommender system applications based on the relative relevance of geographically proximate and distant users and items.
Web Intelligence and Agent Systems An International JournalOn the enhancement of collaborative filtering by demographic data
45 Citations2006Manolis G. Vozalis, Konstantinos G. Margaritis
This work starts by providing a general, step-by-step description of an approach which combines demographic information with existing filtering algorithms, via a weighted sum, in order to generate more accurate predictions.
Information SciencesA document management methodology based on similarity contents
36 Citations2003Farid Meziane
A method for organising, storing and retrieving documents based on similarity contents is proposed and developed for the E-Cognos project which aims at developing tools for the management and sharing of documents in the construction domain.
University of Minnesota Digital Conservancy (University of Minnesota)An Effective Term-Weighting Scheme for Information Retrieval
18 Citations2000YunJae Jung, Haesun Park +1 more