Bulgarian, Hungarian and Czech Stemming Using YASS
Lecture notes in computer sciencePublished 1 January 2008
Prasenjit Majumder, Mandar Mitra, Dipasree Pal
Citations16
SJR quartileQ2
SJR score0.35
SNIP0.55
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
It is found that, for all languages, YASS produces significant improvements over the baseline (unstemmed) runs and is comparable to that of other available stemmers for all the three east European Languages.
Abstract
This is the second year in a row we are participating in CLEF. Our aim is to test the performance of a statistical stemmer on various languages. For CLEF 2006, we tried the stemmer on French [1]; while for CLEF 2007, we did experiments for the Hungarian, Bulgarian and Czech monolingual tasks. We find that, for all languages, YASS produces significant improvements over the baseline (unstemmed) runs. The performance of YASS is also found to be comparable to that of other available stemmers for all the three east European Languages.
Keywords
Computer Science
Lecture notes in computer scienceAccessing Multilingual Information Repositories
265 Citations2006C Peters, Fredric C. Gey +6 more
Lecture notes in computer scienceEvaluation of Multilingual and Multi-modal Information Retrieval
205 Citations2007Peters, Carol, Stempfhuber, Maximilian +6 more
Lecture notes in computer scienceComparative Evaluation of Multilingual Information Access Systems
181 Citations2004C Peters, Julio Gonzalo +2 more
The paper discusses the evaluation approach adopted, describes the tracks and tasks offered and the test collections used, and provides an outline of the guidelines given to the participants.
ACM Transactions on Information SystemsYASS
160 Citations2007Prasenjit Majumder, Mandar Mitra +4 more
A clustering-based approach to discover equivalence classes of root words and their morphological variants and provides consistent improvements in retrieval performance for French and Bengali, which are currently resource-poor.
Lecture notes in computer scienceStemming Approaches for East European Languages
30 Citations2008Ljiljana Dolamic, Jacques Savoy
This CLEF evaluation campaign proposes and evaluates various indexing and search strategies for the Czech language that will hopefully result in more effective retrieval than language-independent approaches (n-gram) and proposes a light stemmer and also a second one based on a more aggressive suffix-stripping scheme that will remove some derivational suffixes.
Information Processing & ManagementSearching strategies for the Hungarian language
27 Citations2007Jacques Savoy
It is demonstrated that applying an automatic decompounding procedure for both queries and documents significantly improves IR performance (+10%), compared to word-based indexing strategies.
Lecture notes in computer scienceReport on CLEF-2003 Monolingual Tracks: Fusion of Probabilistic Models for Effective Monolingual Retrieval
26 Citations2004Jacques Savoy
This paper proposes more effective and general stopword lists for the Swedish, Finnish and Russian languages, along with an improved, more efficient and simpler stemming procedure for these three languages, and suggests a combined search approach based on a data fusion strategy that would work with various European languages.
Lecture notes in computer scienceFour Stemmers and a Funeral: Stemming in Hungarian at CLEF 2005
12 Citations2006Anna Tordai, Maarten de Rijke
It is found that stemming over a broad range of suffixes especially on nouns is highly useful and therefore the ad-hoc monolingual task for CLEF 2005.
Lecture notes in computer scienceStatistical vs. Rule-Based Stemming for Monolingual French Retrieval
7 Citations2007Prasenjit Majumder, Mandar Mitra +1 more
The results show that stemming significantly improves retrieval performance (as expected) by about 9-10%, and the performance of the statistical stemmer is comparable with that of the rule-based stemmer.
Lecture notes in computer scienceExperiments with Monolingual, Bilingual, and Robust Retrieval
6 Citations2007Jacques Savoy, Samir Abdou
The objective was to obtain a better picture of the relative merit of various search engines for the French, Portuguese/Brazilian and Bulgarian languages and to propose and evaluate a decompounding algorithm and a more aggressive stemmer for the Hungarian language.
reroDoc Digital LibraryExperiments with Monolingual, Bilingual, and Robust Retrieval
5 Citations2007Jacques Savoy, Samir Abdou
Czech Monolingual Information Retrieval Using Off-The-Shelf Components - the University of West Bohemia at CLEF 2007 Ad-Hoc track
2 Citations2007Pavel Ircing, Luděk Müller
A brief description of the system assembled for the CLEF 2007 Ad-Hoc track by the University of West Bohemia using two incarnations of the tf.idf model as implemented in the Lemur toolkit, with results achieved seem to be quite reasonable.
Lecture notes in computer scienceCharles University at CLEF 2007 Ad-Hoc Track
2 Citations2008Pavel Češka, Pavel Pecina
It is demonstrated that for Czech as a highly inflectional language, lemmatization significantly improves retrieval results and manually created queries are only slightly better than queries automatically generated from topic specifications.