Integrating automatic genre analysis into digital libraries
Published 1 January 2001
Andreas Rauber, Alexander Müller-Kögler
Citations71
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
An approach to automatically analyze the structure of documents and to integrate this information into an automatically created content-based organization is presented and documents on similar topics, yet representing different genres, are depicted as books in differing colors.
Abstract
With the number and types of documents in digital library systems incr easing, tools for automatically organizing and presenting the content have to be found. While many approaches focus on topic-based organization and structuring, hardly any system incorporates automatic structural analysis and representation. Yet, genre information (unconsciously) forms one of the most distinguishing features in conventional libraries and in information searches. In this paper we present an approach to automatically analyze the structure of documents and to integrate this information into an automatically created content-based organization. In the resulting visualization, documents on similar topics, yet representing different genres, are depicted as books in differing colors. This representation supports users intuitively in locating relevant information presented in a relevant form.
Keywords
Computer ScienceArts and Humanities
Springer series in information sciencesSelf-Organizing Maps
10,377 Citations1997Teuvo Kohonen
The mathematical preliminaries, background, basic ideas, and implications of the Self-Organising Map algorithm are expounded in a manner which is accessible without prior expert knowledge.
Biological CyberneticsSelf-organized formation of topologically correct feature maps
9,519 Citations1982Teuvo Kohonen
In a simple network of adaptive physical elements which receives signals from a primary event space, the signal representations are automatically mapped onto a set of output responses in such a way that the responses acquire the same topological order as that of the primary events.
Cambridge University Press eBooksVariation across Speech and Writing
5,128 Citations1988Douglas Biber
In Variation Across Speech and Writing, six dimensions of variation are identified through a factor analysis, on the basis of linguistic co-occurence patterns, and the resulting model of variation provides for the description of the distinctive linguistic characteristic of any spoken or written text and enables reconciliation of the contradictory conclusions reached in previous research.
Journal of the American Statistical AssociationThe Use of Faces to Represent Points in k-Dimensional Space Graphically
1,252 Citations1973Herman Chernoff
Every multivariate observation is visualized as a computer-drawn face that makes it easy for the human mind to grasp many of the essential regularities and irregularities present in the data.
IEEE Transactions on Neural NetworksSelf organization of a massive document collection
911 Citations2000Teuvo Kohonen, Samuel Kaski +5 more
A system that is able to organize vast document collections according to textual similarities based on the self-organizing map (SOM) algorithm, based on 500-dimensional vectors of stochastic figures obtained as random projections of weighted word histograms.
Automatic detection of text genre
358 Citations1997Brett Kessler, Geoffrey Numberg +1 more
A theory of genres as bundles of facets, which correlate with various surface cues, are proposed, and it is argued that genre detection based on surface cues is as successful as Detection based on deeper structural properties.
Recognizing text genres with simple metrics using discriminant analysis
293 Citations1994Jussi Karlgren, Douglass R. Cutting
A simple method for categorizing texts into pre-determined text genre categories using the statistical standard technique of discriminant analysis is demonstrated with application to the Brown corpus.
Journal of Visual Communication and Image RepresentationInternet Categorization and Search: A Self-Organizing Approach
237 Citations1996Hsinchun Chen, Chris Schuffels +1 more
This research aims to provide an alternative concept-based categorization and search capability for WWW servers based on selected machine learning algorithms that could serve to partition the vast Internet services into subject-specific categories and databases and improve Internet keyword searching and/or browsing.
Text, speech and language technologyStylistic Experiments in Information Retrieval
151 Citations1999Jussi Karlgren
A discussion on various experiments to utilize stylistic variation among texts for information retrieval purposes and how this affects decision-making in the field of retrieval.
LabelSOM: on the labeling of self-organizing maps
78 Citations2003Andreas Rauber
The LabelSOM approach for automatically labeling a trained self-organizing map with the features of the input data that are the most relevant ones for the assignment of a set of input data to a particular cluster is presented.
A SOM based cluster visualization and its application for false coloring
77 Citations2000Johan Himberg
The main application here is to derive different color coding that express the approximate cluster structure of the SOM model vectors, which may be exploited in making false color (pseudo color) presentations of the original data.
Lecture notes in computer scienceThe SOMLib Digital Library System
65 Citations1999Andreas Rauber, Dieter Merkl
The SOMLib project has created a digital library system that uses a neural network-based core for the representation of the library, and uses the self-organizing map, a popular unsupervised neural network model, to topically structure a document collection similar to the organization of real-world libraries.
Studies in fuzziness and soft computingDocument Classification with Unsupervised Artificial Neural Networks
33 Citations2000Dieter Merkl, Andreas Rauber
It is shown that a similar display can be obtained by using hierarchical feature maps to represent the contents of a document archive while still having the general maps available for global orientation.
Iterative Information Retrieval Using Fast Clustering and Usage-Specific Genres
27 Citations1999Jussi Karlgren, Ivan Bretan +3 more
This paper describes how collection specific empirically defined stylistics based genre prediction can be brought together together with rapid topical clustering to build an interactive information retrieval interface with multi-dimensional presentation of search results.
SOMLib
24 Citations1999Andreas Rauber, Dieter Merkl
The SOMLib project creates a digital library system that uses a neural network-based core for library representation and query processing, and uses the self-organizing map, a popular unsupervised neural network model, to automatically structure a document collection.
Web-Specific Genre Visualization.
24 Citations1998Ivan Bretan, Johan Dewe +3 more
This work uses both stylistic genre-based document categorization and statistical content-based clustering to organize documents along these criteria in a highly interactive visualization front-end to WWW search engines, enabling quick overview and incremental query refinement.
Lecture notes in computer scienceAutomatically Detecting and Organizing Documents into Topic Hierarchies: A Neural Network Based Approach to Bookshelf Creation and Arrangement
12 Citations2000Andreas Rauber, Michael Dittenbach +1 more
The GHSOM is presented, which allows an automatic hierarchical decomposition and organization of documents, which very intuitively reflects the organization typically found in (manually organized) conventional libraries.
Visualizing Electronic Document Repositories: Drawing Books and Papers in a Digital Library
11 Citations2000Andreas Rauber, H. Bina
While methods for retrieving documents from large information repositories have improved a lot, presentation of the retrieved documents still leaves a lot to be desired.