A Multilevel Text Processing Model of Newsgroup Dynamics

Lecture notes in computer sciencePublished 1 January 2002

G. Sampathsampath tcnj.edu, Miroslav Martinović

DOI10.1007/3-540-36271-1_19

Source URL

Citations4

SJR quartileQ2

SJR score0.35

SNIP0.55

TL;DR

A multilevel model of discussions in USENET newsgroups that includes the use of statistical and linguistic methods to obtain lexical, semantic and discourse characteristics of the text is presented.

Abstract

We present a multilevel model of discussions in USENET newsgroups that includes the use of statistical and linguistic methods to obtain lexical, semantic and discourse characteristics of the text. We expose constraints that make information extraction and summarization more amenable to analysis at different levels. Our model makes use of posting structure, times of posting, time spans, and length and depth of a thread in order to extract higher-level information on subject matter, interest level, topicality, and discussion trends.

Keywords

Computer SciencePhysics and Astronomy

Foundations of statistical natural language processing

9,996 Citations1999Christopher D. Manning, Hinrich Schütze

Computer NetworksGraph structure in the Web

2,760 Citations2000Andrei Broder, Ravi Kumar +6 more

The study of the web as a graph yields valuable insight into web algorithms for crawling, searching and community discovery, and the sociological phenomena which characterize its evolution.

Computer NetworksTrawling the Web for emerging cyber-communities

1,010 Citations1999Ravi Kumar, Prabhakar Raghavan +2 more

The subject of this paper is the systematic enumeration of over 100,000 emerging communities from a Web crawl, motivating a graph-theoretic approach to locating such communities, and describing the algorithms and algorithmic engineering necessary to find structures that subscribe to this notion.

Building a distributed full-text index for the Web

135 Citations2001Sergey Melnik, Sriram Raghavan +2 more

A novel pipelining technique for structuring the core index-building system that substantially reduces the index construction time is introduced and a storage scheme for creating and managing inverted files using an embedded database system is proposed.

AI MagazineCorpus-Based Approaches to Semantic Interpretation in NLP

42 Citations1997Hwee Tou Ng, John M. Zelle

An introduction to some of the emerging research in the application of corpus-based learning techniques to problems in semantic interpretation, namely, word-sense disambiguation and semantic parsing.

Scalable collection summarization and selection

29 Citations1999R. Dolin, Divyakant Agrawal +1 more

The feasibility of the Pharos architecture is demonstrated using 2500 Usenet newsgroups as separate collections and it is shown that using Pharos as an intermediate retrieval mechanism provides acceptable accuracy of source selection compared to selecting sources using complete classi cation information, while maintaining good scalability.

View PDF

Lecture notes in computer scienceDiscovering Structure from Document Databases

13 Citations1999Mon-Fong Jiang, Shian‐Shyong Tseng +1 more

An intelligent information retrieval system which can help users to retrieve the required personnel regulations in Taiwan is developed and it can be easily seen that the retrieval results using SD are better than traditional approaches.

Grading Knowledge: Extracting Degree Information from Texts

10 Citations1999Steffen Staab

The author derives two distinct categories of natural language degree expressions and proposes knowledge-intensive algorithms to handle their analyses in the ParseTalk system and generalizes from well-known constraint propagation mechanisms.

Lecture notes in computer scienceGrading Knowledge

3 Citations1999Steffen Staab

The author derives two distinct categories of natural language degree expressions and proposes knowledge-intensive algorithms to handle their analyses in the ParseTalk system, and generalizes from well-known constraint propagation mechanisms for inferencing.