Stylistic text classification using functional lexical features
Journal of the American Society for Information Science and TechnologyPublished 26 February 2007Open access
Shlomo Argamon, Casey Whitelaw, Paul Chase, Sobhan Raj Hota, Navendu Garg, Shlomo Levitan
Citations202
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
This article develops a new type of lexical feature for use in stylistic text classification, based on taxonomies of various semantic functions of certain choice words or phrases, and demonstrates the usefulness of such features for the stylisticText classification tasks of determining author identity and nationality, the gender of literary characters, a text’s sentiment, and the rhetorical character of scientific journal articles.
Abstract
Abstract Most text analysis and retrieval work to date has focused on the topic of a text; that is, what it is about. However, a text also contains much useful information in its style, or how it is written. This includes information about its author, its purpose, feelings it is meant to evoke, and more. This article develops a new type of lexical feature for use in stylistic text classification, based on taxonomies of various semantic functions of certain choice words or phrases. We demonstrate the usefulness of such features for the stylistic text classification tasks of determining author identity and nationality, the gender of literary characters, a text's sentiment (positive/negative evaluation), and the rhetorical character of scientific journal articles. We further show how the use of functional features aids in gaining insight about stylistic differences among different kinds of texts.
Keywords
Computer Science
Language<b>Introduction to functional grammar</b> . By M. A. K. Halliday London & Baltimore: Edward Arnold, 1985. Pp. xxxv, 387.
9,924 Citations1989Christian M.I.M. Matthiessen
The Measurement of Meaning
8,716 Citations1957Charles E. Osgood, George J. Suci +1 more
ACM Computing SurveysMachine learning in automated text categorization
7,899 Citations2002Fabrizio Sebastiani
This survey discusses the main approaches to text categorization that fall within the machine learning paradigm and discusses in detail issues pertaining to three different problems, namely, document representation, classifier construction, and classifier evaluation.
Thumbs up?
6,987 Citations2002Bo Pang, Lillian Lee +1 more
This work considers the problem of classifying documents not by topic, but by overall sentiment, e.g., determining whether a review is positive or negative, and concludes by examining factors that make the sentiment classification problem more challenging.
International Conference on Neural Information ProcessingAdvances in kernel methods: support vector learning
5,815 Citations1999Bernhard Schölkopf, Christopher J. C. Burges +1 more
Support vector machines for dynamic reconstruction of a chaotic system, Klaus-Robert Muller et al pairwise classification and support vector machines, Ulrich Kressel.
Cohesion in English
5,806 Citations2014Μ. Α. Κ. Halliday, Ruqaiya Hasan
The MIT Press eBooksFast Training of Support Vector Machines Using Sequential Minimal Optimization
5,462 Citations1998John Platt
International Journal of LexicographyIntroduction to WordNet: An On-line Lexical Database<sup>*</sup>
4,207 Citations1990George A. Miller, Richard Beckwith +3 more
Standard alphabetical procedures for organizing lexical information put together words that are spelled alike and scatter words with similar or related meanings haphazardly through the list.
ePrints Soton (University of Southampton)An Introduction to Support Vector Machines
4,120 Citations2000Nello Cristianini, John Shawe‐Taylor
Meeting of the Association for Computational LinguisticsThumbs Up or Thumbs Down? Semantic Orientation Applied to Unsupervised Classification of Reviews
3,654 Citations2002Peter Peter, Turney
A sentimental education
3,343 Citations2004Bo Pang, Lillian Lee
A novel machine-learning method is proposed that applies text-categorization techniques to just the subjective portions of the document, which greatly facilitates incorporation of cross-sentence contextual constraints.
Cognitive PsychologyUnderstanding natural language
2,802 Citations1972Terry Winograd
A computer system for understanding English that contains a parser, a recognition grammar of English, programs for semantic analysis, and a general problem solving system based on the belief that in modeling language understanding, it must deal in an integrated way with all of the aspects of language—syntax, semantics, and inference.
The Language of Evaluation: Appraisal in English
2,779 Citations2005James R. Martin, Peter Robert Rupert White
ACM SIGIR ForumA Language Modeling Approach to Information Retrieval
2,532 Citations2017Jay Ponte, W. Bruce Croft
It will be shown that probabilistic methods can be used to predict topic changes in the context of the task of new event detection and provide further proof of concept for the use of language models for retrieval tasks.
Information Systems ResearchThe Measurement of Web-Customer Satisfaction: An Expectation and Disconfirmation Approach
1,972 Citations2002Vicki McKinney, Kanghyun Yoon +1 more
This paper separates Web site quality into information quality (IQ) and system quality (SQ), and proposes nine key constructs for Web-customer satisfaction, and indicates that the proposed metrics have a relatively high degree of validity and reliability.
University of Maribor digital library (University of Maribor)Data Mining Techniques: For Marketing, Sales, and Customer Support
1,756 Citations1997Michael J. Berry, Gordon S. Linoff
One of the first practical guides to mining business data, Data Mining Techniques describes techniques for detecting customer behavior patterns useful in formulating marketing, sales, and customer support strategies.
A language modeling approach to information retrieval
1,723 Citations1998Jay Ponte, W. Bruce Croft
This work proposes an approach to retrieval based on probabilistic language modeling and integrates document indexing and document retrieval into a single model, which significantly outperforms standard tf.idf weighting on two different collections and query sets.
Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
1,597 Citations2002Pierre Isabelle
Sociolinguistics: An Introduction to Language and Society
1,363 Citations1975Peter Trudgill
Maximum Entropy Markov Models for Information Extraction and Segmentation
1,333 Citations2000Andrew McCallum, Dayne Freitag +1 more
A new Markovian sequence model is presented that allows observations to be represented as arbitrary overlapping features (such as word, capitalization, formatting, part-of-speech), and defines the conditional probability of state sequences given observation sequences.
Medical Entomology and ZoologyInference and disputed authorship : The Federalist
916 Citations1964Frederick Mosteller, David L. Wallace
Communications of the ACMInformation extraction
726 Citations1996Jim Cowie, Wendy G. Lehnert
A relatively new development—information extraction (IE)—is the subject of this article and can transform the raw material, refining and reducing it to a germ of the original text.
Improving machine learning approaches to coreference resolution
709 Citations2001Vincent Ng, Claire Cardie
A noun phrase coreference system that extends the work of Soon et al. (2001) and produces the best results to date on the M UC-6 and MUC-7 coreference resolution data sets --- F-measures of 70.4 and 63.4, respectively.
Using appraisal groups for sentiment analysis
562 Citations2005Casey Whitelaw, Navendu Garg +1 more
A new method for sentiment classification based on extracting and analyzing appraisal groups such as ``very good'' or ``not terribly funny'' is presented, based on several task-independent semantic taxonomies based on Appraisal Theory.
Text - Interdisciplinary Journal for the Study of DiscourseGender, genre, and writing style in formal written texts
552 Citations2003Shlomo Argamon, Moshe Koppel +2 more
arXiv (Cornell University)An evaluation of Naive Bayesian anti-spam filtering
527 Citations2000Ion Androutsopoulos, John Koutsias +3 more
It is reached that additional safety nets are needed for the Naive Bayesian anti-spam filter to be viable in practice.
Training algorithms for linear text classifiers
516 Citations1996David Lewis, Robert E. Schapire +2 more
This work proposes that two machine learning algorithms, the Widrow-Hoff and EG algorithms, be used in training linear text classifiers for IR tasks, and theoretical analysis provides performance guarantees and guidance on parameter settings for these algorithms.
Literary and Linguistic ComputingThe Evolution of Stylometry in Humanities Scholarship
471 Citations1998David I. Holmes
The growing power of the computer and the ready availability of machine-readable texts are transforming modern stylometry, which has now attracted the attention of the media.
Kluwer international series in engineering and computer scienceInformation Retrieval: Algorithms and Heuristics
467 Citations1998David A. Grossman, Ophir Frieder
This paper presents a meta-modelling architecture that automates the very labor-intensive and therefore time-heavy and expensive process of integrating structured data and text into a discrete-time system.
Computational LinguisticsAutomatic Text Categorization in Terms of Genre and Author
401 Citations2000Efstathios Stamatatos, Nikos Fakotakis +1 more
This paper proposes a set of style markers including analysis-level measures that represent the way in which the input text has been analyzed and capture useful stylistic information without additional cost to take full advantage of existing natural language processing (NLP) tools.
Literary and Linguistic ComputingOutside the cave of shadows: using syntactic annotation to enhance authorship attribution
387 Citations1996R. Harald Baayen, Hans van Halteren +1 more
The outcome of this experimentests that the frequencies with which syntactic rewrite rules are put to use provide a better clue to authorship than word usage.
Automatic detection of text genre
358 Citations1997Brett Kessler, Geoffrey Numberg +1 more
A theory of genres as bundles of facets, which correlate with various surface cues, are proposed, and it is argued that genre detection based on surface cues is as successful as Detection based on deeper structural properties.
Computation into criticism : a study of Jane Austen's novels and an experiment in method
280 Citations1987John Burrows
International Joint Conference on Artificial IntelligenceFASTUS: A Finite-state Processor for Information Extraction from Real-world Text.
256 Citations1993Douglas E. Appelt, Jerry R. Hobbs +3 more
FASTUS has been evaluated on several blind tests that demonstrate that state-of-the-art performance on information-extraction tasks is obtainable with surprisingly little computational effort.
Studies in language companion seriesStructure and Function – A Guide to Three Major Structural-Functional Theories
235 Citations2003Christopher S. Butler
A major feature of the book is the use of examples from corpora of English and other languages, which serve not only to exemplify theoretical and descriptive claims, but also at times to challenge them.
Edinburgh Research ExplorerA problem for RST: the need for multi-level discourse analysis
231 Citations1992Johanna D. Moore, Martha E. Pollack
Two levels of analysis are focused on, which involve the relation between the information conveyed in consecutive elements of a coherent discourse and the fact that discourses are produced to effect changes in the mental state of the discourse participants.
Computers and the HumanitiesNeural network applications in stylometry: The Federalist Papers
208 Citations1996Fiona J. Tweedie, Sameer Singh +1 more
It is believed that statistical methods of attributing authorship can be coupled effectively with neural networks to produce a very powerful classification tool.
arXiv (Cornell University)Automatic Detection of Text Genre
206 Citations1997Brett Kessler, Geoffrey Nunberg +1 more
Literary and Linguistic ComputingNot Unless You Ask Nicely: The Interpretative Nexus Between Analysis and Information
205 Citations1992J. F. Burrows
Journal of the American Society for Information Science and TechnologyA probabilistic similarity metric for Medline records: A model for author name disambiguation
195 Citations2004Vetle I. Torvik, Marc Weeber +2 more
Learning to remove Internet advertisements
192 Citations1999Nicholas Kushmerick
The experiments demonstrate that the inductive learning approach to browsing assistant is practical: the off-line training phase takes less than six minutes; on-line classification takes about 70 msec; and classification accuracy exceeds 97% given a modest set of training data.
Analyzing Appraisal Automatically
180 Citations2004Maite Taboada, Jack Grieve
A standard method for calculating semantic orientation is applied, and a linguistic classification of Appraisal is applied that could be helpful in distinguishing different types of subjective texts (e.g., movie reviews from consumer product reviews).
Journal of the American Society for Information Science and TechnologyEvaluating Internet resources: Identity, affiliation, and cognitive authority in a networked world
170 Citations2001John Fritch, Robert L. Cromwell
A formal model and evaluative criteria are herein suggested and explained to provide a means for accurately ascribing cognitive authority in a networked environment; the model is unique in its representation of overt and covert affiliations as a mechanism for ascribing proper authority to Internet information.
Text, speech and language technologyStylistic Experiments in Information Retrieval
151 Citations1999Jussi Karlgren
A discussion on various experiments to utilize stylistic variation among texts for information retrieval purposes and how this affects decision-making in the field of retrieval.
The rhetorical parsing of natural language texts
151 Citations1997Daniel Marcu
Medical Entomology and ZoologyForensic Linguistics: Advances in Forensic Stylistics
147 Citations2002Gerald Mcmenamin
Interaction with Texts: Information Retrieval as Information-Seeking Behavior.
139 Citations1993Nicholas J. Belkin
It is proposed that information retireval is most properly considered as information-seeking behavior, that the central process of information retrieval is user interaction with text, and that the user is the central component of the information retrieval system.
Forensic Linguistics
136 Citations2002Gerald Mcmenamin
Identifying Collocations for Recognizing Opinions
135 Citations2001Jens Wiebe
Promising results are shown for a straightforward method of identifying collocational clues of subjectivity, as well as evidence of the usefulness of these clues for recognizing opinionated documents.
Choice Reviews OnlineText generation and systemic-functional linguistics: experiences from English and Japanese
127 Citations1992
Up to and beyond the limits of the basic framework: metafunctional refinements stratal extensions - the environment as seen for lexicogrammar.
Journal of Intelligent Information SystemsA Comparison of Word- and Sense-Based Text Categorization Using Several Classification Algorithms
98 Citations2003Athanasios Kehagias, Vassilios Petridis +2 more
This paper compares the categorization accuracy of classifier based on words to that of classifiers based on senses, and a series of experiments indicates that the use of senses does not result in any significant categorization improvement.
Literary and Linguistic ComputingFrequent Word Sequences and Statistical Stylistics
96 Citations2002David L. Hoover
It is suggested that analyses based on frequent word sequences constitute improved tools for authorship and stylistic studies and produce superior results for small groups of problematic novels and critical texts extracted from the larger corpora.
Relational learning via propositional algorithms: an information extraction case study
86 Citations2001Dan Roth, Wen-tau Yih
This paper develops a new paradigm for relational learning which allows for the representation and learning of relational information using propositional means and allows the use of any propositional algorithm, including probabilistic algorithms, within it.
A decision-based approach to rhetorical parsing
80 Citations1999Daniel Marcu
A shift-reduce rhetorical parsing algorithm that learns to construct rhetorical structures of texts from a corpus of discourse-parse action sequences that exploits robust lexical, syntactic, and semantic knowledge sources.
Lecture notes in computer scienceGenre Classification and Domain Transfer for Information Filtering
76 Citations2002Aidan Finn, Nicholas Kushmerick +1 more
This work investigates three approaches to automatically classifying documents by genre: traditional bag of words techniques, part-of-speech statistics, and hand-crafted shallow linguistic features, particularly in domain transfer conditions.
Using Appraisal Taxonomies for Sentiment Analysis
73 Citations2005Casey Whitelaw
Non-topical text analysis, in which characterizations are sought of the opinions, feelings, and attitudes expressed in a text, rather than just the facts, is seen as a growing interest.
Journal of the American Society for Information Science and TechnologyA flexible interface design for Web directories to accommodate different cognitive styles
65 Citations2004Sherry Y. Chen, George D. Magoulas +1 more
This paper has adopted an individual differences approach to explore user's attitudes towards various interface features provided by existing Web directories, and developed a set of design guidelines to accommodate the preferences of different cognitive style groups.
QUT ePrints (Queensland University of Technology)Language and gender author cohort analysis of e-mail for computer forensics
42 Citations2002Olivier Y. de Vel, Malcolm Corney +2 more
Experiments using a corpus of e-mail documents generated by a large number of authors of both genders gave promising results for both author gender and language background cohort categorisation.
Systemic grammar in computation
25 Citations1983Christian M.I.M. Matthiessen
An examination of what the design properties of systemic grammar are that make it attractive for text generation, and the functional character of the grammar and its organization around the notion of choice are presented.
A Corpus-Independent Feature Set for Style-Based Text Categorization
24 Citations2003Moshe Koppel, Navot Akiva +1 more
It is shown that frequent but unstable features are especially useful for stylebased text categorization, and a new measure on linguistic features, called stability, which captures the extent to which a language element is replaceable by semantically equivalent elements is introduced.
Discourse Structure and Co-Reference: An Empirical Study
24 Citations1999Dan Cristea, Nancy lde +2 more
In most cases, the COLLECT module determines an LPA by enumerating all antecedents in a window of text that pLecedes the anaphor under scrutiny by means of statistical or uncertainty reasoning techniques.
Demonstration of GENESYS
20 Citations1990Robin P. Fawcett, Gordon Tucker
This paper provides background material to the demonstration to be given at COLING '90 of the GENESYS component of the COMMUNAL system.
Communications of the ACMToward meaningful computing
15 Citations2006Shlomo Argamon, Mark Olsen
Computer science can revolutionize the humanities as it has the hard sciences by revealing and contextualizing the meaning hidden in digital libraries.
Mapping Collocational Properties into Machine Learning Features
15 Citations1998Janyce Wiebe, Kenneth J. McKeever +1 more
A statistical analysis of the results across di(cid:11)erent machine learning algorithms shows the relationship between property and organization was strikingly consistent across algorithms.
Visualization of literary style
11 Citations2003Bradley Kjell, Ophir Frieder
Visualization techniques help organize the vast amount of data generated in computational studies of literary style by showing two-dimensional representations of the style of the authors of the Federalist Papers.
Proceedings of the American Society for Information Science and TechnologyToward machine understanding of information quality
10 Citations2003Rong Tang, K. B. Ng +2 more
Preliminary results of a study to develop, and subsequently to automate, new metrics for assessment of information quality in text documents, particularly in news reveal that nine aspects form clusters of “content” and “presentation.”
Reducing Complexity in A Systemic Parser
8 Citations1993Michael O’Donnell
This paper outlines some techniques which are employed in a systemic parser to reduce the average-case complexity of such unification with disjunctive descriptions.
The Languages of Science: A Corpus-Based Study of Experimental and Historical Science Articles
4 Citations2005Shlomo Argamon, Paul Chase +1 more
The current results demonstrate more generally that historical science writing is readily distinguishable from that of experimental science, and the most significant linguistic features of these distinctive styles are directly related to differences posited by philosophers of science between the historical and experimental sciences.