Text-level Discourse Parsing with Rich Linguistic Features
Published 8 July 2012
Vanessa Wei Feng, Graeme Hirst
Citations150
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
An RST-style text-level discourseparser, based on the HILDA discourse parser, is developed, which significantly improves its tree-building step by incorporating its own rich linguistic features.
Abstract
In this paper, we develop an RST-style textlevel discourse parser, based on the HILDA discourse parser (Hernault et al., 2010b). We significantly improve its tree-building step by incorporating our own rich linguistic features. We also analyze the difficulty of extending traditional sentence-level discourse parsing to text-level parsing by comparing discourseparsing performance under different discourse conditions. 1
Keywords
Computer Science
ACM Transactions on Intelligent Systems and TechnologyLIBSVM
41,340 Citations2011Chih-Chung Chang, Chih‐Jen Lin
Issues such as solving SVM optimization problems theoretical convergence multiclass classification probability estimates and parameter selection are discussed in detail.
The Penn Discourse TreeBank 2.0.
1,130 Citations2008Rashmi Prasad, Nikhil Dinesh +5 more
The second version of the Penn Discourse Treebank, PDTB-2.0, is presented, describing its lexically-grounded annotations of discourse relations and their two abstract object arguments over the 1 million word Wall Street Journal corpus.
A support vector method for multivariate performance measures
800 Citations2005Thorsten Joachims
An algorithm with which such multivariate SVMs can be trained in polynomial time for large classes of potentially non-linear performance measures, in particular ROCArea and all measures that can be computed from the contingency table are given.
Building a discourse-tagged corpus in the framework of Rhetorical Structure Theory
600 Citations2001Lynn Carlson, Daniel Marcu +1 more
Working in the framework of Rhetorical Structure Theory, a large annotated resource with very high consistency is created, using a well-defined methodology and protocol to enable researchers to develop empirically grounded, discourse-specific applications.
Sentence level discourse parsing using syntactic and lexical information
411 Citations2003Radu Soricut, Daniel Marcu
Two probabilistic models that can be used to identify elementary discourse units and build sentence-level discourse parse trees are introduced and shown to be sophisticated enough to yield discourse trees at an accuracy level that matches near-human levels of performance.
An unsupervised approach to recognizing discourse relations
384 Citations2001Daniel Marcu, Abdessamad Echihabi
It is shown that discourse relation classifiers trained on examples that are automatically extracted from massive amounts of text can be used to distinguish between some of these relations with accuracies as high as 93%, even when the relations are not explicitly marked by cue phrases.
Recognizing implicit discourse relations in the Penn Discourse Treebank
283 Citations2009Ziheng Lin, Min‐Yen Kan +1 more
An implicit discourse relation classifier is presented in the Penn Discourse Treebank that considers the context of the two arguments, word pair information, as well as the arguments' internal constituent and dependency parses.
Discourse ProcessesUsing linguistic phenomena to motivate a set of coherence relations
270 Citations1994Alistair Knott, Robert Dale
Dialogue & DiscourseHILDA: A Discourse Parser Using Support Vector Machine Classification
212 Citations2010Hugo Hernault, Helmut Prendinger +2 more
This article presents HILDA, an implemented discourse parser based on RST and Support Vector Machine (SVM) classification that outperforms other discourse parsers for tree structure construction and discourse relation labeling.
The rhetorical parsing of natural language texts
151 Citations1997Daniel Marcu
An effective discourse parser that uses rich linguistic information
116 Citations2009Rajen Subba, Barbara Di Eugenio
The modified shift-reduce parsing model that uses the authors' relation classifier significantly outperforms a right-branching majority-class baseline and a statistically significant improvement in classifying relations over attribute-value learning paradigms such as Decision Trees, RIPPER and Naive Bayes.
Cognitive ScienceD-LTAG: extending lexicalized TAG to discourse
110 Citations2004Bonnie Webber
This paper surveys work on applying the insights of lexicalized grammars to low-level discourse, to show the value of positing an autonomous grammar for low- level discourse in which words are associated with discourse-level predicate–argument structures or modification structures that convey their syntactic-semantic meaning and scope.
A novel discourse parser based on support vector machine classification
101 Citations2009David A. duVerle, Helmut Prendinger
A new algorithm to parse discourse within the framework of Rhetorical Structure Theory (RST) and a rich feature space is introduced, which is 5% to 12% more accurate than current state-of-the-art parsers.
The rhetorical parsing of natural language texts
95 Citations1997Daniel Marcu
Two new, surface-form-based algorithms are derived by means of one that identifies discourse usages of cue phrases and breaks sentences into clauses, and one that produces valid rhetorical structure trees for unrestricted natural languages texts.
Analysis of discourse structure with syntactic dependencies and data-driven shift-reduce parsing
61 Citations2009Kenji Sagae
This work applies shift-reduce algorithms for dependency and constituent parsing to determine syntactic dependencies for the sentences in a document, and subsequently a Rhetorical Structure Theory (RST) tree for the entire document.
Generating discourse structures for written texts
57 Citations2004Huong LeThanh, Geetha Abeysinghe +1 more
This paper presents a system for automatically generating discourse structures from written text that shows promising results in a reasonable search space compared to the discourse trees generated by human analysts.
Probabilistic Head-Driven Parsing for Discourse Structure
48 Citations2005Jason Baldridge, Alex Lascarides
LDV-Forum/Journal for language technology and computational linguisticsSimple Signals for Complex Rhetorics: On Rhetorical Analysis with Rich-Feature Support Vector Models
44 Citations2003David Reitter
A machinelearning governed approach to such an analysis in the framework of Rhetorical Structure Theory is presented, which defines a chain of annotation tools that profits from a new underspecified representation of rhetorical structure.
A PDTB-Styled End-to-End Discourse Parser
39 Citations2012Z Iheng, Yen Kan
A Semi-Supervised Approach to Improve Classification of Infrequent Discourse Relations Using Feature Vector Extension
39 Citations2010Hugo Hernault, Danushka Bollegala +1 more
This paper proposes a novel semi-supervised method for discourse relation classification based on the analysis of co-occurring features in unlabeled data, which is then taken into account for extending the feature vectors given to a classifier.
arXiv (Cornell University)A PDTB-Styled End-to-End Discourse Parser
32 Citations2010Ziheng Lin, Hwee Tou Ng +1 more
A full discourse parser in the Penn Discourse Treebank (PDTB) style is developed that identifies all discourse and non-discourse relations, locates and labels their arguments, and then classifies their relation types.