Multidimensional text analysis for eRulemaking
Published 1 January 2006
Namhee Kwon, Stuart W. Shulman, Eduard Hovy
Citations55
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Techniques to automatically analyze large number of public comments on proposed regulations, performed on comments submitted to the Environmental Protection Agency in response to their proposed rule for mercury regulation, are developed.
Abstract
To support rule-writers, we are developing techniques to automatically analyze large number of public comments on proposed regulations. A document is analyzed in various ways including argument structure, topics, and opinions. The individual results are integrated into a unified output. The experiments reported here were performed on comments submitted to the Environmental Protection Agency in response to their proposed rule for mercury regulation.
Keywords
Computer Science
The Nature of Statistical Learning Theory
39,279 Citations1995Vladimir Vapnik
Journal of the American Statistical AssociationContent Analysis: An Introduction to its Methodology.
24,566 Citations1984Mack Shelley, Klaus Krippendorff
Wiley series in probability and statisticsStatistical Methods for Rates and Proportions
18,048 Citations2003Joseph L. Fleiss, Bruce Levin +1 more
Language<b>WordNet: An electronic lexical database</b> . Ed. by Christiane Fellbaum. Cambridge, MA: MIT Press, 1998. Pp. xxii, 423.
11,687 Citations2000Adam Kilgarriff
The lexical database: nouns in WordNet, George A. Miller modifiers in WordNet, Katherine J. Miller a semantic network of English verbs, and applications of WordNet: building semantic concordances are presented.
Practical Statistics for Medical Research
9,764 Citations1990Douglas G. Altman
Communications of the ACMA vector space model for automatic indexing
7,434 Citations1975Gerard Salton, Anita M.-Y. Wong +1 more
An approach based on space density computations is used to choose an optimum indexing vocabulary for a collection of documents, demonstating the usefulness of the model.
Thumbs up?
6,987 Citations2002Bo Pang, Lillian Lee +1 more
This work considers the problem of classifying documents not by topic, but by overall sentiment, e.g., determining whether a review is positive or negative, and concludes by examining factors that make the sentiment classification problem more challenging.
Optimizing search engines using clickthrough data
3,898 Citations2002Thorsten Joachims
The goal of this paper is to develop a method that utilizes clickthrough data for training, namely the query-log of the search engine in connection with the log of links the users clicked on in the presented ranking.
Recognizing contextual polarity in phrase-level sentiment analysis
3,379 Citations2005Theresa Wilson, Janyce Wiebe +1 more
A new approach to phrase-level sentiment analysis is presented that first determines whether an expression is neutral or polar and then disambiguates the polarity of the polar expressions.
Computational LinguisticsA maximum entropy approach to natural language processing
3,120 Citations1996Adam Berger, Vincent J. Della Pietra +1 more
A maximum-likelihood approach for automatically constructing maximum entropy models is presented and how to implement this approach efficiently is described, using as examples several problems in natural language processing.
The Berkeley FrameNet Project
2,564 Citations1998Collin F. Baker, Charles J. Fillmore +1 more
This report will present the project's goals and workflow, and information about the computational tools that have been adapted or created in-house for this work.
ACM Transactions on Information SystemsMeasuring praise and criticism
1,509 Citations2003Peter D. Turney, Michael L. Littman
This article introduces a method for inferring the semantic orientation of a word from its statistical association with a set of positive and negative paradigm words, based on two different statistical measures of word association.
Determining the sentiment of opinions
1,485 Citations2004Soo-Min Kim, Eduard Hovy
A system that, given a topic, automatically finds the people who hold opinions about that topic and the sentiment of each opinion and another module for determining word sentiment and another for combining sentiments within a sentence is presented.
TextTiling: segmenting text into multi-paragraph subtopic passages
1,253 Citations1997Marti A. Hearst
The algorithm is fully implemented and is shown to produce segmentation that corresponds well to human judgments of the subtopic boundaries of 12 texts, which should be useful for many text analysis tasks, including information retrieval and summarization.
Towards answering opinion questions
1,051 Citations2003Hong Yu, Vasileios Hatzivassiloglou
A Bayesian classifier for discriminating between documents with a preponderance of opinions such as editorials from regular news stories is presented, and three unsupervised, statistical techniques for the significantly harder task of detecting opinions at the sentence level are described.
Machine LearningAn Algorithm that Learns What's in a Name
784 Citations1999Daniel M. Bikel, Richard Schwartz +1 more
IdentiFinderTM, a hidden Markov model that learns to recognize and classify names, dates, times, and numerical quantities, is evaluated and is competitive with approaches based on handcrafted rules on mixed case text and superior on text where case information is not available.
Computational LinguisticsLearning Subjective Language
743 Citations2004Janyce Wiebe, Theresa Wilson +3 more
This article shows that the density of subjectivity clues in the surrounding context strongly affects how likely it is that a word is subjective, and it provides the results of an annotation study assessing the subjectivity of sentences with high-density features.
arXiv (Cornell University)Some Advances in Transformation-Based Part of Speech Tagging
279 Citations1994Eric Brill
An annotation scheme for discourse-level argumentation in research articles
186 Citations1999Simone Teufel, Jean Carletta +1 more
This paper introduces an annotation scheme for scientific articles which can be used to build robust automatic abstracting systems in a consistent way and shows that the scheme is stable, reproducible and intuitive to use.
Computational LinguisticsEvaluating Discourse and Dialogue Coding Schemes
83 Citations2005Richard Craggs, Mary McGee Wood
The role of agreement measures is described and it is argued that only chance-corrected measures that assume a common distribution of labels for all coders are suitable for measuring agreement in reliability studies.
Annotating Opinions in the World Press
83 Citations2003Theresa Wilson, Janyce Wiebe
This paper presents a detailed scheme for annotating expressions of opinions, beliefs, emotions, sentiment and speculation in the news and other discourse, and explores inter-annotator agreement for individual private state expressions.
Towards automatic classification of discourse elements in essays
62 Citations2001Jill Burstein, Daniel Marcu +2 more
Using a relatively small corpus of manually annotated data, this work uses Bayesian classification to identify thesis statements and yields results that are much closer to human performance than the results produced by two baseline systems.
Discourse-level argumentation in scientific articles: human and automatic annotation
38 Citations1999Simone Teufel, Marc Moens
A rhetorically defined annotation scheme which is part of the authors' corpus-based method for the summarisation of scientific articles, and it is shown that this kind of resource can be used to train a system to automate the annotation work.
International Journal of Public AdministrationE-Rulemaking: Issues in Current Research and Practice<sup>[1]</sup>
36 Citations2005Stuart W. Shulman
This article examines the origin of Regulations.Gov, a federal Web portal, in the context of recent literature on public participation, and federally funded research into impact of eRulemaking.
International Conference on Digital Government ResearchNear-duplicate detection for eRulemaking
33 Citations2005Hui Yang, Jamie Callan
SSRN Electronic JournalThe Internet and Citizen Participation in Rulemaking
31 Citations2003Cary Coglianese
It is argued that existing efforts to apply information technology to rulemaking will not noticeably affect citizen participation, as these current efforts do little more than digitize the existing process without addressing the underlying obstacles to greater citizen participation.
FrameNet-based semantic parsing using maximum entropy models
16 Citations2004Namhee Kwon, Michael Fleischman +1 more
This work defines sentence segmentation first and shows how Maximum Entropy re-ranking helps achieve a level of 76.2% F-score (answer among topfive candidates) or 61.5% (correct answer).
The Knowledge Bank (The Ohio State University)A Relatedness Analysis Tool for Comparing Drafted Regulations and Associated Public Comments
8 Citations2005Gloria T. Lau, Kincho H. Law +1 more
This research proposes to make use of available Information and Communication Technology to help describe the relationship of public comments to policy drafts and deliberations to illustrate the use and limitations of ICT to support policy making.
Meeting of the Association for Computational LinguisticsSenseval automatic labeling of semantic roles using Maximum Entropy models
8 Citations2004Namhee Kwon, Michael Fleischman +1 more
Maximum Entropy classification is applied with feature sets of syntactic patterns from parse trees and officially attain 80.2% precision and 65.4% recall when the frame element boundaries are given.
Semantic parsing based on FrameNet
8 Citations2004Cosmin A. Bejan, Alessandro Moschitti +3 more
This paper describes the method based on Support Vector Machines for automatically assigning semantic roles to constituents of English sentences, which employs four different feature sets, one of which being first reported herein.