Towards Automatic Web Genre Identification
Hawaii International Conference on System SciencesPublished 7 January 2002
Georg Rehm
Citations43
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
A database-driven corpus is developed, currently containing 1300000+ documents, which comprises the empirical research basis and the notions of Web genre type which constitutes the framework for a certain Web genre, and compulsory and optional Web genre modules are introduced.
Abstract
We analyse academic Web pages in order to automatically classify them into Web genres. For this purpose, we have developed a database-driven corpus, currently containing 1300000+ documents, which comprises our empirical research basis. We introduce the notions of Web genre type which constitutes the framework for a certain Web genre, and compulsory and optional Web genre modules. These act as building blocks which go together to make up the structure characterised by the Web genre type and operate as modifiers for the default assignment. The analysis of a 200 document sample illustrates our notion of Web genre hierarchy into which Web genre types and modules are embedded. The analysis of four documents of the Web Genre Academic's Personal Homepage demonstrates our approach and our long-term goal of automatically extracting the contents of Web genre modules in order to build up structured XML documents of unstructured HTML documents.
Keywords
Computer Science
Modern Language JournalGenre Analysis: English in Academic and Research Settings
4,720 Citations1992Mark O. James, John M. Swales
Learning to extract symbolic knowledge from the World Wide Web
675 Citations1998Mark Craven, Dan DiPasquo +5 more
The goal of the research described here is to automatically create a computer understandable world wide knowledge base whose content mirrors that of the World Wide Web, and several machine learning algorithms for this task are described.
XWRAP: an XML-enabled wrapper construction system for Web information sources
427 Citations2002Liu Liu, Calton Pu +1 more
The paper describes the methodology and the software development of XWRAP, an XML-enabled wrapper construction system for semi-automatic generation of wrapper programs, and introduces and develops a two-phase code generation framework.
The Information SocietyReproduced and Emergent Genres of Communication on the World Wide Web
352 Citations2000Kevin Crowston
Recognizing text genres with simple metrics using discriminant analysis
293 Citations1994Jussi Karlgren, Douglass R. Cutting
A simple method for categorizing texts into pre-determined text genre categories using the statistical standard technique of discriminant analysis is demonstrated with application to the Brown corpus.
Data & Knowledge EngineeringBuilding intelligent Web applications using lightweight wrappers
235 Citations2001Arnaud Sahuguet, Fabien Azavant
The World Wide Web Wrapper Factory (W4F) is presented, a toolkit for the generation of wrappers for Web sources that offers an expressive language to specify the extraction of complex structures from HTML pages and a declarative mapping to various data formats like XML.
arXiv (Cornell University)Automatic Detection of Text Genre
206 Citations1997Brett Kessler, Geoffrey Nunberg +1 more
The evolution of cybergenres
173 Citations2002Michael Shepherd, Carolyn Watters
A taxonomy of novel genres, either not based on previously existing genres or substantially different from existing genres on the basis of increased functionality, is proposed and the evolution of the news cybergenre and the mathematics dictionary cyburgenre is examined.
Semi-automatic wrapper generation for Internet information sources
156 Citations2002Naveen Ashish, Craig A. Knoblock
The key idea is to exploit formatting information in Web pages to hypothesize the underlying structure of a page and generate a wrapper that facilitates querying of a source and possibly integrating it with other sources.
Journal of the American Society for Information ScienceGenres and the WEB: Is the personal home page the first uniquely digital genre?
147 Citations2000Andrew Dillon, Barbara Gushrowski
Data from a survey of user perceptions of the form and content of web home pages reveal a significant correlation between commonly found elements of home pages and user preferences and expectations of type, supporting the argument that the personal home page has rapidly evolved into a recognizable form with stable, user-preferred elements and thus may be considered the first truly digital genre.
The functionality attribute of cybergenres
106 Citations2003Michael Shepherd, Carolyn Watters
This paper examines the "functionality" attribute of various cybergenres in an attempt to identify the essential functionality that this new medium affords, to help to understand the influence of this medium on genre, but also to use genre effectively in the design of computer and network-based applications.
Communications of the ACMThe World-Wide-Web as social hypertext
82 Citations1996Thomas Erickson
The World-Wide Web is undergoing a slow transformation from an abstract, chaotic, information web into what I call a social hypertext, and the widespread appearance of personal pages enables another critical feature to emerge: links from a personal page often point to socially salient pages.
Genre based navigation on the Web
81 Citations2005Dmitri Roussinov, Kevin Crowston +4 more
A novel user interface for Web searching that allows genre based navigation through three major functionalities: limiting search to specified genres, visualizing the hierarchy of genres discovered in the search results and accepting user feedback on the relevancy of the specified genres.
Journal of the American Society for Information ScienceReaders, authors, and page structure: A discussion of four questions arising from a content analysis of web pages
64 Citations2000Stephanie W. Haas, Erika S. Grams
Evolution of the Web news genre-the slow move beyond the print metaphor
54 Citations2005Lars Bo Eriksen, Carina Ihlström
Based on repetitive visits to three Scandinavian newspaper organizations, it is concluded that Web news by 1999 possesses characteristics that makes it distinctive from print media and Web news sites from 1996.
Genre as interface metaphor: exploiting form and function in digital environments
48 Citations2003Elaine G. Toms, D. Grant Campbell
The findings indicate that the form attributes of a genre play a significant role in the identification of corresponding documents, and suggest that genre can potentially serve as an interface metaphor.
The effects of linking on genres of Web documents
47 Citations2003Kevin Crowston, Michelle A. Williams
It is suggested that links that tie together document pieces simply recreate the already accepted FAQ genre, but links that provide navigation within the document or that link to other information sources begin to extend and adapt the FAQ genre to the needs and capabilities of the Web.
The home page as genre: a narrative approach
28 Citations2002Gretchen Roberts
It is demonstrated that personal home pages (PHPs) represent a distinct genre by using a functionalist, narrative analysis approach to address authors' involvement strategies, and developing expectations of what constitutes a PHP to the author and the audience, as well as the idea of prestige and PHP design.
AutoWrapper: automatic wrapper generation for multiple online services
18 Citations1999Xiaoying Gao, Leon Sterling
This paper presents a system called AutoWrapper which automatically generates wrappers from HTML source pages based on textual similarity and heuristics, and details its two key components, the domain-independent HTML similarity comparison algorithm and the wrapper induction algorithm.
Journal of Hazardous MaterialsAnchors in Context: A corpus analysis of web pages authoring conventions
10 Citations1998Einat Amitay
Inducing Conceptual User Models
8 Citations1999Martin Müller
User Modeling and Machine Learning for User Modeling have both become important research topics and key techniques in recent adaptive systems and need to be inspectable and understandable by the user himself.
Netvertising: content-based subgeneric variations in a digital genre
7 Citations2002Inmaculada Fortanet-Gómez, Juan Carlos Palmer +1 more
A new emerging digital genre in the world of the Internet: netvertising is defined and texts in this genre are formed by very brief sentences and noun phrases, the systematic use of imperative and simple present tenses, second-person personal pronouns, and a higher use of punctuation marks.
Information extraction and gathering for search engines: the Taylor approach
5 Citations2000François Paradis
Taylor, a search engine designed to reduce the effort required by a user for the perusal of documents is presented by delivering document passages to the user, rather than a list of pointers to documents.
Publication Server of the Institute for German Language (Institute for German Language)From Open Source to Open Information: Collaborative Methods in Creating XML-based Markup Languages
3 Citations2000Georg Rehm, Henning Lobin
This paper examines a part of the Information Marketplace (Dertouzos, 1997) that will give users of the WWW a wide range of new possibilities for gathering information, a task that is predominantly carried out using index-based or catalogue-based search engines.