FudanNLP: A Toolkit for Chinese Natural Language Processing

Published 1 August 2013

Xipeng Qiu, Qi Zhang, Xuanjing Huang

Citations73

TL;DR

FudanNLP is an open source toolkit for Chinese natural language processing (NLP), which uses statistics-based and rule-based methods to deal with Chinese NLP tasks, such as word segmentation, part-ofspeech tagging, named entity recognition, dependency parsing, time phrase recognition, anaphora resolution and so on.

Abstract

The growing need for Chinese natural language processing (NLP) is largely in a range of research and commercial applications. However, most of the currently Chinese NLP tools or components still have a wide range of issues need to be further improved and developed. FudanNLP is an open source toolkit for Chinese natural language processing (NLP), which uses statistics-based and rule-based methods to deal with Chinese NLP tasks, such as word segmentation, part-ofspeech tagging, named entity recognition, dependency parsing, time phrase recognition, anaphora resolution and so on. 1

Keywords

Computer Science

ScholarlyCommons (University of Pennsylvania)Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data

12,978 Citations2001John Lafferty, Andrew McCallum +1 more

This work presents iterative parameter estimation algorithms for conditional random fields and compares the performance of the resulting models to HMMs and MEMMs on synthetic and natural-language data.

View PDF

Online Passive-Aggressive Algorithms

1,449 Citations2006Koby Crammer, Ofer Dekel +3 more

Statistical Dependency Analysis with Support Vector Machines

605 Citations2003Hiroyasu Yamada, Yūji Matsumoto

Though the result is little worse than the most up-to-date phrase structure based parsers, it looks satisfactorily accurate considering that the parser uses no information from phrase structures.

Chinese segmentation and new word detection using conditional random fields

468 Citations2004Fuchun Peng, Fangfang Feng +1 more

The ability of linear-chain conditional random fields (CRFs) to perform robust and accurate Chinese word segmentation by providing a principled framework that easily supports the integration of domain knowledge in the form of multiple lexicons of characters and words is demonstrated.

View PDF

The CoNLL-2009 shared task

339 Citations2009Jan Hajič, Jan Štěpánek +12 more

This shared task combines the shared tasks of the previous five years under a unique dependency-based formalism similar to the 2008 task and describes how the data sets were created and show their quantitative properties.

View PDF

WORLD SCIENTIFIC eBooksHownet and the Computation of Meaning

300 Citations2006Zhendong Dong, Qiang Dong

The presentation will show 9 HowNet-based application tools, which are not merely demonstration of some methodology or algorithm, but are real application tools that can be tested by users themselves.

ScholarlyCommons (University of Pennsylvania)The Part-Of-Speech Tagging Guidelines for the Penn Chinese Treebank (3.0)

90 Citations2000Fei Xia

This document describes the Part-of-Speech (POS) tagging guidelines for the Penn Chinese Treebank Project and discusses the criteria for POS tagging and other factors that were considered when designing the POS tagset.

View PDF