An Improved Chinese Segmentation Algorithm Based on New Dictionary Construction
Generate an AI Snapshot to get a quick, structured summary of this paper.
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
The result of word frequency statistics is used to design a new dictionary construction and propose an improved FMM algorithm which based on analysis the principle and characteristics of traditional F MM algorithm can further improve the efficiency of the Chinese word segmentation.
Abstract
In this paper, we make use of the result of word frequency statistics design a new dictionary construction and propose an improved FMM algorithm which based on analysis the principle and characteristics of traditional FMM algorithm. Through the time complexity analysis and experimental comparison, the improved FMM algorithm can further improve the efficiency of the Chinese word segmentation.