Topic Modeling of Chinese Language Beyond a Bag-of-Words

Publication date: Available online 6 April 2016
Source:Computer Speech & Language
Author(s): Zengchang Qin, Yonghui Cong, Tao Wan
The topic model is one of best known hierarchical Bayesian models for language modeling and document analysis. It has achieved a great success in text classification, in which a text is represented as a big of its words, disregarding grammar and even word order, that is referred to as the bag-of-words assumption. In this paper, we investigate topic modeling of the Chinese language, which has different morphology from alphabetical western languages like English. The Chinese characters, but not the Chinese words, are the basic structural units in Chinese. In previous empirical studies, it shows that the character-based topic model performs better than the word-based topic model. In this research, we propose the character-word topic model (CWTM) to consider the character-word relation in topic modeling. Two types of experiments are designed to test the performance of the new proposed model: topic extraction and text classification. By empirical studies, we demonstrate the superiority of the new proposed model comparing to both word and character based topic models.



from Speech via a.lsfakia on Inoreader http://ift.tt/25M6lRt
via IFTTT