Chinese text chunking using lexicalized HMMs Export

@inproceedings{citeulike:1165458, abstract = {This paper presents a lexicalized HMM-based approach to Chinese text chunking. To tackle the problem of unknown words, we formalize Chinese text chunking as a tagging task on a sequence of known words. To do this, we employ the uniformly lexicalized HMMs and develop a lattice-based tagger to assign each known word a proper hybrid tag, which involves four types of information: word boundary, POS, chunk boundary and chunk type. In comparison with most previous approaches, our approach is able to integrate different features such as part-of-speech information, chunk-internal cues and contextual information for text chunking under the framework of HMMs. As a result, the performance of the system can be improved without losing its efficiency in training and tagging. Our preliminary experiments on the PolyU Shallow Treebank show that the use of lexicalization technique can substantially improve the performance of a HMM-based chunking system.}, author = {Fu, Guo-Hong and Xu, Rui-Feng and Luke, Kang-Kwong and Lu, Qin}, citeulike-article-id = {1165458}, citeulike-linkout-0 = {http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1526911}, journal = {Machine Learning and Cybernetics, 2005. Proceedings of 2005 International Conference on}, keywords = {chinease, chunking, hmm, non-english}, pages = {7--12 Vol. 1}, posted-at = {2007-03-15 13:53:01}, priority = {2}, title = {Chinese text chunking using lexicalized HMMs}, url = {http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1526911}, volume = {1}, year = {2005} }

TY - CONF ID - citeulike:1165458 L3 - citeulike-article-id:1165458 N2 - This paper presents a lexicalized HMM-based approach to Chinese text chunking. To tackle the problem of unknown words, we formalize Chinese text chunking as a tagging task on a sequence of known words. To do this, we employ the uniformly lexicalized HMMs and develop a lattice-based tagger to assign each known word a proper hybrid tag, which involves four types of information: word boundary, POS, chunk boundary and chunk type. In comparison with most previous approaches, our approach is able to integrate different features such as part-of-speech information, chunk-internal cues and contextual information for text chunking under the framework of HMMs. As a result, the performance of the system can be improved without losing its efficiency in training and tagging. Our preliminary experiments on the PolyU Shallow Treebank show that the use of lexicalization technique can substantially improve the performance of a HMM-based chunking system. JF - Machine Learning and Cybernetics, 2005. Proceedings of 2005 International Conference on EP - 12 Vol. 1 TI - Chinese text chunking using lexicalized HMMs VL - 1 SP - 7 KW - chinease KW - chunking KW - hmm KW - non-english AU - Fu, Guo-Hong AU - Xu, Rui-Feng AU - Luke, Kang-Kwong AU - Lu, Qin PY - 2005/// UR - http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1526911 ER -