Dynamic Programming Method Applied in Vietnamese Word Segmentation Based on Mutual Information among Syllables
Journal Title: International Journal of Advanced Research in Artificial Intelligence(IJARAI) - Year 2014, Vol 3, Issue 9
Abstract
Vietnamese word segmentation is an important step in Vietnamese natural language processing such as text categorization, text summary, and automated machine translation. The problem with Vietnamese word segmentation is complicated because Vietnamese words are not always separated by a space. One word can include one or more syllables depending on the context. This paper proposes a method for Vietnamese word segmentation based on the mutual information among the syllables combined with dynamic programming. With this method, we can achieve an accuracy rate of about 90% with a raw text corpus.
Authors and Affiliations
Nguyen Uyen, Tran Sang
Keywords
Related Articles
- EP ID EP147576
- DOI 10.14569/IJARAI.2014.030904
- Views 133
- Downloads 0
Rice Crop Field Monitoring System with Radio Controlled Helicopter Based Near Infrared Cameras Through Nitrogen Content Estimation and Its Distribution Monitoring
Rice crop field monitoring system with radio controlled helicopter based near infrared cameras is proposed together with nitrogen content estimation method for monitoring its distribution in the field in concern. T...
Temperature Control System Using Fuzzy Logic Technique
Fuzzy logic technique is an innovative technology used in designing solutions for multi-parameter and non-linear control models for the definition of a control strategy. As a result, it delivers solutions faster th...
Evaluating Sentiment Analysis Methods and Identifying Scope of Negation in Newspaper Articles
Automatic detection of linguistic negation in free text is a demanding need for many text processing applications including Sentiment Analysis. Our system uses online news archives from two different resources name...
Method for Vigor Diagnosis of Tea Trees based on Nitrogen Content in Tealeaves Relating to NDVI
Method for vigor diagnosis of tea trees based on nitrogen content in tealeaves relating to NDVI is proposed. In the proposed method, NIR camera images of tealeaves are used for estimation of nitrogen content in tea...
Human Lips-Contour Recognition and Tracing
Human-lip detection is an important criterion for many automated modern system in present day. Like computerized speech reading, face recognition etc. system can work more precisely if human-lip can detect accurate...