Classifying and Segmenting Classical and Modern Standard Arabic using Minimum Cross-Entropy
Journal Title: International Journal of Advanced Computer Science & Applications - Year 2017, Vol 8, Issue 4
Abstract
Text classification is the process of assigning a text or a document to various predefined classes or categories to reflect their contents. With the rapid growth of Arabic text on the Web, studies that address the problems of classification and segmentation of the Arabic language are limited compared to other languages, most of which implement word-based and feature extraction algorithms. This paper adopts a PPM character-based compression scheme to classify and segment Classical Arabic (CA) and Modern Standard Arabic (MSA) texts. An initial experiment using the PPM classification method on samples of text resulted in an accuracy of 95.5%, an average precision of 0.958, an average recall of 0.955 and an average F-measure of 0.954, using the concept of minimum cross-entropy. PPM-based classification experiments on standard Arabic corpora showed that they contained different types of text (CA or MSA), or a mixture of the both (CA and MSA). Further experiments with the same corpora showed that a more accurate picture of the contents of the corpora was possible using the PPM-based segmentation method. Tag-based compression experiments (using tags produced by parts-of-speech Arabic taggers) also showed that the quality of the tagging (as measured by compression quality) is significantly affected when tagging either CA and MSA text. The conclusion is that NLP applications (such as taggers) should treat these texts separately and use different training data for each or process them differently.
Authors and Affiliations
Ibrahim S Alkhazi, William J. Teahan
Keywords
Related Articles
- EP ID EP258381
- DOI 10.14569/IJACSA.2017.080456
- Views 114
- Downloads 0
Bound Model of Clustering and Classification (BMCC) for Proficient Performance Prediction of Didactical Outcomes of Students
In this era of High-Performance High computing systems, Large-scale Data Mining methodologies in the field of education have become a convenience to discover and extract knowledge from Databased of their respective educa...
Modeling and Simulation Analysis of Power Frequency Electric Field of UHV AC Transmission Line
In order to study the power frequency electric field of UHV AC transmission lines, this paper which models and calculates using boundary element method simulates various factors influencing the distribution of the power...
Communication Disconnection Prevention System by Bandwidth Depression-Type Traffic Measurement in a Multi-Robot Environment using an LCX Network
In this paper, we propose and develop a method for determining the transmission amount of each mobile robot connected to a network constructed with a leaky coaxial cable (LCX) by using broadcast packets. Tele-operation o...
New Framework for Improving Big Data Analysis Using Mobile Agent
The rising number of applications serving millions of users and dealing with terabytes of data need to a faster processing paradigms. Recently, there is growing enthusiasm for the notion of big data analysis. Big data an...
Healthcare Providers’ Perceptions towards Health Information Applications at King Abdul-Aziz Medical City, Saudi Arabia