Text Clustering using Ensemble Clustering Technique
Journal Title: International Journal of Advanced Computer Science & Applications - Year 2018, Vol 9, Issue 9
Abstract
Clustering is being used in different fields of research, including data mining, taxonomy, document retrieval, image segmentation, pattern classification. Text clustering is a technique through which text/ documents are divided into a particular number of groups, so that text within each group is related in contents. In this paper, the idea of ensemble text clustering of majority voting is defined. For this purpose, different clustering methods such as fuzzy c-means, k-means, agglomerative, Gustafson Kessel and k-medoid are used. After performing the pre-processing of the documents, inverse document frequency (IDF) has been achieved by the provided dataset. The achieved IDF is considered as input to the clustering algorithms. Dunn Index and Davies Bouldin Index have been calculated which are applied to analyze the usefulness of the proposed ensemble clustering. In this work, a dataset "Textclus" which contains four different classes, history, education, politician and art as a text is applied. Additionally, another dataset "20newsgroups" is also applied for analysis. The clustering quality measures have also been calculated from the proposed ensemble clustering results. The attained results show that the proposed ensemble clustering outperforms the other state of the art clustering techniques.
Authors and Affiliations
Muhammad Mateen, Junhao Wen, Mehdi Hassan, Sun Song
Keywords
Related Articles
- EP ID EP393846
- DOI 10.14569/IJACSA.2018.090925
- Views 82
- Downloads 0
A Comprehensive IoT Attacks Survey based on a Building-blocked Reference Model
Internet of Things (IoT) has not yet reached a distinctive definition. A generic understanding of IoT is that it offers numerous services in many domains, utilizing conventional internet infrastructure by enabling differ...
Edge Detection in Satellite Image Using Cellular Neural Network
The present paper proposes a novel approach for edge detection in satellite images based on cellular neural networks. CNN based edge detector in used conjunction with image enhancement and noise removal techniques, in or...
Analysis on Existing Basic Slas and Green Slas to Define New Sustainable Green SLA
Nowadays, most of the IT (Information Technology) and ICT (Information and Communication Technology) industries are practicing sustainability under green computing hoods. Users/Customers are also moving towards a new sus...
Learning on High Frequency Stock Market Data Using Misclassified Instances in Ensemble
Learning on non-stationary distribution has been shown to be a very challenging problem in machine learning and data mining, because the joint probability distribution between the data and classes changes over time. Many...
Assessment for the Model Predicting of the Cognitive and Language Ability in the Mild Dementia by the Method of Data-Mining Technique
Assessments of cognitive and verbal functions are widely used as screening tests to detect early dementia. This study developed an early dementia prediction model for Korean elderly based on random forest algorithm and c...