Improvement in Classification Algorithms through Model Stacking with the Consideration of their Correlation
Journal Title: International Journal of Advanced Computer Science & Applications - Year 2019, Vol 10, Issue 3
Abstract
In this research we analyzed the performance of some well-known classification algorithms in terms of their accuracy and proposed a methodology for model stacking on the basis of their correlation which improves the accuracy of these algorithms. We selected; Support Vector Machines (svm), Naïve Bayes (nb), k-Nearest Neighbors (knn), Generalized Linear Model (glm), Latent Discriminant Analysis (lda), gbm, Recursive Partitioning and Regression Trees (rpart), rda, Neural Networks (nnet) and Conditional Inference Trees (ctree) in our research and preformed analyses on three textual datasets of different sizes; Scopus 50,000 instances, IMDB Movie Reviews having 10,000 instances, Amazon Products Reviews having 1000 instances and Yelp dataset having 1000 instances. We used R-Studio for performing experiments. Results show that the performance of all algorithms increased at Meta level. Neural Networks achieved the best results with more than 25% improvement at Meta-Level and outperformed the other evaluated methods with an accuracy of 95.66%, and altogether our model gives far better results than individual algorithms’ performance.
Authors and Affiliations
Muhammad Azam, Dr. Tanvir Ahmed, Dr. M. Usman Hashmi, Rehan Ahmad, Abdul Manan, Fahad Sabah
Keywords
Related Articles
- EP ID EP499588
- DOI 10.14569/IJACSA.2019.0100360
- Views 97
- Downloads 0
NF-SAVO: Neuro-Fuzzy system for Arabic Video OCR
In this paper we propose a robust approach for text extraction and recognition from video clips which is called Neuro-Fuzzy system for Arabic Video OCR. In Arabic video text recognition, a number of noise components prov...
Heuristic Evaluation of Serious Game Application for Slow-reading Students
The findings of preliminary studies found that conventional approaches were still relevant but students showed weak and moderate interest and quickly lost focus rather than technology approaches such as serious games wer...
Usability of Government Websites
Usability of Government websites plays pivotal role in order to provide benefits and services to the citizens. This study presents a usability evaluation for investigating the Nielsen’s usability attributes in Government...
Towards No-Reference of Peak Signal to Noise Ratio
The aim of this work is to define a no-referenced perceptual image quality estimator applying the perceptual concepts of the Chromatic Induction Model The approach consists in comparing the received image, presumably deg...
A Practical Approach for Evaluating and Prioritizing Situational Factors in Global Software Project Development
There has been an enormous increase in globaliza-tion that has led to more cooperation and competition across boundaries. Software engineering, particularly distributed soft-ware development (DSD) and global software dev...