Effect of Feature Selection on the Accuracy of Machine Learning Model
Journal Title: International Journal of Multidisciplinary Research and Analysis - Year 2023, Vol 6, Issue 09
Abstract
In real life data science problems, it’s almost rare that all the features in the dataset are useful for building a model. In machine learning, feature selection is the process of selecting a subset of relevant features or attributes for constructing a model. Removing irrelevant and redundant features and, selecting relevant features will improve the accuracy of a machine learning model. Furthermore, adding unnecessary variables to a model increases the overall complexity of the model. Our experiment indicates that the accuracy of a classification model is highly affected by the process of feature selection. We train three algorithms (K-Nearest Neighbors, Decision Tree, Multi-layer Perceptron) by selecting all the features and we got accuracies 49%, 84% and 71% accordingly. After doing some feature selection without any logical changes in models code the accuracy scores jumped to 82%, 86% and 78% accordingly which is quite impressive.
Authors and Affiliations
Asst. Professor Mohammad Salim Hamdard, Asst. Professor Hedayatullah Lodin
Keywords
Related Articles
- EP ID EP721197
- DOI 10.47191/ijmra/v6-i9-66
- Views 18
- Downloads 0
Productivity of Sweet Potato (Ipomoea Batatas (L.) Lamb.) Crossed Between Antin 1 and Beta 2 Accessions
The sweet potato is an important food source in the world because, in addition to carbohydrates, it contains several vitamins, minerals, β-carotene and anthocyanins. The presence of self-incompatibility causes high genet...
To go or not to go: Role of Online Reviews towards Customer Dining Intention
The objective of this study is to investigate the role of online reviews towards customer dining intention in casual dining restaurants. Specifically, this study sought to answer the questions (1) how does online reviews...
Nature in Philippine Folktales
Nature allows human beings to become stewards and to interface with animals. By acting as the cornerstone, human beings create meanings to their existence through their experiences with animals and other elements of natu...
The Influence of Principal Leadership Behavior and Work Environment on Teaching Satisfaction of High School Teachers
This study aimed to determine the effect of the principal's leadership behavior and work environment on teacher teaching satisfaction at Teladan Private Senior High School Pematang Siantar. The problems discussed in this...
Evaluation from the Perspective of Standardized Tests (Pisa) at the Pre-University Level of the Dominican Republic
The Dominican Republic faces great challenges in pre-university education and one of them is the evaluation culture. Evaluation as a systemic process is an added value to educational quality to a large extent, to its hum...