Effect of Feature Selection on the Accuracy of Machine Learning Model
Journal Title: International Journal of Multidisciplinary Research and Analysis - Year 2023, Vol 6, Issue 09
Abstract
In real life data science problems, it’s almost rare that all the features in the dataset are useful for building a model. In machine learning, feature selection is the process of selecting a subset of relevant features or attributes for constructing a model. Removing irrelevant and redundant features and, selecting relevant features will improve the accuracy of a machine learning model. Furthermore, adding unnecessary variables to a model increases the overall complexity of the model. Our experiment indicates that the accuracy of a classification model is highly affected by the process of feature selection. We train three algorithms (K-Nearest Neighbors, Decision Tree, Multi-layer Perceptron) by selecting all the features and we got accuracies 49%, 84% and 71% accordingly. After doing some feature selection without any logical changes in models code the accuracy scores jumped to 82%, 86% and 78% accordingly which is quite impressive.
Authors and Affiliations
Asst. Professor Mohammad Salim Hamdard, Asst. Professor Hedayatullah Lodin
Keywords
Related Articles
- EP ID EP721197
- DOI 10.47191/ijmra/v6-i9-66
- Views 62
- Downloads 0
Logistic Smooth Transition Autoregressive (LSTAR) and Exponential Smooth Transition Autoregressive (ESTAR) Methods in Predicting the Exchange Rate of Farmers in Lampung Province, Indonesia
There are many time series forecasting techniques, one of which is Smooth Transition Autoregressive (STAR). STAR is an extension of the autoregressive model for nonlinear time series data. The STAR model consists of the...
The Dynamics of Differential Impacts of COVID-19 on African Countries Compared to Other Parts of the World
Corona virus disease (COVID-19) is an infectious disease caused by a newly discovered corona virus. Most people who fall sick with COVID-19 experience mild to moderate symptoms and recover without special treatment. A nu...
Evaluating the Quality of Indonesian English Teachers’ Research Reports on the Guru Berbagi Platform
This study aimed to evaluate the quality of research-based activities reported by English as a Foreign Language (EFL) teachers on the Guru Berbagi Platform, using the Six-Trait writing method developed by Spandel and Sti...
An Overview of Quantitative Research Methods
The phrase "research" refers to seeking knowledge. It is a scholarly and systematic search for relevant knowledge on a specified subject. The Oxford Learner’s Dictionaries defines “Research” as “A careful study of a subj...
The Effect of Conflict and Termination of Employment on Employee's Work Spirit
This study aims to find out the conflict and termination of employment both partially and simultaneously have a significant effect on the morale of employees at PT. The benefits of Medan Technique and how much it affects...