Effect of Feature Selection on the Accuracy of Machine Learning Model

Abstract

In real life data science problems, it’s almost rare that all the features in the dataset are useful for building a model. In machine learning, feature selection is the process of selecting a subset of relevant features or attributes for constructing a model. Removing irrelevant and redundant features and, selecting relevant features will improve the accuracy of a machine learning model. Furthermore, adding unnecessary variables to a model increases the overall complexity of the model. Our experiment indicates that the accuracy of a classification model is highly affected by the process of feature selection. We train three algorithms (K-Nearest Neighbors, Decision Tree, Multi-layer Perceptron) by selecting all the features and we got accuracies 49%, 84% and 71% accordingly. After doing some feature selection without any logical changes in models code the accuracy scores jumped to 82%, 86% and 78% accordingly which is quite impressive.

Authors and Affiliations

Asst. Professor Mohammad Salim Hamdard, Asst. Professor Hedayatullah Lodin

Keywords

Related Articles

The Lived Experiences of Paternal Parents as Primary Caregivers in Raising Children with Developmental Disabilities

This study delves into the lived experiences of paternal parents raising children with developmental disabilities within the City of Cabuyao Laguna. It aims to comprehend their unique challenges, explore how the distress...

Effect of Massed Practice and Distributed Practice Methods on the Accuracy of Backhand Short Service and Forehand Short Service in Badminton Games for the Students of Victory Badminton School Yogyakarta

This research aims to determine: (1) the effect of the massed practice and distributed practice methods on the accuracy of backhand short service in the badminton game of the students of Victory Badminton School Yogyakar...

Leadership as a Dynamic and Multifaceted Process: A Phenomenological Study on Non-BEED School Heads' View on Leadership Styles in Elementary Schools

This study investigates the leadership styles of Non-BEED school heads managing elementary schools in the Division of Ilocos Sur, employing a qualitative phenomenological research design. Through in-depth interviews with...

Effects of Work Flexibility and Compensation on Employee Performance through Job Satisfaction: Evidence from Shopee- Food East Java, Indonesia

This study aims at analyzing the effect of work flexibility and compensation on partner performance through job satisfaction as a mediation. The population of this study was ShopeeFood driver partners in Malang Raya, Ea...

Review on Effects of Organophosphate Pesticides in Human Health and Way to Mitigates its Harmful Impacts

Due to increasing the human population day by day, for the control of the human population, needs to increase the agricultural productivity, for agricultural production is increasing we use pesticide. Pesticides not only...

Download PDF file
  • EP ID EP721197
  • DOI 10.47191/ijmra/v6-i9-66
  • Views 48
  • Downloads 0

How To Cite

Asst. Professor Mohammad Salim Hamdard, Asst. Professor Hedayatullah Lodin (2023). Effect of Feature Selection on the Accuracy of Machine Learning Model. International Journal of Multidisciplinary Research and Analysis, 6(09), -. https://europub.co.uk/articles/-A-721197