User Interface Bug Classification Model Using ML and NLP Techniques: A Comparative Performance Analysis of ML Models
Journal Title: International Journal of Experimental Research and Review - Year 2024, Vol 45, Issue 9
Abstract
Analyzing user interface (UI) bugs is an important step taken by testers and developers to assess the usability of the software product. UI bug classification helps in understanding the nature and cause of software failures. Manually classifying thousands of bugs is an inefficient and tedious job for both testers and developers. Objective of this research is to develop a classification model for the User Interface (UI) related bugs using supervised Machine Learning (ML) algorithms and Natural Language Processing (NLP) techniques. Also, to assess the effect of different sampling and feature vectorization techniques on the performance of ML algorithms. Classification is based upon ‘Summary’ feature of the bug report and utilizes six classifiers i.e., Gaussian Naïve Bayes (GNB), Multinomial Naïve Bayes (MNB), Logistic Regression (LR), Support Vector Machines (SVM), Random Forest (RF) and Gradient Boosting (GB). Dataset obtained is vectored using two vectorization techniques of NLP i.e., Bag of Words (BoW) and Term Frequency-Inverse Document Frequency (TF-IDF). ML models are trained after vectorization and data balancing. The models ' hyperparameter tuning (HT) has also been done using the grid search approach to improve their efficacy. This work provides a comparative performance analysis of ML techniques using Accuracy, Precision, Recall and F1 Score. Performance results showed that a UI bug classification model can be built by training a tuned SVM classifier using TF-IDF and SMOTE (Synthetic Minority Oversampling Techniques). SVM classifier provided the highest performance measure with Accuracy: 0.88, Precision: 0.86, Recall: 0.85 and F1: 0.85. Result also inferred that the performance of ML algorithms with TF-IDF is better than BoW in most cases. This work provides classification of bugs that are related to only the user interface. Also, the effect of two different feature extraction techniques and sampling techniques on algorithms were analyzed, adding novelty to the research work.
Authors and Affiliations
Sara Khan, Saurabh Pal
Keywords
Related Articles
- EP ID EP752538
- DOI 10.52756/ijerr.2024.v45spl.005
- Views 30
- Downloads 1
Understanding the response of phytoplankton to the cyclonic event Sitrang A case study in the Hooghly estuary of Sundarban Bay of Bengal region
The study aims to investigate the impact of tropical cyclone Sitrang on the phytoplankton community and water quality parameters at estuarine zone of Hooghly River near Namkhana region of Sundarban. Focusing on the respo...
Effect of temperature variation on disease proliferation of common fishes in perspective of climate change
Meteorological variations and global warming frequently produce serious losses in fishing stocks and fish production. The rate of fish production depends on climatic variation and demand more prudent management of natura...
Analytical Method Development and Validation of RP-HPLC Method for Estimation of Pazopanib Drug Sample and It’s Dosage Form
The study focuses on developing and verifying a cost-effective Reverse Phase High-Performance Liquid Chromatography (RP-HPLC) technique for quantifying Pazopanib HCl in both bulk and tablet forms. The study aims to devel...
Anti-cancer Properties of Dietary Supplement CELNORM against Colon and Lung Cancer: An in vitro preliminary study
Cancer is a complex disease characterized by a cascade of events that culminate in the accumulation of several genetic alterations. Because of the high incidence and mortality rate, scientists began seeking novel medicat...
Design, Performance and Economic evaluation of a 4kW Grid-interactive Solar PV Rooftop in Odisha using Pvsyst
The global decline of fossil fuels has required the development of alternative energy sources to satisfy the electricity demand. This article assesses and inaugurated the viability of grid-interactive photovoltaic system...