Holistic Evaluation Framework for Automated Bug Triage Systems: Integration of Developer Performance

Abstract

Bug Triage is an important aspect of Open Source Software Development. Automated Bug Triage system is essential to reduce the cost and effort incurred by manual Bug Triage. At present, the metrics that are available in the literature to evaluate the Automated Bug Triage System are only recommendation centric. These metrics address only the correctness and coverage of the Automated Bug Triage System. Thus, there is a need for user-centric evaluation of the Bug Triage System. The two types of metrics to evaluate the Automated Bug Triage System include Recommendation Metrics and User Metrics. There is a need to corroborate the results produced by the Recommendation Metrics with User Metrics. To this end, this paper furnishes a Holistic Evaluation Framework for Bug Triage System by integrating the developer performance into the evaluation framework. The Automated Bug Triage System is also to retrieve a set of developers for resolving a bug. Hence, this paper proposes Key Performance Indicators (KPI) for appraising a developer’s effectiveness in contribution towards the resolution of the bug. By applying the KPIs on the retrieved set of developers, the Bug Triage System can be evaluated quantitatively.

Authors and Affiliations

Dr. V. Akila, Dr. V. Govindasamy

Keywords

Related Articles

Improving TCP Throughput Using Modified Packet Reordering Technique (MPRT) Over Manets

At the beginning of development of network technology TCP transport agent were designed assuming that communication is using wired network, but recently there is huge demand and use of wireless networks for communication...

VHDL Design and FPGA Implementation of LDPC Decoder for High Data Rate

In this work, we present a FPGA design and implementation of a parallel architecture of a low complexity LDPC decoder for high data rate applications. The selected code is a regular LDPC code (3, 4). VHDL design and synt...

Dynamic Clustering for Information Retrieval from Big Data Depending on Compressed Files

The rapid growth in the database data led to origination a large amount of data. So, it is still a big problem to access this data for answering user queries. In this paper a novel approach for aggregating the required d...

Trust: A Requirement for Cloud Technology Adoption

Cloud computing is a recent model for enabling convenient, on-demand network access to a shared pool of configurable computing resources such as networks, servers, storage, applications, and services; that can be rapidly...

Industrial Internet of Things as a Challenge for Higher Education

This paper is aimed to examine the adoption of the Internet of Things (IoT) in industry (so-called Industrial Internet of Things, shortly IIoT) and the requirements for higher education in the times of the fourth industr...

Download PDF file
  • EP ID EP112333
  • DOI 10.14569/IJACSA.2016.070429
  • Views 101
  • Downloads 0

How To Cite

Dr. V. Akila, Dr. V. Govindasamy (2016). Holistic Evaluation Framework for Automated Bug Triage Systems: Integration of Developer Performance. International Journal of Advanced Computer Science & Applications, 7(4), 239-244. https://europub.co.uk/articles/-A-112333