A Cloud-Based Platform for Democratizing and Socializing the Benchmarking Process

Abstract

Performances evaluation, benchmarking and re-producibility represent significant aspects for evaluating the practical impact of scientific research outcomes in the Computer Science field. In spite of all the benefits (e.g., increasing visibility, boosting impact, improving the research quality) which can be obtained from conducting comprehensive and extensive experi-mental evaluations or providing reproducible software artifacts and detailed description of experimental setup, the required effort for achieving these goals remains prohibitive. In this article, we present the design and the implementation details of the Liquid Benchmarking platform as a social and cloud-based platform for democratizing and socializing the software benchmarking processes. Particularly, the platform facilitates the process of sharing the experimental artifacts (computing resources, datasets, software implementations, benchmarking tasks) as services where the end users can easily design, mashup, execute the experiments and visualize the experimental results with zero installation or configuration efforts. Moreover, the social features of the platform enable the users to share and provide feedback on the results of the executed experiments in a form that can guarantee a transparent scientific crediting process. Finally, we present four benchmarking case studies that have been realized via the Liquid Benchmarking platform in the following domains: XML compression techniques, graph indexing and querying techniques, string similarity join algorithms and reverse K nearest neighbors algorithms.

Authors and Affiliations

Fuad Bajaber, Amin Shafaat, Omar Batarfi, Radwa Elshawi, Abdulrahman Altalhi, Ahmed Barnawi, Sherif Sakr

Keywords

Related Articles

Towards Secure IoT Communication with Smart Contracts in a Blockchain Infrastructure

The Internet of Things (IoT) is undergoing rapid growth in the IT industry, but, it continues to be associated with several security and privacy concerns as a result of its massive scale, decentralised topology, and reso...

Direct Torque Control of Saturated Doubly-Fed Induction Generator using High Order Sliding Mode Controllers

The present work examines a direct torque control strategy using a high order sliding mode controllers of a doubly-fed induction generator (DFIG) incorporated in a wind energy conversion system and working in saturated s...

Modifications of Particle Swarm Optimization Techniques and Its Application on Stock Market: A Survey

Particle Swarm Optimization (PSO) has become popular choice for solving complex and intricate problems which are otherwise difficult to solve by traditional methods. The usage of the Particle Swarm Optimization technique...

Classification of Alzheimer Disease based on Normalized Hu Moment Invariants and Multiclassifier

There is a great benefit of Alzheimer disease (AD) classification for health care application. AD is the most common form of dementia. This paper presents a new methodology of invariant interest point descriptor for Alzh...

Networking Issues for Security and Privacy in Mobile Health Apps

It is highly important to give social care on the personal information that is collected by mobile health applications. There has been a rise in the mobile applications which are applied in almost all the departments and...

Download PDF file
  • EP ID EP90536
  • DOI 10.14569/IJACSA.2016.070268
  • Views 108
  • Downloads 0

How To Cite

Fuad Bajaber, Amin Shafaat, Omar Batarfi, Radwa Elshawi, Abdulrahman Altalhi, Ahmed Barnawi, Sherif Sakr (2016). A Cloud-Based Platform for Democratizing and Socializing the Benchmarking Process. International Journal of Advanced Computer Science & Applications, 7(2), 519-530. https://europub.co.uk/articles/-A-90536