A Cloud-Based Platform for Democratizing and Socializing the Benchmarking Process
Journal Title: International Journal of Advanced Computer Science & Applications - Year 2016, Vol 7, Issue 2
Abstract
Performances evaluation, benchmarking and re-producibility represent significant aspects for evaluating the practical impact of scientific research outcomes in the Computer Science field. In spite of all the benefits (e.g., increasing visibility, boosting impact, improving the research quality) which can be obtained from conducting comprehensive and extensive experi-mental evaluations or providing reproducible software artifacts and detailed description of experimental setup, the required effort for achieving these goals remains prohibitive. In this article, we present the design and the implementation details of the Liquid Benchmarking platform as a social and cloud-based platform for democratizing and socializing the software benchmarking processes. Particularly, the platform facilitates the process of sharing the experimental artifacts (computing resources, datasets, software implementations, benchmarking tasks) as services where the end users can easily design, mashup, execute the experiments and visualize the experimental results with zero installation or configuration efforts. Moreover, the social features of the platform enable the users to share and provide feedback on the results of the executed experiments in a form that can guarantee a transparent scientific crediting process. Finally, we present four benchmarking case studies that have been realized via the Liquid Benchmarking platform in the following domains: XML compression techniques, graph indexing and querying techniques, string similarity join algorithms and reverse K nearest neighbors algorithms.
Authors and Affiliations
Fuad Bajaber, Amin Shafaat, Omar Batarfi, Radwa Elshawi, Abdulrahman Altalhi, Ahmed Barnawi, Sherif Sakr
Keywords
Related Articles
- EP ID EP90536
- DOI 10.14569/IJACSA.2016.070268
- Views 85
- Downloads 0
Towards Agile Implementation of Test Maturity Model Integration (TMMI) Level 2 using Scrum Practices
the software industry has invested the substantial effort to improve the quality of its products like ISO, CMMI and TMMI. Although applying of TMMI maturity criteria has a positive impact on product quality, test enginee...
An Efficient Method for Breast Mass Segmentation and Classification in Mammographic Images
According to the World Health Organization, breast cancer is the main cause of cancer death among women in the world. Until now, there are no effective ways of preventing this disease. Thus, early screening and detection...
Assessment and Comparison of Fuzzy Based Test Suite Prioritization Method for GUI Based Software
The testing of event driven software has significant role to improve overall quality of software. Due to event driven nature of GUI based software many test cases are generated and it is difficult to identify test cases...
A New Application Programming Interface and a Fortran-like Modeling Language for Evaluating Functions and Specifying Optimization Problems at Runtime
A new application programming interface for evaluating functions and specifying optimization problems at runtime has been developed. The new interface, named FEFAR, uses a simple language named LEFAR. Compared with...
Developing a New Hybrid Cipher Algorithm using DNA and RC4
This paper proposes a new hybrid security algorithm called RC4-DNA-Alg. It combines the symmetric stream cipher RC4 algorithm with DNA-indexing algorithm to provide secured data hiding with high complexity inside stegano...