Map-Reduce Synchronized and Comparative Queue Capacity Scheduler in Hadoop for Extensive Data
Journal Title: IOSR Journals (IOSR Journal of Computer Engineering) - Year 2015, Vol 17, Issue 6
Abstract
Abstract: Map-Reduce is drawing attention of both industrial and academic for processing of big data. In this paper, we have mainly focused on core scheduler of Hadoop i.e. Capacity Scheduler. The scheduler assigns tasks to the resources. Capacity Scheduler shares various resources in a cluster between concurrent jobs. We have performed various experiments based on Map-Reduce benchmark applications i.e. TestDFSIO, Pi, Word Count for analyzing and performance enhancement of capacity scheduler in terms of both execution time as wellas capacity. We have proposed a method Synchronized and Comparative Queue Capacity Scheduler (SCQ) that makes better resource utilization which reflects enhanced performance in terms of execution time, throughput and average IO rate.
Authors and Affiliations
Sukhmani Goraya , Vikas Khullar
Keywords
Related Articles
- EP ID EP159114
- DOI -
- Views 77
- Downloads 0
Comparative Study of Watershed and K means Clustering in Brain Tumour Identification
The core objective of our paper is to compare K means clustering and watershed algorithm using MATLAB tool. The comparison is based on their performance, accuracy, and its geometrical dimension. A Brain tumour is one of...
Hand Gesture Recognition System for Creating & Controlling Media Player using Mat Lab Tool
Abstract: In this paper we have discussed a dynamic hand gesture recognition system for creating and controlling the media player. The system is made possible by using the concepts of threshold and color detection. The...
Segmentation of Tumor Region from Brain Mri Images Using Fuzzy C-Means Clustering And Seeded Region Growing
Abstract: The detection of brain tumor is one of the most challenging tasks in the field of medical image processing, since brain images are very complicated and tumors can be analyzed efficiently only by the expert radi...
Empirical Evaluation of machine learning techniques for software effort estimation
Accurate estimation of software development effort is a very difficult job.Both under estimation as well as over estimation can lead to serious consequences. So its very important to find a technique which can yiel...
Comparative Analysis of Various Grid Based SchedulingAlgorithms
Abstract : Grid computing provides access to heterogeneous resources which are distributed geographicallywhich makes resource scheduling a complex problem. Hence, scheduling algorithms are necessary whichallocate j...