Hadoop Map Reduce Job Scheduler Implementation and Analysis in Heterogeneous Environment
Journal Title: International Journal of Research in Computer and Communication Technology - Year 2015, Vol 4, Issue 3
Abstract
Hadoop MapReduce is one of the popular framework for BigData analytics. MapReduce cluster is shared among multiple users with heterogeneous workloads. When jobs are concurrently submitted to the cluster, resources are shared among them so system performance might be degrades. The issue here is that schedule the tasks and provide the fairness of resources to all jobs. Hadoop supports different schedulers than the default FIFO scheduler We started experiment on Hadoop FIFO, Fair and Capacity scheduler with heterogeneous workloads. Our aim is to compare the different job scheduler with heterogeneous workload and it is important to understand the task scheduler parameter, based on that we considered few parameter for the performance analysis.
Authors and Affiliations
Swathi Prabhu, Anisha P Rodrigues
Keywords
Related Articles
- EP ID EP28171
- DOI -
- Views 237
- Downloads 2
Effective R-cube Algorithm for Deriving Relevant Information on the Web
The analysis of user search goals can be very useful in improving search engine relevance and user experience. A novel approach to infer user search goals by examines search engine query logs. A framework to determin...
The Goals of E- Learning and Distance Learning Towards The Educational Development of Nigerian Public Service
The goals of e – learning and distance learning towards the educational development of Nigerian Public Service cannot be overemphasized, hence the need to create more awareness on how to acquire higher academic knowl...
Embedding of Data in Motion Vectors by Using Steganography Concept
This paper applies steganography algorithm in videos. In the proposed method, we take GOP techniques which are nothing but video algorithms so we use advantage of prediction types of MPEG bit streams to embed waterma...
A Survey on Password Attack Resist Tools
Passwords are the key to all digital secrets. Passwords remain the most widely used authentication method despite their well-known security weaknesses. Text password is the most popular form of user authentication on...
Design of Energy Efficient Logic Using Adiabatic Technique
With the adiabatic switching approach, the circuit energies are conserved rather than dissipated as heat. Depending on the application and the system requirements, this approach can be used to reduce the power dissip...