Hadoop Map Reduce Job Scheduler Implementation and Analysis in Heterogeneous Environment
Journal Title: International Journal of Research in Computer and Communication Technology - Year 2015, Vol 4, Issue 3
Abstract
Hadoop MapReduce is one of the popular framework for BigData analytics. MapReduce cluster is shared among multiple users with heterogeneous workloads. When jobs are concurrently submitted to the cluster, resources are shared among them so system performance might be degrades. The issue here is that schedule the tasks and provide the fairness of resources to all jobs. Hadoop supports different schedulers than the default FIFO scheduler We started experiment on Hadoop FIFO, Fair and Capacity scheduler with heterogeneous workloads. Our aim is to compare the different job scheduler with heterogeneous workload and it is important to understand the task scheduler parameter, based on that we considered few parameter for the performance analysis.
Authors and Affiliations
Swathi Prabhu, Anisha P Rodrigues
Keywords
Related Articles
- EP ID EP28171
- DOI -
- Views 251
- Downloads 2
An Approach to Percolate Surplus Information Significances from OSN User Walls
As of Recent Years, Online Social Networks have transformed into a vital bit of step by step life for a few. One crucial issue in today user wall(s) is to give users the ability to control the messages posted in solitud...
Cooperative and Riskless Data Publishing in Cloud Computing
This paper explains. Proposing a flexible distributed storage integrity auditing mechanism, utilizing the homomorphic token and distributed erasurecoded data. The proposed design allows users to audit the cloud storag...
An Optimal and Secure Ranking Search Over out Sourced Cloud Databases
Considering top k multi keywords from the out sourced information files is still an intriguing examination issue in light of the fact that out sourced information over cloud can be scrambled for secrecy .In this pape...
A Formal Study of Cryptanalysis on Ciphers
Cryptanalysis is co-study of cryptography. A cipher is said to be successful cipher if it design resists all cipher attacks. Cryptanalyis are two-fold. One way is a benign activity where cryptanalysis is performed to...
Loading Balance of Distribution Feeders With Loop Power Controllers In Centralised And PV Based Decentralised Power Generation Systems
For effective operation of distribution system , balanced loading on distribution feeders is very important. It mitigates power flow overloading and reduces power losses. In this paper, LOOP POWER CONTROLLER(LPC) is...