Hadoop Map Reduce Job Scheduler Implementation and Analysis in Heterogeneous Environment
Journal Title: International Journal of Research in Computer and Communication Technology - Year 2015, Vol 4, Issue 3
Abstract
Hadoop MapReduce is one of the popular framework for BigData analytics. MapReduce cluster is shared among multiple users with heterogeneous workloads. When jobs are concurrently submitted to the cluster, resources are shared among them so system performance might be degrades. The issue here is that schedule the tasks and provide the fairness of resources to all jobs. Hadoop supports different schedulers than the default FIFO scheduler We started experiment on Hadoop FIFO, Fair and Capacity scheduler with heterogeneous workloads. Our aim is to compare the different job scheduler with heterogeneous workload and it is important to understand the task scheduler parameter, based on that we considered few parameter for the performance analysis.
Authors and Affiliations
Swathi Prabhu, Anisha P Rodrigues
Keywords
Related Articles
- EP ID EP28171
- DOI -
- Views 253
- Downloads 2
Co-Operative Riskless Data Publishing Using Cpdp In Multi Colud
Cloud computing is a new and fast growing technology that offers an innovative, efficient and scalable business model for organizations to adopt various information technology (IT) resources i.e. software, hardware,...
LD: A Leak Detector Mechanism For Finding Misbehaving Nodes In MANETS
MANET is a collection of mobile nodes equipped with both a wireless-transmitter and receiver that communicate with each other via bi-directional wireless links either directly or indirectly. Due to the open medium an...
Optimal Price Setting For Video Stream Redistribution in Mobile Networks
Now a days mobile device became a necessity for the people and with this 3G network service consumer can watch he video program by subscribing data plans from the various service providers. Due to heavy use of mobile...
A Survey On Multi_Criteria Offloading Decision For Mobile Cloud Computing In Heterogeneous Network
Mobile cloud computing is an technique where mobile applications be built, motorized by means of cloud computing..Wireless network include incomplete resources similar to battery life,storage space capacity,system ba...
A Novel Image Classification System Based on Evidence Probabilistic Transformation
This paper uses the evidence probabilistic transformation (EPT) for unsupervised image retrieval framework. The main advantages with EPT are substantially resolves the "take-them-or-leave-them" problem, gives a firme...