An improved micropartitioning mechanism for map reduce using evaluation of cost functions
Journal Title: International Journal for Research in Applied Science and Engineering Technology (IJRASET) - Year 2015, Vol 3, Issue 2
Abstract
Due to the massive improvement in the usage of data’s in the real world, it becomes more burdens to handle and process it effectively. The Map reduce is the one of the more developed technology which is used to handle and process the big data/largest tasks. Map reduce is used to partition the task into sub partitions and map those partitions into the machines for processing. This process need to be done by the considering the minimization of cost and meeting deadline to improve the user satisfaction. In the previous work, CRESP approach is used which focus on allocating the map reduces tasks in the machine with the consideration of reduction of cost and deadline. However this method does not concentrate on the skew and stragglers problem which can occur while handling the largest task. In our work, we try improve the performance of resource allocation strategy by considering the skews and stragglers problem in mind. This problem of skews and stragglers are handled by introducing the partitioning mechanism. The partitioning mechanism will improve the failure of task allocation strategy.
Authors and Affiliations
Nithya. M, Damodharan. P
Keywords
Related Articles
- EP ID EP19610
- DOI -
- Views 247
- Downloads 4
Intelligent Speed Observing in Transportation system Using ARM 9
Radio Frequency Identification (RFID) has attracted considerable attentions in recent years for its broad applications and complements to the current GPS navigation system when GPS signals are not available But in pract...
Design and development of traffic light retiming using camera based traffic density estimation
As an instantaneous and range concept, “traffic density” was originally defined by looking at a snapshot of the traffic from an aerial camera along a stretch of freeway. The “density” is defined as the number of vehicle...
Effects of the Addition of Pistachio Shell Particles on the Properties of Polyurethane Matrix Composite
In this research, a composite material-based polyurethane matrix with natural resources is prepared via the casting method and the effects of the weight fractions (2.5-12.5) wt% of pistachio shell particles on the prope...
Implementation of Embedded System Based Face Recognition System
Face Recognition is the ability to detect and recognize a person by their facial characteristics. Face is a multidimensional and hence requires a lot of mathematical computations. Face recognition system is very essenti...
NANODENTISTRY- A Review
Nanotechnology is the manipulation of matter on the molecular and atomic levels. Nanotechnology has changed the treatment strategy in the field of dentistry and medicine. Nanotechnology has several applications in the f...