An improved micropartitioning mechanism for map reduce using evaluation of cost functions
Journal Title: International Journal for Research in Applied Science and Engineering Technology (IJRASET) - Year 2015, Vol 3, Issue 2
Abstract
Due to the massive improvement in the usage of data’s in the real world, it becomes more burdens to handle and process it effectively. The Map reduce is the one of the more developed technology which is used to handle and process the big data/largest tasks. Map reduce is used to partition the task into sub partitions and map those partitions into the machines for processing. This process need to be done by the considering the minimization of cost and meeting deadline to improve the user satisfaction. In the previous work, CRESP approach is used which focus on allocating the map reduces tasks in the machine with the consideration of reduction of cost and deadline. However this method does not concentrate on the skew and stragglers problem which can occur while handling the largest task. In our work, we try improve the performance of resource allocation strategy by considering the skews and stragglers problem in mind. This problem of skews and stragglers are handled by introducing the partitioning mechanism. The partitioning mechanism will improve the failure of task allocation strategy.
Authors and Affiliations
Nithya. M, Damodharan. P
Keywords
Related Articles
- EP ID EP19610
- DOI -
- Views 280
- Downloads 4
Nano materials filled Polymers for reducing the thermal Peak temperature in a vehicle
There is an increasing demand for fuel nowadays and it is soon expected that there will be an acute shortage in the fuel that we are using at present. Hence there is a need to optimize the fuel usage. Almost 10% of f...
Requirement Engineering and Creative Process in Video Game Industry
Requirement engineering process plays a significant role in video gaming industry. Basically it is process of gathering information from clients, analyzing the data (functional and non-functional) and formatting it into...
Detection And Analysis Of Ddos Attacks Using Machine Learning Techniques: A Literature Review
Distributed Denial of Service (DDoS) attacks is a serious threat to the network security. Servers of many companies have been the victims of such novel type of attacks. In a short span of time, these attacks from the mu...
High Density of Noise Removal Using FBD Filter
This research work has been done on data mining for noise type detection and filtering process to ample more effectiveness for removing the noise content in an image. In this article we have proposed a scheme of data mi...
Comparison of Vibration Performance of Modified Tuned Liquid Damper and Friction Damper
Structural response control with various forms of dampers have been a core area of study which was adopted to mitigate various natural hazards like wind and earthquake. Passive auxillary dynamic vibration absorbers have...