Log Mining Based on Hadoop’s Map and Reduce Technique
Journal Title: International Journal on Computer Science and Engineering - Year 2013, Vol 5, Issue 4
Abstract
In the world of cloud and grid computing Virtual Database Technology (VDB) is one of the effective solutions for integration of data from heterogeneous sources. Hadoop is a large-scale distributed batch processing infrastructure and also designed to efficiently distribute large amounts of work across a set of machines. Hadoop is an implementation of Map Reduce. This paper proposes application for inauguration of new branch of pizza in particular area according to hits from customers. In this paper we will take the log files for the particular website which will be stored on web mining server. These data will be passed on to the cloud server for region wise distribution on the virtual servers. Mapping and reduction will be done on these region wise data. The final output is then sent back to the server and client. This paper utilizes the parallel and distributed processing capability of Hadoop Map Reduce for handling heterogeneous query execution on large datasets. So Virtual Database Engine built on top of this will result in effective high performance distributed data integration
Authors and Affiliations
Anuja Pandit , Amruta Deshpande , Prajakta Karmarkar
Keywords
Related Articles
- EP ID EP146249
- DOI -
- Views 84
- Downloads 0
Analysis and diagnosis of the different defects of asynchronous machines by vibration analysis
The electric machines and particularly the asynchronous machines act an important role nowadays in all industrial applications. To assure the availability and the safety of working of these is a fundamental job. It is th...
Impact Analysis of Recent DDoS Attacks
In the present era Internet has changed the way of traditional essential services such as banking, transportation, power, health, and defence being operated. These operations are being replaced by cheaper, more efficient...
TEMPORAL SEQUENTIAL PATTERN IN DATA MINING TASKS
The rapid increase in the data available leads to the difficulty for analyzing those data and different types of frameworks are required for unearthing useful knowledge that can be extracted from such databases. The fiel...
Prediction of Rainfall Using Backpropagation Neural Network Model
Agriculture is the predominant occupation in India, accounting for about 52% of employment. The Irrigation acilities are nadequate, as revealed by the fact that only 52.6% of the land was irrigated in 2009–10 which res...
IMAGE SEGMENTATION BY USING EDGE DETECTION
In this paper, we present methods for edge segmentation of atellite images; we used seven techniques for this category; obel operator technique, Prewitt technique, Kiresh technique, Laplacian technique, Canny technique...