Mutual Exclusion Principle for Multithreaded Web Crawlers
Journal Title: International Journal of Advanced Computer Science & Applications - Year 2012, Vol 3, Issue 9
Abstract
This paper describes mutual exclusion principle for multithreaded web crawlers. The existing web crawlers use data structures to hold frontier set in local address space. This space could be used to run more crawler threads for faster operation. All crawler threads fetch the URL to crawl from the centralized frontier. The mutual exclusion principle is used to provide access to frontier for each crawler thread in synchronized manner to avoid deadlock. The approach to utilize the waiting time on mutual exclusion lock in efficient manner has been discussed in detail.
Authors and Affiliations
Kartik Perisetla
Keywords
Related Articles
- EP ID EP108868
- DOI -
- Views 116
- Downloads 0
Implementation of NOGIE and NOWGIE for Human Skin Detection
The Digital image processing is one of the most widely implemented fields worldwide. The most applied applications of digital image processing are facial recognition, finger print recognition, medical imaging, law enforc...
The SMH Algorithm : An Heuristic for Structural Matrix Computation in the Partial Least Square Path Modeling
The Structural equations modeling with latent’s variables (SEMLV) are a class of statistical methods for modeling the relationships between unobservable concepts called latent variables. In this type of model, each laten...
Performance Evaluation of Adaptive Virtual Machine Load Balancing Algorithm
The conception of Cloud computing has not only reshaped the field of distributed systems but also extend businesses potential. Load balancing is a core and challenging issue in Cloud Computing. How to use Cloud com...
Improved Appliance Coordination Scheme with Waiting Time in Smart Grids
Smart grids aim to merge the advances in communications and information technologies with traditional power grids. In smart grids, users can generate energy and sell it to the local utility supplier. The users can reduce...
Junction Point Detection and Identification of Broken Character in Touching Arabic Handwritten Text using Overlapping Set Theory
Touching characters are formed when two or more characters share the same space with each other. Therefore, segmentation of these touching character is very challenging research topic especially for handwritten Arabic de...