Mutual Exclusion Principle for Multithreaded Web Crawlers
Journal Title: International Journal of Advanced Computer Science & Applications - Year 2012, Vol 3, Issue 9
Abstract
This paper describes mutual exclusion principle for multithreaded web crawlers. The existing web crawlers use data structures to hold frontier set in local address space. This space could be used to run more crawler threads for faster operation. All crawler threads fetch the URL to crawl from the centralized frontier. The mutual exclusion principle is used to provide access to frontier for each crawler thread in synchronized manner to avoid deadlock. The approach to utilize the waiting time on mutual exclusion lock in efficient manner has been discussed in detail.
Authors and Affiliations
Kartik Perisetla
Keywords
Related Articles
- EP ID EP108868
- DOI -
- Views 119
- Downloads 0
Online Incremental Rough Set Learning in Intelligent Traffic System
In the last few years, vehicle to vehicle communication (V2V) technology has been developed to improve the efficiency of traffic communication and road accident avoidance. In this paper, we have proposed a model for onli...
On the Codes over a Semilocal Finite Ring
In this paper, we study the structure of cyclic, quasi cyclic, constacyclic codes and their skew codes over the finite ring R. The Gray images of cyclic, quasi cyclic, skew cyclic, skew quasi cyclic and skew constacyclic...
Accuracy Performance Degradation in Image Classification Models due to Concept Drift
Big data is playing a significant role in the current computing revolution. Industries and organizations are utilizing their insights for Business Intelligence by using Deep Learning Networks (DLN). However, dynamic char...
The Construction of a Web-Based Learning Platform from the Perspective of Computer Support for Collaborative Design
The purpose of this study is to construct a web-based learning platform of Computer Support for Collaborative Design (CSCD) based on theories related to a constructivist learning environment model, mind mapping and...
New 3D Objects Retrieval Approach using Multi Agent Systems and Artificial Neural Network
Content-based 3D object retrieval is a substantial research area that has drawn a significant number of scientists in last couple of decades. Due to the rapid advancement of technology, 3D models are more and more access...