Mutual Exclusion Principle for Multithreaded Web Crawlers
Journal Title: International Journal of Advanced Computer Science & Applications - Year 2012, Vol 3, Issue 9
Abstract
This paper describes mutual exclusion principle for multithreaded web crawlers. The existing web crawlers use data structures to hold frontier set in local address space. This space could be used to run more crawler threads for faster operation. All crawler threads fetch the URL to crawl from the centralized frontier. The mutual exclusion principle is used to provide access to frontier for each crawler thread in synchronized manner to avoid deadlock. The approach to utilize the waiting time on mutual exclusion lock in efficient manner has been discussed in detail.
Authors and Affiliations
Kartik Perisetla
Keywords
Related Articles
- EP ID EP108868
- DOI -
- Views 104
- Downloads 0
A Smartwatch Centric Social Networking Application for Alzheimer People
In recent years, people are increasingly interacting with an overwhelming of devices especially wearable devices. These later have initiated new ways in human connections with the world. The basic concept of these device...
Java Based Computer Algorithms for the Solution of a Business Mathematics Model
A novel approach is proposed as a framework for working out uncertainties associated with decisions between the choices of leasing and procurement of capital assets in a manufacturing industry. The mathematical concept o...
A Mobile Robot Teleoperation System with a Wireless Communication Infrastructure using a Leaky Coaxial Cable based on TCP/IP
In this study, we propose and develop a wireless teleoperation system for mobile robots using a leaky coaxial cable (LCX) with a wireless communication infrastructure. In closed spaces resulting from disasters, some prob...
An Enhencment Medical Image Compression Algorithm Based on Neural Network
The main objective of medical image compression is to attain the best possible fidelity for an available communication and storage [6], in order to preserve the information contained in the image and does not have an err...
Blockchain Traffic Offence Demerit Points Smart Contracts: Proof of Work
In Malaysia, a new regulation of traffic offences demerit points has been over a debate. Therefore, a blockchain model is formulated to solve this issue. It serves a purpose to be a Proof of Work (PoW) of a blockchain sy...