Faster and Resourceful Multi-core Web Crawling
Journal Title: UNKNOWN - Year 2012, Vol 1, Issue 2
Abstract
Due to massive growth of World Wide Web, search engines have become crucial tools for navigation of web pages. In order to provide fast and powerful search facility, search engine maintains indexes for documents and its contents on the web by downloading web pages for processing in iterative manner. Web indexes are created and managed by web crawlers which work as a module of search engines and traverse the web in systematic manner for indexing its contents. A web crawling is a process which fetches data from various servers. It is a time taking process as it gathers data from various servers. Hence, to speed up the searching process in search engines the crawling should be fast enough. The aim of the proposed system is to enhance the speed of crawling process and CPU usage by use of multi-core concept.
Authors and Affiliations
Keywords
Related Articles
- EP ID EP333747
- DOI -
- Views 220
- Downloads 0
The Effects of the Agricultural Policies on the Relative Privileges of Meat Production in Egypt
The most important results that the study has concluded are restricted to the highly relative privilege which Egypt has in producing the poultry meat estimated about 78.9% This is followed by the relative privilege which...
Improvement of Convection Heat Transfer by Using Porous Media and Nanofluid: Review
Porous media has two specifications: First its dissipation area is greater than the conventional fins that enhance heat convection. Second the irregular motion of the fluid flow around the individual beads mixes the flui...
Performance Evaluation of Power Saving Routing Protocol
There is tremendous increase in the applications which uses internet which results into affecting the network performance(QoS) because of heavy traffic load on the core routers which causes into more power requirements i...
Effective Approach for Localizing Jammers in Wireless Sensor Network
"The communication in wireless network can be disrupted by jammers in the network. Jammers’ position information allows the defender to actively eliminate the jamming attacks. In this paper, our aim is to design a framew...
Assessment of Abnormal Liver Chemistry in Malaria & Dengue Infections
"Background: Malaria and dengue are the two most common mosquito-borne diseases in tropical region including India. Although the routine diagnostic procedure does not involve assessing liver chemistry in above diseases,...