THE CONCEPTION OF INTEGRATING MUTITHREDED CRAWLER WITH PAGE RANK TECHNIQUE :A SURVEY
Journal Title: International Journal of Engineering Sciences & Research Technology - Year 30, Vol 4, Issue 6
Abstract
Web Crawler also well - known as “Web Robot”, “Web Spider” or merely “Bot” is software for downloading pages from the Web by design. Contrasting what the name may propose, a Web crawler does not in reality stir around computers connected to the Internet – as viruses or intelligent agents do – but only sends requests for documents on Web servers. The input to this software is starting or seed page. As the volume of th e World Wide Web (WWW) grows, it became essential to parallelize a web crawling process, with the intention of finish downloading pages in a rational amount of time. Web crawler which employs multi - processing to permit multiple crawler processes running in concurrent manner. There are a lot of programs out there for web crawling but it required a WebCrawler that allowed trouble - free customization. In this paper we have discussed on crawling technique and how Page Rank can increase the efficiency of web craw ling.
Authors and Affiliations
Ms. Amrita Banjare , Mr. Rohit Miri
Keywords
Related Articles
- EP ID EP132536
- DOI -
- Views 60
- Downloads 0
Design and Control of Internet of Things Enabled Wireless Sensor Network
In this paper, we have reported an effective implementation of Internet of Things used for monitoring and control of regular domestic conditions by means of low cost sensor network. The interconnecting mechanisms...
Mobile Data Collection in Wireless Sensor Networks Using Bounded Relay Hop
Energy consumption becomes a primary concern in a Wireless Sensor Network. Wireless sensor network (WSN) requires robust and energy efficient communication protocols to minimize the energy consumption as much as...
Image Fusion Approach with NOISE REDUCTION USING GENETIC ALGORITHM & Sure-let Algorithm
Fusing information contained in multiple images plays an increasingly important role for quality inspection in industrial processes as well as in situation assessment for autonomous systems and assistance systems....
ROLE OF MICROORGANISM AND MICROFAUNA IN PLANT LITTER DECOMPOSITION
Though the fungi play a very significant role in the plant litter decomposition, studies revealed that the bacteria colonize the litters in the initial stages of decomposition. It has been observed that leaf speci...
COMPARATIVE STUDY OF TWO STANDBY INNOVATIVE SYSTEMS WHERE OPERATION OF ALL STANDBY UNITS IS NECESSARY ON THE FAILURE OF MAIN UNIT
The present paper gives the comparative study with respect to profit between two models for boiler working in thermal power plant. The system consists of one high pressure boiler, which is a main unit and two/three low...