THE CONCEPTION OF INTEGRATING MUTITHREDED CRAWLER WITH PAGE RANK TECHNIQUE :A SURVEY
Journal Title: International Journal of Engineering Sciences & Research Technology - Year 30, Vol 4, Issue 6
Abstract
Web Crawler also well-known as “Web Robot”, “Web Spider” or merely “Bot” is software for downloading pages from the Web by design. Contrasting what the name may propose, a Web crawler does not in reality stir around computers connected to the Internet –as viruses or intelligent agents do– but only sends requests for documents on Web servers. The input to this software is starting or seed page. As the volume of the World Wide Web (WWW) grows, it became essential to parallelize a web crawling process, with the intention of finish downloading pages in a rational amount of time. Web crawler which employs multi-processing to permit multiple crawler processes running in concurrent manner. There are a lot of programs out there for web crawling but it required a WebCrawler that allowed trouble-free customization. In this paper we have discussed on crawling technique and how Page Rank can increase the efficiency of web crawling.
Authors and Affiliations
Ms. Amrita Banjare
Keywords
Related Articles
- EP ID EP163722
- DOI -
- Views 71
- Downloads 0
A Study on Energy-Balanced Transmission policies for Maximize Network Lifetime in Wireless Sensor Networks
Unbalanced energy consumption is an inherent problem in wireless sensor networks characterized by multihop routing and many-to-one traffic pattern, and this uneven energy dissipation can significantly reduce netwo...
LINEAR IDENTIFICATION AND CONTROL OF REACTOR FOR PHTHALIC ANHYDRIDE PRODUCTION PROCESS - CASE STUDY
Phthalic anhydride is one of the most essential and rare chemicals used in manufacturing of paints, pigments, dyes and esters. Now a day, the demand for the purest form of Phthalic anhydride is increasing but the p...
REVIEW PAPER: ANALYSIS OF DATA TRANSFORMATION IN RAPID PROTOTYPING TECHNOLOGY
Layered manufacturing (LM) machines use stereolithography (STL) files to build parts by creating continuous slices on top of each other. An STL file approximates the surface of a part with planar triangles. This r...
EFFECT OF DILATION OF COAL BLEND ON PUSH FORCE AND COKE QUALITY IN STAMP CHARGED COKE MAKING PROCESS
An abstract of no more than 200 words The blending of coals as practiced for stamp charged coke making is determined primarily by technical factors and secondary by economic factors. The most common problem in sta...
SOLUTION FOR RUBIK’S CUBE BY USING GENETIC ALGORITHM
Solutions calculated by Genetic Algorithms have come to surpass exact methods for solving various problems. The Rubik’s Cube optimization problem is one such area. In this work we present a different approach to s...