THE CONCEPTION OF INTEGRATING MUTITHREDED CRAWLER WITH PAGE RANK TECHNIQUE :A SURVEY
Journal Title: International Journal of Engineering Sciences & Research Technology - Year 30, Vol 4, Issue 6
Abstract
Web Crawler also well - known as “Web Robot”, “Web Spider” or merely “Bot” is software for downloading pages from the Web by design. Contrasting what the name may propose, a Web crawler does not in reality stir around computers connected to the Internet – as viruses or intelligent agents do – but only sends requests for documents on Web servers. The input to this software is starting or seed page. As the volume of th e World Wide Web (WWW) grows, it became essential to parallelize a web crawling process, with the intention of finish downloading pages in a rational amount of time. Web crawler which employs multi - processing to permit multiple crawler processes running in concurrent manner. There are a lot of programs out there for web crawling but it required a WebCrawler that allowed trouble - free customization. In this paper we have discussed on crawling technique and how Page Rank can increase the efficiency of web craw ling.
Authors and Affiliations
Ms. Amrita Banjare , Mr. Rohit Miri
Keywords
Related Articles
- EP ID EP132536
- DOI -
- Views 61
- Downloads 0
RISK ASSESSMENT OF LEAD IN CHICKEN MEAT AND EGGS FROM DIFFERENT ENVIRONMENTS OF EGYPT
Chickens are the most common sources of poultry meat (87%) of total poultry production. Heavy metals as lead are widely dispersed in the environment and may causing contamination of foods and health risks to consu...
COMPARATIVE STUDY OF TERRAIN CHARACTERIZATION USING DEM FROM TWO DIFFERENT SOURCES (SRTM & ASTER)
Remote Sensing and GIS recently had been extensively used in various spatial analyses for different parameters to understand the spatial characteristic to be used in decision making. Remote sensing and GIS provides...
VALIDATION OF SINGLE POINT INCREMENTAL FORMING PROCESS FOR DEEP DRAWN PYRAMIDAL CUPS USING EXPERIMENTAL GRID-BASED DEFORMATION
The use of finite element analysis in manufacturing has enabled the development of several new sheet metal forming processes. Recent advances have enabled the localized deformation to be accurately controlled using...
A SURVEY ON OUTLIER DETECTION FOR UNCERTAIN METEOROLOGY DATA
In recent times climate change has been considered to be the major problem. Meteorology is the study of atmosphere like humidity, pressure, etc. It is important to analyze the hidden knowledge about the huge meteo...
BLOCK BASED IMAGE FORGERY DETECTION TECHNIQUES
Since the day o f an advent of the internet and the World Wide Web digital images started playing an important role in exchanging ideas and sharing the information. Today it’s hard to imagine the world of web without...