Effective Searching Policies for Web Crawler
Journal Title: International Journal of Modern Engineering Research (IJMER) - Year 2013, Vol 3, Issue 5
Abstract
As we know search engines cannot index every Web page, due to limited storage, bandwidth, computational resources and the dynamic nature of the web. It cannot monitored continuously all parts of the web for changes. Therefore it is important to develop effective searching policies. In this technique there is the combination of different searching technique to form a effective searching policies. These combined techniques are best first search, focused crawling, info spiders, recrawling pages for updation, crawling the hidden web page.This combined technique also includes Selection policy such as page rank, path ascending, focused crawling Revisit policy such as freshness , age Politeness , Parallelization so that it allow distributed web crawling.
Authors and Affiliations
Suyash Gupta, KrishanDev Mishra, Prerna Singh
Keywords
Related Articles
- EP ID EP88094
- DOI -
- Views 86
- Downloads 0
A PRAGMATIC TECHNIQUE FOR DETECTION AND REMOVAL OF CRACKS IN DIGITIZED PAINTINGS
A Pragmatic technique for the detection and removal of cracks on digitized paintings is presented in this paper. The cracks are detected by thresholding the output of the morphological top-hat and bottom-hat transf...
An Adaptive Routing Algorithm for Communication Networks using Back Pressure Technique
The basic idea of backpressure techniques is to prioritize transmissions over links that have the highest queue differentials. Backpressure method effectively makes packets flow through the network as though pulled by...
Performance Analysis of OFDM System Using PAPR Reduction Techniques
Abstract: Orthogonal Frequency division Multiplexing (OFDM) is an efficient method of data transmission for high speed communication systems. However, the main drawback of OFDM system is the high Peak to Average Po...
Experimental Approach of CNC Drilling Operation for Mild Steel Using Taguchi Design
Drilling is the most common (multi-point) cutting technique targeted for the production of small-diameter holes. Hole making is among the most important operations in manufacturing, and drilling is a major and common hol...
SSDA.Analysis - A Class Library for Analysis of Sample Survey Data
Agricultural researchers frequently use sample survey methodologies for estimation of various parameters in crops, livestock, fisheries production and allied fields. Analysis of data generated from these surveys re...