Effective Searching Policies for Web Crawler
Journal Title: International Journal of Modern Engineering Research (IJMER) - Year 2013, Vol 3, Issue 5
Abstract
As we know search engines cannot index every Web page, due to limited storage, bandwidth, computational resources and the dynamic nature of the web. It cannot monitored continuously all parts of the web for changes. Therefore it is important to develop effective searching policies. In this technique there is the combination of different searching technique to form a effective searching policies. These combined techniques are best first search, focused crawling, info spiders, recrawling pages for updation, crawling the hidden web page.This combined technique also includes Selection policy such as page rank, path ascending, focused crawling Revisit policy such as freshness , age Politeness , Parallelization so that it allow distributed web crawling.
Authors and Affiliations
Suyash Gupta, KrishanDev Mishra, Prerna Singh
Keywords
Related Articles
- EP ID EP88094
- DOI -
- Views 101
- Downloads 0
Applying Classification Technique using DID3 Algorithm to improve Decision Support System under Uncertain Situations[b][/b]
Decision Support System (DSS) is equivalent synonym as management information systems (MIS). Most of imported data are being used in solutions like data mining (DM). Decision supporting systems include also decisio...
Quasi Active Power Factor Correction Scheme forHigh Efficiency Ac/Dc
Harmonic pollution and low power factor in power systems caused by power converters have been of great concern. To overcome these problems several converter topologies using advanced semiconductor devices and con...
Calculating Voltage Instability Using Index Analysis in Radial Distribution System
This paper presents analysis of voltage stability index by a simple and efficient load flow method to find out the magnitude of voltage at each node in radial distribution system in that network. It shows the val...
Assesment of Irrigation Water Quality of Some Provinces of Turkey
ABSTRACT: Yozgat and Tekirdag are important agriculture center for Turkey. In these cities, agriculture is still important. On the other hand, the water resource is polluted by agriculture facilities day by day. In...
A PRAGMATIC TECHNIQUE FOR DETECTION AND REMOVAL OF CRACKS IN DIGITIZED PAINTINGS
A Pragmatic technique for the detection and removal of cracks on digitized paintings is presented in this paper. The cracks are detected by thresholding the output of the morphological top-hat and bottom-hat transf...