Effective Searching Policies for Web Crawler
Journal Title: International Journal of Modern Engineering Research (IJMER) - Year 2013, Vol 3, Issue 5
Abstract
As we know search engines cannot index every Web page, due to limited storage, bandwidth, computational resources and the dynamic nature of the web. It cannot monitored continuously all parts of the web for changes. Therefore it is important to develop effective searching policies. In this technique there is the combination of different searching technique to form a effective searching policies. These combined techniques are best first search, focused crawling, info spiders, recrawling pages for updation, crawling the hidden web page.This combined technique also includes Selection policy such as page rank, path ascending, focused crawling Revisit policy such as freshness , age Politeness , Parallelization so that it allow distributed web crawling.
Authors and Affiliations
Suyash Gupta, KrishanDev Mishra, Prerna Singh
Keywords
Related Articles
- EP ID EP88094
- DOI -
- Views 127
- Downloads 0
Microcontroller Based Automatic Sprinkler Irrigation System
Microcontroller based Automatic Sprinkler System is a new concept of using intelligence power of embedded technology in the sprinkler irrigation work. Designed system replaces the conventional manual work invol...
Spring MVC: Companion of J2EE for Rapid Development of Web Applications
: With Java bean model the reusability concept is added, for java application. Industry developers identifies some problem in java bean model for application in real-time. Some of them are bean model because...
Assesment of Irrigation Water Quality of Some Provinces of Turkey
ABSTRACT: Yozgat and Tekirdag are important agriculture center for Turkey. In these cities, agriculture is still important. On the other hand, the water resource is polluted by agriculture facilities day by day. In...
BER Performance for Convalutional Code with Soft & Hard Viterbi Decoding
Viterbi decoding has a fixed decoding time. It is well suited to hardware decoder. Hear we proposed Viterbi algorithm with Decoding rate 1/3. Which dynamically improve performance of the channel.
Genetic Algorithm based Fractal Image Compression
Abstract:Fractal Image Compression is a lossy compression technique that has been developed in the early 1990s. Fractal image compression explores the self-similarity property of a natural image and utilizes the pa...