Improvement of performance of web crawlers for efficient web searching and crawling
Journal Title: International Journal of Computer Science & Engineering Technology - Year 2013, Vol 4, Issue 4
Abstract
The effectiveness of a crawler directly affects the efficiency of the searching quality of the web search engines. As the crawler interacts with billions of hosts or servers over a period of weeks or months, the issues of validity, flexibility and manageability are of major importance. Also crawler could retrieve some other information, which may be of unimportant to the search from the HTML files as it is parsing them to get the new URLs. In this paper, an attempt has been made to improve the performance of the web crawler by analyzing certain features of several algorithms such as best-first, breadth-first, pagerank, shark search and HITS. For this, various performance parameters such as precision, recall, accuracy and F-Score are taken into consideration. Based on the output parameters, an analysis is made for the improvement of web crawler towards web searching.
Authors and Affiliations
Dr. P. Jaganathan , S. Jaiganesh , P. Babu
Keywords
Related Articles
- EP ID EP109334
- DOI -
- Views 122
- Downloads 0
AN ENHANCED PRIVACY PRESERVING SEARCH ENGINE FRAMEWORK USING GREEDY ALGORITHM
By using internet, the user collect all the information. Because of weak search quality the users get irrelevant information. By using Personalized Web Search (PWS), this paper achieves the highquality search results. In...
Computer Aided Music Generation Using Genetic Algorithm and Its Potential Applications
Music speaks what cannot be expressed, soothes the mind and gives it rest, heals the heart and makes is whole. Not everyone is gifted with a good voice but almost everyone has good ears when it comes to pleasant music. T...
Comparative Study on Text Pattern Matching for Heterogeneous System
Pattern-matching has been routinely used in various computer applications, for example, in editors, retrieval of information either textual, image, or sound and searching nucleotide or amino acid sequence patterns in gen...
Enhancement of Robustness of Color Video Watermarking using 2D-DWT
In this paper we propose an effective, robust and imperceptible video watermarking algorithm by applying DWT (Discrete Wavelet transform) on video frames. The video frames will be first decomposed using DWT and the binar...
An Algorithm - EMD for Emergency in VANET
Vehicular Ad hoc Networks [VANET] is one of the fastest emerging technologies for research as day to day many challenges and problem to be identified by the researchers before the technology becomes commercialized. Commu...