An Appraisal of Web Crawling Algorithms

Journal Title: International Journal of Engineering and Science Invention - Year 2018, Vol 7, Issue 4

Abstract

Central To Any Research Work Or Data-Mining Project Is Having Sufficient Amounts Of Data That Can Be Processed To Provide Meaningful And Statistically Relevant Information. It Is Almost Impossible For Anybody Using The World Wide Web To Get Meaningful Information Without Having To Use A Search Engine. In This Study, We Appraisal Different Crawling Algorithms; Their Strength And Weakness And Also Present The Ideology Behind The Development Of These Algorithms. We Then Go A Step Further To Discuss The Architecture Of A Web Crawler And The General Crawling Policy Of Web Crawlers.

Authors and Affiliations

Oni O. A. , Chinedu Ukeje

Keywords

Related Articles

Use of Natural Material – Clay for Sustainable Treatment of Water Polluted By Dyes

Apart from the colorful side of dyes, the harmful effects they impose on environment cannot be overlooked. Treatment of water containing these dye effluents is todays demand. For encouraging methods that are sustainable...

Degree Equitable Sum Matrix of a Graph

In this paper, we have defined a new graph energy parameter in the field of chemical graph theory and obtained some basic properties.

A study on Utilization of BIM Model for the Development of Disaster Response Support Technology

Recently, studies on diversified platform technologies of integrated information for disaster response as well as service technologies for disaster response and evacuation increased. Although the basic concepts and objec...

A Soft Computing Technique For Diagnose Psychological Disorder at Different Stages

The Mental Illness Diagnostic Expert System Is Designed To Help Or Assist The Psychology Doctors To Diagnosing The Various Mental Disorders Related To Human. This Expert System Can Be Used To Perform Some Evaluation Of P...

Sea Level Manipulation

Sea level changes is a key issue in the global warming scenario. It has been widely claimed that sea is rising as a function of the late 20th’s warming pulse. Global tide gauge data sets may vary between +1.7 mm/yr to +0...

Download PDF file
  • EP ID EP396706
  • DOI -
  • Views 66
  • Downloads 0

How To Cite

Oni O. A. , Chinedu Ukeje (2018). An Appraisal of Web Crawling Algorithms. International Journal of Engineering and Science Invention, 7(4), 42-50. https://europub.co.uk/articles/-A-396706