Study of Web Crawler and its Different Types

Journal Title: IOSR Journals (IOSR Journal of Computer Engineering) - Year 2014, Vol 16, Issue 1

Abstract

 Due to the current size of the Web and its dynamic nature, building an efficient search mechanism is very important. A vast number of web pages are continually being added every day, and information is constantly changing. Search engines are used to extract valuable Information from the internet. Web crawlers are the principal part of search engine, is a computer program or software that browses the World Wide Web in a methodical, automated manner or in an orderly fashion. It is an essential method for collecting data on, and keeping in touch with the rapidly increasing Internet. This Paper briefly reviews the concepts of web crawler, its architecture and its various types

Authors and Affiliations

Trupti V. Udapure

Keywords

Related Articles

 A New Skin Color Based Face Detection Algorithm by CombiningThree Color Model Algorithms

 Abstract: Human face recognition systems have gained a considerable attention during last decade due to itsvast applications in the field of computer and advantages over previous biometric methods. There are manyap...

Providing High Security and Recovering Good Quality Image using Visual Cryptographic Technique

Abstract: Security is an important factor, since many digital images are transmitted through internet, which contains secret information. Symmetric and Asymmetric methods are two types of cryptographic techniques used to...

 An efficient process mining model for Petri Nets in process discovery

 Abstract: Process mining is a process management system used to analyze business processes based on event logs. The knowledge is extracted from event logs by using knowledge retrieval techniques. The process mining...

 Effects of Cyber Security on Selected Mobile Phone Payment System in Nairobi Central Business District, Kenya

Abstract: The study aimed at examining effects of cyber security on selected mobile phone payment systems in Nairobi County, Kenya. A purposive complete census was conducted to collect data from the selected mobile phone...

Built-In Self-Repair Techniques of Embedded Memories with BIST for Improving Reliability

Error correction code (ECC) and built-in selfrepair(BISR) techniques by using redundancies have beenwidely used for improving the yield and reliability of embeddedmemories. The target faults of these two schemes are soft...

Download PDF file
  • EP ID EP120940
  • DOI -
  • Views 120
  • Downloads 0

How To Cite

Trupti V. Udapure (2014).  Study of Web Crawler and its Different Types. IOSR Journals (IOSR Journal of Computer Engineering), 16(1), 1-5. https://europub.co.uk/articles/-A-120940