A Novel Interface to a Web Crawler using VB.NET  Technology

Journal Title: IOSR Journals (IOSR Journal of Computer Engineering) - Year 2013, Vol 15, Issue 6

Abstract

 The number of web pages is increasing into millions and trillions around the world. To make searching much easier for users, web search engines came into existence. Web Search engines are used to find  specific information on the World Wide Web. Without search engines, it would be almost impossible to locate  anything on the Web unless or until a specific URL address is known. This information is provided to search by  a web crawler which is a computer program or software. Web crawler is an essential component of search  engines, data mining and other Internet applications. Scheduling Web pages to be downloaded is an important  aspect of crawling. Previous research on Web crawl focused on optimizing either crawl speed or quality of the  Web pages downloaded. While both metrics are important, scheduling using one of them alone is insufficient  and can bias or hurt overall crawl process. This paper is all about design a new Web Crawler using VB.NET  Technology.

Authors and Affiliations

Deepak Kumar

Keywords

Related Articles

 An Improved Hashing Method for the Detection of Image Forgery

 Abstract: Detection of image forgery is always a crucial factor in image forensic and security applications. Usually this detection is possible with the help of local or global features of an image. We can ensure...

 An Enhanced ILD Diagnosis Method using DWT

 Interstitial Lung Disease (ILD) is a group of lung diseases affecting lung parenchyma. Since the lesions can be clearly identified in the CT scan of the lung, CT analysis is best among the ways for the identifi...

Opportunistic Networks: A Review

Abstract: Opportunistic network is a wireless ad hoc network. It is a type of delay tolerant network and an extension of mobile ad hoc networks. This network has a special characteristic which is intermittent connectivit...

 Comparative Analysis of Different Types of Full Adder Circuits

 The Full Adder circuit is an important component in application such as Digital Signal Processing (DSP) architecture, microprocessor, and microcontroller and data processing units. This paper discusses the ev...

 Design and Implementation of Automatic Irrigation ControlSystem

Abstract: The objective of irrigation is to keep measure on food security and the aim of automatic irrigationcontrol system is to minimize the intervention of the human operator (gardener) in irrigation activities. Theau...

Download PDF file
  • EP ID EP120934
  • DOI -
  • Views 129
  • Downloads 0

How To Cite

Deepak Kumar (2013).  A Novel Interface to a Web Crawler using VB.NET  Technology. IOSR Journals (IOSR Journal of Computer Engineering), 15(6), 59-63. https://europub.co.uk/articles/-A-120934