A Methodical Study Of Web Crawler
Journal Title: International Journal of engineering Research and Applications - Year 2018, Vol 8, Issue 11
Abstract
World Wide Web (or simply web) is a massive, wealthy, preferable, effortlessly available and appropriate source of information and its users are increasing very swiftly now a day. To salvage information from web, search engines are used which access web pages as per the requirement of the users. The size of the web is very wide and contains structured, semi structured and unstructured data. Most of the data present in the web is unmanaged so it is not possible to access the whole web at once in a single attempt, so search engine use web crawler. Web crawler is a vital part of the search engine. It is a program that navigates the web and downloads the references of the web pages.Search engine runs several instances of the crawlers on wide spread servers to get diversified information from them. The web crawler crawls from one page to another in the World Wide Web, fetch the webpage, load the content of the page to search engine’s database and index it. Index is a huge database of words and text that occur on different webpage. This paper presentsa systematic study of the web crawler. The study of web crawler is very important because properly designed web crawlers always yield well results most of the time.
Authors and Affiliations
Vandana shrivastava
Keywords
Related Articles
- EP ID EP406765
- DOI 10.9790/9622-0811010108.
- Views 124
- Downloads 0
A Review on MQL in Green Environments Used For Machining Process
It is realized that these fluids are a serious damage to the environment and to the health of the operator working with it. Many alternatives were developed to minimize the quantity of cutting fluid used. The purpose of...
Health Monitoring System Using Wireless Sensor Network
This paper proposes an efficient approach to monitor the illness of the patient during the check up condition. Now a days medical equipments help the patient monitoring; also avoid lot of risk by Doctor‟s in ICU. These m...
Extraction of Non Proliferative Diabetic retinopathy using new designed wavelet and classification using KNN classifier
Diabetic retinopathy is very serious condition in which increased blood sugar level causes swelling in the blood vessels and it may leak in to the retina. It is the effect of diabetes on the eye. There are four stages of...
Environmental Degradation Associated With Crude Oil Related Activities In The Niger Delta.
The Niger Delta region of Nigeria has, for decades, faced unprecedented environmental challenges due to the combined effects of oil spill and gas flaring resulting in biodiversity loss. As put by (Ogwu, et al, 2015),due...
Mild balanced Intuitionistic Fuzzy Graphs
In this paper, we introduce intense subgraphs and feeble subgraphs based on their densities and discuss mild balanced IFG and equally balanced intuitionistic fuzzy subgraphs and their properties. The operations “sum” and...