Improvement of Page Ranking Algorithm by Negative Score of Spam Pages
Journal Title: Webology - Year 2019, Vol 16, Issue 2
Abstract
There are billions of web pages in the web and the most significant point is how to search these pages regarding their usefulness. Usually a user enters a query into a search engine and looking for the best responses. Search engines work based on ranking algorithms. Ranking algorithms employ web mining methods. Web mining is divided into structure, content and web usage mining. In search engines, related pages with user's query must be listed as a result and to obtain a better results, content mining algorithms may be included. Features such as input and output weight, content weight, spam score, length of URL, the number of related pages and href tags values are considered with a negative score. Proposed algorithms are implemented and compared with well-known algorithm. In this algorithm, Spam score feature is used which is combined with the age of domain and content weight of pages. In PRS (PageRank with Spam score) and PRST (PageRank with Spam score and Time factor) algorithms a better response is achieved than PR (PageRank) algorithm. Obtained results of the other algorithm, WPCRST (Weighted Page Content Rank with Spam score and Time factor) indicates that all measures are improved comparing with PR algorithm and provide better responses. First proposed algorithm combines extracted spam features from “moz.com” with structural features of Web mining. In the second proposed algorithm age of pages is used in addition to the neighborhood matrix and spam score. This feature is used to fix the rich getting richer. Logically this algorithm offers better scores than the previous algorithms. Third proposed algorithm uses weighting methods. In fact, in this algorithm, weight of inbound links and weight of outbound links and content weight of pages are used simultaneously. This algorithm includes web content mining by using content weight of pages. Values of TFIDF and BM25 algorithms are used to obtain the content weight. Obtained results specify that this algorithm has a better ranking than PRST algorithm except for the measure of precision. About 41 percent improvement can be seen in the measure of NDCG and 48 percent improvement for precision while AP has improved 0.8 percent and finally 2.5 percent improvement can be seen in Mean NDCG. In this algorithm, value of TFIDF algorithm is considered as the content weight.
Authors and Affiliations
Ateye Zeraatkar, Hamid Mirvaziri and Mostafa Ghazizadeh Ahsaee
Keywords
Related Articles
- EP ID EP687817
- DOI 10.14704/WEB/V16I2/a187
- Views 156
- Downloads 0
Getting Connected: Can Social Capital be Virtual?
This article reports on an analysis of data from a study conducted in Australia on the impact of Internet access on social capital. The debate regarding the definition of social capital is explored, and basic indicator...
Development of a Numerical Index to Assess the Quality of Websites Design
A Website Design Quality Index, called WDQI, was developed to assess the websites design quality using a numerical approach. WDQI was formulated using a set of criteria such as availability literature on website design q...
A Comparative Theoretical and Empirical Analysis of Machine Learning Algorithms
With the explosion of data in recent times, Machine learning has emerged as one of the most important methodical approaches to observe significant insights from the vast amount of data. Particularly, it is witnessed that...
American libraries and the Internet: The social construction of Web appropriation and use
One can hardly find any aspect of human life that has not been affected one way or another by the Internet. Most of the Internet’s impact is because of the changes it has brought about in the areas of communication and...
Situated practices of information use and representation: an ethnographic study of a web design project for boys
This article explores the production practices employed by children building personal webpages in a semi-structured afterschool program: the Fifth Dimension (5D). Following a critical Multiliteracies (CritMLs) approach t...