Improvement of Page Ranking Algorithm by Negative Score of Spam Pages
Journal Title: Webology - Year 2019, Vol 16, Issue 2
Abstract
There are billions of web pages in the web and the most significant point is how to search these pages regarding their usefulness. Usually a user enters a query into a search engine and looking for the best responses. Search engines work based on ranking algorithms. Ranking algorithms employ web mining methods. Web mining is divided into structure, content and web usage mining. In search engines, related pages with user's query must be listed as a result and to obtain a better results, content mining algorithms may be included. Features such as input and output weight, content weight, spam score, length of URL, the number of related pages and href tags values are considered with a negative score. Proposed algorithms are implemented and compared with well-known algorithm. In this algorithm, Spam score feature is used which is combined with the age of domain and content weight of pages. In PRS (PageRank with Spam score) and PRST (PageRank with Spam score and Time factor) algorithms a better response is achieved than PR (PageRank) algorithm. Obtained results of the other algorithm, WPCRST (Weighted Page Content Rank with Spam score and Time factor) indicates that all measures are improved comparing with PR algorithm and provide better responses. First proposed algorithm combines extracted spam features from “moz.com” with structural features of Web mining. In the second proposed algorithm age of pages is used in addition to the neighborhood matrix and spam score. This feature is used to fix the rich getting richer. Logically this algorithm offers better scores than the previous algorithms. Third proposed algorithm uses weighting methods. In fact, in this algorithm, weight of inbound links and weight of outbound links and content weight of pages are used simultaneously. This algorithm includes web content mining by using content weight of pages. Values of TFIDF and BM25 algorithms are used to obtain the content weight. Obtained results specify that this algorithm has a better ranking than PRST algorithm except for the measure of precision. About 41 percent improvement can be seen in the measure of NDCG and 48 percent improvement for precision while AP has improved 0.8 percent and finally 2.5 percent improvement can be seen in Mean NDCG. In this algorithm, value of TFIDF algorithm is considered as the content weight.
Authors and Affiliations
Ateye Zeraatkar, Hamid Mirvaziri and Mostafa Ghazizadeh Ahsaee
Keywords
Related Articles
- EP ID EP687817
- DOI 10.14704/WEB/V16I2/a187
- Views 271
- Downloads 0
Institutional Repositories: Content and Culture in an Open Access Environment
As repository technology matures, the cultural and organizational aspects of setting up and running an institutional repository have come to the forefront of the discussion surrounding their deployment. The book delibera...
Method for Ontology Content and Structure Optimization, Provided by a Weighted Conceptual Graph
The complex dynamic structure of the ontology and its content requires implementing of optimization procedures to better ontology processing performance and resolve conflicts between data. This paper addresses the issues...
Have digital repositories come of age? The views of library directors
This survey of approximately 150 repositories assessed the achievements, impact, and success of digital repositories. Results show that while the size and use of repositories has been relatively modest, almost half of al...
Location-Based Search Engines Tasks and Capabilities: A Comparative Study
Location-based web searching is one of the popular tasks expected from the search engines. A location-based query consists of a topic and a reference location. Unlike general web search, in location-based search it is...
Impact of ResearchGate on Increasing Citations and Usage Counts of Hot Papers in Clinical Medicine Indexed in Web of Science
The purpose of this research was to conduct a comparative study of the impact of ResearchGate indicators on increasing citation and usage counts of hot papers in clinical medicine indexed in the Web of Science (WoS) data...