A fuzzy approach for ambiguity reducing in text similarity estimation (case study: Persian web contents)
Journal Title: Journal of Information Systems and Telecommunication - Year 2015, Vol 3, Issue 4
Abstract
Finding similar web contents have great efficiency in academic community and software systems. There are many methods and metrics in literature to measure the extent of text similarity among various documents and some its application especially in plagiarism detection systems. However, most of them do not take ambiguity inherent in word or text pair’s comparison as well as structural features into account. As a result, pervious methods did not have enough accuracy to deal vague information. So using structural features and considering ambiguity inherent word improve the identification of similar contents. In this paper, a new method has been proposed that taking lexical and structural features in text similarity measures into consideration. After preprocessing and removing stopwords, each text was divided into general words and domain-specific knowledge words. Then, the two lexical and structural fuzzy inference systems were designed to assess lexical and structural text similarity. The proposed method has been evaluated on Persian paper abstracts of International Conference on e-Learning and e-Teaching (ICELET) Corpus. The results shows that the proposed method can achieve a rate of 75% in terms of precision and can detect 81% of the similar cases.
Authors and Affiliations
Hamid Ahangarbahan, Golam Ali Montazer
Keywords
Related Articles
- EP ID EP184604
- DOI 10.7508/jist.2015.04.002
- Views 147
- Downloads 0
Fast Automatic Face Recognition from Single Image per Person Using GAW-KNN
Real time face recognition systems have several limitations such as collecting features. One training sample per target means less feature extraction techniques are available to use. To obtain an acceptable accuracy, mos...
GoF-Based Spectrum Sensing of OFDM Signals over Fading Channels
Goodness-of-Fit (GoF) based spectrum sensing of orthogonal frequency-division multiplexing (OFDM) signals is investigated in this paper. To this end, some novel local sensing methods based on Shapiro-Wilk (SW), Shapiro-F...
Enhancing Efficiency of Software Fault Tolerance Techniques in Satellite Motion System
This research shows the influence of using multi-core architecture to reduce the execution time and thus increase performance of some software fault tolerance techniques. According to superiority of N-version Programming...
Security Analysis of Scalar Costa Scheme Against Known Message Attack in DCT-Domain Image Watermarking
This paper proposes an accurate information-theoretic security analysis of Scalar Costa Scheme (SCS) when the SCS is employed in the embedding layer of digital image watermarking. For this purpose, Discrete Cosine Transf...
A New Method for Detecting the Number of Coherent Sources in the Presence of Colored Noise
In this paper, a new method for determining the number of coherent/correlated signals in the presence of colored noise is proposed which is based on the Eigen Increment Threshold (EIT) method. First, we present a new app...