Evaluating Sentiment Analysis Methods and Identifying Scope of Negation in Newspaper Articles
Journal Title: International Journal of Advanced Research in Artificial Intelligence(IJARAI) - Year 2014, Vol 3, Issue 11
Abstract
Automatic detection of linguistic negation in free text is a demanding need for many text processing applications including Sentiment Analysis. Our system uses online news archives from two different resources namely NDTV and The Hindu. While dealing with news articles, we performed three subtasks namely identifying the target; separation of good and bad news content from the good and bad sentiment expressed on the target and analysis of clearly marked opinion that is expressed explicitly, not needing interpretation or the use of world knowledge. In this paper, our main focus was on evaluating and comparing three sentiment analysis methods (two machine learning based and one lexical based) and also identifying the scope of negation in news articles for two political parties namely BJP and UPA by using three existing methodologies. They were Rest of the Sentence (RoS), Fixed Window Length (FWL) and Dependency Analysis (DA). Among the sentiment methods the best F-measure was SVM with the values 0.688 and 0.657 for BJP and UPA respectively. On the other hand, the F measures for RoS, FWL and DA were 0.58, 0.69 and 0.75 respectively. We observed that DA was performing better than the other two. Among 1675 sentences in the corpus, according to annotator I, 1,137 were positive and 538 were negative whereas according to annotator II, 1,130 were positive and 545 were negative. Further we also identified the score of each sentence and calculated the accuracy on the basis of average score of both the annotators.
Authors and Affiliations
S Padmaja, Prof. S Fatima, Sasidhar Bandu
Keywords
Related Articles
- EP ID EP142407
- DOI 10.14569/IJARAI.2014.031101
- Views 126
- Downloads 0
Relations between Psychological Status and Eye Movements
Relations between psychological status and eye movements are found through experiments with readings of different types of documents as well as playing games. Psychological status can be monitored with Electroencep...
A Rank Aggregation Algorithm for Ensemble of Multiple Feature Selection Techniques in Credit Risk Evaluation
In credit risk evaluation the accuracy of a classifier is very significant for classifying the high-risk loan applicants correctly. Feature selection is one way of improving the accuracy of a classifier. It provide...
Digital Library of Expert System Based at Indonesia Technology University
Digital library is a very interesting phenomenon in the world of libraries. In this era of globalization, the digital library is needed by students, faculty, and the community in the search for quick reference thro...
Clustering Web Documents based on Efficient Multi-Tire Hashing Algorithm for Mining Frequent Termsets
Document Clustering is one of the main themes in text mining. It refers to the process of grouping documents with similar contents or topics into clusters to improve both availability and reliability of text mining...
Fuzzy Soft Sets Supporting Multi-Criteria Decision Processes
Students experience various types of difficulties when it comes to examinations, where some of them are subject related while others are more of a psychological character. A number of factors influencing academic s...