Reconsideration of Potential Problems of Applying EMIM for Text Analysis
Journal Title: International Journal of Advanced Computer Science & Applications - Year 2014, Vol 5, Issue 8
Abstract
It seems that the term dependence methods developed using the expected mutual information measure (EMIM) have not achieved their potential in many areas of science, involving statistical text analysis or document processing. This study examines the reasons for the failure and highlights potential problems of applications. Several interesting questions are arisen, including, does a term provide any information if it occurs in all the sample documents? how the mutual information of two terms, under their status values, makes contribution to EMIM? are two terms highly dependent for their co-occurrence if they receive a high positive EMIM value? what may imply for dependence of two term pairs when they receive the same EMIM value? how can properly verify two terms to be high dependent for their cooccurrence? how can properly apply EMIM? does the size of the sample set matter? This study attempts to answer these questions in order to clarify confusions caused by the problems and/or suggest solutions to the problems. Some interesting examples are provided to clarify our viewpoints.
Authors and Affiliations
D. Cai
Keywords
Related Articles
- EP ID EP152693
- DOI 10.14569/IJACSA.2014.050826
- Views 130
- Downloads 0
Rule Adaptation in Collaborative Working Environments using RBAC Model
Collaborative Working Environments (CWEs) are getting prominence these days. With the increase in the use of collaboration tools and technologies, a lot of sharing and privacy issues have also emerged. Due to its dynamic...
Stylometric Techniques for Multiple Author Clustering
In 1598-99 printer, William Jaggard named Shakespeare as the sole author of The Passionate Pilgrim even though Jaggard chose a number of non-Shakespearian poems in the volume. Using a neurolinguistics approach to authors...
Key Issues in Vowel Based Splitting of Telugu Bigrams
Splitting of compound Telugu words into its components or root words is one of the important, tedious and yet inaccurate tasks of Natural Language Processing (NLP). Except in few special cases, at least one vowel i...
A Survey on Case-based Reasoning in Medicine
Case-based reasoning (CBR) based on the memory-centered cognitive model is a strategy that focuses on how people learn a new skill or how they generate hypothesis on new situations based on their past experiences. Among...
A Text based Authentication Scheme for Improving Security of Textual Passwords
User authentication through textual passwords is very common in computer systems due to its ease of use. However textual passwords are vulnerable to different kinds of security attacks, such as spyware and dictionary att...