Implementation of a Noise Filter for Grouping in Bibliographic Databases using Latent Semantic Indexing
Journal Title: International Journal of Bioinformatics and Intelligent Computing - Year 2023, Vol 2, Issue 1
Abstract
Clustering algorithms can assist in scientific research by presenting themes related to some topics from which we can extract information more easily. However, it is common for many of these clusters to have documents that have no relevance to the topic of interest, thereby reducing the quality of the information. We can manage the reduced quality of information of clusters for a bibliographic database by dealing with noise in the semantic space that represents the relations between the grouped documents. In this work, we sustain the hypothesis of using the Latent Semantic Indexing (LSI) technique as an efficient instrument to reduce noise and promote better group quality. Using a database of 90 scientific publications from different areas, we pre-processed the documents by LSI and grouped them using six clustering algorithms. The results were significantly improved compared to our initial results that did not use LSI-based pre-processing. From the perspective of individual performance of the algorithms demonstrating the best results, CMeans was the one that got the highest average gain, with approximately 25%, followed by K-Means and SKmeans, with 17% each; PAM, with 16.5%; and EM, with 15%. The conclusion is that Latent Semantic Indexing has proven to be a helpful tool for noise reduction. We recommend its use to improve the cluster quality of bibliographic databases significantly.
Authors and Affiliations
Murilo Marques Armelin Gomes, William Ferreira dos Anjos, Arun Kumar Jaiswal, Sandeep Tiwari, Preetam Ghosh, Debmalya Barh, Vasco Azevedo, Anderson Santos
Keywords
Related Articles
- EP ID EP724401
- DOI https://doi.org/10.61797/ijbic.v2i1.208
- Views 60
- Downloads 0
Advancements in Neuroradiology via Artificial Intelligence and Machine Learning
Neuroradiology is significantly showing the broad impact in field of Artificial intelligence research and also in Machine learning. Neuro-radiology includes methods such as neuro-imaging which simply diagnose and charact...
A review on Epigenome Editing using CRISPR-based Tools to Rejuvenate Skin Tissues
Genomic activity is controlled by a sophisticated series of cell functions known as the epigenome. The creation of tools capable of directly altering various processes is required to unravel this intricacy. Additionally,...
Identification of Selected Kinetoplastids 18S rRNA Residues required for Efficient Recruitment of Initiator tRNA Met and AUG Selection in silico
High Resolution 18S rRNA structures of kinetoplastids ribosomes from theoretical methods have provided atomic level details about the process of translation. This process entails detailed information on the mRNA and tRNA...
Review of Bioinformatics Tools and Techniques to Accelerate Ovarian Cancer Research
Since the history of humans there was no definitive cure for cancer. The rapid development in the field of bioinformatics has resulted in acceleration of advancement of cancer research. As computing and IT technology imp...
Deep Learning to Predicting Live Births and Aneuploid Miscarriages from Images of Blastocysts Combined with Maternal Age
Objectives: Making an artificial intelligence (AI) classifier that uses the maternal age and an image of the implanted blastocyst to determine the probability of getting a live birth. Methods: The dataset comprised m...