Implementation of a Noise Filter for Grouping in Bibliographic Databases using Latent Semantic Indexing

Abstract

Clustering algorithms can assist in scientific research by presenting themes related to some topics from which we can extract information more easily. However, it is common for many of these clusters to have documents that have no relevance to the topic of interest, thereby reducing the quality of the information. We can manage the reduced quality of information of clusters for a bibliographic database by dealing with noise in the semantic space that represents the relations between the grouped documents. In this work, we sustain the hypothesis of using the Latent Semantic Indexing (LSI) technique as an efficient instrument to reduce noise and promote better group quality. Using a database of 90 scientific publications from different areas, we pre-processed the documents by LSI and grouped them using six clustering algorithms. The results were significantly improved compared to our initial results that did not use LSI-based pre-processing. From the perspective of individual performance of the algorithms demonstrating the best results, CMeans was the one that got the highest average gain, with approximately 25%, followed by K-Means and SKmeans, with 17% each; PAM, with 16.5%; and EM, with 15%. The conclusion is that Latent Semantic Indexing has proven to be a helpful tool for noise reduction. We recommend its use to improve the cluster quality of bibliographic databases significantly.

Authors and Affiliations

Murilo Marques Armelin Gomes, William Ferreira dos Anjos, Arun Kumar Jaiswal, Sandeep Tiwari, Preetam Ghosh, Debmalya Barh, Vasco Azevedo, Anderson Santos

Keywords

Related Articles

Prognostic Analysis of Machine Learning Techniques for Breast Cancer Detection

Later lung cancer, breast cancer is the casual nosy cancer and it is the second dominant root of cancer demise in women. Cancer is when the mutations that occurs in genes regulate cell growth and mutations multiply and d...

Utilizing CRISPR as a Novel Tool for the Induction of Cell Reprogramming

Researchers can now target specific DNA sequences and easily modify them thanks to recent developments in CRISPR technology, enabling genome manipulation with unmatched precision. Furthermore, cell reprogramming is one o...

Identification of Unique Water Molecules in Human GRK2 Protein with Bound and Unbound GβGγ Subunit: A Study by Structural Bioinformatics Method

The human G-protein coupled receptor kinase 2 (hGRK2) regulates the desensitization of beta-adrenergic receptors (β-AR), and its overexpression has been implicated in heart failure. The hGRK2 is a serine/ threonine kinas...

Cross-Project Fault Prediction using Artificial Intelligence

Software defect prediction project focuses on finding errors or flaws in software and aiming to improve accuracy which gives evolution batch with detectable results while adding to modern outcomes and advancement liabili...

Facial Skin Disease Detection using Image Processing

Busy lifestyle, modernization, increasing pollution and unhealthy diet have led to problems which people are neglecting. Not drinking enough water, stress and hormonal changes are causing problems to skin. Causes may be...

Download PDF file
  • EP ID EP724401
  • DOI https://doi.org/10.61797/ijbic.v2i1.208
  • Views 36
  • Downloads 0

How To Cite

Murilo Marques Armelin Gomes, William Ferreira dos Anjos, Arun Kumar Jaiswal, Sandeep Tiwari, Preetam Ghosh, Debmalya Barh, Vasco Azevedo, Anderson Santos (2023). Implementation of a Noise Filter for Grouping in Bibliographic Databases using Latent Semantic Indexing. International Journal of Bioinformatics and Intelligent Computing, 2(1), -. https://europub.co.uk/articles/-A-724401