Multimodal Automatic Image Annotation Method using Association Rules Mining and Clustering

Abstract

Effective and fast retrieval of images from image datasets is not an easy task, especially with the continuous and fast growth of digital images added everyday by used to the web. Automatic image annotation is an approach that has been proposed to facilitate the retrieval of images semantically related to a query image. A multimodal image annotation method is proposed in this paper. The goal is to benefit from the visual features extracted from images and their associated user tags. The proposed method relies on clustering to regroup the text and visual features into clusters and on association rules mining to generate the rules that associate text clusters to visual clusters. In the experimental evaluation, two datasets of the photo annotation tasks are considered; ImageCLEF 2011 and ImageCLEF 2012. Results achieved by the proposed method are better than all the multimodal methods of participants in ImageCLEF 2011 photo annotation task and state-of-the-art methods. Moreover, the MiAP of the proposed method is better than the MiAP of 7 participants out of 11 when using ImageCLEF 2012 in the evaluation.

Authors and Affiliations

Mounira Taileb, Eman Alahmadi

Keywords

Related Articles

An Approach to Finding Similarity Between Two Community Graphs Using Graph Mining Techniques

Graph similarity has studied in the fields of shape retrieval, object recognition, face recognition and many more areas. Sometimes it is important to compare two community graphs for similarity which makes easier for min...

Performance Evaluation of Anti-Collision Algorithms for RFID System with Different Delay Requirements

The main purpose of Radio-frequency identification (RFID) implementation is to keep track of the tagged items. The basic components of an RFID system include tags and readers. Tags communicate with the reader through a s...

Novel LVCSR Decoder Based on Perfect Hash Automata and Tuple Structures – SPREAD –

The paper presents the novel design of a one-pass large vocabulary continuous-speech recognition decoder engine, named SPREAD. The decoder is based on a time-synchronous beam-search approach, including statically expande...

Real Time RNA Sequence Edition with Matrix Insertion Deletion for Improved Bio Molecular Computing using Template Match Measure

The RNA sequence editing has become a challenging task in the molecular computing. There are number of approaches that have been discussed earlier for the problem RNA editing in bio molecular computing, but they suffer t...

An integrated modular approach for Visual Analytic Systems in Electronic Health Records

Latest visual analytic tools help physicians to visualize temporal data in regards to medical health records. Existing systems lack vast support in the generalized collaboration, a single user-centered and task based des...

Download PDF file
  • EP ID EP417782
  • DOI 10.14569/IJACSA.2018.091197
  • Views 124
  • Downloads 0

How To Cite

Mounira Taileb, Eman Alahmadi (2018). Multimodal Automatic Image Annotation Method using Association Rules Mining and Clustering. International Journal of Advanced Computer Science & Applications, 9(11), 678-684. https://europub.co.uk/articles/-A-417782