Multimodal Automatic Image Annotation Method using Association Rules Mining and Clustering

Abstract

Effective and fast retrieval of images from image datasets is not an easy task, especially with the continuous and fast growth of digital images added everyday by used to the web. Automatic image annotation is an approach that has been proposed to facilitate the retrieval of images semantically related to a query image. A multimodal image annotation method is proposed in this paper. The goal is to benefit from the visual features extracted from images and their associated user tags. The proposed method relies on clustering to regroup the text and visual features into clusters and on association rules mining to generate the rules that associate text clusters to visual clusters. In the experimental evaluation, two datasets of the photo annotation tasks are considered; ImageCLEF 2011 and ImageCLEF 2012. Results achieved by the proposed method are better than all the multimodal methods of participants in ImageCLEF 2011 photo annotation task and state-of-the-art methods. Moreover, the MiAP of the proposed method is better than the MiAP of 7 participants out of 11 when using ImageCLEF 2012 in the evaluation.

Authors and Affiliations

Mounira Taileb, Eman Alahmadi

Keywords

Related Articles

Attractiveness Analysis of Quiz Games

Quiz games are played on platforms such as television game shows, radio game shows, and recently, on mobile apps. In this study, HQ Trivia and SongPop 2 were chosen as the benchmark. Each game data have been collected fo...

Non Correlation DWT Based Watermarking Behavior in Different Color Spaces

There are two digital watermarking techniques. Digital watermarking techniques based on correlation and digital watermarking techniques that are not based on correlation. In previous work, we proposed a DWT2 based CDMA i...

Web Service Architecture for a Meta Search Engine 

With the rapid advancements in Information Technology, Information Retrieval on Internet is gaining its importance day by day. Nowadays there are millions of Websites and billions of homepages available on the Internet....

Fuzzy Logic-Controlled 6-DOF Robotic Arm Color-based Sorter with Machine Vision Feedback

A demonstration of the application of fuzzy logic-based joint controller (FLJC) to a 6-DOF robotic arm as a color-based sorter system is presented in this study. The robotic arm with FLJC is integrated with a machine vis...

Sea Lion Optimization Algorithm

This paper suggests a new nature inspired metaheuristic optimization algorithm which is called Sea Lion Optimization (SLnO) algorithm. The SLnO algorithm imitates the hunting behavior of sea lions in nature. Moreover, it...

Download PDF file
  • EP ID EP417782
  • DOI 10.14569/IJACSA.2018.091197
  • Views 128
  • Downloads 0

How To Cite

Mounira Taileb, Eman Alahmadi (2018). Multimodal Automatic Image Annotation Method using Association Rules Mining and Clustering. International Journal of Advanced Computer Science & Applications, 9(11), 678-684. https://europub.co.uk/articles/-A-417782