An Effective Automatic Image Annotation Model Via Attention Model and Data Equilibrium
Journal Title: International Journal of Advanced Computer Science & Applications - Year 2018, Vol 9, Issue 3
Abstract
Nowadays, a huge number of images are available. However, retrieving a required image for an ordinary user is a challenging task in computer vision systems. During the past two decades, many types of research have been introduced to improve the performance of the automatic annotation of images, which are traditionally focused on content-based image retrieval. Although, recent research demonstrates that there is a semantic gap between content-based image retrieval and image semantics understandable by humans. As a result, existing research in this area has caused to bridge the semantic gap between low-level image features and high-level semantics. The conventional method of bridging the semantic gap is through the automatic image annotation (AIA) that extracts semantic features using machine learning techniques. In this paper, we propose a novel AIA model based on the deep learning feature extraction method. The proposed model has three phases, including a feature extractor, a tag generator, and an image annotator. First, the proposed model extracts automatically the high and low-level features based on dual tree continues wavelet transform (DT-CWT), singular value decomposition, distribution of color ton, and the deep neural network. Moreover, the tag generator balances the dictionary of the annotated keywords by a new log-entropy auto-encoder (LEAE) and then describes these keywords by word embedding. Finally, the annotator works based on the long-short-term memory (LSTM) network in order to obtain the importance degree of specific features of the image. The experiments conducted on two benchmark datasets confirm that the superiority of proposed model compared to the previous models in terms of performance criteria.
Authors and Affiliations
Amir Vatani, Milad Taleby Ahvanooey, Mostafa Rahimi
Keywords
Related Articles
- EP ID EP278278
- DOI 10.14569/IJACSA.2018.090338
- Views 88
- Downloads 0
A Proposed Approach for Image Compression based on Wavelet Transform and Neural Network
Over the last years, wavelet theory has been used with great success in a wide range of applications as signal de-noising and image compression. An ideal image compression system must yield high-quality compressed image...
AUTOMATED EDGE DETECTION USING CONVOLUTIONAL NEURAL NETWORK
The edge detection on the images is so important for image processing. It is used in a various fields of applications ranging from real-time video surveillance and traffic management to medical imaging applications. Curr...
Formal Method to Derive Interoperability Requirements and Guarantees
Interoperability among telecommunications systems, possibly by different vendors, is essential for both the development of many telecommunications networks, and today's civilization development. Interoperability testing...
Vitality Aware Cluster Head Election to Alleviate the Wireless Sensor Network for Long Time
The Wireless Sensor Networks (WSN) motivated by its unique characters such as it is capable of enduring callous ecological circumstances, and grant better scalability. The wireless sensor network is composed of insignifi...
A MODIFIED METHOD FOR ORDER REDUCTION OF LARGE SCALE DISCRETE SYSTEMS
In this paper, an effective procedure to determine the reduced order model of higher order linear time invariant discrete systems is discussed. A new procedure has been proposed for evaluating Time moments of the origina...