Hybrid Algorithm for the Optimization of Training Convolutional Neural Network

Abstract

The training optimization processes and efficient fast classification are vital elements in the development of a convolution neural network (CNN). Although stochastic gradient descend (SGD) is a Prevalence algorithm used by many researchers for the optimization of training CNNs, it has vast limitations. In this paper, it is endeavor to diminish and tackle drawbacks inherited from SGD by proposing an alternate algorithm for CNN training optimization. A hybrid of genetic algorithm (GA) and particle swarm optimization (PSO) is deployed in this work. In addition to SGD, PSO and genetic algorithm (PSO-GA) are also incorporated as a combined and efficient mechanism in achieving non trivial solutions. The proposed unified method achieves state-of-the-art classification results on the different challenge benchmark datasets such as MNIST, CIFAR-10, and SVHN. Experimental results showed that the results outperform and achieve superior results to most contemporary approaches.

Authors and Affiliations

Hayder Albeahdili, Tony Han, Naz Islam

Keywords

Related Articles

Enhanced Random Early Detection using Responsive Congestion Indicators

Random Early Detection (RED) is an Active Queue Management (AQM) method proposed in the early 1990s to reduce the effects of network congestion on the router buffer. Although various AQM methods have extended RED to enha...

Identification and Nonlinear PID Control of Hammerstein Model using Polynomial Structures

In this paper, a new nonlinear discrete-time PID is proposed to control Hammerstein model. This model is composed by a static nonlinearity gain associated to a linear dynamic sub-system. Nonlinear polynomial structures a...

Towards Analytical Modeling for Persuasive Design Choices in Mobile Apps

Persuasive technology has emerged as a new field of research in the past decade with its applications in various domains including web-designing, human-computer interaction, healthcare systems, and social networks. Altho...

Security Risk Scoring Incorporating Computers' Environment

A framework of a Continuous Monitoring System (CMS) is presented, having new improved capabilities. The system uses the actual real-time configuration of the system and environment characterized by a Configuration Manage...

Download PDF file
  • EP ID EP106528
  • DOI 10.14569/IJACSA.2015.061011
  • Views 128
  • Downloads 0

How To Cite

Hayder Albeahdili, Tony Han, Naz Islam (2015). Hybrid Algorithm for the Optimization of Training Convolutional Neural Network. International Journal of Advanced Computer Science & Applications, 6(10), 79-85. https://europub.co.uk/articles/-A-106528