Hybrid Algorithm for the Optimization of Training Convolutional Neural Network
Journal Title: International Journal of Advanced Computer Science & Applications - Year 2015, Vol 6, Issue 10
Abstract
The training optimization processes and efficient fast classification are vital elements in the development of a convolution neural network (CNN). Although stochastic gradient descend (SGD) is a Prevalence algorithm used by many researchers for the optimization of training CNNs, it has vast limitations. In this paper, it is endeavor to diminish and tackle drawbacks inherited from SGD by proposing an alternate algorithm for CNN training optimization. A hybrid of genetic algorithm (GA) and particle swarm optimization (PSO) is deployed in this work. In addition to SGD, PSO and genetic algorithm (PSO-GA) are also incorporated as a combined and efficient mechanism in achieving non trivial solutions. The proposed unified method achieves state-of-the-art classification results on the different challenge benchmark datasets such as MNIST, CIFAR-10, and SVHN. Experimental results showed that the results outperform and achieve superior results to most contemporary approaches.
Authors and Affiliations
Hayder Albeahdili, Tony Han, Naz Islam
Keywords
Related Articles
- EP ID EP106528
- DOI 10.14569/IJACSA.2015.061011
- Views 124
- Downloads 0
Balanced Distribution of Load on Grid Resources using Cellular Automata
Load balancing is a technique for equal and fair distribution of workloads on resources and maximizing their performance as well as reducing the overall execution time. However, meeting all of these goals in a single alg...
A New Uncertainty Measure in Belief Entropy Framework
Belief entropy, which represents the uncertainty measure between several pieces of evidence in the Dempster-Shafer framework, is attracting increasing interest in research. It has been used in many applications and is ma...
Fuzzy Data Mining for Autism Classification of Children
Autism is a development condition linked with healthcare costs, therefore, early screening of autism symptoms can cut down on these costs. The autism screening process involves presenting a series of questions for parent...
Identifying Top-k Most Influential Nodes by using the Topological Diffusion Models in the Complex Networks
Social networks are sub-set of complex networks, where users are defined as nodes, and the connections between users are edges. One of the important issues concerning social network analysis is identifying influential an...
Modeling and Control by Multi-Model Approach of the Greenhouse Dynamical System with Multiple Time-delays
This paper presents the Internal Multi-Model Control IMMC for a multivariable discrete-time system with variable multiple delays. This work focus on the Greenhouse climate model as a multivariable time-delay system. In f...