Structural Optimization of Deep Belief Network by Evolutionary Computation Methods including Tabu Search

Journal Title: Transactions on Machine Learning and Artificial Intelligence - Year 2018, Vol 6, Issue 1

Abstract

This paper proposes structural optimization method of a Deep Belief Network (DBN) which consists of multiple Restricted Boltzmann Machines (RBMs) and a single Feedforward Neural Network (FNN) using several kinds of evolutionary computation methods and modularization. The performance, accuracy of data classification or data prediction, should strongly depend on the structure of the network. Concretely, the number of RMBs, the number of nodes in the hidden layer of RMB. The result of the experiments using some benchmarks for image data classification problems by DBN optimized by the proposed method, DBN without any structural optimization, and some other data classification methods indicate that our proposed method defeats other existing classification methods.

Authors and Affiliations

Tomohiro Hayashida, Ichiro Nishizaki, Shinya Sekizaki, Masanori Nishida, Murman Dwi Prasetio

Keywords

Related Articles

SIMARECH 3: A New Application for the Governance of Scientific Research

In the international context of research assessment, many countries appear to move critically towards a quantitative evaluation policy, which would eventually complement or replace the traditional peer review system. How...

A Dynamic Clustering Approach for Maximizing Scalability in Wireless Sensor Networks

Scalability is an important and crucial issue which in routing protocols for Wireless Sensor Networks (WSNs). In this paper, we present an approach to achieving a balanced energy consumption rate using dynamic clustering...

Extracting Sentiments and Summarizing Health Reviews from Social Media Using Machine Learning Techniques

Most of the health organizations provide an array of medical services and request their beneficiaries to provide their experience’s in the form of opinion/reviews for which they are associated. Doctors of national and in...

Image Category Recognition using Bag of Visual Words Representation

Image category recognition is one of the challenging tasks due to difference in image background, illumination, scale, clutter, rotation, etc. Bag-of-Visual-Words (BoVW) model is considered as the standard approach for i...

Structural Optimization of Deep Belief Network by Evolutionary Computation Methods including Tabu Search

This paper proposes structural optimization method of a Deep Belief Network (DBN) which consists of multiple Restricted Boltzmann Machines (RBMs) and a single Feedforward Neural Network (FNN) using several kinds of evolu...

Download PDF file
  • EP ID EP265776
  • DOI 10.14738/tmlai.61.4048
  • Views 77
  • Downloads 0

How To Cite

Tomohiro Hayashida, Ichiro Nishizaki, Shinya Sekizaki, Masanori Nishida, Murman Dwi Prasetio (2018). Structural Optimization of Deep Belief Network by Evolutionary Computation Methods including Tabu Search. Transactions on Machine Learning and Artificial Intelligence, 6(1), 69-80. https://europub.co.uk/articles/-A-265776