Structural Optimization of Deep Belief Network by Evolutionary Computation Methods including Tabu Search

Journal Title: Transactions on Machine Learning and Artificial Intelligence - Year 2018, Vol 6, Issue 1

Abstract

This paper proposes structural optimization method of a Deep Belief Network (DBN) which consists of multiple Restricted Boltzmann Machines (RBMs) and a single Feedforward Neural Network (FNN) using several kinds of evolutionary computation methods and modularization. The performance, accuracy of data classification or data prediction, should strongly depend on the structure of the network. Concretely, the number of RMBs, the number of nodes in the hidden layer of RMB. The result of the experiments using some benchmarks for image data classification problems by DBN optimized by the proposed method, DBN without any structural optimization, and some other data classification methods indicate that our proposed method defeats other existing classification methods.

Authors and Affiliations

Tomohiro Hayashida, Ichiro Nishizaki, Shinya Sekizaki, Masanori Nishida, Murman Dwi Prasetio

Keywords

Related Articles

Support Vector Machine Regression and Artificial Neural Network for Channel Estimation of LTE Downlink in High-Mobility Environments

In this paper we apply and assess the performance of support vector machine regression (SVR) and artificial neural network (ANN) channel estimation algorithms to the reference signal structure standardized for LTE Downli...

Computing on Encrypted Data into the Cloud though Fully Homomorphic Encryption

Securing Data in the cloud based on Fully Homomorphic Encryption (FHE) is a new and potential form of security that allows computing on encrypted data without decrypted it first. However, a practical FHE solution is not...

Isolating Natural Problem Environments in Unconstrained Natural Language Processing: Corruption and Skew

This work examines the full range of commonly available natural language processors' behaviors in a natural, unconstrained, and unguided environment. While permissible for typical research to constrain the language envir...

Detection of the Onset of Diabetes Mellitus by Bayesian Classifier Based Medical Expert System

Expert systems play an important role in medical diagnosis research. Researches are still being conducted for building expert systems capable of diagnosing different diseases. Diabetes mellitus is one of the diseases tha...

Study of Test Anxiety of Freshmen Engineering Boys and Girls Students and their Academic Performance in Science & Humanities Subjects

The main aim of this learning was the effect of teaching of self-regulation on test anxiety; college achievement and met cognition in boy students, The Society under study include all boy and girl students of MLRIT. From...

Download PDF file
  • EP ID EP265776
  • DOI 10.14738/tmlai.61.4048
  • Views 71
  • Downloads 0

How To Cite

Tomohiro Hayashida, Ichiro Nishizaki, Shinya Sekizaki, Masanori Nishida, Murman Dwi Prasetio (2018). Structural Optimization of Deep Belief Network by Evolutionary Computation Methods including Tabu Search. Transactions on Machine Learning and Artificial Intelligence, 6(1), 69-80. https://europub.co.uk/articles/-A-265776