Natural Gradient Descent for Training Stochastic Complex-Valued Neural Networks

Abstract

In this paper, the natural gradient descent method for the multilayer stochastic complex-valued neural networks is considered, and the natural gradient is given for a single stochastic complex-valued neuron as an example. Since the space of the learnable parameters of stochastic complex-valued neural networks is not the Euclidean space but a curved manifold, the complex-valued natural gradient method is expected to exhibit excellent learning performance.

Authors and Affiliations

Tohru Nitta

Keywords

Related Articles

Seamless Connectivity for Adaptive Multimedia Provisioning over P2P-enabled IP Multimedia Subsystem

The subsystem multimedia internet network (IMS) has been upgraded to support peer-to-peer content distribution services, the peer heterogeneity constraint imposes a challenge that is the guarantee of a certain level of Q...

A Novel Approach to Detect Duplicate Code Blocks to Reduce Maintenance Effort

It was found in many cases that a code might be a clone for one programmer but not the same for another one. This problem occurs because of inaccurate documentation. According to research, the maintainers are not aware o...

Hyperspectral Image Segmentation using Homogeneous Area Limiting and Shortest Path Algorithm

Segmentation, as a preprocessing, plays an important role in hyperspectral images. In this paper, considering the similarity of neighboring pixels, using the size measure, the image spectrum is divided into several segme...

Implementation of Machine Learning Model to Predict Heart Failure Disease

In the current era, Heart Failure (HF) is one of the common diseases that can lead to dangerous situation. Every year almost 26 million of patients are affecting with this kind of disease. From the heart consultant and s...

Multiple-Published Tables Privacy-Preserving Data Mining: A Survey for Multiple-Published Tables Techniques

With large growth in technology, reduced cost of storage media and networking enabled the organizations to collect very large volume of information from huge sources. Different data mining techniques are applied on such...

Download PDF file
  • EP ID EP121478
  • DOI 10.14569/IJACSA.2014.050729
  • Views 106
  • Downloads 0

How To Cite

Tohru Nitta (2014). Natural Gradient Descent for Training Stochastic Complex-Valued Neural Networks. International Journal of Advanced Computer Science & Applications, 5(7), 193-198. https://europub.co.uk/articles/-A-121478