Contradiction Resolution between Self and Outer Evaluation for Supervised Multi-Layered Neural Networks
Journal Title: International Journal of Advanced Research in Artificial Intelligence(IJARAI) - Year 2013, Vol 2, Issue 7
Abstract
In this paper, we propose a new type of informationtheoretic method. We suppose that a neuron should be evaluated from different points of view to precisely discern its properties. In this paper, we restrict ourselves to two types of evaluation methods for neurons, namely, self and outer-evaluation. A neuron fires only as a result of evaluating itself, while the neuron can fire as a result of evaluation by all surrounding neurons. Selfand outer-evaluation should be equivalent to each other. When contradiction between two types of evaluation exists, the contradiction should be as small as possible. Contradiction between self- and outer-evaluations is realized in terms of the Kullback- Leibler divergence between two types of neurons. Contradiction between self- and outer-evaluation can be resolved by decreasing the contradiction ratio between the two types of evaluation in terms of KL divergence. This method is expected to extract the main features in input patterns, if those are shared by two types of evaluation. We applied the method to two data sets, namely, the logistic and dollar-yen exchange rate data. In both problems, experimental results showed that visualization performance could be improved, leading to clearer class structure for both problems. In addition, when visualization was improved, generalization performance did not necessarily degrade, showing the possibility of networks with better visualization and prediction performance.
Authors and Affiliations
Ryotaro Kamimura
Keywords
Related Articles
- EP ID EP98678
- DOI -
- Views 147
- Downloads 0
Comparative study between the proposed shape independent clustering method and the conventional methods (K-means and the other)
Cluster analysis aims at identifying groups of similar objects and, therefore helps to discover distribution of patterns and interesting correlations in the data sets. In this paper, we propose to provide a consist...
Multi Spectral Image Classification Method with Selection of Independent Spectral Features through Correlation Analysis
Multi spectral image classification method with selection processes of independent spectral features through correlation analysis is proposed. The proposed method is validated by applying to the polarimetric Synthetic Ap...
Dynamic Decision Support System Based on Bayesian Networks
The improvement of medical care quality is a significant interest for the future years. The fight against nosocomial infections (NI) in the intensive care units (ICU) is a good example. We will focus on a set of ob...
Evolutionary Approaches to Expensive Optimisation
Surrogate assisted evolutionary algorithms (EA) are rapidly gaining popularity where applications of EA in complex real world problem domains are concerned. Although EAs are powerful global optimizers, finding opti...
Parallelization of 2-D IADE-DY Scheme on Geranium Cadcam Cluster for Heat Equation
A parallel implementation of the Iterative Alternating Direction Explicit method by D’Yakonov (IADE-DY) for solving 2-D heat equation on a distributed system of Geranium Cadcam cluster (GCC) using the Message Passi...