Contradiction Resolution between Self and Outer Evaluation for Supervised Multi-Layered Neural Networks
Journal Title: International Journal of Advanced Research in Artificial Intelligence(IJARAI) - Year 2013, Vol 2, Issue 7
Abstract
In this paper, we propose a new type of informationtheoretic method. We suppose that a neuron should be evaluated from different points of view to precisely discern its properties. In this paper, we restrict ourselves to two types of evaluation methods for neurons, namely, self and outer-evaluation. A neuron fires only as a result of evaluating itself, while the neuron can fire as a result of evaluation by all surrounding neurons. Selfand outer-evaluation should be equivalent to each other. When contradiction between two types of evaluation exists, the contradiction should be as small as possible. Contradiction between self- and outer-evaluations is realized in terms of the Kullback- Leibler divergence between two types of neurons. Contradiction between self- and outer-evaluation can be resolved by decreasing the contradiction ratio between the two types of evaluation in terms of KL divergence. This method is expected to extract the main features in input patterns, if those are shared by two types of evaluation. We applied the method to two data sets, namely, the logistic and dollar-yen exchange rate data. In both problems, experimental results showed that visualization performance could be improved, leading to clearer class structure for both problems. In addition, when visualization was improved, generalization performance did not necessarily degrade, showing the possibility of networks with better visualization and prediction performance.
Authors and Affiliations
Ryotaro Kamimura
Keywords
Related Articles
- EP ID EP98678
- DOI -
- Views 152
- Downloads 0
A Novel Control-Navigation System- Based Adaptive Optimal Controller & EKF Localization of DDMR
This paper presents a newly developed approach for Differential Drive Mobile Robot (DDMR). The main goal is to provide a high dynamic system response in the joint space level, the low level control, as well as to e...
Migration Dynamics in Artificial Agent Societies
An Artificial Agent Society can be defined as a collection of agents interacting with each other for some purpose and/or inhabiting a specific locality, possibly in accordance to some common norms/rules. These soci...
A Method of Multi-License Plate Location in Road Bayonet Image
To solve the problem of multi-license plate location in road bayonet image, a novel approach was presented, which utilized plate’s color features, geometry characteristics and gray feature. Firstly, the RGB color i...
Evaluation of Cirrus Cloud Detection Accuracy of GOSAT/CAI and Landsat-8 with Laser Radar: Lidar and Confirmation with Calipso Data
Cirrus cloud detection accuracy of GOSAT/CAI and Landsat-8 is evaluated with a ground based Laser Radar: Lidar data and sky view camera data. Also, the evaluation results are confirmed with Calipso data together wi...
A Comparative Study on different AI Techniques towards Performance Evaluation in RRM(Radar Resource Management)
The multifunction radar (MFR) has to make a decision as to which functions are to be performed first or which must be degraded or even not done at all when there are not enough resources to be allocated. The process of m...