Contradiction Resolution between Self and Outer Evaluation for Supervised Multi-Layered Neural Networks
Journal Title: International Journal of Advanced Research in Artificial Intelligence(IJARAI) - Year 2013, Vol 2, Issue 7
Abstract
In this paper, we propose a new type of informationtheoretic method. We suppose that a neuron should be evaluated from different points of view to precisely discern its properties. In this paper, we restrict ourselves to two types of evaluation methods for neurons, namely, self and outer-evaluation. A neuron fires only as a result of evaluating itself, while the neuron can fire as a result of evaluation by all surrounding neurons. Selfand outer-evaluation should be equivalent to each other. When contradiction between two types of evaluation exists, the contradiction should be as small as possible. Contradiction between self- and outer-evaluations is realized in terms of the Kullback- Leibler divergence between two types of neurons. Contradiction between self- and outer-evaluation can be resolved by decreasing the contradiction ratio between the two types of evaluation in terms of KL divergence. This method is expected to extract the main features in input patterns, if those are shared by two types of evaluation. We applied the method to two data sets, namely, the logistic and dollar-yen exchange rate data. In both problems, experimental results showed that visualization performance could be improved, leading to clearer class structure for both problems. In addition, when visualization was improved, generalization performance did not necessarily degrade, showing the possibility of networks with better visualization and prediction performance.
Authors and Affiliations
Ryotaro Kamimura
Keywords
Related Articles
- EP ID EP98678
- DOI -
- Views 162
- Downloads 0
NUMERICAL REPRESENTATION OF WEB SITES OF REMOTE SENSING SATELLITE DATA PROVIDERS AND ITS APPLICATION TO KNOWLEDGE BASED INFORMATION RETRIEVALS WITH NATURAL LANGUAGE
A method for numerical expression of web site which is relating to satellite remote sensing and its application to knowledge based information retrieval system which allows retrievals with natural language is propo...
CBR in the service of accident cases evaluating
This paper introduces a research aiming at the development of a decision support system concerning the approval of automated railway transportation systems. The objective is to implement a valuation method for the degree...
Color Radiomap Interpolation for Efficient Fingerprint WiFi-based Indoor Location Estimation
Indoor location estimation system based on existing 802.11 signal strength is becoming increasingly prevalent in the area of mobility and ubiquity. The user-based location determination system utilizes the informat...
An Interval-Based Context Reasoning Approach
Context-aware computing is an emerging computing paradigm that provides intelligent context-aware application. Context reasoning is an important aspect in context awareness, by which high level context can be derived fro...
Comparative Study on Sea Surface Temperature Estimation with Thermal Infrared Radiometer Data among Conventional MCSST, Split Window and Conjugate Gradient Based Methods
Comparative study on Sea Surface Temperature: SST estimations among the conventional Multi-Channel Seat Surface Temperature: MCSST, split window method and the proposed Conjugate Gradient based method: CGM with Thermal I...