Parameter Optimization for Nadaraya-Watson Kernel Regression Method with Small Samples
Journal Title: International Journal of Advanced Research in Artificial Intelligence(IJARAI) - Year 2016, Vol 5, Issue 5
Abstract
Many current regression algorithms have unsatisfactory prediction accuracy with small samples. To solve this problem, a regression algorithm based on Nadaraya-Watson kernel regression (NWKR) is proposed. The proposed method advocates parameter selection directly from the standard deviation of training data, optimized with leave-one-out cross- validation (LOO-CV). Good generalization performance of the proposed parameter selection is demonstrated empirically using small sample regression problems with Gaussian noise. The results show that proposed parameter optimization method is more robust and accurate than other methods for different noise levels and different sample sizes, and indicate the importance of Vapnik’s e-insensitive loss for regression problems with small samples.
Authors and Affiliations
Li Fengping, Zhou Yuqing, Xue Wei
Keywords
Related Articles
- EP ID EP90645
- DOI 10.14569/IJARAI.2016.050501
- Views 150
- Downloads 0
An Efficient Routing Protocol under Noisy Environment for Mobile Ad Hoc Networks using Fuzzy Logic
A MANET is a collection of mobile nodes communicating and cooperating with each other to route a packet from the source to their destinations. A MANET is used to support dynamic routing strategies in absence of wir...
FISHER DISTANCE BASED GA CLUSTERING TAKING INTO ACCOUNT OVERLAPPED SPACE AMONG PROBABILITY DENSITY FUNCTIONS OF CLUSTERS IN FEATURE SPACE
Fisher distance based Genetic Algorithm: GA clustering method which takes into account overlapped space among probability density functions of clusters in feature space is proposed. Through experiments with simulation da...
A genetic algorithm approach for scheduling of resources in well-services companies
In this paper, two examples of resources scheduling in well-services companies are solved by means of genetic algorithms: resources for call solving, people scheduling. The results demonstrate that the genetic algorithm...
Attribute Reduction for Generalized Decision Systems*
Attribute reduction of information system is one of the most important applications of rough set theory. This paper focuses on generalized decision system and aims at studying positive region reduction and distribu...
Category Decomposition Method Based on Matched Filter for Un-Mixing of Mixed Pixels Acquired with Spaceborne Based Hyperspectral Radiometers
Category decomposition method based on matched filter for un-mixing of mixed pixels: mixels which are acquired with spaceborne based hyperspectral radiometers is proposed. Through simulation studies with simulated...