Parameter Optimization for Nadaraya-Watson Kernel Regression Method with Small Samples

Abstract

 Many current regression algorithms have unsatisfactory prediction accuracy with small samples. To solve this problem, a regression algorithm based on Nadaraya-Watson kernel regression (NWKR) is proposed. The proposed method advocates parameter selection directly from the standard deviation of training data, optimized with leave-one-out cross- validation (LOO-CV). Good generalization performance of the proposed parameter selection is demonstrated empirically using small sample regression problems with Gaussian noise. The results show that proposed parameter optimization method is more robust and accurate than other methods for different noise levels and different sample sizes, and indicate the importance of Vapnik’s e-insensitive loss for regression problems with small samples.

Authors and Affiliations

Li Fengping, Zhou Yuqing, Xue Wei

Keywords

Related Articles

Automatic Melakarta Raaga Identification Syste: Carnatic Music

It is through experience one could as certain that the classifier in the arsenal or machine learning technique is the Nearest Neighbour Classifier. Automatic melakarta raaga identification system is achieved by identifyi...

 Relation Between Chlorophyll-A Concentration and Red Tide in the Intensive Study Area of the Ariake Sea, Japan in Winter Seasons by using MODIS Data

 Relation between chlorophyll-a concentration and red tide in the intensive study area of the back of Ariake Sea, Japan in the recent winter seasons is investigated by using MODIS data. Mechanism of red tide appeara...

Memetic Algorithm with Filtering Scheme for the Minimum Weighted Edge Dominating Set Problem

The minimum weighted edge dominating set problem (MWEDS) generalizes both the weighted vertex cover problem and the problem of covering the edges of graph by a minimum cost set of both vertices and edges. In this paper,...

Method for 3D Object Reconstruction Using Several Portion of 2D Images from the Different Aspects Acquired with Image Scopes Included in the Fiber Retractor

Method for 3D object reconstruction using several portions of 2D images from the different aspects which are acquired with image scopes included in the fiber retractor is proposed. Experimental results show a great possi...

 METHOD FOR TEALEAVES QUALITY ESTIMATION THROUGH MEASUREMENTS OF DEGREE OF POLAZATION, LEAF AREA INDEX, PHOTOSYNTHESIS AVAILABLE RADIANCE AND NORMALIZED DIFFERENCE VEGETATION INDEX FOR CHARACTERIZATION OF TEALEAVES

Method for tealeaves quality estimation through measurements of Degree of Polarization: DP, Leaf Area Index: LAI, Photosynthesis Available Radiance: PAR and Normalized Difference Vegetation Index: NDVI for characterizati...

Download PDF file
  • EP ID EP90645
  • DOI 10.14569/IJARAI.2016.050501
  • Views 131
  • Downloads 0

How To Cite

Li Fengping, Zhou Yuqing, Xue Wei (2016).  Parameter Optimization for Nadaraya-Watson Kernel Regression Method with Small Samples. International Journal of Advanced Research in Artificial Intelligence(IJARAI), 5(5), 1-6. https://europub.co.uk/articles/-A-90645