Shrinkage Parameters for Each Explanatory Variable Found Via Particle Swarm Optimization in Ridge Regression
Journal Title: Trends in Computer Science and Information Technology - Year 2017, Vol 2, Issue 1
Abstract
Ridge regression method is an improved method when the assumptions of independence of the explanatory variables cannot be achieved, which is also called multicollinearity problem, in regression analysis. One of the way to eliminate the multicollinearity problem is to ignore the unbiased property of. β Ridge regression estimates the regression coefficients biased in order to decrease the variance of the regression coefficients. One of the most important problems in ridge regression is to decide what the shrinkage parameter (k) value will be. This k value was found to be a single value in almost all these studies in the literature. In this study, different from those studies, we found different k values corresponding to each diagonal elements of variance-covariance matrix of instead of a single value of k by using a new algorithm based on particle swarm optimization. To evaluate the performance of our proposed method, the proposed method is firstly applied to real-life data sets and compared with some other studies suggested in the ridge regression literature. Finally, two different simulation studies are performed and the performance of the proposed method with different conditions is evaluated by considering other studies suggested in the ridge regression literature.
Authors and Affiliations
Ngambusabongsopa Ransikarn, Havyarimana Vincent, Li Zhiyong
Keywords
Related Articles
- EP ID EP543579
- DOI 10.17352/tcsit.000005
- Views 71
- Downloads 0
Squaring the Circle Using Modified Tartaglia Method
The paper presents a modified Tartaglia method. Tartaglia proposed a simple approach to perform an approximate quadrature of the circle. His construction results with the number pi=3.125. Using a similar construction as...
Optimizing the Cross Section of Cold-Rolled Steel Beams Using a Genetic Algorithm: Avoiding Local Optima Using Adaptive Mutation Control, Flexible Restriction Handling and Inbreed Avoiding Mating Strategies
In modern mechanical engineering and steelwork the use of cold-rolled steel sections is a standard method. These sections should be mechanically stable on the one hand and cost efficient on the other hand. To decide what...
Video-based assessment of practical operative skills for Undergraduate dental students
Introduction: The aim of this study is to evaluate, within the scope of an experimental design, to what extent the assessment of two different settings of prepared cavities, based on video sequences, containing digital a...
Classification by Artificial Neural Network according to the values affecting Electricity Generation
Predicting the amount of electricity produced in a power plant is very important for today’s economy. Oven Power (MW), Boiler Input Gas Temperature, Superheated Steam Amount, ID-Fan Speed, Feeding Water Tank data affect...
Leveraging Data Analytics by Transforming Relational Database Schema in to Big Data
The growth of data and its efficient handling is becoming more popular trend in recent years bringing new challenges to explore new avenues. Data analytics can be done more efficiently with the availability of distribute...