ortizontal Aggregation in SQL for Data Mining Analysis to Prepare Data Sets
Journal Title: International Journal of Modern Engineering Research (IJMER) - Year 2013, Vol 3, Issue 4
Abstract
: Preparing a data set for analysis is generally the most time consuming task in a data mining project, requiring many complex SQL queries, joining tables and aggregating columns. Existing SQL aggregations have limitations to prepare data sets because they return one column per aggregated group. In general, a significant manual effort is required to build data sets, where a horizontal layout is required. We propose simple, yet powerful, methods to generate SQL code to return aggregated columns in a horizontal tabular layout, returning a set of numbers instead of one number per row. This new class of functions is called horizontal aggregations. Horizontal aggregations build data sets with a horizontal denormalized layout (e.g. point-dimension, observation-variable, instance-feature), which is the standard layout required by most data mining algorithms. We propose three fundamental methods to evaluate horizontal aggregations: CASE: Exploiting the programming CASE construct; SPJ: Based on standard relational algebra operators (SPJ queries); PIVOT: Using thePIVOT operator, which is offered by some DBMSs. Experiments with large tables compare the proposed query evaluation methods. Our CASE method has similar speed to the PIVOT operator and it is much faster than the SPJ method. In general, the CASE and PIVOT methods exhibit linear scalability, where as the SPJ method does not.
Authors and Affiliations
B Susrutha, J. Vamsi Nath
Keywords
Related Articles
- EP ID EP141140
- DOI -
- Views 121
- Downloads 0
Integral solution of the non-homogeneous heptic equation in terms of the generalised Fibonacci and Lucas sequences
Abstract: We obtain infinitely many non-zero integer sextuples ( , , , , , ) x y z w p T satisfying the Non-homogeneous equation of degree seven with six unknowns given by 5 5 3 3 2 2 2 2 3 x y x y xy z w p T...
A Survey of User Authentication Schemes for Mobile Device
Personal mobile devices (PMDs) have become ubiquitous technology. There, steadily increasing computational and storage capabilities have enabled them to over an increasingly large set of services. Mobile devices...
CFD Analysis and Fabrication of Aluminium Cenosphere Composites
Metal matrix composites are engineered materials with a combination of two or more dissimilar materials, to obtain enhanced properties. Aluminium alloys reinforced with ceramic particles exhibit superior mechanical...
Distributed Utility-Based Energy Efficient Cooperative Medium Access Control in MANETS
Cooperative communication, that utilizes near terminals to relay the overhearing information to grasp the variability gains, choices a nice potential to strengthen the transmission potency in wireless networks....
Seismic Assessment of Existing Bridge Using OPENSEES
The task of this paper is to determine if the response of existing bridge near village Korti in the vicinity of Pandharpur, designed using the Indian Standard Specifications would meet performance requirements...