ortizontal Aggregation in SQL for Data Mining Analysis to Prepare Data Sets
Journal Title: International Journal of Modern Engineering Research (IJMER) - Year 2013, Vol 3, Issue 4
Abstract
: Preparing a data set for analysis is generally the most time consuming task in a data mining project, requiring many complex SQL queries, joining tables and aggregating columns. Existing SQL aggregations have limitations to prepare data sets because they return one column per aggregated group. In general, a significant manual effort is required to build data sets, where a horizontal layout is required. We propose simple, yet powerful, methods to generate SQL code to return aggregated columns in a horizontal tabular layout, returning a set of numbers instead of one number per row. This new class of functions is called horizontal aggregations. Horizontal aggregations build data sets with a horizontal denormalized layout (e.g. point-dimension, observation-variable, instance-feature), which is the standard layout required by most data mining algorithms. We propose three fundamental methods to evaluate horizontal aggregations: CASE: Exploiting the programming CASE construct; SPJ: Based on standard relational algebra operators (SPJ queries); PIVOT: Using thePIVOT operator, which is offered by some DBMSs. Experiments with large tables compare the proposed query evaluation methods. Our CASE method has similar speed to the PIVOT operator and it is much faster than the SPJ method. In general, the CASE and PIVOT methods exhibit linear scalability, where as the SPJ method does not.
Authors and Affiliations
B Susrutha, J. Vamsi Nath
Keywords
Related Articles
- EP ID EP141140
- DOI -
- Views 112
- Downloads 0
Evaluation and Accuracy Assessment of Static GPS Technique in Monitoring of Horizontal Structural Deformations
It is well known that, deformation monitoring systems are considered, nowadays, to be the back bone factor for human safety as well as preserving the ultimate economy of his achievements. In this context, there...
Design of Cooling Package of Diesel Genset
Traditional cooling systems have relied on a mechanical coolant pump and an engine mounted radiator fan driven off the engine’s crankshaft. The compactness of the system often turned out to be a problem when the generato...
Solidification Simulation of Aluminum Alloy Casting – A Theoretical and Experimental Approach
Aluminium alloy castings are extensively used in general engineering, automotive and aerospace industries due to their excellent castability, machinability and high strength-to-weight ratio. The major problem w...
Content Extraction with text mining using natural language processing for anatomy based topic summarization
Abstract: Inorder to get exact content for the web browsers when searching for some information we have combined two methods together.The first method is text mining using natural language processing and parse tree...
Integration of Wired and Wireless Networks through a Personal Communication network (PCN)
Abstract: The Personal Communication Network (PCN) is known as the personal communication services (PCS) and is the result of the evolution of a mobile phone system. The PCN aims to support the services provided by...