Efficient Deep Learning Approach for Dimensionality Reduction using Micro blogs from Big data
Journal Title: International Journal for Research in Applied Science and Engineering Technology (IJRASET) - Year 2017, Vol 5, Issue 3
Abstract
Nowadays Information Technology plays a vital role in every aspects of the human life. Now a world, the huge amount of stored information has been enormously increasing day by day which is generally in the unstructured form and cannot be used for any processing to extract useful information. Exploring potentially useful information from huge amount of textual data produced by micro blogging services has attracted much attention in recent years. An important preprocessing step of micro blog text mining is to convert natural language texts into proper numerical representations. Due to the short-length characteristics of micro blog texts, using term frequency vectors to represent micro blog texts will cause “sparse data” problem. Finding proper representations of micro blog texts is a challenging issue. In this project, we apply deep learning networks to map the high-dimensional representations of micro blog texts to low-dimensional representations. To improve the result of dimensionality reduction, we take advantage of the semantic similarity derived from two types of micro blog specific information, namely the retweet relationship and hash tags. Two types of approaches, including modifying training data and modifying the training objective of deep networks, are proposed to make use of micro blog-specific information. To improve the efficiency we implement the system in Hadoop. In addition to that to make services effective. To achieve the scalability and efficiency with help of map reduce framework in a big data environment.
Authors and Affiliations
Mr. M. Vengateshwaran, Mrs. C. Ramyapriyadarsini, Ms. N. Valarmathi
Keywords
Related Articles
- EP ID EP23199
- DOI http://doi.org/10.22214/ijraset.2017.3002
- Views 289
- Downloads 6
Synthesis and Characterization of Nano Copper Particles
Nanoscience and Nanotechnology are the growing fields of scientific research and commercial development. Nanosize powders are solid particles with typical size in the range of 1 to 100 nm. Nanosize powders have very lar...
Light Weight Bricks Using Waste EPS Beads
Demand of construction materials is increasing day by day, Technology has improved a lot in construction techniques of structures. Earlier structures were constructed with heavy materials, but in present time of constru...
A Comparative Study Of Digital Image Watermarking With Its Types And Techniques
In this study, we presented a study of digital watermarking with its techniques and types. Image Watermarking is being seen as a forthcoming answer for security. At the present time, there is a wide range of watermarkin...
Short Range Inter Vehicle Communication, Sharing Information Using DSRC
Vehicular communication systems are a type of network in which the vehicles are the communicating nodes, providing each other with information, such as safety warnings and traffic information. As a cooperative approach,...
Effective Detection of DDOS Based on Big Data- MapReduce
Distributed Denial of Service (DDoS) attacks is large-scale cooperative attacks launched from a large number of compromised hosts called Zombies are a major threat to Internet services. As the serious damage caused by D...