Real-Time Analysis of Students’ Activities on an E-Learning Platform based on Apache Spark
Journal Title: International Journal of Advanced Computer Science & Applications - Year 2017, Vol 8, Issue 7
Abstract
Real time analytics is the capacity to extract valuables insights from data that comes continuously from activities on the web or network sensors. It is largely used in web based business to drive decisions based on user’s experiences, such dynamic pricing and personalized advertising. Many universities have adopted web based learning in their learning process. They use data-mining techniques to better understand students’ behavior, and most of the tools developed are based on historical and stored data, and do not allow real time reactivity. Online activities of learners generate at high speed a huge amount of data in form of users’ interactions which have all characteristics to be considered as Big data. Deal with volume and velocity of these data in order to inform and enable decisions-makers to act at right time lead us to use new methods to capture E-Learning data, and process it in real time. This paper focuses on the design and implementation of modern and hybrid real time data pipeline architecture using Apache Flume to collect data, Apache Spark as an unified engine computation for performing analytics on students’ activities data and Apache Hive as a data warehouse for storing the processed data and for use by various reporting tools. To conceive this platform we conduct an experiment on Moodle database source.
Authors and Affiliations
Abdelmajid Chaffai, Larbi Hassouni, Houda Anoun
Keywords
Related Articles
- EP ID EP260199
- DOI 10.14569/IJACSA.2017.080715
- Views 92
- Downloads 0
One-Year Survival Prediction of Myocardial Infarction
Myocardial infarction is still one of the leading causes of death and morbidity. The early prediction of such disease can prevent or reduce the development of it. Machine learning can be an efficient tool for predicting...
Mixed Profile Method of Speed and Location for Robotic Arms Motion used for Precise Positioning
The paper describes a new real-time computation method named Mixt Profile of Speed (MPS), which is used to obtain the value of speed, at every sampling period of time, during the acceleration and deceleration stage, wher...
Digital Image Security: Fusion of Encryption, Steganography and Watermarking
Digital images are widely communicated over the internet. The security of digital images is an essential and challenging task on shared communication channel. Various techniques are used to secure the digital image, such...
Audio Augmentation for Traffic Signs: A Case Study of Pakistani Traffic Signs
Augmented Reality (AR) extend the appearance of real-world by adding digital information to the scene using computer graphics and image processing techniques. Various approaches have been used to detect, identify and tra...
Comprehensive Survey on Dynamic Graph Models
Most of the critical real-world networks are con-tinuously changing and evolving with time. Motivated by the growing importance and widespread impact of this type of networks, the dynamic nature of these networks have ga...