Web Scraper Revealing Trends of Target Products and New Insights in Online Shopping Websites
Journal Title: International Journal of Advanced Computer Science & Applications - Year 2018, Vol 9, Issue 6
Abstract
Trillions of posts from Facebook, tweets in Twitter, photos on Instagram and e-mails on exchange servers are overwhelming the Internet with big data. This necessitates the development of such tools that can detect the frequent updates and select the required information instantly. This research work aims to implement scraper software that is capable of collecting the updated information from the target products hosted in fabulous online e-commerce websites. The software is implemented using Scrapy and Django frameworks. The software is configured and evaluated across different e-commerce websites. Individual website generates a greater amount of data about the products that need to be scraped. The proposed software provides the ability to search a target product in a single consolidated place instead of searching across various websites, such as amazon.com, alibaba.com and daraz.pk. Furthermore, the scheduling mechanism enables the scraper to execute at a required frequency within a specified time frame.
Authors and Affiliations
Habib Ullah, Zahid Ullah, Shahid Maqsood, Abdul Hafeez
Keywords
Related Articles
- EP ID EP324798
- DOI 10.14569/IJACSA.2018.090658
- Views 61
- Downloads 0
Feature Fusion: H-ELM based Learned Features and Hand-Crafted Features for Human Activity Recognition
Recognizing human activities is one of the main goals of human-centered intelligent systems. Smartphone sensors produce a continuous sequence of observations. These observations are noisy, unstructured and high dimension...
Integration of Wearable Smart Sensor for Improving e-Healthcare
Analyzing health conditions using sensors is one of the daily activities in a healthcare organization. The purpose of this research is to improve the e-healthcare formulated through the integration of wearable smart sens...
An Analysis of Information Technology on Data Processing by using Cobit Framework
Information technology and processes is inter connected, directing and controlling the company in achieving corporate goals through value-added and balancing the risks and benefits of information technology. This study i...
Predicting Future Gold Rates using Machine Learning Approach
Historically, gold was used for supporting trade transactions around the world besides other modes of payment. Various states maintained and enhanced their gold reserves and were recognized as wealthy and progressive sta...
Investigating Clinical Decision Support Systems Success Factors with Usability Testing
Clinical Decision Support Systems (CDSS) have been used widely since 2000s to improve the healthcare quality. CDSS can be utilized to support healthcare services as a tool to diagnose, predict, as well as to provide clin...