Deep Learning-Based Automated Classroom Slide Extraction
Journal Title: International Journal of Innovations in Science and Technology - Year 2024, Vol 6, Issue 2
Abstract
Automated extraction of valuable content from real-time classroom lectures holds significant potential for enhancing educational accessibility and efficiency. However, capturing the spontaneous insights of live lectures often proves challenging due to rapid visual transitions, instructor movement, and diverse learning styles. This paper presents a novel approach that combines the strengths of YOLO and Scale-Invariant Feature Transform (SIFT) techniques to automatically extract slides from live classroom lectures. YOLO, a real-time object detection algorithm, is employed to identify board area, teacher, and other objects within the video stream. While SIFT, a robust feature-based method, was used to accurately merge key points from multiple pictures of the same region. The proposed method involves a multi-stage process: first, YOLO detects the potential place of the teacher, which occluded the board within the video frames. Subsequently, the teacher was removed from the image. The board was divided into multiple segments, to remove and merge redundant content Scale-invariant feature Transform (SIFT) was employed. Experimental results on a diverse dataset of classroom lecture videos demonstrated the effectiveness of the proposed method in extracting slides across different environments, lecture styles, and recording conditions. The potential benefits include improved note-taking, reduced manual effort in content curation, and enhanced accessibility to lecture materials. The presented approach contributes to the broader goal of leveraging computer vision and machine learning techniques to transform traditional classroom settings into modern, interactive, and adaptive learning environments.
Authors and Affiliations
Zeeshan Azhar, Hassan Nazeer Chaudhry, Farzana Kulsoom, Sanam Narejo
Keywords
Related Articles
- EP ID EP760316
- DOI -
- Views 8
- Downloads 0
Machine Learning in Livestock Management: A Systematic Exploration of Techniques and Outcomes
This Systematic Literature Review (SLR) examines the growing field of leveraging Machine Learning (ML) to improve livestock productivity. Through a meticulous analysis of peer-reviewed articles, the study categorizes r...
SSOCANET -Empowering VANETs with Salp Swarm Optimization-Enhanced Clustering Algorithm
Vehicular Ad hoc networks (VANETs) present significant challenges due to the dynamic nature of vehicle movements, leading to a constantly changing vehicular network topology. This instability results in packet loss, ne...
A Review on Cloud Computing Threats, Securityand Possible Solutions
loud computing is increasingly popular, with major companies like Microsoft, Google, and Amazon creating expansive cloud environments to support vast user bases. Despite its benefits, security remains a significant con...
Enhanced Brain Tumor Diagnosis with EfficientNetB6: Leveraging Transfer Learning and Edge Detection Techniques
Correct identification of brain tumors is crucial for determining the subsequent steps in patient management and prognosis. This study introduces a novel approach by mimicking three enhanced deep learning models Effici...
Codebook-Based Feature Engineering for Human Activity Recognition Using Multimodal Sensory Data
Recently, Human Activity Recognition (HAR) using sensory data from various devices has become increasingly vital in fields like healthcare, elderly care, and smart home systems. However, many existing HAR systems face...