A Large Language Model-based Web Application for Contextual Document Conversation
Journal Title: International Journal of Innovations in Science and Technology - Year 2024, Vol 6, Issue 4
Abstract
The emergence of Large Language Models (LLM), such as ChatGPT, Gemini, and Claude has ushered in a new era of natural language processing, enabling rich textual interactions with computers. However, despite the capabilities of these new language models, they face significant challenges when queried on recent information or private data not included in the model’s dataset. Retrieval Augmented Generation (RAG) overcame the problems mentioned earlier by augmenting user queries with relevant context from a user-provided document(s), thus grounding the model’s response to inaccurate source material. In research, RAG enables users to engage interactively with their documents, instead of manually reading through their document(s). Users provide their document(s) to the system, which is then converted into vector indices, and used to inject contextual information into the user prompt during retrieval. The augmented prompt then enables the language model to contextually answer user queries. The research is composed of a web application, with an intuitive interface for interacting with the LIama 3.2 1B, an open-source LLM. Users can upload their document(s) and chat with the LLM in the context of their uploaded document(s).
Authors and Affiliations
Asad Khan, Abdul Haseeb Malik, Talha Ahsan, Qazi Ejaz Ali
Keywords
Related Articles
- EP ID EP760589
- DOI -
- Views 44
- Downloads 0
An Enhanced Novel Iot-Based Car Accident Detection and AlertSystem
The excessive use of vehicles for our day-to-day tasks in this revolutionized era has become a necessity, making our lives convenient and technology-dependent. This rise in the use of vehicles has led to a greater numb...
Image Compression Exploration using Discrete Wavelets Transform Families and Level
This analysis paper is based on Discrete Wavelets Transform (DWT) for image compression using wavelets families and levels. The DW transforms the image or data into frequency components that match its resolution scale...
Deep Learning for Viral Detection: Affordable Camera Technology in Public Health
Viral infections like chickenpox, measles, and monkeypox pose significant global health challenges, affecting millions with varying severity. This study presents a novel deeplearning approach using widely available low-...
Machine Learning Prediction of Mechanical Properties in Reinforcement Bars: A Data-Driven Approach
Introduction/Importance of Study: This study addresses the pressing need for precise prediction of mechanical properties in steel reinforcement bars (rebars) through a data-driven approach utilizing machine learning te...
Design Of aPhotocatalytic Reaction System forPollutant Degradation: A Computational Study
In this study, Computational Fluid Dynamics (CFD) was used to model and simulate the photocatalytic degradation of methyl orange (MeO) in a stirred photoreactor, particularly in the presence of a bismuth oxide cat...