Skip to content

Shubhf/LLM_Hinglish

Folders and files

NameName
Last commit message
Last commit date

Latest commit

ย 

History

4 Commits
ย 
ย 
ย 
ย 
ย 
ย 
ย 
ย 

Repository files navigation

๐Ÿš€ Hinglish RAG Chatbot โ€“ LLM-Powered Retrieval-Augmented Generation ๐Ÿ‡ฎ๐Ÿ‡ณ

This project is an LLM-powered Retrieval-Augmented Generation (RAG) chatbot designed specifically for Hinglish (Hindi-English code-switched) conversations. Inspired by TurboMLโ€™s mission to democratize AI, this chatbot leverages efficient retrieval and lightweight inference to enable real-time, multilingual AI applications.

โœจ Key Features

๐Ÿ”น FAISS-based Retrieval โ€“ Quickly fetches relevant Hinglish text to enhance context.
๐Ÿ”น LLM-powered Response Generation โ€“ Uses Mistral-7B/LLaMA-2-7B for contextual replies.
๐Ÿ”น Optimized for Low-Resource Languages โ€“ Custom embeddings & reinforcement learning improve retrieval.
๐Ÿ”น Efficient Inference Pipeline โ€“ Runs on GPU for fast processing in real-world applications.
๐Ÿ”น Gradio-powered UI โ€“ Interactive chatbot interface for seamless deployment.

๐Ÿš€ How It Works

1๏ธโƒฃ Retrieval: FAISS searches the most relevant Hinglish text snippets.
2๏ธโƒฃ Contextual Prompting: Retrieved text is formatted into a structured prompt.
3๏ธโƒฃ Response Generation: A fine-tuned LLM (Mistral/LLaMA-2) generates an appropriate response.
4๏ธโƒฃ User Interaction: The chatbot provides real-time answers in Hinglish.

๐Ÿ”ง Installation & Setup (Run on GPU ๐Ÿš€)

# Clone the repository
git clone https://github.com/LLM_Hinglish/hinglish-rag-chatbot.git  
cd hinglish-rag-chatbot  

# Install dependencies (Ensure GPU support)
pip install -r requirements.txt  

# Run the chatbot
python app.py  

๐Ÿ–ฅ๏ธ Gradio Interface

To launch the chatbot UI:

python app.py  

This will generate a public shareable link for easy access.

๐Ÿ’ก Motivation & Impact

โœ… India-first LLM Adaptation: Hinglish is widely spoken but underrepresented in AI models.
โœ… Scalable & Efficient: Works well even in low-resource environments.
โœ… TurboML Inspiration: Aligns with the mission of building open-source foundation models for India.


๐Ÿ”ฅ Want to contribute? Fork the repo & raise a PR!
๐Ÿ“ฉ Interested in AI research? Connect with me on LinkedIn!

Letโ€™s build Indiaโ€™s AI future together! ๐Ÿš€ ๐Ÿ‡ฎ๐Ÿ‡ณ

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published