DEV Community

Cover image for Do you Know! Llama ?
Baivab Sarkar
Baivab Sarkar

Posted on

Do you Know! Llama ?

Llama2 CSV ChatBot

It's a conversational tool powered by a fine-tuned large language model (LLM) known as Llama-2 7B. This chatbot utilizes CSV retrieval capabilities, enabling users to engage in multi-turn interactions based on uploaded CSV data.

Image description

Suuuuuuu Want to try: ๐Ÿ‘‡๐Ÿ‘‡๐Ÿ‘‡

huggingface.co/Llama-2-GGML-CSV-Chatbot

๐Ÿ“– ChatBot Conversession

Image description

โšกStreamlit ver. on #v2.0.2.dev20240102

ChatBot Conversession img-1 png

Development Specs

๐Ÿ› ๏ธ Try it on your ๐Ÿ’ป

  1. Clone the Repository:
git clone https://github.com/ThisIs-Developer/Llama-2-GGML-CSV-Chatbot.git
Enter fullscreen mode Exit fullscreen mode
  1. Install Dependencies:
pip install -r requirements.txt
Enter fullscreen mode Exit fullscreen mode

Download the Llama 2 Model:

Download the Llama 2 model file named llama-2-7b-chat.ggmlv3.q4_0.bin from the following link:
๐Ÿ”—Download Llama 2 Model

Image description

Llama 2 Model Information

Name Quant method Bits Size Max RAM required
llama-2-7b-chat.ggmlv3.q4_0.bin q4_0 4 3.79 GB 6.29 GB

Note: After downloading the model, add the model file to the models directory. The file should be located at models\llama-2-7b-chat.ggmlv3.q4_0.bin, in order to run the code.

๐Ÿ“ Usage

  1. Run the Application:
streamlit run app.py
Enter fullscreen mode Exit fullscreen mode
  1. Access the Application:
    • Once the application is running, access it through the provided URL.

Image description

System Requirements

  • CPU: Intelยฎ Coreโ„ข i5 or equivalent.
  • RAM: 8 GB.
  • Disk Space: 7 GB.
  • Hardware: Operates on CPU; no GPU required.

Image description

๐Ÿ“Œ Important Notes

  • While robust, this chatbot is not a substitute for professional advice.
  • Ensure the CSV file adheres to the expected format for optimal performance.

Top comments (0)