Llama2 CSV ChatBot
It's a conversational tool powered by a fine-tuned large language model (LLM) known as Llama-2 7B. This chatbot utilizes CSV retrieval capabilities, enabling users to engage in multi-turn interactions based on uploaded CSV data.
Suuuuuuu Want to try: ๐๐๐
huggingface.co/Llama-2-GGML-CSV-Chatbot
๐ ChatBot Conversession
โกStreamlit ver. on #v2.0.2.dev20240102
Development Specs
- Utilizes Llama-2 7B and Sentence Transformers for robust functionality.
- Developed using Langchain and Streamlit technologies for enhanced performance.
- Cross-platform compatibility with Linux, macOS, or Windows OS.
๐ ๏ธ Try it on your ๐ป
- Clone the Repository:
git clone https://github.com/ThisIs-Developer/Llama-2-GGML-CSV-Chatbot.git
- Install Dependencies:
pip install -r requirements.txt
Download the Llama 2 Model:
Download the Llama 2 model file named
llama-2-7b-chat.ggmlv3.q4_0.bin
from the following link:
๐Download Llama 2 Model
Llama 2 Model Information
Name Quant method Bits Size Max RAM required llama-2-7b-chat.ggmlv3.q4_0.bin q4_0 4 3.79 GB 6.29 GB Note: After downloading the model, add the model file to the
models
directory. The file should be located atmodels\llama-2-7b-chat.ggmlv3.q4_0.bin
, in order to run the code.
๐ Usage
- Run the Application:
streamlit run app.py
- Access the Application:
- Once the application is running, access it through the provided URL.
System Requirements
- CPU: Intelยฎ Coreโข i5 or equivalent.
- RAM: 8 GB.
- Disk Space: 7 GB.
- Hardware: Operates on CPU; no GPU required.
๐ Important Notes
- While robust, this chatbot is not a substitute for professional advice.
- Ensure the CSV file adheres to the expected format for optimal performance.
Top comments (0)