Getting Started

From your Markdown files to a deployed website in few minutes.

Install

0. If you don't have rye python package manager, install in here
1. Clone repository and install dependencies

git clone https://github.com/seonglae/llama2gptq
cd llama2gptq
git clone https://huggingface.co/datasets/texonom/llama2gptq db
rye sync

2. Run web UI Actiavet rye venv environment and run Web UI

source .venv/Scripts/activate
streamlit run chat.py

source .venv/bin/activate
streamlit run chat.py

source .venv/bin/activate
streamlit run chat.py

Boom!

Chat supported with related documents

CLI streaming demo