telegramGpt

Replace your friends with machines, easily train llama on you telegram data

Based on https://github.com/tloen/alpaca-lora

Installation

Requirements:

python3.10
pipenv

Install deps:

pipenv install --ignore-pipfile

Features

• memory efficient training using https://github.com/TimDettmers/bitsandbytes
• Gradio Interface for inference
• telegram bot

Training

copy your telegram data message*.html's into data/your-dataset-name

start training with

python -d your-dataset-name -e 1 --create_dataset

Specify modelname with -m modelname for models other than decapoda-research/llama-7b-hf

resume from checkpoint via -re path/to/checkpoint

number of epochs -e float

--create_dataset to create the dataset at first run or --no-create_dataset to use the old dataset from previous run

Inference

start server with

python inference.py --cp logs/your-checkpoint-dir

Telegram Bot

start bot with

python tele_bot.py --cp logs/your-checkpoint-dir -bt your-bot-token