autogen-k8s-basic

AutoGen DeepDive

Consider giving this repo a ✨! Thanks!!!

Here's a link to the YouTube video explaining this setup in greater detail:

Prerequisites

You need to have the following tools installed:

• Poetry
• Docker Desktop Or Racher Desktop
• K3d

Environment Setup

1. Setup poetry & K8s Environment

# To setup poetry
poetry install

# To setup a k3d cluster
k3d cluster create --config k3d.config.yaml

2. Install Inferix (OpenAI compatible server)

• Make sure you have Ollama installed.
• Make sure you have pulled a model. I recommend OpenHermes 2.5.
• Use this guide to setup the inference server locally. This supports function calling which most projects do not.

3. Run the AutoGen App

poetry run python src/main.py --prompt "give me all the pods"