LiteLLM - DOCKER Deployment

For those who need a load balancer for LLM's using Ollama/Openai/Groq etc.

Included is a docker-compose file that spins up a PostresDB and LiteLLM. The config is done by changing the config.yml.

Getting started

To get up and running, create a .env file example below:

OLLAMA_API_BASE=http://localhost:11434
OLLAMA_API_KEY=OLLAMA

Enjoy!

Name		Name	Last commit message	Last commit date
Latest commit History 6 Commits
.gitignore		.gitignore
Dockerfile		Dockerfile
LICENSE		LICENSE
README.md		README.md
config.example.yml		config.example.yml
docker-compose.yml		docker-compose.yml
railway.json		railway.json