irfanuruchi/local-llm-service repository overview

⁠Local LLM Service

Self-hosted local LLM service with:

• Persistent multi-chat history
• Conversation rename support
• Default baked-in GGUF model
• Model override via environment variables
• Multi-architecture support (linux/amd64, linux/arm64)
• Clean minimal dark UI

⁠🚀 Quick Start

docker run -p 8000:8000 irfanuruchi/local-llm-service:latest

Open:

http://localhost:8000

⁠With persistence

docker run \
  -v $(pwd)/data:/data \
  -p 8000:8000 \
  irfanuruchi/local-llm-service:latest

⁠Override model

docker run \
  -v $(pwd)/models:/models \
  -e MODEL_PATH=/models/custom.gguf \
  -p 8000:8000 \
  irfanuruchi/local-llm-service:latest

⁠Environment variables

⁠Source code

Github: https://github.com/irfanuruchi/local-llm-service⁠