baransels

Bonsai-27B Q1_0 GGUF for Docker Model Runner (vision)

DeepSeek-V4-Flash-Vision-Exp UD-IQ3_XXS GGUF for Docker Model Runner (vision)

Holo 3.1 35B-A3B Q4_K_M GGUF for Docker Model Runner (vision)

GLM-Z1-9B-0414 Q4_K_M GGUF for Docker Model Runner (chat)

Olmo 3.1 32B Instruct Q4_K_M GGUF for Docker Model Runner (chat)

GLM-4-32B-0414 Q4_K_M GGUF for Docker Model Runner (chat)

LFM2.5-24B-A2B Q4_K_M GGUF for Docker Model Runner (chat)

Mellum2.1-12B-A2.5B-Thinking Q4_K_M GGUF for Docker Model Runner (chat)

Qwen2.5-32B-Instruct Q4_K_M GGUF for Docker Model Runner (chat)

Jan-v3.5-4B Q4_K_M GGUF for Docker Model Runner (chat)

Hy-MT2-1.8B Q4_K_M GGUF for Docker Model Runner (translation)

GLM-Z1-32B-0414 Q4_K_M GGUF for Docker Model Runner (chat)

DeepSeek-Coder-V2-Lite-Instruct Q4_K_M GGUF for Docker Model Runner (chat)

GLM-4-9B-0414 Q4_K_M GGUF for Docker Model Runner (chat)

Step-3.5-Flash Q3_K_M GGUF for Docker Model Runner (chat)

MiniMax-M2.5 UD-Q2_K_XL GGUF for Docker Model Runner (chat)

GLM-4.6V Q4_K_M GGUF for Docker Model Runner (vision)

Qwen-AgentWorld-35B-A3B UD-Q4_K_M GGUF for Docker Model Runner (chat)

KAT-Coder-V2.5-Dev Q4_K_M GGUF for Docker Model Runner (chat)

ERNIE-4.5-21B-A3B-Thinking Q4_K_M GGUF for Docker Model Runner (chat)

Mellum2-12B-A2.5B-Instruct Q8_0 GGUF for Docker Model Runner (chat)

GLM-4.6V-Flash Q4_K_M GGUF for Docker Model Runner (vision)

LFM2.5-8B-A1B Q4_K_M GGUF for Docker Model Runner (chat)

Qwen3-Omni-30B-A3B-Instruct Q4_K_M GGUF for Docker Model Runner (vision)

Mistral-Small-3.2-24B-Instruct Q4_K_M GGUF for Docker Model Runner (vision)

DeepSeek-R1-Distill-Qwen-14B Q4_K_M GGUF for Docker Model Runner (chat)

DeepSeek-OCR-2 Q8_0 GGUF for Docker Model Runner (OCR)

Unlimited-OCR Q8_0 GGUF for Docker Model Runner (OCR)

multilingual-e5-large F16 GGUF for Docker Model Runner (embeddings)