https://github.com/ggml-org/llama.cpp
1.2K
Convert and Run
docker run -it -v /data:/data ghcr.io/ggml-org/llama.cpp:full --convert --outtype=auto /data/deepseek-r1-1.5b/
docker run -d -p 8080:8080 -v /data:/data ghcr.io/ggml-org/llama.cpp:server -m /data/deepseek-r1-1.5b/deepseek-r1-1.5B-BF16.gguf --host 0.0.0.0 [--port 8080]
docker run -d -p 8080:8080 woshikid/deepseek-r1:1.5b -m /deepseek-r1-1.5B-BF16.gguf --host 0.0.0.0 [--port 8080]
docker run -d -p 8080:8080 woshikid/deepseek-r1:1.5q -m /deepseek-r1-1.5B-Q8_0.gguf --host 0.0.0.0 [--port 8080]
docker run -d -p 8080:8080 woshikid/deepseek-r1:7b -m /deepseek-r1-7B-BF16.gguf --host 0.0.0.0 [--port 8080]
docker run -d -p 8080:8080 woshikid/deepseek-r1:7q -m /deepseek-r1-7B-Q8_0.gguf --host 0.0.0.0 [--port 8080]
docker run -d -p 8080:8080 woshikid/deepseek-r1:8b -m /deepseek-r1-8B-BF16.gguf --host 0.0.0.0 [--port 8080]
docker run -d -p 8080:8080 woshikid/deepseek-r1:8q -m /deepseek-r1-8B-Q8_0.gguf --host 0.0.0.0 [--port 8080]
docker run -d -p 8080:8080 woshikid/deepseek-r1:14b -m /deepseek-r1-14B-BF16.gguf --host 0.0.0.0 [--port 8080]
docker run -d -p 8080:8080 woshikid/deepseek-r1:14q -m /deepseek-r1-14B-Q8_0.gguf --host 0.0.0.0 [--port 8080]
Content type
Image
Digest
sha256:461bc76a0…
Size
14 GB
Last updated
over 1 year ago
docker pull woshikid/deepseek-r1:14q