Sign inSign up

woshikid/deepseek-r1

By woshikid

Updated over 1 year ago

https://github.com/ggml-org/llama.cpp

Image
Machine learning & AI
0

1.2K

woshikid/deepseek-r1 repository overview

Convert and Run

docker run -it -v /data:/data ghcr.io/ggml-org/llama.cpp:full --convert --outtype=auto /data/deepseek-r1-1.5b/
docker run -d -p 8080:8080 -v /data:/data ghcr.io/ggml-org/llama.cpp:server -m /data/deepseek-r1-1.5b/deepseek-r1-1.5B-BF16.gguf --host 0.0.0.0 [--port 8080]
1.5b
docker run -d -p 8080:8080 woshikid/deepseek-r1:1.5b -m /deepseek-r1-1.5B-BF16.gguf --host 0.0.0.0 [--port 8080]
1.5q
docker run -d -p 8080:8080 woshikid/deepseek-r1:1.5q -m /deepseek-r1-1.5B-Q8_0.gguf --host 0.0.0.0 [--port 8080]
7b
docker run -d -p 8080:8080 woshikid/deepseek-r1:7b -m /deepseek-r1-7B-BF16.gguf --host 0.0.0.0 [--port 8080]
7q
docker run -d -p 8080:8080 woshikid/deepseek-r1:7q -m /deepseek-r1-7B-Q8_0.gguf --host 0.0.0.0 [--port 8080]
8b
docker run -d -p 8080:8080 woshikid/deepseek-r1:8b -m /deepseek-r1-8B-BF16.gguf --host 0.0.0.0 [--port 8080]
8q
docker run -d -p 8080:8080 woshikid/deepseek-r1:8q -m /deepseek-r1-8B-Q8_0.gguf --host 0.0.0.0 [--port 8080]
14b
docker run -d -p 8080:8080 woshikid/deepseek-r1:14b -m /deepseek-r1-14B-BF16.gguf --host 0.0.0.0 [--port 8080]
14q
docker run -d -p 8080:8080 woshikid/deepseek-r1:14q -m /deepseek-r1-14B-Q8_0.gguf --host 0.0.0.0 [--port 8080]

Tag summary

Content type

Image

Digest

sha256:461bc76a0

Size

14 GB

Last updated

over 1 year ago

docker pull woshikid/deepseek-r1:14q