czyt/shimmy:2-vulkan

Multi-platform

Index digest

sha256:51454506c0711a5c0409454af7604ec05a1c1a6269ce542eb000097f9f93ee8c

OS/ARCH

Compressed size

117.98 MB

Last pushed

about 1 month by czyt

Type

Image

Manifest digest

sha256:d6839bfc0a6a16379e3f92ff7f8873fc4d372c27a0f553023af1c7ea0f21e9c1

Image Layers

1# debian.sh --arch 'amd64' out/26.92 MB

2RUN /bin/sh -c apt-get update87.58 MB

3COPY /app/target/release/shimmy /usr/local/bin/shimmy # buildkit3.48 MB

4USER shimmy0 B

5WORKDIR /app32 B

6EXPOSE [11434/tcp]0 B

7ENV SHIMMY_BASE_GGUF=/app/models SHIMMY_BIND_ADDRESS=0.0.0.0:11434 WGPU_BACKEND=vulkan0 B

8VOLUME [/app/models]0 B

9ENTRYPOINT ["shimmy"]0 B

10CMD ["serve"]0 B

Command

# debian.sh --arch 'amd64' out/ 'bookworm' '@1785715200'