czyt/shimmy:2.5-vulkan

Multi-platform

Index digest

sha256:51454506c0711a5c0409454af7604ec05a1c1a6269ce542eb000097f9f93ee8c

OS/ARCH

Compressed size

113.01 MB

Last pushed

about 1 month by czyt

Type

Image

Manifest digest

sha256:94bf40c79c7b0a560d1f27b502c9fa3a01c0dd6d76bb4038a95cc514845866b8

Image Layers

1# debian.sh --arch 'arm64' out/26.81 MB

2RUN /bin/sh -c apt-get update82.43 MB

3COPY /app/target/release/shimmy /usr/local/bin/shimmy # buildkit3.76 MB

4USER shimmy0 B

5WORKDIR /app32 B

6EXPOSE [11434/tcp]0 B

7ENV SHIMMY_BASE_GGUF=/app/models SHIMMY_BIND_ADDRESS=0.0.0.0:11434 WGPU_BACKEND=vulkan0 B

8VOLUME [/app/models]0 B

9ENTRYPOINT ["shimmy"]0 B

10CMD ["serve"]0 B

Command

# debian.sh --arch 'arm64' out/ 'bookworm' '@1785715200'