Bonsai-27B Q1_0 GGUF for Docker Model Runner (vision)
18
PrismML's 1-bit 27B model: a 27B model in under 4 GB.
docker model pull baransels/bonsai-27b:Q1_0
docker model run baransels/bonsai-27b:Q1_0 "Explain containers to a new developer in three sentences."
| Original model | GGUF | Licence |
|---|---|---|
| prism-ml/Bonsai-27B-gguf | prism-ml/Bonsai-27B-gguf | Apache-2.0 |
Not an official artifact. Packaged by Baransel Saginda.
Content type
Model
Digest
sha256:90b7f015e…
Size
4.1 GB
Last updated
7 days ago
docker model pull baransels/bonsai-27b:Q1_0