A GaiaNet node: https://www.gaianet.ai/
2.7K
The GaiaNet node is an OpenAI-compatible API server. It contains
How to use it: https://github.com/GaiaNet-AI/gaianet-node/tree/main/docker
On Mac, or Linux / Windows with CPU only:
docker run --name gaianet \
-p 8080:8080 \
gaianet/llama-3-8b-instruct:latest
On Linux / Windows with Nvidia GPU CUDA 11
docker run --name gaianet \
-p 8080:8080 --device nvidia.com/gpu=all \
gaianet/llama-3-8b-instruct:cuda11
On Linux / Windows with Nvidia GPU CUDA 12
docker run --name gaianet \
-p 8080:8080 --device nvidia.com/gpu=all \
gaianet/llama-3-8b-instruct:cuda12
Content type
Image
Digest
sha256:7adfed2e4…
Size
5.7 GB
Last updated
about 2 years ago
docker pull gaianet/llama-3-8b-instruct