Sign inSign up

gaianet/llama-3-8b-instruct_paris

By gaianet

•Updated about 2 years ago

A GaiaNet node: https://www.gaianet.ai/

Image
Machine learning & AI
Developer tools
0

1.2K

gaianet/llama-3-8b-instruct_paris repository overview

The GaiaNet node is a Paris tour guide. It contains

  • The Llama-3-8b-instruct LLM for chat
  • The nomic-embed-text-v1.5 model for embedding
  • A Paris guidebook content for the knowledge base

How to use it: https://github.com/GaiaNet-AI/gaianet-node/tree/main/docker⁠⁠

On Mac, or Linux / Windows with CPU only:

docker run --name gaianet \
  -p 8080:8080 \
  -v $(pwd)/qdrant_storage:/root/gaianet/qdrant/storage:z \
  gaianet/llama-3-8b-instruct_paris:latest

On Linux / Windows with Nvidia GPU CUDA 11

docker run --name gaianet \
  -p 8080:8080 --device nvidia.com/gpu=all \
  -v $(pwd)/qdrant_storage:/root/gaianet/qdrant/storage:z \
  gaianet/llama-3-8b-instruct_paris:cuda11

On Linux / Windows with Nvidia GPU CUDA 12

docker run --name gaianet \
  -p 8080:8080 --device nvidia.com/gpu=all \
  -v $(pwd)/qdrant_storage:/root/gaianet/qdrant/storage:z \
  gaianet/llama-3-8b-instruct_paris:cuda12

Tag summary

Content type

Image

Digest

sha256:cbc9153ba…

Size

5.7 GB

Last updated

about 2 years ago

docker pull gaianet/llama-3-8b-instruct_paris