Sign inSign up

gaianet/phi-3-mini-instruct-4k_paris

By gaianet

Updated about 2 years ago

A GaiaNet node: https://www.gaianet.ai/

Image
Machine learning & AI
Developer tools
2

7.0K

gaianet/phi-3-mini-instruct-4k_paris repository overview

The GaiaNet node is a Paris tour guide. It contains

  • The phi-3-mini-instruct-4k LLM for chat
  • The nomic-embed-text-v1.5 model for embedding
  • A Paris guidebook content for knowledge base

How to use it: https://github.com/GaiaNet-AI/gaianet-node/tree/main/docker

On Mac, or Linux / Windows with CPU only:

docker run --name gaianet \
  -p 8080:8080 \
  -v $(pwd)/qdrant_storage:/root/gaianet/qdrant/storage:z \
  gaianet/phi-3-mini-instruct-4k_paris:latest

On Linux / Windows with Nvidia GPU CUDA 11

docker run --name gaianet \
  -p 8080:8080 --device nvidia.com/gpu=all \
  -v $(pwd)/qdrant_storage:/root/gaianet/qdrant/storage:z \
  gaianet/phi-3-mini-instruct-4k_paris:cuda11

On Linux / Windows with Nvidia GPU CUDA 12

docker run --name gaianet \
  -p 8080:8080 --device nvidia.com/gpu=all \
  -v $(pwd)/qdrant_storage:/root/gaianet/qdrant/storage:z \
  gaianet/phi-3-mini-instruct-4k_paris:cuda12

Tag summary

Content type

Image

Digest

sha256:80cc4d441

Size

3 GB

Last updated

about 2 years ago

docker pull gaianet/phi-3-mini-instruct-4k_paris