gaianet/qwen2-0.5b-instruct_rustlang repository overview

The GaiaNet node is an OpenAI-compatible API server. It contains

• The Qwen 2.5 0.5B LLM for chat
• The nomic-embed-text-v1.5 model for embedding
• A knowledge base for the Rust language from the Rust Foundation

How to use it: https://github.com/GaiaNet-AI/gaianet-node/tree/main/docker⁠⁠⁠

On Mac, or Linux / Windows:

docker run --name gaianet \
  -p 8080:8080 \
  -v $(pwd)/qdrant_storage:/root/gaianet/qdrant/storage:z \
  gaianet/qwen2-0.5b-instruct_rustlang:latest