Sign inSign up

valentemath/lemonade-stand

By valentemath

Updated 10 days ago

ROCm-optimized Lemonade Server for AMD Strix Halo with enhanced CLI tools.

Image
Machine learning & AI
Developer tools
1

5.1K

valentemath/lemonade-stand repository overview

🍋 Lemonade Stand

A server-first Docker image for Lemonade Server with full AMD acceleration support (ROCm, Vulkan, NPU).

Lemonade ships with a desktop GUI, but this image is for users who prefer to run Lemonade as a headless server and manage everything from the command line. It includes Fish shell with a Starship prompt and custom shell functions that enhance the existing lemonade-server CLI and wrap common API calls for ergonomic, interactive model management.

What's included

  • Lemonade Server and FastFlowLM built from source
  • ROCm, Vulkan, and XRT/AMDXDNA backends for AMD GPUs, APUs, and NPUs
  • Fish shell with Starship prompt and custom load/unload commands with live tab completion
  • Docker health check against /api/v1/health

Quick start

services:
  lemonade-stand:
    image: valentemath/lemonade-stand:latest
    container_name: lemonade-stand
    ports:
      - "8000:8000"
    devices:
      - /dev/kfd:/dev/kfd
      - /dev/dri:/dev/dri
      # - /dev/accel:/dev/accel  # Uncomment for NPU access
    volumes:
      - /path/to/huggingface:/huggingface
      - /path/to/fish-history:/root/.local/share/fish
      - /path/to/lemonade-cache:/root/.cache/lemonade
    environment:
      - LEMONADE_HOST=0.0.0.0
      # Recommended llamacpp args for Strix Halo:
      - LEMONADE_LLAMACPP=rocm
      - LEMONADE_LLAMACPP_ARGS=
          --flash-attn on
          --no-mmap 
      # - LEMONADE_FLM_LINUX_BETA=1 # Uncomment for NPU access
    restart: unless-stopped
docker compose up -d
docker exec -it lemonade-stand fish

Shell tools

CommandDescription
lm [args...]Alias for lemonade-server.
load <model> [model...]Load models via the API. Tab-completes from available models.
load --set <name>Load a named group of models from model_sets.json.
unload <model>Unload a model. Tab-completes from loaded models.
unload --allUnload all currently loaded models.

Volumes

Container pathPurpose
/huggingfaceModel weights (mount to avoid re-downloading).
/root/.cache/lemonadeCustom model registrations and model_sets.json.
/root/.local/share/fishFish shell command history.

For full documentation, configuration reference, and examples, see the GitHub repository.

Tag summary

Content type

Image

Digest

sha256:5c30f4960

Size

1.2 GB

Last updated

10 days ago

docker pull valentemath/lemonade-stand