Sign inSign up

shinejh0528/ollama

By shinejh0528

Updated 8 months ago

ollama + fastAPI server

Image
API management
Machine learning & AI
0

10K+

shinejh0528/ollama repository overview

Ollama + fastAPI server

This image is based on ollama/ollama, and was developed to allow external systems to release GPU memory occupied by Ollama.


Usage

Run container
  • 11434 port : ollama
  • 5000 port : fastAPI server
docker run -itd --gpus=all -v F:\docker_volume\llama:/root/.ollama -p 11434:11434 -p 5000:5000 --name ollama shinejh0528/ollama:1.0.0

stop model
curl -X POST http://localhost:5000/stop -H "Content-Type: application/json" -d '{"model":"gemma3:latest"}'
output
{"message":"Model 'gemma3:latest' stopped successfully.","output":""}

Tag summary

Content type

Image

Digest

sha256:cf36f61cd

Size

3.1 GB

Last updated

8 months ago

docker pull shinejh0528/ollama:1.1.0