Sign inSign up

zappi/vllm-openai

By zappi

•Updated 11 months ago

OpenAI compatible server for vLLM

Image
Machine learning & AI
0

197

zappi/vllm-openai repository overview

vLLM

⁠A high-throughput and memory-efficient inference and serving engine for LLMs.

Tag Summary

No tags have been pushed to this repository yet.