xorbitsai/inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

WOKHEI This is an open source repository surfaced by WokHei. The description above is from the original GitHub repo. Click "View repository" to explore the code, issues, and contributors.