OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

12.5k

Stars

+583

Gained

4.9%

Growth

Python

Language

View on GitHub → ↑0.1% this week

🎭 Best For

Machine Learning and AI Engineer

🏷️ Topics & Ecosystem

bentoml fine-tuning llama llama2 llama3-1 llama3-2 llama3-2-vision llm llm-inference llm-ops llm-serving llmops mistral mlops model-inference open-source-llm openllm vicuna

📊 Activity

Latest commit: 2026-08-17. Over the past 286 days, this repository gained 583 stars (+4.9% growth). Activity data is based on daily RepoPi snapshots of the GitHub repository.