OpenLLM

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

12.6k

Stars

+625

Gained

5.2%

Growth

Python

Language

View on GitHub → ↑0.0% this week

🎭 Best For

Machine Learning and AI Engineer

🏷️ Topics & Ecosystem

bentoml fine-tuning llama llama2 llama3-1 llama3-2 llama3-2-vision llm llm-inference llm-ops llm-serving llmops mistral mlops model-inference open-source-llm openllm vicuna

📊 Activity

Latest commit: 2026-10-05. Over the past 331 days, this repository gained 625 stars (+5.2% growth). Activity data is based on daily RepoPi snapshots of the GitHub repository.