BentoML

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

8.8k
Stars
+610
Gained
7.4%
Growth
Python
Language

🎭 Best For

🏷️ Topics & Ecosystem

ai-inference deep-learning generative-ai inference-platform llm llm-inference llm-serving llmops machine-learning ml-engineering mlops model-inference-service model-serving multimodal python

📊 Activity

Latest commit: 2026-08-21. Over the past 286 days, this repository gained 610 stars (+7.4% growth). Activity data is based on daily RepoPi snapshots of the GitHub repository.