BentoML

All

106 repositories

BentoML
Public
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
python machine-learning deep-learning model-serving multimodal mlops ml-engineering ai-inference llm generative-ai
Python
•
Apache License 2.0
•801•7.3k•153•12•Updated Jan 17, 2025Jan 17, 2025
helm-charts
Public
0•0•0•0•Updated Jan 17, 2025Jan 17, 2025
yatai-image-builder
Public
🐳 Build OCI images for Bentos in k8s
docker docker-image container container-image kubernetes k8s
Go
•10•15•5•7•Updated Jan 17, 2025Jan 17, 2025
openllm-models
Public
Python
•10•25•1•1•Updated Jan 16, 2025Jan 16, 2025
BentoVLLM
Public
Self-host LLMs with vLLM and BentoML
Python
•12•79•4•2•Updated Jan 16, 2025Jan 16, 2025
BentoBLIP
Public
how to build an image captioning application on top of a BLIP model with BentoML
Python
•2•3•0•2•Updated Jan 16, 2025Jan 16, 2025
comfy-pack
Public
A comprehensive toolkit for reliably locking, packing and deploying environments for ComfyUI workflows.
ai-art comfyui genai comfyui-manager comfyui-workflow comfyui-nodes comfyui-api
Python
•
Apache License 2.0
•9•87•2•0•Updated Jan 16, 2025Jan 16, 2025
BentoWhisperX
Public
Python
•5•11•0•8•Updated Jan 15, 2025Jan 15, 2025
OpenLLM
Public
Run any open-source LLMs, such as Llama, Mistral, as OpenAI compatible API endpoint in the cloud.
llama mistral fine-tuning mlops bentoml vicuna llm model-inference llmops llm-serving
Python
•
Apache License 2.0
•658•10k•17•0•Updated Jan 14, 2025Jan 14, 2025
asynq
Public
Simple, reliable, and efficient distributed task queue in Go
Go
•
MIT License
•752•0•0•0•Updated Jan 7, 2025Jan 7, 2025
gallery
Public
BentoML Example Projects 🎨
data-science gallery aws-lambda serverless machine-learning-library model-management azure-machine-learning model-deployment model-serving machine-learning-workflow
50•136•0•0•Updated Jan 6, 2025Jan 6, 2025
kantoku
Public
A Process & Socket Manager built with zmq
Python
•
Other
•257•0•0•0•Updated Dec 26, 2024Dec 26, 2024
BentoXGBoost
Public
Python
•0•0•0•0•Updated Dec 26, 2024Dec 26, 2024
BentoGradio
Public
Python
•0•0•0•0•Updated Dec 26, 2024Dec 26, 2024
BentoMLflow
Public
Python
•0•0•0•0•Updated Dec 26, 2024Dec 26, 2024
BentoLMDeploy
Public
Self-host LLMs with LMDeploy and BentoML
Python
•2•17•1•0•Updated Dec 25, 2024Dec 25, 2024
BentoSGLang
Public
Python
•1•1•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoCLIP
Public
building a CLIP application using BentoML
Python
•2•8•0•2•Updated Dec 23, 2024Dec 23, 2024
BentoSentenceTransformers
Public
how to build a sentence embedding application using BentoML
Python
•2•6•0•1•Updated Dec 23, 2024Dec 23, 2024
BentoXTTS
Public
how to build an text-to-speech application using BentoML
Python
•2•5•1•3•Updated Dec 23, 2024Dec 23, 2024
BentoFunctionCalling
Public
Python
•1•5•0•1•Updated Dec 23, 2024Dec 23, 2024
BentoTGI
Public
Python
•1•1•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoMLCLLM
Public
Python
•1•2•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoTRTLLM
Public
Python
•1•9•2•0•Updated Dec 23, 2024Dec 23, 2024
BentoDiffusion
Public
BentoDiffusion: A collection of diffusion models served with BentoML
kubernetes ai lora model-serving fine-tuning diffusion-models stable-diffusion
Python
•
Apache License 2.0
•25•345•9•1•Updated Dec 23, 2024Dec 23, 2024
BentoMoirai
Public
Python
•0•2•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoColPali
Public
Python
•0•10•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoResnet
Public
Python
•4•3•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoYolo
Public
BentoML service of YOLO v8
Python
•
Apache License 2.0
•2•6•0•0•Updated Dec 23, 2024Dec 23, 2024
BentoMoshi
Public
Python
•
Apache License 2.0
•1•1•0•0•Updated Dec 23, 2024Dec 23, 2024