Infrastructure
Model serving, vector databases, and deployment tools.
123456789101112131415161718192021222324252627282930
93
vLLM
↓ 1.7infrafreeSelf-hosted
81
Hugging Face
↑ 4.1infrafreemium
80
Ollama
↓ 2.0infrafreeSelf-hosted
74
llama.cpp
↓ 2.0infrafreeSelf-hosted
69
Together AI
↓ 11.7infrapaid
58
Groq
↓ 12.9infrafreemium
42
OpenRouter
↓ 14.5infrafreemium
35
Replicate
↓ 33.5infrapaid
34
ChromaDB
↓ 26.2infrafreeSelf-hosted
31
LM Studio
↓ 33.5infrafreeSelf-hosted
0
SkyPilot
NEWinfrafreeSelf-hosted
0
Qdrant
NEWinfrafreemiumSelf-hosted
0
Weaviate
NEWinfrafreemiumSelf-hosted
0
LanceDB
NEWinfrafreeSelf-hosted
0
RunPod
NEWinfrapaid
0
Baseten
NEWinfrapaid
0
Text Generation Inference
NEWinfrafreeSelf-hosted
0
Weights & Biases
NEWinfrafreemium
0
LiteLLM
NEWinfrafreeSelf-hosted
0
Helicone
NEWinfrafreemiumSelf-hosted
0
Truss
NEWinfrafreeSelf-hosted
0
Pinecone
NEWinfrafreemium
0
Milvus
NEWinfrafreeSelf-hosted
0
Modal
NEWinfrafreemium
0
Fireworks AI
NEWinfrapaid
0
BentoML
NEWinfrafreeSelf-hosted
0
MLflow
NEWinfrafreeSelf-hosted
0
Ray
NEWinfrafreeSelf-hosted
0
Langfuse
NEWinfrafreemiumSelf-hosted
0
Portkey AI
NEWinfrafreemium