LLM Inference
Hosted model APIs, GPU inference, fast token serving
Soft.xyz tracks 7 llm inference tools, 5 with a free plan. Paid entries start at $0/mo (Groq) and go up to $0/mo (Cerebras). Most GitHub traction: Cerebras with 1,200 stars. Rankings below use real metrics, not vendor claims.
7 llm inference tools currently tracked: 0 open source, 5 with a managed free tier, 2 paid-only.
By GitHub activity the most popular is Cerebras (1.2k stars).
Managed with free tier (5)
Paid only (2)
FAQ
How many llm inference tools are tracked here?
7, of which 5 offer a free plan.
What is the cheapest llm inference tool?
Groq starts at $0/mo, while Cerebras is the priciest tracked entry at $0/mo.
Which llm inference tool has the most traction?
Cerebras leads the tracked set with 1,200 GitHub stars.