Skip to content

LLM Inference

Hosted model APIs, GPU inference, fast token serving

Reviewed byRoman K· 2026-05-06

Soft.xyz tracks 7 llm inference tools, 5 with a free plan. Paid entries start at $0/mo (Groq) and go up to $0/mo (Cerebras). Most GitHub traction: Cerebras with 1,200 stars. Rankings below use real metrics, not vendor claims.

7 llm inference tools currently tracked: 0 open source, 5 with a managed free tier, 2 paid-only.

By GitHub activity the most popular is Cerebras (1.2k stars).

FAQ

How many llm inference tools are tracked here?

7, of which 5 offer a free plan.

What is the cheapest llm inference tool?

Groq starts at $0/mo, while Cerebras is the priciest tracked entry at $0/mo.

Which llm inference tool has the most traction?

Cerebras leads the tracked set with 1,200 GitHub stars.