Skip to content

LLM Inference

Hosted model APIs, GPU inference, fast token serving

Reviewed byRoman K· 2026-05-06

7 llm inference tools currently tracked: 0 open source, 5 with a managed free tier, 2 paid-only.

By GitHub activity the most popular is Cerebras (1.2k stars).