LLM Inference
Hosted model APIs, GPU inference, fast token serving
7 llm inference tools currently tracked: 0 open source, 5 with a managed free tier, 2 paid-only.
By GitHub activity the most popular is Cerebras (1.2k stars).
Hosted model APIs, GPU inference, fast token serving
7 llm inference tools currently tracked: 0 open source, 5 with a managed free tier, 2 paid-only.
By GitHub activity the most popular is Cerebras (1.2k stars).