Methodology
Soft.xyz ranks 232 developer tools across 69 categories. Every metric on the site comes from a public source you can verify yourself. This page documents what we pull, how we pull it, and how we turn raw data into the scores you see on tool, comparison, and category pages.
Data sources
- GitHub REST API v3 — stars, forks, open issues, last commit date, default branch activity. Pulled via the public unauthenticated endpoints for OSS repos.
- npm Registry API — weekly download counts per package. We track the primary package per tool, not the org-wide download total.
- Official pricing pages — free-tier limits, starting price, billing model. Scraped weekly and human-verified on change.
- Public changelogs and release notes — used for changelog velocity, breaking-change tracking, and the Sunset Signals on graveyard pages.
- Hacker News and Reddit — mention counts for the Community Pulse score. Aggregated over a rolling 90-day window.
Refresh cadence
GitHub and npm metrics are refreshed weekly. Pricing pages are checked on the same cycle, and changes are flagged to a human editor before being committed. The dateModified on every tool page reflects the last refresh of its source data, not the last edit to the page copy.
Scoring
We expose multiple lenses rather than collapsing tools into a single score. Each methodology page below documents one lens in detail:
- SDK Quality — A–F ratings across TypeScript support, error handling, bundle size, and documentation.
- API Stability — breaking-change cadence, deprecation window, versioning policy per API.
- SLA Comparison — stated uptime, refund mechanism, public incident history transparency.
- Lock-in Score — vendor lock-in risk, data portability, and exit cost.
- Security — incident history, scorecard signals, and disclosure patterns.
- Cold Starts — boot latency for serverless and edge platforms.
- Radar — adoption stage and momentum classification.
- Upgrade Path — breaking-change cadence and migration cost.
- Stack Autopsy — post-mortem analysis of failed or sunset stacks.
- Alternatives Matrix — curated alternative groupings used by /alternatives pages.
Editorial review
Every tool, comparison, category, and methodology page has a named editor — see /team. Edits are committed to a public-style versioned repository so that changes are attributable.
No paid placements
We do not accept sponsorship for ranking position, comparison conclusions, or category inclusion. We do not run affiliate links on tool sign-up flows. Revenue comes from ad slots clearly labelled as such, the paid Stack Audit report ($199), and a programmatic dataset API. None of these channels influence ranking.
Conflict of interest
Where an editor has a direct relationship with a tool — current or recent employment, equity holding, or paid advisory — that relationship is disclosed on the affected tool, comparison, or category page.
Corrections
Email hello@soft.xyz with the URL and the specific claim you believe is wrong. We respond within one business day and publish corrections inline on the affected page, with a timestamp.
Dataset license: CC BY 4.0 with attribution. See /license.