Changelog
Each measured run, each correction and each site change, newest first. Vendors can ask for a re-run or send a correction: see evaluations.
As data: changelog.json.
-
site
Added the evaluations page (how a vendor is measured, and how to ask for a re-run or a correction) and this changelog. Added a Markdown copy of each page, a sitemap with last-modified dates, a schema.org Dataset description of the benchmark data, and a Last measured date on every measured table.
-
run
Measured Ubicloud standard runners (premium routing off) at 2, 4 and 8 vCPU on the same two jobs, starting 15:23 UTC, about ten hours after the GitHub and Sengi rounds. 32 runs including two GitHub warmup runs. Published in the measured ranking with the raw runs.
-
run
Measured GitHub-hosted (2 vCPU), Sengi Basic and Sengi Premium (2, 4 and 8 vCPU) on two jobs, a server test shard and a typecheck, starting 05:38 UTC. Five scored runs each. 72 runs including two GitHub warmup runs, which are left out of the medians. Published in the measured ranking with the raw runs.
-
site
Published the open-source runner catalog, the open-source project sweep with a listing request form, and the cheapest hosted runner answer. Dropped the GitHub self-hosted fee column. As of 10 November 2026, GitHub had postponed that charge.
-
site
Published the benchmark at list prices, the quick start and the waitlist.