openrunners

Evaluations

How a runner vendor gets measured.

Scheduled monthly runs are free for vendors. This page says how a run is made, what a vendor can ask for, and where every change is written down.

Who runs this site

openrunners is maintained by engineers who also build Sengi, one of the runners listed. The method, the raw runs and the ranking rule are public so anyone can check the numbers, and every change is on the changelog.

Method

This is the rule for scheduled runs from now on. Every vendor in a run gets:

Prices are the public list price on the date checked. Each row links to the vendor's own page for it.

So far

The 11 November 2026 data did not meet that rule. GitHub and Sengi ran at 05:38 UTC and Ubicloud ran at 15:23 UTC. That is the same day, but in separate rounds. GitHub ran at 2 vCPU only. The other listed vendors have not been measured yet. The most recent measured run is dated 2026-11-11. The next measured table has not been published yet. The next full monthly run measures every vendor whose app is installed, all on the same day.

Scheduled runs

The run happens in the first week of each month. It costs a vendor nothing and covers every listed vendor whose app is installed. Each run is added to the changelog with a link to its raw file.

Ask for a re-run

A vendor can ask for a run outside the schedule by emailing evaluations@openrunners.io.

Send a correction

A vendor can send a correction to any price or fact at evaluations@openrunners.io, with a link to its own page that shows the right figure. Anyone else may write too. We check the vendor's page. If it supports the correction, we update the data and log it on the changelog.

Data, method and ranking