What space do you get in circleci builds? > /usr/bin/ld: final link failed: No space left on device

Is there a good way to run a benchmark during CI on circleci? For Datahike we could use an instance that has a certain performance consistency to run a benchmark on.

@timok I've been told more than once that CI isn't a good environment to do this

unless you arrange your own bare metal probably

right. that is basically the requirement, to run a bare metal instance

https://circleci.com/docs/2.0/runner-overview/ is the only way I know of currently to run a CircleCI job on bare metal.

@timok using the machine executor is (currently) equivalent to getting an n2 instance on GCP, and will always be a dedicated VM

so that might be sufficient for you

the docker executor runs on a multi-tenant system, but we don’t overprovision, so in theory it should be fairly consistent. In practice this varies

Cool, thanks! 👍 I will probably start with a machine and take a look on consistency there. maybe improving it with something self-hosted later.

i suspect the performance inconsistency is actually because we allow jobs to use spare CPU above their allocation if nothing else is using it, so if you land on a quiet machine you might go faster