How often is this running?

[jasonwilliams]

Hey, very interesting project.

Are these running nightly? If so could you make it clear? It’s useful to know how upto date or stale these numbers are.

Thanks!

[ivankra]

Oh it's not yet automated. I build and run benchmarks manually for now on my laptop and desktop. You can see in the table below each engine name the exact revision from which its binary was built - these are pinned by hand for now in docker/args.txt.

I am going to work on moving the builds over to github actions in the next weeks, and then see how usable it is also for benchmarking.

[jasonwilliams]

Ok, if you wanted any precedent https://boajs.dev/benchmarks runs on GitHub actions