Is your feature request related to a problem? Please describe.
Even when tests pass, sometimes running benchmarks fail. There are several reasons: (i) manual container setup for running benchmarks, (ii) configuration of benchmarks (iii) code differences that pass the test because benchmark coverage is less
Describe the solution you'd like
Ideally, CI will run benchmarks with small data and upload the data as artifact
Describe alternatives you've considered
This could also be resolved with planned automation of benchmarking results rendering.
Is your feature request related to a problem? Please describe.
Even when tests pass, sometimes running benchmarks fail. There are several reasons: (i) manual container setup for running benchmarks, (ii) configuration of benchmarks (iii) code differences that pass the test because benchmark coverage is less
Describe the solution you'd like
Ideally, CI will run benchmarks with small data and upload the data as artifact
Describe alternatives you've considered
This could also be resolved with planned automation of benchmarking results rendering.