Skip to content

fix(ci): normalize github-hosted perf baseline env#58

Merged
kenanay merged 1 commit intomainfrom
fix/perf-baseline-github-hosted-normalization
Mar 14, 2026
Merged

fix(ci): normalize github-hosted perf baseline env#58
kenanay merged 1 commit intomainfrom
fix/perf-baseline-github-hosted-normalization

Conversation

@kenanay
Copy link
Owner

@kenanay kenanay commented Mar 14, 2026

Summary

Normalize the performance baseline environment contract for GitHub-hosted runners so image build digest flapping does not produce false baseline mismatches.

Changes

  • Exclude from when baseline authority is
  • Keep as an audit field, but stop treating GitHub-hosted digest drift as a blocking mismatch
  • Refresh to the normalized env hash

Why

GitHub-hosted runners are rotating between different image digests while exposing the same effective toolchain surface, which makes flap on without a real metric regression.

Validation

  • Replayed the failing run performance artifact against the new normalization logic and confirmed it no longer produces baseline diffs

@kenanay kenanay added the baseline-update Performance baseline update (authorized) label Mar 14, 2026
@kenanay kenanay merged commit c1d324f into main Mar 14, 2026
3 of 4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

baseline-update Performance baseline update (authorized)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant