Skip to content

Auto tp tests less flaky#2637

Open
t-b wants to merge 3 commits intomainfrom
bugfix/2637-auto-tp-tests-less-flaky
Open

Auto tp tests less flaky#2637
t-b wants to merge 3 commits intomainfrom
bugfix/2637-auto-tp-tests-less-flaky

Conversation

@t-b
Copy link
Collaborator

@t-b t-b commented Feb 25, 2026

@timjarsky I've polished our hack from Monday.

t-b added 3 commits February 25, 2026 17:49
This allows Auto TP during automated testing to run longer, as we use
the rows to keep track of the current index in TP_AutoBaseline.
By predefining some results we can have a deterministic result and also
drop the IUTF_RETRY_FAILED flag.

The return values are slightly changed but this does not matter for the
test as we only want to test that changing the clamp mode during TP stops
Auto TP.
@t-b t-b self-assigned this Feb 25, 2026
@t-b t-b requested a review from timjarsky as a code owner February 25, 2026 16:54
Copilot AI review requested due to automatic review settings February 25, 2026 16:54
@t-b t-b requested a review from MichaelHuth as a code owner February 25, 2026 16:54
Copy link

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR improves the reliability of Auto Test Pulse tests by addressing timing-related flakiness and resource constraints.

Changes:

  • Increased override results buffer size from 64 to 2048 entries to accommodate longer-running tests
  • Reduced test duration by stopping test pulse after 2 seconds instead of 10 seconds
  • Updated test expectations to reflect proper headstage state after clamp mode change (HS0 remains in IC trying AutoTP, HS1 switches to VC)
  • Removed retry pragma since tests are now more stable
  • Added early initialization of override results with proper values for both headstages

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated no comments.

File Description
Packages/tests/HardwareBasic/UTF_AutoTestpulse.ipf Added override results initialization in preAcq, reduced timing from 10s to 2s, updated test expectations to match new behavior, removed retry pragma
Packages/MIES/MIES_TestPulse.ipf Increased override results buffer size from 64 to 2048 entries to prevent exhaustion during longer test runs

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

@timjarsky
Copy link
Collaborator

@timjarsky I've polished our hack from Monday.

Sounds good. If it passes, we can merge!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants