Flaky test TestSSHAuthenticate #1328
Description
This is by far the most flaky test in our CI. Here is an analysis of the last 47 runs of the go-tests-coverage job on main:
════════════════════════════════════════════════════════
Summary
════════════════════════════════════════════════════════
Total runs analyzed : 47
Runs with failures : 32
Runs clean : 15
Percentage failed : 68.1%
Failure counts by test (across all runs):
──────────────────────────────────────────
32 TestSSHAuthenticate
12 TestSSHAuthenticate/Remember_last_successful_broker_and_mode
11 TestSSHAuthenticate/Authenticate_user_successfully_and_enters_shell
9 TestSSHAuthenticate/Authenticate_user_successfully
7 TestSSHAuthenticate/Authenticate_user_and_accept_password_reset
7 TestSSHAuthenticate/Authenticate_user_with_form_mode_with_button
7 TestSSHAuthenticate/Authenticate_user_successfully_if_already_registered_with_upper_case
6 TestSSHAuthenticate/Deny_authentication_if_newpassword_does_not_match_required_criteria
6 TestSSHAuthenticate/Authenticate_user_and_add_it_to_local_group
6 TestSSHAuthenticate/Authenticate_user_with_mfa_and_reset_password_while_enforcing_policy
6 TestSSHAuthenticate/Authenticate_user_and_reset_password_while_enforcing_policy
5 TestSSHAuthenticate/Authenticate_user_and_offer_password_reset
5 TestSSHAuthenticate/Authenticate_user_switching_auth_mode
5 TestSSHAuthenticate/Prevent_user_from_switching_username
5 TestSSHAuthenticate/Authenticate_user_with_mfa
4 TestSSHAuthenticate/Authenticate_user_successfully_if_already_registered
4 TestSSHAuthenticate/Authenticate_user_and_reset_password_with_case_insensitive_user_selection
3 TestSSHAuthenticate/Authenticate_user_locks_and_unlocks_it
3 TestSSHAuthenticate/Authenticate_user_successfully_with_upper_case
2 TestSSHAuthenticate/Authenticate_user_with_qr_code
2 TestSSHAuthenticate/Authenticate_user_with_mfa_and_reset_same_password
Error traces
❌ run-20337411902 2025-12-18T12:45:54Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_and_accept_password_reset
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "optional_password_reset_accept", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_locks_and_unlocks_it
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth_locks_unlocks", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Remember_last_successful_broker_and_mode
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "remember_broker_and_mode", see vhs output above
❌ run-20814120100 2026-01-08T10:44:21Z conclusion: cancelled
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_and_offer_password_reset
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "optional_password_reset_skip", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully_and_enters_shell
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth_with_shell", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_switching_auth_mode
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "switch_auth_mode", see vhs output above
❌ TestSSHAuthenticate/Remember_last_successful_broker_and_mode
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "remember_broker_and_mode", see vhs output above
❌ run-20814363069 2026-01-08T10:53:34Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_successfully_and_enters_shell
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth_with_shell", see vhs output above
❌ TestSSHAuthenticate/Prevent_user_from_switching_username
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "switch_preset_username", see vhs output above
❌ run-20818304869 2026-01-08T13:23:17Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_successfully_if_already_registered
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_mfa
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mfa_auth", see vhs output above
❌ TestSSHAuthenticate/Deny_authentication_if_newpassword_does_not_match_required_criteria
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "bad_password", see vhs output above
❌ TestSSHAuthenticate/Remember_last_successful_broker_and_mode
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "remember_broker_and_mode", see vhs output above
❌ run-20919503986 2026-01-12T12:33:13Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_and_add_it_to_local_group
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "local_group", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_form_mode_with_button
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "form_with_button", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_mfa
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mfa_auth", see vhs output above
❌ TestSSHAuthenticate/Remember_last_successful_broker_and_mode
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "remember_broker_and_mode", see vhs output above
❌ run-20922490930 2026-01-12T14:14:18Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_and_offer_password_reset
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "optional_password_reset_skip", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_mfa_and_reset_password_while_enforcing_policy
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mfa_reset_pwquality_auth", see vhs output above
❌ TestSSHAuthenticate/Prevent_user_from_switching_username
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "switch_preset_username", see vhs output above
❌ TestSSHAuthenticate/Remember_last_successful_broker_and_mode
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "remember_broker_and_mode", see vhs output above
❌ run-20923881583 2026-01-12T14:57:35Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_and_accept_password_reset
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "optional_password_reset_accept", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_and_reset_password_with_case_insensitive_user_selection
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mandatory_password_reset_case_insensitive", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_qr_code
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "qr_code", see vhs output above
❌ TestSSHAuthenticate/Remember_last_successful_broker_and_mode
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "remember_broker_and_mode", see vhs output above
❌ run-20993268165 2026-01-14T11:59:00Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_and_accept_password_reset
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "optional_password_reset_accept", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully_if_already_registered_with_upper_case
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Deny_authentication_if_newpassword_does_not_match_required_criteria
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "bad_password", see vhs output above
❌ run-20999474005 2026-01-14T15:22:32Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Remember_last_successful_broker_and_mode
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "remember_broker_and_mode", see vhs output above
❌ run-21029614311 2026-01-15T11:25:05Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_successfully
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully_and_enters_shell
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth_with_shell", see vhs output above
❌ run-21220642236 2026-01-21T18:13:07Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_and_reset_password_while_enforcing_policy
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mandatory_password_reset", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully_if_already_registered_with_upper_case
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_switching_auth_mode
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "switch_auth_mode", see vhs output above
❌ TestSSHAuthenticate/Remember_last_successful_broker_and_mode
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "remember_broker_and_mode", see vhs output above
❌ run-21248703925 2026-01-22T12:36:55Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_and_offer_password_reset
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "optional_password_reset_skip", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully_and_enters_shell
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth_with_shell", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully_if_already_registered_with_upper_case
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully_with_upper_case
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_switching_auth_mode
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "switch_auth_mode", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_form_mode_with_button
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "form_with_button", see vhs output above
❌ run-21458105859 2026-01-28T22:36:19Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_and_accept_password_reset
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "optional_password_reset_accept", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_and_offer_password_reset
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "optional_password_reset_skip", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_and_reset_password_while_enforcing_policy
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mandatory_password_reset", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully_if_already_registered
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Deny_authentication_if_newpassword_does_not_match_required_criteria
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "bad_password", see vhs output above
❌ TestSSHAuthenticate/Prevent_user_from_switching_username
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "switch_preset_username", see vhs output above
❌ TestSSHAuthenticate/Remember_last_successful_broker_and_mode
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "remember_broker_and_mode", see vhs output above
❌ run-21488294962 2026-01-29T17:31:33Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_and_reset_password_while_enforcing_policy
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mandatory_password_reset", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_locks_and_unlocks_it
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth_locks_unlocks", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully_if_already_registered
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_mfa
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mfa_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_mfa_and_reset_password_while_enforcing_policy
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mfa_reset_pwquality_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_mfa_and_reset_same_password
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mfa_reset_same_password", see vhs output above
❌ TestSSHAuthenticate/Deny_authentication_if_newpassword_does_not_match_required_criteria
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "bad_password", see vhs output above
❌ TestSSHAuthenticate/Remember_last_successful_broker_and_mode
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "remember_broker_and_mode", see vhs output above
❌ run-21521848619 2026-01-30T15:54:16Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_with_form_mode_with_button
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "form_with_button", see vhs output above
❌ run-21535453392 2026-01-31T00:31:16Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_and_add_it_to_local_group
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "local_group", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_and_offer_password_reset
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "optional_password_reset_skip", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_and_reset_password_while_enforcing_policy
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mandatory_password_reset", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully_and_enters_shell
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth_with_shell", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully_if_already_registered
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_form_mode_with_button
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "form_with_button", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_mfa
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mfa_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_mfa_and_reset_password_while_enforcing_policy
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mfa_reset_pwquality_auth", see vhs output above
❌ run-21736642746 2026-02-06T02:38:48Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_successfully_with_upper_case
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_mfa_and_reset_password_while_enforcing_policy
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mfa_reset_pwquality_auth", see vhs output above
❌ TestSSHAuthenticate/Deny_authentication_if_newpassword_does_not_match_required_criteria
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "bad_password", see vhs output above
❌ TestSSHAuthenticate/Remember_last_successful_broker_and_mode
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "remember_broker_and_mode", see vhs output above
❌ run-21750990894 2026-02-06T12:43:31Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_and_add_it_to_local_group
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "local_group", see vhs output above
❌ run-21762796648 2026-02-06T19:15:14Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_successfully
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully_and_enters_shell
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth_with_shell", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully_if_already_registered_with_upper_case
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_form_mode_with_button
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "form_with_button", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_mfa_and_reset_same_password
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mfa_reset_same_password", see vhs output above
❌ run-21885881120 2026-02-10T23:06:39Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_locks_and_unlocks_it
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth_locks_unlocks", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully_if_already_registered_with_upper_case
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_mfa_and_reset_password_while_enforcing_policy
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mfa_reset_pwquality_auth", see vhs output above
❌ TestSSHAuthenticate/Remember_last_successful_broker_and_mode
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "remember_broker_and_mode", see vhs output above
❌ run-21923472774 2026-02-11T21:20:05Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_successfully_if_already_registered_with_upper_case
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_switching_auth_mode
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "switch_auth_mode", see vhs output above
❌ TestSSHAuthenticate/Prevent_user_from_switching_username
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "switch_preset_username", see vhs output above
❌ run-22146927477 2026-02-18T15:53:33Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_successfully_and_enters_shell
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth_with_shell", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully_if_already_registered_with_upper_case
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ run-22306600446 2026-02-23T12:43:03Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_and_accept_password_reset
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "optional_password_reset_accept", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_and_reset_password_with_case_insensitive_user_selection
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mandatory_password_reset_case_insensitive", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully_and_enters_shell
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth_with_shell", see vhs output above
❌ run-22346648064 2026-02-24T10:23:03Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_successfully_with_upper_case
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ run-22391156058 2026-02-25T09:42:12Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_and_accept_password_reset
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "optional_password_reset_accept", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_and_add_it_to_local_group
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "local_group", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_and_reset_password_with_case_insensitive_user_selection
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mandatory_password_reset_case_insensitive", see vhs output above
❌ TestSSHAuthenticate/Deny_authentication_if_newpassword_does_not_match_required_criteria
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "bad_password", see vhs output above
❌ run-22439705099 2026-02-26T11:16:25Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_and_add_it_to_local_group
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "local_group", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully_and_enters_shell
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth_with_shell", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_mfa
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mfa_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_mfa_and_reset_password_while_enforcing_policy
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mfa_reset_pwquality_auth", see vhs output above
❌ run-22450158147 2026-02-26T16:01:57Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_and_add_it_to_local_group
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "local_group", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_and_reset_password_while_enforcing_policy
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mandatory_password_reset", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ run-22480044063 2026-02-27T09:11:49Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_successfully_and_enters_shell
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth_with_shell", see vhs output above
❌ run-22736623959 2026-03-05T21:03:10Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_successfully
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ run-22949250148 2026-03-11T10:58:36Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_successfully_and_enters_shell
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth_with_shell", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_form_mode_with_button
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "form_with_button", see vhs output above
❌ run-22951283101 2026-03-11T11:54:06Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_and_reset_password_while_enforcing_policy
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mandatory_password_reset", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_and_reset_password_with_case_insensitive_user_selection
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "mandatory_password_reset_case_insensitive", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_switching_auth_mode
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "switch_auth_mode", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_qr_code
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:543
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "qr_code", see vhs output above
❌ run-23144093086 2026-03-16T12:39:42Z conclusion: failure
❌ TestSSHAuthenticate
❌ TestSSHAuthenticate/Authenticate_user_and_accept_password_reset
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:556
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "optional_password_reset_accept", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_successfully
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:556
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "simple_auth", see vhs output above
❌ TestSSHAuthenticate/Authenticate_user_with_form_mode_with_button
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:556
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "form_with_button", see vhs output above
❌ TestSSHAuthenticate/Prevent_user_from_switching_username
Error Trace: /home/runner/work/authd/authd/pam/integration-tests/vhs-helpers_test.go:348
/home/runner/work/authd/authd/pam/integration-tests/ssh_test.go:556
Error: Received unexpected error:
exit status 1
Messages: Failed to run tape "switch_preset_username", see vhs output above