| title | CI Check Failure Handling |
|---|---|
| impact | HIGH |
| impactDescription | Misinterpreting CI failures wastes debugging time |
| tags | ci, debugging, workflow |
When reviewing CI check failures in Cal.com:
- E2E tests can be flaky and may fail intermittently
- Focus only on CI failures that are directly related to your code changes
- Infrastructure-related failures (like dependency installation issues) can be disregarded if all code-specific checks pass
These errors are related to SAML database misconfiguration on CI and should be ignored:
- "password authentication failed for user postgres"
- "Invalid URL"
E2E tests skipping is expected behavior:
- When E2E tests are skipped, it's because the
ready-for-e2elabel has not been added to the PR - The "required" check intentionally fails when E2E tests are skipped to prevent merging without E2E
- Do not try to fix anything related to skipped E2E tests - this is completely expected and normal
Always run type checks locally using yarn type-check:ci --force before concluding that CI failures are unrelated to your changes. Even if errors appear in files you haven't directly modified, your changes might still be causing type issues through dependencies or type inference.