ci: Add automatic flaky test detector #42839
JPeer264build.yml
on: pull_request
Get Metadata
8s
Check PR branches
2s
Matrix: job_browser_loader_tests
Matrix: job_browser_playwright_tests
Matrix: job_node_integration_tests
Matrix: job_node_unit_tests
Matrix: job_remix_integration_tests
Size Check
1m 45s
Lint
6m 55s
Circular Dependency Check
1m 37s
Upload Artifacts
0s
Browser Unit Tests
1m 24s
Bun Unit Tests
53s
Deno Unit Tests
56s
Cloudflare Integration Tests
44s
Node Overhead Check
3m 37s
Check for faulty .d.ts files
37s
Matrix: job_e2e_tests
Matrix: job_optional_e2e_tests
All required jobs passed or were skipped
4s
Annotations
3 errors and 130 warnings
|
Node (20) Integration Tests
Process completed with exit code 1.
|
|
suites/sessions/errored-session-aggregate/test.ts > should aggregate successful, crashed and erroneous sessions:
dev-packages/node-integration-tests/utils/assertions.ts#L53
AssertionError: expected { …(2) } to match object { aggregates: [ { …(4) } ] }
(3 matching properties omitted from actual)
- Expected
+ Received
{
"aggregates": [
{
- "crashed": 1,
- "errored": 1,
+ "crashed": 0,
+ "errored": 0,
"exited": 1,
"started": Any<String>,
+ },
+ {
+ "crashed": 1,
+ "errored": 1,
+ "exited": 0,
+ "started": "2026-02-05T10:58:00.000Z",
},
],
}
❯ assertSentrySessions utils/assertions.ts:53:18
❯ expectSessionsEvent utils/runner.ts:764:5
❯ newEnvelope utils/runner.ts:520:15
❯ tryParseEnvelopeFromStdoutLine utils/runner.ts:633:15
❯ Socket.<anonymous> utils/runner.ts:651:15
|
|
All required jobs passed or were skipped
Process completed with exit code 1.
|
|
Node (22) Unit Tests
Please ensure your test framework is generating JUnit XML output.
|
|
Node (22) Unit Tests
No JUnit XML files found matching pattern: ./**/*.junit.xml
|
|
Node (22) Unit Tests
No files found matching pattern: ./**/*.junit.xml
|
|
Browser Unit Tests
Failed to upload coverage artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Browser Unit Tests
Please ensure your test framework is generating JUnit XML output.
|
|
Browser Unit Tests
No JUnit XML files found matching pattern: ./**/*.junit.xml
|
|
Browser Unit Tests
No files found matching pattern: ./**/*.junit.xml
|
|
Node (18) Unit Tests
Failed to upload coverage artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Node (18) Unit Tests
Please ensure your test framework is generating JUnit XML output.
|
|
Node (18) Unit Tests
No JUnit XML files found matching pattern: ./**/*.junit.xml
|
|
Node (18) Unit Tests
No files found matching pattern: ./**/*.junit.xml
|
|
PW loader_debug Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Node (24) Unit Tests
Failed to upload coverage artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Node (24) Unit Tests
Please ensure your test framework is generating JUnit XML output.
|
|
Node (24) Unit Tests
No JUnit XML files found matching pattern: ./**/*.junit.xml
|
|
PW loader_debug Tests
No coverage files found
|
|
Node (24) Unit Tests
No files found matching pattern: ./**/*.junit.xml
|
|
PW loader_replay_buffer Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
PW loader_replay_buffer Tests
No coverage files found
|
|
PW loader_replay_buffer Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Node (20) Unit Tests
Failed to upload coverage artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Node (20) Unit Tests
Please ensure your test framework is generating JUnit XML output.
|
|
Node (20) Unit Tests
No JUnit XML files found matching pattern: ./**/*.junit.xml
|
|
Node (20) Unit Tests
No files found matching pattern: ./**/*.junit.xml
|
|
PW loader_base Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
PW loader_base Tests
No coverage files found
|
|
PW loader_base Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
PW loader_tracing Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
PW loader_tracing Tests
No coverage files found
|
|
PW loader_tracing Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Playwright bundle_tracing_replay_feedback_logs_metrics_min firefox Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Playwright bundle_tracing_replay_feedback_logs_metrics_min firefox Tests
No coverage files found
|
|
Playwright bundle_tracing_replay_feedback_logs_metrics_min firefox Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
PW loader_replay Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
PW loader_replay Tests
No coverage files found
|
|
PW loader_replay Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
PW loader_eager Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
PW loader_eager Tests
No coverage files found
|
|
PW loader_eager Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
PW loader_tracing_replay Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
PW loader_tracing_replay Tests
No coverage files found
|
|
PW loader_tracing_replay Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Playwright bundle Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Playwright bundle Tests
No coverage files found
|
|
Playwright bundle Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Playwright bundle_logs_metrics Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Playwright bundle_logs_metrics Tests
No coverage files found
|
|
Playwright bundle_logs_metrics Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Remix (Node 22) Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Remix (Node 22) Tests
No coverage files found
|
|
Remix (Node 22) Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Remix (Node 20) Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Remix (Node 20) Tests
No coverage files found
|
|
Remix (Node 20) Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Playwright bundle_min Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Playwright bundle_min Tests
No coverage files found
|
|
Playwright bundle_min Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Remix (Node 18) Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Remix (Node 18) Tests
No coverage files found
|
|
Remix (Node 18) Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Remix (Node 24) Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Remix (Node 24) Tests
No coverage files found
|
|
Remix (Node 24) Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Playwright bundle_replay_logs_metrics Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Playwright bundle_replay_logs_metrics Tests
No coverage files found
|
|
Playwright bundle_replay_logs_metrics Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Playwright bundle_replay Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Playwright bundle_replay Tests
No coverage files found
|
|
Playwright bundle_replay Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Playwright esm (2/4) Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Playwright esm (2/4) Tests
No coverage files found
|
|
Playwright esm (2/4) Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Playwright esm (1/4) Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Playwright esm (1/4) Tests
No coverage files found
|
|
Playwright esm (1/4) Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Playwright esm (3/4) Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Playwright esm (3/4) Tests
No coverage files found
|
|
Playwright esm (3/4) Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Playwright bundle_tracing_replay_feedback_logs_metrics_min webkit Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Playwright bundle_tracing_replay_feedback_logs_metrics_min webkit Tests
No coverage files found
|
|
Playwright bundle_tracing_replay_feedback_logs_metrics_min webkit Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Playwright bundle_tracing Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Playwright bundle_tracing Tests
No coverage files found
|
|
Playwright bundle_tracing Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Playwright esm (4/4) Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Playwright esm (4/4) Tests
No coverage files found
|
|
Playwright esm (4/4) Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Playwright bundle_tracing_logs_metrics Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Playwright bundle_tracing_logs_metrics Tests
No coverage files found
|
|
Playwright bundle_tracing_logs_metrics Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Playwright bundle_tracing_replay Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Playwright bundle_tracing_replay Tests
No coverage files found
|
|
Playwright bundle_tracing_replay Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Playwright bundle_tracing_replay_feedback Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Playwright bundle_tracing_replay_feedback Tests
No coverage files found
|
|
Playwright bundle_tracing_replay_feedback Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Playwright bundle_tracing_replay_feedback_logs_metrics Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Playwright bundle_tracing_replay_feedback_logs_metrics Tests
No coverage files found
|
|
Playwright bundle_tracing_replay_feedback_logs_metrics Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Playwright bundle_tracing_replay_feedback_logs_metrics_min Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Playwright bundle_tracing_replay_feedback_logs_metrics_min Tests
No coverage files found
|
|
Playwright bundle_tracing_replay_feedback_logs_metrics_min Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Playwright bundle_tracing_replay_logs_metrics Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Playwright bundle_tracing_replay_logs_metrics Tests
No coverage files found
|
|
Playwright bundle_tracing_replay_logs_metrics Tests
Failed to upload test artifact: Failed to CreateArtifact: Received non-retryable error: Failed request: (409) Conflict: an artifact with this name already exists on the workflow run
|
|
Node (22) Integration Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Node (22) Integration Tests
No coverage files found
|
|
Node (22) Integration Tests
Please ensure your test framework is generating JUnit XML output.
|
|
Node (22) Integration Tests
No JUnit XML files found matching pattern: ./**/*.junit.xml
|
|
Node (22) Integration Tests
No files found matching pattern: ./**/*.junit.xml
|
|
Node (24) Integration Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Node (24) Integration Tests
No coverage files found
|
|
Node (24) Integration Tests
Please ensure your test framework is generating JUnit XML output.
|
|
Node (24) Integration Tests
No JUnit XML files found matching pattern: ./**/*.junit.xml
|
|
Node (24) Integration Tests
No files found matching pattern: ./**/*.junit.xml
|
|
Node (18) Integration Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Node (18) Integration Tests
No coverage files found
|
|
Node (18) Integration Tests
Please ensure your test framework is generating JUnit XML output.
|
|
Node (18) Integration Tests
No JUnit XML files found matching pattern: ./**/*.junit.xml
|
|
Node (18) Integration Tests
No files found matching pattern: ./**/*.junit.xml
|
|
Node (20) Integration Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Node (20) Integration Tests
No coverage files found
|
|
Node (20) Integration Tests
Please ensure your test framework is generating JUnit XML output.
|
|
Node (20) Integration Tests
No JUnit XML files found matching pattern: ./**/*.junit.xml
|
|
Node (20) Integration Tests
No files found matching pattern: ./**/*.junit.xml
|
|
Node (24) (TS 3.8) Integration Tests
Supported formats: clover, cobertura, jacoco, lcov, istanbul, go, codecov
|
|
Node (24) (TS 3.8) Integration Tests
No coverage files found
|
|
Node (24) (TS 3.8) Integration Tests
Please ensure your test framework is generating JUnit XML output.
|
|
Node (24) (TS 3.8) Integration Tests
No JUnit XML files found matching pattern: ./**/*.junit.xml
|
|
Node (24) (TS 3.8) Integration Tests
No files found matching pattern: ./**/*.junit.xml
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
build-output
Expired
|
34.2 MB |
sha256:52b80e7ecfdc193c125cdc71ca4332f025d2d592bb5e2f1ea5edd2ded9c85e90
|
|
|
codecov-coverage-results-nh-automatic-flaky-test-detection
Expired
|
1 KB |
sha256:9a240120191c3a1db1a9a3ea6d9c26b3d7a9cd6fedfba3766a5f12d1286a2ccb
|
|
|
codecov-test-results-nh-automatic-flaky-test-detection
Expired
|
240 Bytes |
sha256:168dea29846492d0402676435a8c6e7894d8a5d1ada383f7258a4f91b6583445
|
|