Skip to content

Fix flaky e2e tests: github-models-integration and docker-utils#55

Draft
Copilot wants to merge 3 commits intomasterfrom
copilot/fix-flaky-e2e-tests
Draft

Fix flaky e2e tests: github-models-integration and docker-utils#55
Copilot wants to merge 3 commits intomasterfrom
copilot/fix-flaky-e2e-tests

Conversation

Copy link
Copy Markdown
Contributor

Copilot AI commented Jan 31, 2026

Two e2e tests were intermittently failing in CI due to timing and tar archive issues.

github-models-integration.test.ts

The "should show helpful error when GITHUB_TOKEN is missing" test timed out at 10s before the command could complete plugin loading and file scanning. The error message also appears in both stdout and stderr depending on output buffering.

  • Increased timeout to 60s
  • Check combined stdout + stderr for error message

docker-utils.ts

The addDirectoryToPack function created a root directory entry with name '/' when relativeTo was empty, which could cause extraction issues:

// Before: creates entry with name '/'
pack.entry({ name: relativeTo + '/', type: 'directory', ... });

// After: skip root directory entry
if (relativeTo !== '') {
  pack.entry({ name: relativeTo + '/', type: 'directory', ... });
}

docker-utils.test.ts

  • Added .filter((f) => f.length > 0) to handle empty strings in file list parsing

Warning

Firewall rules blocked me from connecting to one or more addresses (expand for details)

I tried to connect to the following addresses, but was blocked by firewall rules:

  • accounts.google.com
    • Triggering command: /proc/self/exe /proc/self/exe --type=utility --utility-sub-type=network.mojom.NetworkService --lang=en-US --service-sandbox-type=network --no-sandbox --disable-dev-shm-usage --use-angle=swiftshader-webgl --mute-audio --crashpad-handler-pid=10546 --enable-crash-reporter=, --noerrdialogs --user-data-dir=/tmp/puppeteer_dev_chrome_profile-M8GDga --no-subproc-heap-profiling --change-stack-guard-on-fork=enable --shared-files=network_parent_dirs_pipe:100,v8_context_snapshot_data:101 --metrics-shmem-handle=4,i,1919482691601886423,5956388727381180257,524288 --field-trial-handle=3,i,6060825317661574592,6909871243936296294,262144 --enable-features=PdfOopif --disable-features=AcceptCHFrame,IsolateSandboxedIframes,MediaRouter,OptimizationHints,PaintHolding,ProcessPerSiteUpToMainFrameThreshold,Translate (dns block)
    • Triggering command: /home/REDACTED/.cache/puppeteer/chrome/linux-127.0.6533.88/chrome-linux64/chrome /home/REDACTED/.cache/puppeteer/chrome/linux-127.0.6533.88/chrome-linux64/chrome --allow-pre-commit-input --disable-REDACTED-networking --disable-REDACTED-timer-throttling --disable-REDACTEDing-occluded-windows --disable-breakpad --disable-client-side-phishing-detection --disable-component-extensions-with-REDACTED-pages --disable-component-update --disable-default-apps --disable-dev-shm-usage --disable-extensions --disable-hang-monitor --disable-infobars --disable-ipc-flooding-protection --disable-popup-blocking --disable-prompt-on-repost --disable-renderer-REDACTEDing --disable-search-engine-choice-screen --disable-sync (dns block)
    • Triggering command: /proc/self/exe /proc/self/exe --type=utility --utility-sub-type=network.mojom.NetworkService --lang=en-US --service-sandbox-type=network --no-sandbox --disable-dev-shm-usage --use-angle=swiftshader-webgl --mute-audio --crashpad-handler-pid=10695 --enable-crash-reporter=, --noerrdialogs --user-data-dir=/tmp/puppeteer_dev_chrome_profile-DjZ8vv --no-subproc-heap-profiling --change-stack-guard-on-fork=enable --shared-files=network_parent_dirs_pipe:100,v8_context_snapshot_data:101 --metrics-shmem-handle=4,i,316982610252971048,7289519486230544417,524288 --field-trial-handle=3,i,1255733021048745157,17170858620845447434,262144 --enable-features=PdfOopif --disable-features=AcceptCHFrame,IsolateSandboxedIframes,MediaRouter,OptimizationHints,PaintHolding,ProcessPerSiteUpToMainFrameThreshold,Translate (dns block)
  • content-autofill.googleapis.com
    • Triggering command: /proc/self/exe /proc/self/exe --type=utility --utility-sub-type=network.mojom.NetworkService --lang=en-US --service-sandbox-type=network --no-sandbox --disable-dev-shm-usage --use-angle=swiftshader-webgl --mute-audio --crashpad-handler-pid=10546 --enable-crash-reporter=, --noerrdialogs --user-data-dir=/tmp/puppeteer_dev_chrome_profile-M8GDga --no-subproc-heap-profiling --change-stack-guard-on-fork=enable --shared-files=network_parent_dirs_pipe:100,v8_context_snapshot_data:101 --metrics-shmem-handle=4,i,1919482691601886423,5956388727381180257,524288 --field-trial-handle=3,i,6060825317661574592,6909871243936296294,262144 --enable-features=PdfOopif --disable-features=AcceptCHFrame,IsolateSandboxedIframes,MediaRouter,OptimizationHints,PaintHolding,ProcessPerSiteUpToMainFrameThreshold,Translate (dns block)
    • Triggering command: /home/REDACTED/.cache/puppeteer/chrome/linux-127.0.6533.88/chrome-linux64/chrome /home/REDACTED/.cache/puppeteer/chrome/linux-127.0.6533.88/chrome-linux64/chrome --allow-pre-commit-input --disable-REDACTED-networking --disable-REDACTED-timer-throttling --disable-REDACTEDing-occluded-windows --disable-breakpad --disable-client-side-phishing-detection --disable-component-extensions-with-REDACTED-pages --disable-component-update --disable-default-apps --disable-dev-shm-usage --disable-extensions --disable-hang-monitor --disable-infobars --disable-ipc-flooding-protection --disable-popup-blocking --disable-prompt-on-repost --disable-renderer-REDACTEDing --disable-search-engine-choice-screen --disable-sync (dns block)

If you need me to access, download, or install something from one of these locations, you can either:

Original prompt

work on deflaking e2e tests, a few of them are flaky, and your task is to detect a flaky test, and then fix it


✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.

Copilot AI and others added 2 commits January 31, 2026 11:30
Co-authored-by: gtanczyk <1281113+gtanczyk@users.noreply.github.com>
Co-authored-by: gtanczyk <1281113+gtanczyk@users.noreply.github.com>
Copilot AI changed the title [WIP] Fix defects in flaky e2e tests Fix flaky e2e tests: github-models-integration and docker-utils Jan 31, 2026
Copilot AI requested a review from gtanczyk January 31, 2026 11:35
@gtanczyk gtanczyk force-pushed the master branch 2 times, most recently from edaaf8f to 642e4d8 Compare March 16, 2026 22:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants