Skip to content

CI: Various fixes#81

Merged
gtristan merged 6 commits intomasterfrom
tristan/workaround-broken-ci
Dec 6, 2024
Merged

CI: Various fixes#81
gtristan merged 6 commits intomasterfrom
tristan/workaround-broken-ci

Conversation

@gtristan
Copy link
Contributor

@gtristan gtristan commented Dec 3, 2024

This uses ubuntu 22.04 runners, as a workaround for https://issues.apache.org/jira/browse/INFRA-26331, as outlined here: https://etbe.coker.com.au/2024/04/24/ubuntu-24-04-bubblewrap/ bubblewrap is not working on ubuntu 24 without some adjustments.

Also this fixes some linting errors, updates the artifact APIs, uses a new testsuite image which contains bzr, and fixes bzr tests, so all tests are working again.

@gtristan gtristan force-pushed the tristan/workaround-broken-ci branch from dc2262c to 61a1871 Compare December 3, 2024 16:36
@gtristan gtristan force-pushed the tristan/workaround-broken-ci branch 2 times, most recently from 8eb696c to e5c116c Compare December 3, 2024 16:46
@gtristan gtristan changed the title CI: Use ubuntu 20.04 CI: Use ubuntu 22.04 Dec 3, 2024
@gtristan gtristan force-pushed the tristan/workaround-broken-ci branch 2 times, most recently from 51d523f to 8cea980 Compare December 3, 2024 20:05
@gtristan gtristan changed the title CI: Use ubuntu 22.04 CI: Various fixes Dec 4, 2024
@gtristan gtristan force-pushed the tristan/workaround-broken-ci branch 3 times, most recently from 3589014 to efa9e90 Compare December 4, 2024 14:20
Copy link
Contributor

@juergbi juergbi left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Except for the pylint workaround, this looks good to me.

We should also add support for Python 3.13 to tox and CI and drop references to Python 3.8, matching BuildStream. However, we can do this in a follow-up.

This doesnt play well with parameterized pytest tests.
This is a workaround for https://issues.apache.org/jira/browse/INFRA-26331

As outlined here: https://etbe.coker.com.au/2024/04/24/ubuntu-24-04-bubblewrap/

Bubblewrap is not working on ubuntu 24 without some adjustments.
We had a regression where we are not running bzr related tests, which
also includes the cache key test.

Also use ubuntu 22.04 instead of 20.04, because the 20.04 image went missing
in upstream buildstream-docker-images.
Since bzr is not implemented with breezy, and breezy uses a python library,
we cannot execute bzr on some platforms without installing the breezy python
libs into the tox venv, and we cannot install breezy into the venv easily
since it is installing from source, and using things like cython and rust.

Instead, we simply wrap host bzr with a script which overrides the PATH
variable, so that python ignores the venv when entering the bzr code, this
allows us to keep our tox environment clean for buildstream and tests, while
testing the host installation of bzr.
@gtristan gtristan force-pushed the tristan/workaround-broken-ci branch from efa9e90 to 335a4b1 Compare December 6, 2024 11:22
@gtristan gtristan merged commit d6d1d98 into master Dec 6, 2024
@gtristan gtristan deleted the tristan/workaround-broken-ci branch December 6, 2024 11:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants