Skip to content

build: Expand tox test matrix#12

Merged
fghaas merged 3 commits intomainfrom
expand-test-matrix
Mar 5, 2026
Merged

build: Expand tox test matrix#12
fghaas merged 3 commits intomainfrom
expand-test-matrix

Conversation

@fghaas
Copy link
Contributor

@fghaas fghaas commented Mar 5, 2026

Add more tox environments, expanding the test coverage as follows:

  • Ansible Core versions 2.18–2.20 (these are the versions currently
    supported upstream), and 2.16 (this is the version packaged in the
    latest Ubuntu LTS)

  • OpenStack clients matching OpenStack Epoxy and Flamingo (these are
    the two most recent OpenStack releases), and Caracal (packaged in
    the latest Ubuntu LTS).

As of tox 4.47.1, if a testenv factor is a bare version number, and
that version number starts with 2 or 3, tox looks for a Python
interpreter matching that version. Thus, if a testenv name includes
the string "ansible-2.19", it looks for a Python interpreter for the
2.19 version (which never existed).

This is intentional behaviour in tox, and will not be fixed.

Therefore, name the testenvs "ansible2.19" (etc.), without the hyphen.

References:
https://docs.ansible.com/projects/ansible/latest/reference_appendices/release_and_maintenance.html#ansible-core-support-matrix
https://packages.ubuntu.com/noble/ansible-core
https://releases.openstack.org/
https://packages.ubuntu.com/noble/python3-openstackclient
https://packages.ubuntu.com/noble/python3-heatclient
https://packages.ubuntu.com/noble/python3-openstacksdk
tox-dev/tox#3850 (comment)

fghaas added 3 commits March 5, 2026 15:02
Add more tox environments, expanding the test coverage as follows:

* Ansible Core versions 2.18–2.20 (these are the versions currently
  supported upstream), and 2.16 (this is the version packaged in the
  latest Ubuntu LTS)

* OpenStack clients matching OpenStack Epoxy and Flamingo (these are
  the two most recent OpenStack releases), and Caracal (packaged in
  the latest Ubuntu LTS).

As of tox 4.47.1, if a testenv factor is a bare version number, and
that version number starts with 2 or 3, tox looks for a Python
interpreter matching that version. Thus, if a testenv name includes
the string "ansible-2.19", it looks for a Python interpreter for the
2.19 version (which never existed).

This is intentional behaviour in tox, and will not be fixed.

Therefore, name the testenvs "ansible2.19" (etc.), without the hyphen.

References:
https://docs.ansible.com/projects/ansible/latest/reference_appendices/release_and_maintenance.html#ansible-core-support-matrix
https://packages.ubuntu.com/noble/ansible-core
https://releases.openstack.org/
https://packages.ubuntu.com/noble/python3-openstackclient
https://packages.ubuntu.com/noble/python3-heatclient
https://packages.ubuntu.com/noble/python3-openstacksdk
tox-dev/tox#3850 (comment)
Add coverage for multiple ansible-core versions.
* Add the same matrix for Ansible Core releases as in the GitLab pipeline
* Split "build" and "test" jobs as in the GitLab pipeline
@fghaas fghaas requested a review from colder-is-better March 5, 2026 14:21
@fghaas fghaas merged commit 5d35435 into main Mar 5, 2026
16 checks passed
@fghaas fghaas deleted the expand-test-matrix branch March 5, 2026 15:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants