Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
53 commits
Select commit Hold shift + click to select a range
f798fe6
SRVKP-6810 create 1.17 branch in release-tests (#458)
jayesh-garg Nov 26, 2024
8784f20
[release-v1.17] Bump github.com/tektoncd/operator from 0.73.1 to 0.74…
openshift-cherrypick-robot Nov 26, 2024
69a7c5c
[release-v1.17] SRVKP-6765 Add tests for ecosystem multiarch test (#461)
openshift-cherrypick-robot Nov 27, 2024
408e99c
[release-v1.17] gauge reportportal plugin downgraded (#463)
openshift-cherrypick-robot Nov 28, 2024
31a6597
[release-v1.17] fixing Gauge parsing errors that lead to failed test …
openshift-cherrypick-robot Nov 29, 2024
439afb8
[release-v1.17] cluster resolver tests: precondition to remove projec…
openshift-cherrypick-robot Nov 29, 2024
f028001
[release-v1.17] Red Hat certificate (#474)
openshift-cherrypick-robot Nov 29, 2024
02c9fde
[release-v1.17] image in pruner tests updated to ubi8/ubi-minimal (#482)
openshift-cherrypick-robot Dec 2, 2024
4c5bf26
[release-v1.17] don't swallow taskrun and pipelinerun errors (#484)
openshift-cherrypick-robot Dec 2, 2024
1699598
[release-v1.17] clustertasks removed from pre-upgrade and post-upgrad…
openshift-cherrypick-robot Dec 3, 2024
5532f1f
[release-v1.17] addon tests for clustertasks removed, stepactions add…
openshift-cherrypick-robot Dec 3, 2024
25e3845
[release-v1.17] specs for cluster tasks removed (#491)
openshift-cherrypick-robot Dec 3, 2024
0dcd0d3
[release-v1.17] SRVKP-6191 new basic test for http resolver (#493)
openshift-cherrypick-robot Dec 3, 2024
85a1353
[release-v1.17] SRVKP-6190 new basic step action test (#494)
openshift-cherrypick-robot Dec 3, 2024
0ad06cf
[release-v1.17] timeout increased to lower number of flakes (#497)
openshift-cherrypick-robot Dec 4, 2024
81fe7c0
[release-v1.17] timeout for oc delete command increased because of Re…
openshift-cherrypick-robot Dec 5, 2024
faa110c
[release-v1.17] disable screenshot plugin (#504)
openshift-cherrypick-robot Dec 5, 2024
368bc9d
[release-v1.17] omitted maven-settings file (#508)
openshift-cherrypick-robot Dec 5, 2024
1f914b1
[release-v1.17] update readme for pac (#510)
openshift-cherrypick-robot Dec 10, 2024
b9caf3a
[release-v1.17] CI image updated to Fedora 41 (#513)
openshift-cherrypick-robot Dec 16, 2024
4122671
[release-v1.17] SRVKP-6765 Add tests for ecosystem s2i test (#517)
openshift-cherrypick-robot Dec 19, 2024
f985c9d
Added test for validating opc server version (#519)
manthinasai Jan 3, 2025
3233aaf
Revert "Added test for validating opc server version" (#521)
srivickynesh Jan 3, 2025
f444ec7
[release-v1.17] SRVKP-6718 Added test for validating opc server versi…
openshift-cherrypick-robot Jan 3, 2025
2ce9db4
[release-v1.17] SRVKP-6726 Added cel-expression for go-lint-pr (#527)
openshift-cherrypick-robot Jan 22, 2025
8b0833d
[release-v1.17] SRVKP-6715 Build tutorial api UI (#529)
manthinasai Jan 23, 2025
a237453
[release-v1.17] Bump github.com/tektoncd/operator from 0.74.0 to 0.74…
openshift-cherrypick-robot Jan 27, 2025
4ef789a
go mod tidy
ppitonak Jan 27, 2025
4bae930
[release-v1.17] SRVKP-6723 switch release-tests-post-upgrade test fro…
openshift-cherrypick-robot Jan 27, 2025
21474b7
[release-v1.17] CI image: gauge nad yq updated (#536)
openshift-cherrypick-robot Jan 28, 2025
3a4b3f7
[release-v1.17] tkn updated to 1.17 in CI image (#540)
openshift-cherrypick-robot Jan 30, 2025
311b457
[release-v1.17] [SRVKP-6773] add statefuslet enablment to QA tests (#…
openshift-cherrypick-robot Jan 31, 2025
2f83dd3
[release-v1.17] Fix releasetest-pipelines tests (#545)
openshift-cherrypick-robot Feb 6, 2025
7cbef1e
[release-v1.17] [SRVKP-6724] Added custompipelinerun name for s2i-pip…
openshift-cherrypick-robot Feb 11, 2025
31737d3
[release-v1.17] failing test for s2i-java temporarily excluded from t…
openshift-cherrypick-robot Feb 14, 2025
d593739
[release-v1.17] wait for Results annotation (#565)
openshift-cherrypick-robot Feb 28, 2025
99e67a0
[release-v1.17] run acceptance tests only from master branch, limit c…
openshift-cherrypick-robot Mar 3, 2025
b5254d5
[release-v1.17] Dockerfile: OpenShift and gauge updated (#576)
openshift-cherrypick-robot Mar 5, 2025
0970282
[release-v1.17] timeout for lynx increased (#575)
openshift-cherrypick-robot Mar 5, 2025
f503d6c
[release-v1.17] small fixes for pipelines jib-maven and manual-approv…
openshift-cherrypick-robot Mar 11, 2025
dc39c0a
[release-v1.17] Lynx replaced with curl for URL validation (#588)
openshift-cherrypick-robot Mar 12, 2025
9ee7574
[release-v1.17] add skopeo to the CI image (#594)
openshift-cherrypick-robot Mar 17, 2025
16442ab
[release-v1.17] SRVKP-6722 new tests for versioned ecosystem tasks (#…
openshift-cherrypick-robot Mar 25, 2025
38df03c
[release-v1.17] update tkn/tkn-pac tests to actually verify the outp…
openshift-cherrypick-robot Apr 14, 2025
c6de217
[release-v1.17] SRVKP-7336 Refactor Verify ServiceAccount "pipeline" …
openshift-cherrypick-robot Apr 22, 2025
731815d
[release-v1.17] Moved service account check from k8s to hooks (#618)
openshift-cherrypick-robot Apr 23, 2025
8b468ed
[release-v1.17] Reorganize results in olm (#620)
openshift-cherrypick-robot Apr 24, 2025
0de4f27
[release-v1.17] reorder results (#622)
srivickynesh Apr 24, 2025
76c8825
[release-v1.17] Fix linter issues before upgrading to v2
openshift-cherrypick-robot Apr 29, 2025
30c670f
[release-v1.17] CI image updated - Fedora 42, cosign, rekor, lint (#628)
openshift-cherrypick-robot Apr 29, 2025
4d13f19
[release-v1.17] unused code for label and annotation propagation removed
openshift-cherrypick-robot May 9, 2025
5e801dd
Revert "[release-v1.17] [SRVKP-6773] add statefuslet enablment to QA …
manthinasai May 30, 2025
e8193b8
add missing import (#640)
srivickynesh May 30, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 6 additions & 3 deletions .golangci.yaml
Original file line number Diff line number Diff line change
@@ -1,3 +1,4 @@
version: "2"
run:
cache-dir: .golangci-lint-cache
enable-cache: true
Expand All @@ -6,6 +7,7 @@ run:
tests: true
build-tags:
- e2e
modules-download-mode: readonly
outputs:
print-linter-name: true
linters-settings:
Expand All @@ -19,13 +21,14 @@ linters:
enable:
- forbidigo
- misspell
- gofmt
- goimports
- errcheck
- typecheck
- unparam
- gocritic
- gosec
formatters:
enable:
- gofmt
- goimports
issues:
max-issues-per-linter: 0
max-same-issues: 0
4 changes: 3 additions & 1 deletion .tekton/acceptance-tests-pr.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -6,7 +6,7 @@ metadata:
annotations:
pipelinesascode.tekton.dev/max-keep-runs: "2"
pipelinesascode.tekton.dev/on-event: "[pull_request]"
pipelinesascode.tekton.dev/on-target-branch: "[*]"
pipelinesascode.tekton.dev/on-target-branch: "[master]"
pipelinesascode.tekton.dev/pipeline: "https://gitlab.cee.redhat.com/tekton/plumbing/-/raw/master/ci/pipelines/acceptance-tests.yaml"
pipelinesascode.tekton.dev/task-10: "https://gitlab.cee.redhat.com/tekton/plumbing/-/raw/master/ci/tasks/cli-tests-in-container.yaml"
pipelinesascode.tekton.dev/task-20: "https://gitlab.cee.redhat.com/tekton/plumbing/-/raw/master/ci/tasks/configure-operator.yaml"
Expand Down Expand Up @@ -41,6 +41,8 @@ spec:
value: custom-operators
- name: CLI_TESTS_TYPE
value: downstream
- name: CLUSTER_LIFETIME
value: 2h
- name: CLUSTER_POOL
value: "openstack"
- name: GIT_RELEASE_TESTS_BRANCH
Expand Down
3 changes: 3 additions & 0 deletions .tekton/go-lint-pipelinerun.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -9,6 +9,9 @@ metadata:
pipelinesascode.tekton.dev/task: "git-clone"
pipelinesascode.tekton.dev/task-1: "golangci-lint"
pipelinesascode.tekton.dev/max-keep-runs: "5"
# Expression to check for .go files inside pkg & steps directory
pipelinesascode.tekton.dev/on-cel-expression: |
"*/*/*.go".pathChanged() || "*/*.go".pathChanged()
spec:
params:
- name: repo_url
Expand Down
24 changes: 14 additions & 10 deletions Dockerfile.CI
Original file line number Diff line number Diff line change
@@ -1,15 +1,19 @@
FROM quay.io/fedora/fedora:40
FROM quay.io/fedora/fedora:42

RUN dnf update -y &&\
dnf install -y --setopt=tsflags=nodocs azure-cli git go jq lynx make openssl python-unversioned-command python3 python3-antlr4-runtime python3-pip unzip vim wget &&\
dnf install -y --setopt=tsflags=nodocs azure-cli git go jq make openssl python-unversioned-command python3 python3-antlr4-runtime python3-pip skopeo unzip vim wget &&\
dnf clean all -y && rm -fR /var/cache/dnf

RUN pip install pyyaml reportportal-client

RUN wget https://github.com/mikefarah/yq/releases/download/v4.44.3/yq_linux_amd64 -O /usr/bin/yq &&\
RUN wget https://certs.corp.redhat.com/certs/Current-IT-Root-CAs.pem \
-O /etc/pki/ca-trust/source/anchors/Current-IT-Root-CAs.pem && \
update-ca-trust extract

RUN wget https://github.com/mikefarah/yq/releases/download/v4.45.1/yq_linux_amd64 -O /usr/bin/yq &&\
chmod +x /usr/bin/yq

ENV OC_VERSION=4.17
ENV OC_VERSION=4.18
RUN wget https://mirror.openshift.com/pub/openshift-v4/clients/ocp/fast-${OC_VERSION}/openshift-client-linux.tar.gz \
-O /tmp/openshift-client.tar.gz &&\
tar xzf /tmp/openshift-client.tar.gz -C /usr/bin oc &&\
Expand All @@ -33,7 +37,7 @@ RUN wget https://mirror.openshift.com/pub/openshift-v4/clients/rosa/latest/rosa-
tar xzf /tmp/rosa.tar.gz -C /usr/bin --no-same-owner rosa &&\
rm /tmp/rosa.tar.gz

ENV TKN_VERSION=1.16.0
ENV TKN_VERSION=1.17.0
RUN wget https://mirror.openshift.com/pub/openshift-v4/clients/pipelines/${TKN_VERSION}/tkn-linux-amd64.tar.gz \
-O /tmp/tkn.tar.gz &&\
tar xzf /tmp/tkn.tar.gz -C /usr/bin --no-same-owner tkn tkn-pac opc &&\
Expand All @@ -42,7 +46,7 @@ RUN wget https://mirror.openshift.com/pub/openshift-v4/clients/pipelines/${TKN_V
RUN wget https://dl.min.io/client/mc/release/linux-amd64/mc -O /usr/bin/mc &&\
chmod u+x /usr/bin/mc

ENV GAUGE_VERSION=1.6.10
ENV GAUGE_VERSION=1.6.14
RUN wget https://github.com/getgauge/gauge/releases/download/v${GAUGE_VERSION}/gauge-${GAUGE_VERSION}-linux.x86_64.zip \
-O /tmp/gauge.zip &&\
unzip /tmp/gauge.zip gauge -d /usr/bin &&\
Expand All @@ -51,20 +55,20 @@ RUN wget https://github.com/getgauge/gauge/releases/download/v${GAUGE_VERSION}/g
gauge install go &&\
gauge install html-report &&\
gauge install xml-report &&\
gauge install reportportal &&\
gauge install reportportal -v 1.16.2 &&\
gauge config check_updates false &&\
gauge config runner_connection_timeout 600000 && \
gauge config runner_request_timeout 300000 &&\
go env -w GOPROXY="https://proxy.golang.org,direct" &&\
gauge version

RUN wget https://github.com/sigstore/cosign/releases/download/v2.4.1/cosign-linux-amd64 -O /usr/bin/cosign && \
RUN wget https://github.com/sigstore/cosign/releases/download/v2.5.0/cosign-linux-amd64 -O /usr/bin/cosign && \
chmod a+x /usr/bin/cosign

RUN wget https://github.com/sigstore/rekor/releases/download/v1.3.6/rekor-cli-linux-amd64 -O /usr/bin/rekor-cli && \
RUN wget https://github.com/sigstore/rekor/releases/download/v1.3.10/rekor-cli-linux-amd64 -O /usr/bin/rekor-cli && \
chmod u+x /usr/bin/rekor-cli

ENV GOLANGCI_LINT_VERSION=1.61.0
ENV GOLANGCI_LINT_VERSION=2.1.5
RUN wget -O /tmp/golangci-lint.tar.gz https://github.com/golangci/golangci-lint/releases/download/v${GOLANGCI_LINT_VERSION}/golangci-lint-${GOLANGCI_LINT_VERSION}-linux-amd64.tar.gz \
&& tar --strip-components=1 -C /usr/bin -xzf /tmp/golangci-lint.tar.gz golangci-lint-${GOLANGCI_LINT_VERSION}-linux-amd64/golangci-lint \
&& rm -f /tmp/golangci-lint.tar.gz
28 changes: 25 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -88,12 +88,34 @@ gauge run --log-level=debug --verbose --tags 'e2e & !skip_linux/amd64' specs/clu
gauge run --log-level=debug --verbose --tags e2e specs/pac/pac-gitlab.spec
```

## Running PAC GitLab Tests:
Before running PAC GitLab tests, Configure the environment variable from `/spec/pac/README.md`.
## Running PAC GitLab Tests
Pipelines as code is a project allowing you to define your CI/CD using Tekton PipelineRuns and Tasks in a file located in your source control management (SCM) system, such as GitHub or GitLab. This file is then used to automatically create a pipeline for a Pull Request or a Push to a branch.

### Setting up PAC in GitLab

- Create a New project in gitlab.com
- Change the visibility of the project to Public
- Change the main branch to unprotect under `Settings --> Repository --> Protected branches`
- Copy the project ID by clicking on three dots in project root directory and`export GITLAB_PROJECT_ID=<ProjectID>`
- Click on your profile under `preferences` Under `User Settings --> Access tokens`
- Create a New Personal Access Token and `export GITLAB_TOKEN=<Token>`
- Create a new Public Group in GitLab and Copy the only the Group name from URL e.g: From GitLab URL `https://gitlab.com/groups/test324345` Copy only the group name `test324345` and `export GITLAB_GROUP_NAMESPACE=<GroupName>`
- Enter any WebhookSecret to be used for GitLab webhook `export GITLAB_WEBHOOK_TOKEN=<WebhookSecret>`

### Running PAC E2E tests
Export the following Env Variables
```
gauge run --log-level=debug --verbose --tags e2e specs/pac/pac-gitlab.spec
export GITLAB_TOKEN=<Token>
export GITLAB_PROJECT_ID=<ProjectID>
export GITLAB_GROUP_NAMESPACE=<GroupName>
export GITLAB_WEBHOOK_TOKEN=<GitLabWebHookSecret>
```

To run pac e2e tests...

```
gauge run --log-level=debug --verbose --tags e2e specs/pac/pac-gitlab.spec
```
## Authoring a new test specification

1. Create or update a spec file in `specs` directory using `Markdown` syntax.
Expand Down
11 changes: 7 additions & 4 deletions env/default/default.properties
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,9 @@ runner_connection_timeout = 3600000
# language runner returns the response message.
runner_request_timeout = 3600000

# Disable screenshot on failure error: screenshot.png not found
screenshot_on_failure = false

enable_multithreading = false
CHANNEL = latest
CATALOG_SOURCE = redhat-operators
Expand All @@ -42,12 +45,12 @@ SUBSCRIPTION_NAME = openshift-pipelines-operator-rh
CHAINS_VERSION = v0.23
HUB_VERSION = v1.19
MANUAL_APPROVAL_VERSION = v0.4
OPERATOR_VERSION = devel
OSP_VERSION = 5.0.5
OSP_TUTORIAL_BRANCH = master
OPERATOR_VERSION = v0.74
OSP_VERSION = 1.17
OSP_TUTORIAL_BRANCH = pipelines-1.17
PAC_VERSION = 0.29
PIPELINE_VERSION = v0.65
RESULTS_VERSION = v0.13
TARGET = openshift
TKN_CLIENT_VERSION = 0.32
TKN_CLIENT_VERSION = 0.39
TRIGGERS_VERSION = v0.30
49 changes: 25 additions & 24 deletions go.mod
Original file line number Diff line number Diff line change
@@ -1,26 +1,28 @@
module github.com/openshift-pipelines/release-tests

go 1.22.5
go 1.22.7

toolchain go1.22.7
toolchain go1.23.5

require (
github.com/getgauge-contrib/gauge-go v0.4.0
github.com/google/go-cmp v0.6.0
github.com/openshift-pipelines/manual-approval-gate v0.2.2
github.com/openshift-pipelines/pipelines-as-code v0.27.2
github.com/openshift/api v0.0.0-20240521185306-0314f31e7774
github.com/openshift/client-go v0.0.0-20240523113335-452272e0496d
github.com/operator-framework/api v0.16.0
github.com/operator-framework/operator-lifecycle-manager v0.22.0
github.com/pkg/errors v0.9.1
github.com/prometheus/client_golang v1.19.1
github.com/prometheus/client_golang v1.20.2
github.com/prometheus/common v0.55.0
github.com/tektoncd/cli v0.38.1
github.com/tektoncd/operator v0.73.1
github.com/tektoncd/pipeline v0.62.3
github.com/tektoncd/triggers v0.29.1
github.com/xanzy/go-gitlab v0.107.0
github.com/tektoncd/operator v0.74.1
github.com/tektoncd/pipeline v0.65.1
github.com/tektoncd/triggers v0.30.0
github.com/xanzy/go-gitlab v0.109.0
go.opencensus.io v0.24.0
gopkg.in/yaml.v2 v2.4.0
gotest.tools/v3 v3.5.1
k8s.io/api v0.30.0
k8s.io/apimachinery v0.30.0
Expand Down Expand Up @@ -69,14 +71,14 @@ require (
github.com/golang/groupcache v0.0.0-20210331224755-41bb18bfe9da // indirect
github.com/golang/protobuf v1.5.4 // indirect
github.com/google/btree v1.1.2 // indirect
github.com/google/cel-go v0.20.1 // indirect
github.com/google/cel-go v0.21.0 // indirect
github.com/google/gnostic-models v0.6.9-0.20230804172637-c7be7c783f49 // indirect
github.com/google/go-querystring v1.1.0 // indirect
github.com/google/gofuzz v1.2.0 // indirect
github.com/google/shlex v0.0.0-20191202100458-e7afc7fbc510 // indirect
github.com/google/uuid v1.6.0 // indirect
github.com/gregjones/httpcache v0.0.0-20190611155906-901d90724c79 // indirect
github.com/grpc-ecosystem/grpc-gateway/v2 v2.20.0 // indirect
github.com/grpc-ecosystem/grpc-gateway/v2 v2.22.0 // indirect
github.com/hako/durafmt v0.0.0-20210608085754-5c1018a4e16b // indirect
github.com/hashicorp/errwrap v1.1.0 // indirect
github.com/hashicorp/go-cleanhttp v0.5.2 // indirect
Expand All @@ -90,6 +92,7 @@ require (
github.com/json-iterator/go v1.1.12 // indirect
github.com/kballard/go-shellquote v0.0.0-20180428030007-95032a82bc51 // indirect
github.com/kelseyhightower/envconfig v1.4.0 // indirect
github.com/klauspost/compress v1.17.9 // indirect
github.com/ktr0731/go-ansisgr v0.1.0 // indirect
github.com/ktr0731/go-fuzzyfinder v0.8.0 // indirect
github.com/liggitt/tabwriter v0.0.0-20181228230101-89fcab3d43de // indirect
Expand All @@ -106,7 +109,6 @@ require (
github.com/monochromegane/go-gitignore v0.0.0-20200626010858-205db1a8cc00 // indirect
github.com/munnerz/goautoneg v0.0.0-20191010083416-a7dc8b61c822 // indirect
github.com/nsf/termbox-go v1.1.1 // indirect
github.com/openshift-pipelines/pipelines-as-code v0.27.2 // indirect
github.com/openshift/apiserver-library-go v0.0.0-20230816171015-6bfafa975bfb // indirect
github.com/peterbourgon/diskv v2.0.1+incompatible // indirect
github.com/prometheus/client_model v0.6.1 // indirect
Expand All @@ -125,25 +127,24 @@ require (
go.starlark.net v0.0.0-20230525235612-a134d8f9ddca // indirect
go.uber.org/multierr v1.11.0 // indirect
go.uber.org/zap v1.27.0 // indirect
golang.org/x/exp v0.0.0-20240325151524-a685a6edb6d8 // indirect
golang.org/x/net v0.27.0 // indirect
golang.org/x/oauth2 v0.22.0 // indirect
golang.org/x/sync v0.8.0 // indirect
golang.org/x/sys v0.23.0 // indirect
golang.org/x/term v0.23.0 // indirect
golang.org/x/text v0.17.0 // indirect
golang.org/x/time v0.5.0 // indirect
golang.org/x/exp v0.0.0-20240613232115-7f521ea00fb8 // indirect
golang.org/x/net v0.28.0 // indirect
golang.org/x/oauth2 v0.23.0 // indirect
golang.org/x/sync v0.10.0 // indirect
golang.org/x/sys v0.28.0 // indirect
golang.org/x/term v0.27.0 // indirect
golang.org/x/text v0.21.0 // indirect
golang.org/x/time v0.6.0 // indirect
golang.org/x/xerrors v0.0.0-20231012003039-104605ab7028 // indirect
gomodules.xyz/jsonpatch/v2 v2.4.0 // indirect
google.golang.org/api v0.190.0 // indirect
google.golang.org/genproto/googleapis/api v0.0.0-20240725223205-93522f1f2a9f // indirect
google.golang.org/genproto/googleapis/rpc v0.0.0-20240730163845-b1a4ccb954bf // indirect
google.golang.org/grpc v1.65.0 // indirect
google.golang.org/api v0.196.0 // indirect
google.golang.org/genproto/googleapis/api v0.0.0-20240827150818-7e3bb234dfed // indirect
google.golang.org/genproto/googleapis/rpc v0.0.0-20240903143218-8af14fe29dc1 // indirect
google.golang.org/grpc v1.67.0 // indirect
google.golang.org/protobuf v1.34.2 // indirect
gopkg.in/inf.v0 v0.9.1 // indirect
gopkg.in/yaml.v2 v2.4.0 // indirect
gopkg.in/yaml.v3 v3.0.1 // indirect
k8s.io/apiextensions-apiserver v0.29.8 // indirect
k8s.io/apiextensions-apiserver v0.29.10 // indirect
k8s.io/cli-runtime v0.29.8 // indirect
k8s.io/klog/v2 v2.120.1 // indirect
k8s.io/kube-openapi v0.0.0-20240403164606-bc84c2ddaf99 // indirect
Expand Down
Loading