Skip to content

[GLUTEN-11058][Branch-1.5][VL] Switch to use CI image in 1.5 branch #11068

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
PHILO-HE merged 3 commits into from
Nov 13, 2025
Merged

[GLUTEN-11058][Branch-1.5][VL] Switch to use CI image in 1.5 branch #11068

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
da9f643
[VL] Switch to use CI image in 1.5 branch
zhouyuan Nov 11, 2025
23f6ffd
fix maven test options
zhouyuan Nov 12, 2025
efe0e4a
test 22.04
zhouyuan Nov 12, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/build_bundle_package.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -56,7 +56,7 @@ jobs:
ccache-centos7-release-default
- name: Build Gluten velox third party
run: |
docker run -v $GITHUB_WORKSPACE:/work -w /work apache/gluten:vcpkg-centos-7 bash -c "
docker run -v $GITHUB_WORKSPACE:/work -w /work apache/gluten:1.5-vcpkg-centos-7 bash -c "
df -a
cd /work
export CCACHE_DIR=/work/.ccache
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/build_release.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -28,8 +28,8 @@ jobs:
- uses: actions/checkout@v4
- name: Build
run: |
docker pull apache/gluten:vcpkg-centos-7
docker run -v $GITHUB_WORKSPACE:/workspace -w /work apache/gluten:vcpkg-centos-7 bash -c "
docker pull apache/gluten:1.5-vcpkg-centos-7
docker run -v $GITHUB_WORKSPACE:/workspace -w /work apache/gluten:1.5-vcpkg-centos-7 bash -c "
set -e
cd /workspace
bash dev/release/build-release.sh
Expand Down
2 changes: 1 addition & 1 deletion .github/workflows/flink.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -35,7 +35,7 @@ env:
jobs:
flink-test:
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk17
container: apache/gluten:1.5-centos-8-jdk17
steps:
- uses: actions/checkout@v2
- name: Prepare
Expand Down
9 changes: 5 additions & 4 deletions .github/workflows/velox_backend_arm.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -52,7 +52,7 @@ concurrency:
jobs:
build-native-lib-centos-8:
runs-on: ubuntu-24.04-arm
container: apache/gluten:vcpkg-centos-8
container: apache/gluten:1.5-vcpkg-centos-8
steps:
- uses: actions/checkout@v4
- name: Get Ccache
Expand Down Expand Up @@ -146,8 +146,8 @@ jobs:
--extra-conf=spark.gluten.ras.enabled=true

cpp-test-udf-test:
runs-on: ubuntu-24.04-arm
container: apache/gluten:centos-8-jdk8
runs-on: ubuntu-22.04-arm
Copy link
Member Author

@zhouyuan zhouyuan Nov 12, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this is a workaround for issue:
#11063

container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Get Ccache
Expand Down Expand Up @@ -181,8 +181,9 @@ jobs:
export JAVA_HOME=/usr/lib/jvm/java-17-openjdk
export PATH=$JAVA_HOME/bin:$PATH
java -version
export MAVEN_OPTS="-XX:-UseContainerSupport"
$MVN_CMD test -Pspark-3.5 -Pbackends-velox -Pjava-17 -Piceberg -Pdelta -Ppaimon -DtagsToExclude=None \
-DtagsToInclude=org.apache.gluten.tags.UDFTest
-DtagsToInclude=org.apache.gluten.tags.UDFTest
- name: Upload test report
uses: actions/upload-artifact@v4
with:
Expand Down
10 changes: 5 additions & 5 deletions .github/workflows/velox_backend_cache.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -42,7 +42,7 @@ jobs:
ccache-centos7-release-default
- name: Build Gluten native libraries
run: |
docker run -v $GITHUB_WORKSPACE:/work -w /work apache/gluten:vcpkg-centos-7 bash -c "
docker run -v $GITHUB_WORKSPACE:/work -w /work apache/gluten:1.5-vcpkg-centos-7 bash -c "
export CCACHE_DIR=/work/.ccache
mkdir -p /work/.ccache
bash dev/ci-velox-buildstatic-centos-7.sh
Expand All @@ -56,7 +56,7 @@ jobs:

cache-native-lib-centos-8:
runs-on: ${{ matrix.os }}
container: apache/gluten:vcpkg-centos-8
container: apache/gluten:1.5-vcpkg-centos-8
strategy:
matrix:
os: [ ubuntu-22.04, ubuntu-24.04-arm ]
Expand Down Expand Up @@ -84,7 +84,7 @@ jobs:
strategy:
matrix:
os: [ ubuntu-22.04, ubuntu-24.04-arm ]
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Get Ccache
Expand Down Expand Up @@ -119,7 +119,7 @@ jobs:
ccache-enhanced-centos7-release-default
- name: Build Gluten native libraries
run: |
docker run -v $GITHUB_WORKSPACE:/work -w /work apache/gluten:vcpkg-centos-7 bash -c "
docker run -v $GITHUB_WORKSPACE:/work -w /work apache/gluten:1.5-vcpkg-centos-7 bash -c "
export CCACHE_DIR=/work/.ccache
mkdir -p /work/.ccache
bash dev/ci-velox-buildstatic-centos-7-enhanced-features.sh
Expand All @@ -136,7 +136,7 @@ jobs:
strategy:
matrix:
os: [ ubuntu-22.04 ]
container: apache/gluten:centos-9-jdk8-cudf
container: apache/gluten:1.5-centos-9-jdk8-cudf
steps:
- uses: actions/checkout@v2
- name: Get Ccache
Expand Down
10 changes: 5 additions & 5 deletions .github/workflows/velox_backend_enhanced_features.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -62,8 +62,8 @@ jobs:
ccache-enhanced-centos7-release-default
- name: Build Gluten native libraries
run: |
docker pull apache/gluten:vcpkg-centos-7
docker run -v $GITHUB_WORKSPACE:/work -w /work apache/gluten:vcpkg-centos-7 bash -c "
docker pull apache/gluten:1.5-vcpkg-centos-7
docker run -v $GITHUB_WORKSPACE:/work -w /work apache/gluten:1.5-vcpkg-centos-7 bash -c "
set -e
yum install tzdata -y
df -a
Expand Down Expand Up @@ -96,7 +96,7 @@ jobs:
spark-test-spark34:
needs: build-native-lib-centos-7
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Download All Artifacts
Expand Down Expand Up @@ -154,7 +154,7 @@ jobs:
spark-test-spark35:
needs: build-native-lib-centos-7
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Download All Artifacts
Expand Down Expand Up @@ -212,7 +212,7 @@ jobs:
spark-test-spark35-slow:
needs: build-native-lib-centos-7
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Download All Artifacts
Expand Down
38 changes: 19 additions & 19 deletions .github/workflows/velox_backend_x86.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -65,8 +65,8 @@ jobs:
ccache-centos7-release-default
- name: Build Gluten native libraries
run: |
docker pull apache/gluten:vcpkg-centos-7
docker run -v $GITHUB_WORKSPACE:/work -w /work apache/gluten:vcpkg-centos-7 bash -c "
docker pull apache/gluten:1.5-vcpkg-centos-7
docker run -v $GITHUB_WORKSPACE:/work -w /work apache/gluten:1.5-vcpkg-centos-7 bash -c "
set -e
yum install tzdata -y
df -a
Expand Down Expand Up @@ -506,7 +506,7 @@ jobs:
uniffle: [ "0.9.2" ]
hadoop: [ "2.8.5" ]
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Download All Native Artifacts
Expand Down Expand Up @@ -556,7 +556,7 @@ jobs:
spark: [ "spark-3.2" ]
celeborn: [ "celeborn-0.6.0", "celeborn-0.5.4", "celeborn-0.4.3"]
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Download All Native Artifacts
Expand Down Expand Up @@ -612,7 +612,7 @@ jobs:
spark-test-spark32:
needs: build-native-lib-centos-7
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- uses: actions/download-artifact@v4
Expand Down Expand Up @@ -662,7 +662,7 @@ jobs:
spark-test-spark32-slow:
needs: build-native-lib-centos-7
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Download All Artifacts
Expand Down Expand Up @@ -699,7 +699,7 @@ jobs:
spark-test-spark33:
needs: build-native-lib-centos-7
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Download All Artifacts
Expand Down Expand Up @@ -755,7 +755,7 @@ jobs:
spark-test-spark33-slow:
needs: build-native-lib-centos-7
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Download All Artifacts
Expand Down Expand Up @@ -798,7 +798,7 @@ jobs:
spark-test-spark34:
needs: build-native-lib-centos-7
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Download All Artifacts
Expand Down Expand Up @@ -856,7 +856,7 @@ jobs:
spark-test-spark34-slow:
needs: build-native-lib-centos-7
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Download All Artifacts
Expand Down Expand Up @@ -900,7 +900,7 @@ jobs:
spark-test-spark35:
needs: build-native-lib-centos-7
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Download All Artifacts
Expand Down Expand Up @@ -956,7 +956,7 @@ jobs:
spark-test-spark35-scala213:
needs: build-native-lib-centos-7
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Download All Artifacts
Expand Down Expand Up @@ -1006,7 +1006,7 @@ jobs:
spark-test-spark35-slow:
needs: build-native-lib-centos-7
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Download All Artifacts
Expand Down Expand Up @@ -1052,7 +1052,7 @@ jobs:
spark-test-spark35-ras:
needs: build-native-lib-centos-7
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Download All Artifacts
Expand Down Expand Up @@ -1105,7 +1105,7 @@ jobs:
spark-test-spark35-slow-ras:
needs: build-native-lib-centos-7
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Download All Artifacts
Expand Down Expand Up @@ -1150,7 +1150,7 @@ jobs:
spark-test-spark35-smj:
needs: build-native-lib-centos-7
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Download All Artifacts
Expand Down Expand Up @@ -1203,7 +1203,7 @@ jobs:
spark-test-spark35-slow-smj:
needs: build-native-lib-centos-7
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Download All Artifacts
Expand Down Expand Up @@ -1247,7 +1247,7 @@ jobs:

cpp-test-udf-test:
runs-on: ubuntu-22.04
container: apache/gluten:centos-8-jdk8
container: apache/gluten:1.5-centos-8-jdk8
steps:
- uses: actions/checkout@v2
- name: Get Ccache
Expand Down Expand Up @@ -1298,7 +1298,7 @@ jobs:

build-cudf-centos-9:
runs-on: ubuntu-22.04
container: apache/gluten:centos-9-jdk8-cudf
container: apache/gluten:1.5-centos-9-jdk8-cudf
steps:
- uses: actions/checkout@v2
- name: Get Ccache
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/velox_nightly.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -48,7 +48,7 @@ jobs:
ccache-centos7-release-default
- name: Build Gluten velox third party
run: |
docker run -v $GITHUB_WORKSPACE:/work -w /work apache/gluten:vcpkg-centos-7 bash -c "
docker run -v $GITHUB_WORKSPACE:/work -w /work apache/gluten:1.5-vcpkg-centos-7 bash -c "
df -a
cd /work
export CCACHE_DIR=/work/.ccache
Expand Down Expand Up @@ -173,7 +173,7 @@ jobs:
#TODO: split ARM section into different file
build-native-lib-centos-8-arm64:
runs-on: ubuntu-24.04-arm
container: apache/gluten:vcpkg-centos-8
container: apache/gluten:1.5-vcpkg-centos-8
steps:
- uses: actions/checkout@v4
- name: Get Ccache
Expand Down