Skip to content
Draft
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
35 changes: 34 additions & 1 deletion .github/workflows/nightly_sync.yml
Original file line number Diff line number Diff line change
Expand Up @@ -16,11 +16,44 @@
name: Upload docs to apache nightly

on:
push:
pull_request:
paths:
- 'docs/**'
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do we need to add get-velox.sh?

- '.github/workflows/nightly_sync.yml'
jobs:

script-change-test:
name: check Velox script change and build docker image if needed
runs-on: ubuntu-latest
outputs:
scripts_changed: ${{ steps.check_scripts.outputs.scripts_changed }}
steps:
- name: Check if scripts changed
id: check_scripts
run: |
git clone --depth 10 --branch main https://github.com/facebookincubator/velox.git velox
cd velox
if [[ $(git diff --name-only ${{ github.event.before }} ${{ github.event.after }} | grep -E '(^|/)scripts/.*') ]]; then
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

If cudf dependency version changed, we need to build the docker image, the source adapter image does not include cudf, I install it in gluten cudf image.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

would you please make a change on meta/velox?

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you mean install cudf in set up script?

echo "Scripts changed, run gpu-docker-tests"
echo "::set-output name=scripts_changed::true"
else
echo "No script changes, skip gpu-docker-tests"
echo "::set-output name=scripts_changed::false"
exit 0
fi
- name: Set up Git
if: steps.check_scripts.outputs.scripts_changed == 'true'
run: |
git config user.name "github-actions[bot]"
git config user.email "github-actions[bot]@users.noreply.github.com"

- name: Check CI Status
if: steps.check_scripts.outputs.scripts_changed == 'true'
env:
GH_TOKEN: ${{ github.token }}
run: |
gh workflow run ./.github/workflows/docker_image.yml -f job_to_run=build-centos-9-jdk8-cudf

upload_to_nightlies:
if: ${{ startsWith(github.repository, 'apache/') }}
runs-on: ubuntu-latest
Expand Down
Loading