Add Apex to the Pytorch Manifest file

[erman-gurses]

Motivation

Add Apex to the Pytorch Manifest file
Follow up PR for #2547

Test Plan

Test on CI

Test Result

The test runs: https://github.com/ROCm/TheRock/actions/runs/22070943413

Example Manifest from the test:

{
  "pytorch": {
    "commit": "f466ea7ac710374ce7066d9ead92e57dc42dc76f",
    "repo": "https://github.com/ROCm/pytorch.git",
    "branch": "release/2.7"
  },
  "pytorch_audio": {
    "commit": "95c61b4168fc5133be8dd8c1337d929d066ae6cf",
    "repo": "https://github.com/pytorch/audio"
  },
  "pytorch_vision": {
    "commit": "59a3e1f9f78cfe44cb989877cc6f4ea77c8a75ca",
    "repo": "https://github.com/pytorch/vision"
  },
  "triton": {
    "commit": "95abd4daa02d789ed257178ba35b4ef2d746ca29",
    "repo": "https://github.com/ROCm/triton.git"
  },
  "apex": {
    "commit": "7a57becffa31a4394369152e978fa6f8a0f005c2",
    "repo": "https://github.com/ROCm/apex"
  },
  "therock": {
    "commit": "02024427089134e951fe4063100b93c28e7e01a8",
    "repo": "https://github.com/ROCm/TheRock.git",
    "branch": "users/erman-gurses/add-apex-to-pytorch-manifest"
  }
}

Link: https://therock-dev-artifacts.s3.us-east-2.amazonaws.com/22070943413-linux/manifests/gfx94X-dcgpu/therock-manifest_torch_py3.10_release-2.7.json

Submission Checklist

• Look over the contributing guidelines at https://github.com/ROCm/ROCm/blob/develop/CONTRIBUTING.md#pull-requests.

[marbre]

@erman-gurses can you either file the sections in the PR description or remove the empty ones?

[erman-gurses]

@erman-gurses can you either file the sections in the PR description or remove the empty ones?

@marbre, I will fill out fully after I finish my tests then convert it from draft to a full PR.

[HereThereBeDragons]

just looking at the pytorch build failures we are having in nightlies: could we create the manifest anyway independent if the build succeeds or not? so we have an idea what exactly got checked out? even if it is not all components of torch?

[erman-gurses]

just looking at the pytorch build failures we are having in nightlies: could we create the manifest anyway independent if the build succeeds or not? so we have an idea what exactly got checked out? even if it is not all components of torch?

https://github.com/ROCm/TheRock/actions/runs/22070943413/job/63775043033
That is a good point. I generate the manifest file Generate PyTorch Manifest after after Build PyTorch Wheels so for now, we need to finish PyTorch Build successfully. However, this will change in the near future. It should generate the manifest file right after the checkouts. We have ongoing discussion for that.