How to generate the json file like `optim/indictor-misc.json`?

[syheliel]

First, thanks for your awesome work in OOPSLA! I'm trying to reproduce the result and I find that In optim dir, there are json files that record the mapping from the name of the optimization pass and the source code. The following is the source code of indictor-misc.json:

  "randperm_index_add_pattern": {
    "hints": [
      {
        "type": "pattern",
        "codes": [
          "source-code-data/pytorch/inductor-misc/randperm_index_add_pattern.py"
        ]
      }
    ]
  },
  "randperm_index_pattern": {
    "hints": [
      {
        "type": "pattern",
        "codes": [
          "source-code-data/pytorch/inductor-misc/randperm_index_pattern.py"
        ]
      }
    ]
  }
}

Is there a script that can create these file from Pytorch's source code? It seems that I need to create it by hand if I want to test a new opt pass.

[YangChenyuan]

Hi, thanks for your interest in WhiteFox!

Is there a script that can create these files from PyTorch's source code? It seems that I need to create it by hand if I want to test a new opt pass.

Currently, creating files for testing new optimization passes requires manual effort. However, here are some suggestions:

1. You can leverage GPT/LLM to assist with generating some of the content, which can significantly reduce the manual work.
2. We're planning to develop automated scripts that will help generate these JSON files based on user-provided meta information. This feature is on our roadmap.

Let us know if you have any other questions!