-
Notifications
You must be signed in to change notification settings - Fork 15
Description
This issue continues the discussion from #128
My proposed changes are
TorchBenchSuite → ModelTracesSuite
datasets → test_suites
huggingface_op_trace → backendbench_tests
Motivation for the renames
TorchBenchSuite → ModelTracesSuite
TorchBench is a misnomer here, as this test suite actually contains models from HuggingFace Transformers, TIMM, and TorchBench (which is actually the smallest contributor iirc). ModelTraces better captures that the test suite consists of model traces used in PyTorch CI. Given that we plan to expand this test suite primarily through additional traces, this name is more appropriate.
datasets → test_suites
This was poor naming on my part. When creating new test suites, I incorrectly called them datasets, which caused confusion.
huggingface_op_trace → backendbench_tests
I updated the repository name where ModelTracesSuite lives to correct the misnomer—it's a repository of test suites, not HuggingFace op traces.