In the file auto_circuit/metrics/official_circuits/roc_plot.py, there is a conflict between line 52 and lines 55-57. The order of the subplot titles obtained from line 52 may not be consistent with the sorting obtained from lines 55-57. For example, if I plot two tasks 'IOI' and 'Docstring', line 52 gives the titles as ['IOI', 'Docstring'], but the actual subplot results are for 'Docstring' and 'IOI', respectively.
In the file
auto_circuit/metrics/official_circuits/roc_plot.py, there is a conflict between line 52 and lines 55-57. The order of the subplot titles obtained from line 52 may not be consistent with the sorting obtained from lines 55-57. For example, if I plot two tasks 'IOI' and 'Docstring', line 52 gives the titles as ['IOI', 'Docstring'], but the actual subplot results are for 'Docstring' and 'IOI', respectively.