Modifying LLM-Merging/llm_merging/merging/__init__.py invalidates submission?

[himsR]

Hello,

From your readme, it says that files other than setup.py should not be modified. But its required to add the import inside LLM-Merging/llm_merging/merging/init.py , for the code to work. Is that the reason that my submission that was created a week ago is still not showing on the leaderboard?

Thanks

[dptam]

Nope - for any submissions that are invalidated or have an error, we email separately, but there might be a long time delay. Also, note that scores showing up on the leaderboard do not indicate that the submission necessarily satisfies all the rules since we plan to do a final check later.
Regarding your submission, does #20 resolve it?