Seperating aucroc from the curve points to address scaling extreme number of classes.

[hosseinfani]

Hi @hosseinfani

There is an issue in eval phase of dblp.

The running stops and tmux page is disappeared and i dont have access to error in log file. It is repeated two times. No eval phase is completed yet on dblp. Will try to find the reason...

Originally posted by @mahdis-saeedi in #305

[hosseinfani]

Hi @mahdis-saeedi please pull and let me know here if the issue is resolved.

[mahdis-saeedi]

Hi @hosseinfani,
We still face OOM error for evaluation as you can see, however it is in different step:

In the following line of code to_dense still happens before moving to cpu.

OpeNTF/src/mdl/ntf.py

Line 65 in 03f89b0

Y_ = Y_.to_dense().cpu().numpy()

[hosseinfani]

Hi @mahdis-saeedi I just changed the line to Y_ = Y_.cpu().to_dense().numpy() so the dense happens in main memory. pls let me know.

[mahdis-saeedi]

Hi @hosseinfani ,
Thank you for the change.
The eval phase is running since one hour ago and there has not been any error by now. It will be completed by tomorrow and I will update you here when it is finished.

[mahdis-saeedi]

Hi @hosseinfani ,
Unfortunately eval run is stopped and has disappeared from tmux page and i cant see the error. This is the log file of the process. As you can see the last log has been at 22:02 pm last night, however i am sure that the process was safe in my last check near 12 am.