Malformed lines

[lironT74]

Hi @joaopalotti,
It seems that for malformed lines, such as:

trec_eval throws:
trec_eval.get_results: Malformed line 790
While trec_tools does not.

I am not sure that this is a bad thing but perhaps a warning will suite here?
Unfortunately I am a bit swamped lately so I am not available to offer a fix myself.
Thank you!

[joaopalotti]

Hi @lironT74, thank you very much for identifying this mismatch between trec_eval and trectools.
While ago, I created a set of validation scripts for CLEF eHealth. Their goal was to verify this type of error and other similar problems such as non-sequential document rank or non-decreasing score for a given topic.

Having this kind of check integrated into trectools would be amazing!

I will leave this issue with a help-wanted flag and hope to get help from the amazing IR community!