Skip to content

Generating model comparison plots

Nathaniel Evans edited this page Aug 11, 2023 · 1 revision

assumes you have trained two models.

first, run the eval.py script on both trained models:

$ python eval.py --data ../output/exp4-1/proc --uid ../output/exp4-1/GSNN/ef2aa31f-0c57-4210-b12a-68859ed6b1d2/ --model_name model.pt --verbose
$ python eval.py --data ../output/exp4-1/proc --uid ../output/exp4-1/NN/3f416d31-f697-4e92-8064-06cf68035f48/ --model_name model.pt --verbose

This will generate the appropriate metrics in each uid directory. Next, run the compare_models.py script.

$ python compare_models.py --uid1 ../output/exp4-1/GSNN/ef2aa31f-0c57-4210-b12a-68859ed6b1d2/ --uid2 ../output/exp4-1/NN/3f416d31-f697-4e92-8064-06cf68035f48/ --xlabel GSNN --ylabel NN --verbose

Copies of the plot will be saved to both uid directories.

Clone this wiki locally