-
Notifications
You must be signed in to change notification settings - Fork 0
Generating model comparison plots
Nathaniel Evans edited this page Aug 11, 2023
·
1 revision
assumes you have trained two models.
first, run the eval.py script on both trained models:
$ python eval.py --data ../output/exp4-1/proc --uid ../output/exp4-1/GSNN/ef2aa31f-0c57-4210-b12a-68859ed6b1d2/ --model_name model.pt --verbose
$ python eval.py --data ../output/exp4-1/proc --uid ../output/exp4-1/NN/3f416d31-f697-4e92-8064-06cf68035f48/ --model_name model.pt --verbose
This will generate the appropriate metrics in each uid directory. Next, run the compare_models.py script.
$ python compare_models.py --uid1 ../output/exp4-1/GSNN/ef2aa31f-0c57-4210-b12a-68859ed6b1d2/ --uid2 ../output/exp4-1/NN/3f416d31-f697-4e92-8064-06cf68035f48/ --xlabel GSNN --ylabel NN --verbose
Copies of the plot will be saved to both uid directories.