Skip to content

Reproducing Results on UCR Archive's Fungi Dataset  #3

@Namoo7368

Description

@Namoo7368

Thanks for sharing your work.

I conducted experiments on the UCR archive's Fungi dataset using your code, but the results were not reproducible. Regardless of whether the learning rate was set to 0.0001 (default value in your code) or 0.001, there was a difference compared to the reported accuracy.

Specifically, I have executed following commands:
python -u train.py --dataset Fungi --loader UCR --batch-size 8 --repr-dims 320 --max-threads 8 --seed 42 --eval

Results with learning rate set to 0.0001: Evaluation result: {'acc': 0.7580645161290323, 'auprc': 0.8211251408603647} (lr=0.0001)
Results with learning rate set to 0.001: Evaluation result: {'acc': 0.9139784946236559, 'auprc': 0.9722505137346216} (lr=0.001)

Are there any additional steps or considerations I should be aware of?

Thank you for your help!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions