This folder contains benchmark results for 14 SSL algorithms. We report the best error rate(top-1-1 and top-1-20 results can be found in drive). Each setting runs 3 different random seeds and computes the average performance with standard deviation.
| Dataset | #Label | #Training data | #Test data | #Class |
|---|---|---|---|---|
| CIFAR-10 | 4 / 25 / 400 | 50,000 | 10,000 | 10 |
| CIFAR-100 | 4 / 25 / 100 | 50,000 | 10,000 | 100 |
| SVHN | 4 / 25 / 100 | 604,388 | 26,032 | 10 |
| STL-10 | 4 / 25 / 100 | 100,000 | 10,000 | 10 |
Please see Classic CV for the complete table of results.
| Dataset | #Label | #Training data | #Test data | #Class |
|---|---|---|---|---|
| CIFAR-100 | 2 / 4 | 50,000 | 10,000 | 100 |
| STL-10 | 4 / 10 | 5,000 / 100,000 | 8,000 | 10 |
| EuroSat | 2 / 4 | 16,200 | 5,400 | 10 |
| TissueMNIST | 10 / 50 | 165,466 | 47,280 | 8 |
| Semi-Aves | 15-53 | 3,959 / 26,640 | 4,000 | 200 |
Please see USB CV for the complete table of results.
| Dataset | #Label | #Training data | #Val data | #Test data | #Class |
|---|---|---|---|---|---|
| IMDB | 10 / 50 | 23,000 | 2,000 | 25,000 | 2 |
| Amazon Review | 50 / 200 | 250,000 | 25,000 | 65,000 | 5 |
| Yelp Review | 50 / 200 | 250,000 | 25,000 | 50,000 | 5 |
| AG News | 10 / 50 | 100,000 | 10,000 | 7,600 | 4 |
| Yahoo! Answer | 50 / 200 | 500,000 | 50,000 | 60,000 | 10 |
Please see USB NLP for the complete table of results.
| Dataset | #Label | #Training data | #Val data | #Test data | #Class |
|---|---|---|---|---|---|
| Keyword Spotting | 5 / 20 | 18,538 | 2,577 | 2,567 | 10 |
| ESC-50 | 5 / 10 | 1,200 | 400 | 400 | 50 |
| UrbanSound8k | 10 / 40 | 7,079 | 816 | 837 | 10 |
| FSDnoisy18k | 52-171 | 1,772 / 15,813 | - | 947 | 20 |
| GTZAN | 10 / 40 | 7,000 | 1,500 | 1,500 | 10 |
Please see USB Audio for the complete table of results.