Some question about reproducing GLUE #30
Description
Sorry to bother you, I'm very interested in your work:R-Drop, but I encountered some problems when reproducing the GLUE experiment with bert-base-uncased. I used pytorch version = 1.8, python version = 3.6.13 and pip install --editable ., Different hyperparameter are also set according to different datasets in readme, but the results of CoLA, RTE and MRPC are only 58.1, 66.4 and 82.8, which are very different from 62.6, 71.1 and 87.3 in the paper.