What is the use of oracle?

[qinjc]

It seems that after Oracle is created, there is no training for it, but it is used to calculate various losses. So how does Oracle help with training?

[suragnair]

We don't have a ground-truth language model for something like English. So the authors use an oracle as a ground-truth, against which they benchmark the performance of their method. You can find more details in the paper.