As per my understanding for doc2vec algorithm,you must not learn doc2vec label for testing data while training the model,if you will learn all the testing documents labels it will give high accuracy which is misleading.
Instead what we should do
I am sending pull request kindly check