关于训练数据的文本embedding欠缺--Lack of text embeddings in the training data

[Deng-peiying]

作者您好，请问脚本生成的无论是有无attn，都不包含嵌入文本这部分数据，请问这部分数据或者这个训练方法应该如何实现，test_embedding.py是空白文件，请问会有所影响吗？感谢您的恢复，最近在尝试复现您的工作
Hello author, may I ask whether the scripts generate data without including the embedded text part, regardless of whether there is attention (attn) or not? Could you please tell me how this part of the data or this training method should be implemented? test_embedding.py is an empty file — will this have any impact? Thank you for your response. Recently, I have been trying to reproduce your work.