How to Train Orthogonal Bases

[dsj320]

About the orthogonal bases,I can't understand the methods in your codes,i see you use the QR decomposition,but i don't know how to enforce orthogonality during training and optimize it with backpropagation.can you explain it to me?Thanks!

[wyhsirius]

@dsj320 The Orthogonal Bases and latent space navigation used in EDTalk are originally from LIA (https://github.com/wyhsirius/LIA), you can check LIA paper (https://wyhsirius.github.io/LIA-project/) for more information. You do not need to enforce orthonogality during training, because QR dcomposition will automatically give you an orthogonal matrix.