I have this weird behavior with the interactable actor whereby when the object is held in the left hand, it jitters and starts to behave erratically sometimes offsetting huge amounts and moving away from the hand. This stops when the hand is moved around or the player starts moving, however, this is very immersion breaking. I did not have any such issue in UE 5.2 with OVR 1.89 but due to packaging issues I have moved to 5.3. I can package the game successfully, but this specific bug is really a huge issue with my project. Btw, I have downloaded a completely vanilla template of the Unreal Hand Gameplay 5.3 and the issue still exists, so this is obviously an issue in template. Btw, I have not made any changes to the plugins. I am using the OVR + Open XR backend, I have tried changing the hand tracking frequency and hand tracking version, but there is no effect.
I have attached a video as reference.
https://www.dropbox.com/scl/fi/f35jvuc6gjr4711jly8q1/Bug.mp4?rlkey=c19sft0zjdt6xwt3liimlwz2m&st=ffvcjxv9&dl=0