about Realtime estimation

[enzika14]

Hello! I'm glad to know about this model while looking for a multi camera based pose estimation model.
I guess it's not the main purpose of use in this project originally, but is there a way to use this for real-time interaction?

[mprib]

Hi enzika,

Apologies for the late reply. While I've played around with real time tracking, the current setup really doesn't lend itself to that because:

• You need to be running from multiple points of view to get decent tracking
• running inference on multiple frames in parallel becomes a major bottleneck for a single CPU
• frame rates get throttled substantially.

The priority for this project is currently a robust and accurate multicamera calibration tool with inexpensive hardware that uses a simple mediapipe implementation to demonstrate the landmark tracking/triangulation. If you want high quality and real-time, you are going to need significantly more expensive hardware.

It's the classic trade-off of quality, speed, price: pick any two. My current focus is on quality and price.

Mac