build a C++ runtime engine for running the python algorithms. #184
Description
In my opinion all the code that is written for production should be not be written in Python. I think Python is very good at prototyping and making sure the algorithms runs. What problems does it have? It manages a lot of dependencies and we have very little control of the memory and performance boost we can make into the system. We are limited to add performance by adding more libraries or more external tools into it. It cannot be compiled and that makes the code non-portable most of the time.
What Im thinking wouuld be a good idea for a near future, is to have the products that we now are more mature and pass them to C++. In our case I know that the use of YOLO models is going to continue to be fundamental for a lot years. Thats why using a Yolo engine and runtime api could be useful.