You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository was archived by the owner on Apr 8, 2024. It is now read-only.
There's a trade-off between aligning all inferencing modules, and providing flexibility to implement framework-specific arguments.
The inferencing pipeline should be able to rely on a standard set of parameters (ex: data type, batch size, num threads...) while providing flexibility for experiments requiring framework params (ex: using custom binaries).
Writing down a specification in our documentation, and decide which params should be the core "contract" of inferencing modules, then align on each of them, would put us in a better place before expanding to more frameworks.