Skip to content
This repository was archived by the owner on Apr 8, 2024. It is now read-only.
This repository was archived by the owner on Apr 8, 2024. It is now read-only.

Write specifications for all inferencing modules and align #187

@jfomhover

Description

@jfomhover

There's a trade-off between aligning all inferencing modules, and providing flexibility to implement framework-specific arguments.

The inferencing pipeline should be able to rely on a standard set of parameters (ex: data type, batch size, num threads...) while providing flexibility for experiments requiring framework params (ex: using custom binaries).

Writing down a specification in our documentation, and decide which params should be the core "contract" of inferencing modules, then align on each of them, would put us in a better place before expanding to more frameworks.

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentation

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions