Skip to content

Timeout for synchronous prediction #32

@Doerge

Description

@Doerge

Sometimes models get's stuck in kind of infinite loops, taking way longer than normally.
It would be great to have the following API:

ReplicateAI.run(..., timeout: :timer.minutes(2))

that would:

  • Submit a request.
  • Wait and check for a response.
  • Cancel the prediction if the timeout is reached, and return a timeout error.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions