Skip to content

Runtime: automated end-to-end integration tests #55

@camerondurham

Description

@camerondurham

Create end-to-end integration tests for limiting behavior. Should create runner struct and send code that will test the num procs limit, timeout limit and other limits as needed.

Requirements:

  1. verify runtime agent returns an error when program exceeds timeout limit
    1. and that execution does not exceed TimeoutLimit + epsilon
  2. verify runtime agent returns an error when program exceeds max num procs limit
    1. (note: this will be hard to verify at an OS level, at least returning an error should be okay for now)
  3. verify runtime agent returns an error when program exceeds max file size creation limit

Metadata

Metadata

Assignees

No one assigned

    Labels

    runtimeEngine runtime handles safely executing user submitted code

    Projects

    Status

    Todo

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions