05 FAQ

Assignment Submission Errors

AgentInstallError

Check the error that is given and fix accordingly. It is important to note that internet connection is disabled during agent installation. Any attempt to access the outer world (internet) will result in an error.

You can check whether your agent is installable by running:

pip install /path/to/your/agent.zip

IMPORTANT: Make sure that you uploaded the correct zipped agent file with the appropriate formatting (appropriate modification of template). Most of the time the error arises because of the introduction of additional folder. For example:

// Incorrect folder structure

<something>.zip
    agent/
        setup.py
        agent/
            __init__.py
            ...
        ...

The above folder structure is incorrect. To make sure that you zip correctly, please enter the folder in which the setup.py resides, then select all files (setup.py, agent/ folder, MANIFEST.in, etc), then compress it. That should give you:

// Correct folder structure

<something>.zip
    setup.py
    agent/
        __init__.py
        ...
    ...

This is very important for Mac users, as zipping the folder on Mac usually generates other folder/files (e.g., _MACOSX, ._.DS_Store). So please make sure that the setup.py is in the root folder after unzipping.

AgentNotFound

Note: this guide also applies to other import related errors.

This error indicates that the runner can't find the agent in the Python virtual environment.

To check whether your agent can be found, follow the install instruction, then open python terminal and type:

test_case_id = None # change with the appropriate test case ID if your agent depends on one
from agent import create_agent
create_agent(test_case_id)

If it didn't crash, it means that you are good to go.

TimeoutException

This means that your agent is not fast enough. You have to make your agent runs faster.

MalformedOutputError

This error usually indicates that there is some issue with the output of the program (agent), or somehow it fails to run. In most cases, this error is triggered by some print function somewhere in your code (not in our code).

RunnerError

This usually caused by the agent exiting with a non-zero exit code. Please read the error message to figure out what's wrong. If the returned error message is empty, it's most likely being caused by a bad system call (see known issues).

Known issues

Numpy

• numpy.matmul, numpy.dot, and numpy.inner is not supported due to its nature of invoking bad system call which is blocked by seccomp.
  • @ operator, which is a shorthand for numpy.dot, is also not supported.
  • * operator between matrix will call numpy.dot, hence is also not supported.