Investigate Limiting File System Usage

[nmagerko]

In other Docker libraries (e.g. in Node) we can specify a disk quota. In the Python version, I was unable to find this option.

We should try to find out how we can access the disk quota option in this project so that users can specify a workdir without being concerned that the code that they're executing will fill up all available space.

[bhuvy2]

Shouldn't we able to do it with storage opt?

https://stackoverflow.com/questions/33013904/how-to-limit-docker-filesystem-space-available-to-containers

https://github.com/docker/docker-py/blob/master/docker/models/containers.py#L697

(Under storage_opt here https://docker-py.readthedocs.io/en/stable/containers.html)

[nmagerko]

Seems like it. If you would like to find how to configure the disk quota using that, feel free to take this issue.

[bhuvy2]

There is a problem with it that requires more exploration. If the filesystem isn't mounted with the correct options it aborts the entire operation (Error included when trying to spin up a docker daemon). There will probably have to be a design decision made because we won't know if the current filesystem is mounted with the right params until after we try to start a run.

docker.errors.APIError: 500 Server Error: Internal Server Error ("--storage-opt is supported only for overlay over xfs with 'pquota' mount option")