Remove torch as a dependency?

[naterush]

Torch is currently listed as a dependency in the pyproject.toml. Torch is large and takes a long time to install, and I don't see where it is used. Maybe we should remove it?

[naterush]

(Note: this is ported from the eval pipeline repo)