Investigate slow compilation times and heavy memory usage

[blmage]

This may be related to this GHC ticket.

Note that this currently prevents the Windows builds from being run.