When calling 'thumbot retry' it operates on the same build dir.
Some builds don't clean up to a pristine state before each build and thus a case could be made for blowing away the build dir entirely for it to be fresh.
This build: basho/riak_repl#764 (comment) had to be manually cleaned up for retry.
Should we blow away the build dir during retries ?