Failure to instantiate test not appearing in build summary

[stacycurl]

When I build a project with a test like this:

class SomethingTests extends WordSpec {
val x: Int = sys.error("boom")
"won't be executed" in {
}
}

Maker reports that the test failed but it doesn't report that the build as a whole has failed.