I would have said lein with-profile +test check would fail when there's a syntax error in a test file?
it's only failing on src errors
ahhh it's checking only :source-paths https://github.com/technomancy/leiningen/blob/github/src/leiningen/check.clj