If you happen to be using Midje: with today's release, you can set in advance (e.g. in your user profile) the "-Dmidje.check-after-creation=false" JVM property, and CIDER no longer will run tests as it loads/evals test code, leaving the user experience on par with clojure.test.