I don't want to jump to the cider error buffer (when there is an error) to i set cider-auto-select-error-buffer to nil and it still happens. Is there something else i should do or try?

I used this before to do exactly what you describe, maybe there has been a regression