I guess I have to always get the mkl files, even if I just want to use opencl?

This is not clear from the Getting Started guide.

I believe you don't have to, although then you will not be able to print matrices in the REPL, for example. For all practical purposes, I would still keep MKL (or another CPU engine implementation)