is it possible to override a minor mode's keymap exclusively when typing in the minibuffer?

I'll rephrase: I've added a hook in paredit-mode to execute paredit-newline when I click RET. However I'd like to disable this only in the case of eval-expression-minibuffer-setup-hook. Any pointers on how to do it appreciated