Thank you for your responses @mchampine and @richiardiandrea. I did not know that the dired mode rename behaves like move. I also somehow managed to miss clj-refactor. I think clj-refactor is more suited to what I wanted to do since I wanted to move code to a different namespace.