Did I dream this or is there an elisp dotfile I can add to a directory and when emacs loads a file from the dir it attempts to load the dotfile ?

Ah, found it https://www.emacswiki.org/emacs/DirectoryVariables