There is some way to use jump-to-definition and find-usages without running REPL?

Not that I've found. It seems like you should be able to do something with ctags, but I haven't tried that approach.