Is there a command in emacs to upgrade one package without going through the list of upgradable packages?

package-upgrade or so?

Not sure, I use doom emacs which handles that differently :/

It seems I have to double click to go to the first reference

Yeah straight.el is really good for these kind of things

It's also compatible with use-package, you could move to it easily