Connect for Lemmy has an option to 'Ooen links in external browser' which should do what you want I think.