I have a Wireguard VPN to my home network and there it works exactly like you tried it. Connect to VPN, then use the internal IP to connect to the service. Maybe there are settings in the server or client that prevent that. For example, you can set specific IP ranges to not be routed through the VPN (so you can access a local service in Network A even though you are connected to VPN B).

I'm no network expert, but maybe some additional information about your setup can help other user help you better.

Depends on your specific VPN, but look for a feature or setting called "split tunnel." It should create a separate non-vpn route for the local network.

Usually client-side setting, but not always if the tunnel is built on connection.

If it's working correctly, it should be as simple as accessing (internal ip) : (port) at (external ip) : (port).

There are a bunch of things that might be going wrong if it's not working. Unfortunately, I don't have the skills to help you diagnose the issue!

Tailscale. It’s all you need.