Personally i am huge fan of owning my own data so i only have experience with self hosting from a home server.

You can probably find places pretty easily if you look for “cloud computing”, “cloud gpu”

I am pretty sure you don’t need licenses to start. Renting a last gen gpu may be expensive though (pay by the hour) this way of decentralized compute is becoming more and more common for developers.

I recommend waiting a few more years and keeping an eye on how services like nvidia cloud gaming evolve and how mainstream working with virtual machines becomes for the average office worker.

You can spin up a cheap VPS in a matter of minutes for less than five dollars. You do not need anything but a credit card usually. If you want a dedicated server all to yourself then it gets significantly more expensive but no less straightforward. If you want to put your own hardware online you’ll have to look at a collocation seller or arrange something with an ISP.

Of course if your home internet connection upstream is good enough, and your ISP permissive enough you could also just do dynamic DNS and have everything running off that.