Cost of living is not magical. It is created by the opportunities available. If people can pay more for the house or rent, the market will adjust to it. The regulating factor is simply the opportunities available. All other factors are peripheral.

If you can export money by working remotely, you're floating on a rare exception to the rule. If everyone could do the same, the cost of living would adjust to compensate. You are essentially taking the same risk as an ancient merchant on a ship. When the circumstances change, you can easily find yourself stuck in a place without any opportunities.

The fallacy is looking at cost of living as some kind of magical random generated number. It is not. It is a direct measure of the opportunities available to the average person. It doesn't matter where you live, how poor or how rich the area seems, the average person is encountering the exact same pressure and stress about simply staying afloat. The grass is not greener on either side of the fence. The only difference is the availability of opportunities for the average person in an area.