Read my comment if you like speculation and future prediction.

It's a bit too early to talk about this. First the Switch 2 will come out, then probably Steam Deck 2, then Xbox Portable and only then Sony is ready to release. At that point its already in the middle of the Switch 2's life cycle and the market is full of handhelds. If Sony comes up with expensive prices again, it will be a tough sale (in the long run) and it ends up being a similar failure (for units sold) like the Vita.

The Playstation Portal just streams and is already 200 Dollar. It's basically a tablet with controllers attached to it, but less capable. If Sony goes the route of Apple and markets the Playstation Handheld as a premium device for hardcore fans, then do not expect it being cheaper than 500, around same price as the original PS5. I hope Sony will surprise me.