I am using OBS Game Capture plugin and it works perfectly on Wayland. I have yet try it with Wine Wayland, though.

I’m confused, OBS works well. What is missing you are desiring?

AMD has an nvdec/nvenc equivalent called AMF, on Linux it's going to be deprecated in months in favour of va-api.

To my knowledge, it does not have an nvfbc equivalent. Which anyway, Nvidia has deprecated on windows in favour of a windows-native screen capture with a name I don't remember.

For what is worth, va-api encoding + kmsgrab works pretty well for me, it does have some latency, but nothing too unacceptable. Probably less than the one caused by the Bluetooth controller. And none of this is vendor specific, you can get it working on Intel, AMD and Nvidia (Nvidia needs a compatibility layer, but it works). Also, it works on Wayland, but sunshine needs some privileges to work.

Sunshine supposedly supports nvfbc with patched Nvidia drivers, even on Linux, I haven't tried it, so I don't know if it works on Wayland. I don't see why it shouldn't, as long as you give sunshine privileged permissions (like you need for kmsgrab). Even without nvfbc you can use nvenc, so you don't need the va-api compatibility layer.

Supposedly, since this Nvidia driver release nvfbc is used as backend for pipewire screen capture, so it should just work for apps like OBS, I don't know if sunshine has intention to move to it.

In general, screen capture on Linux pretty much works, even on Wayland. The general sentiment that it's broken is actually old news.

There's a caveat though. Proprietary apps tend to use outdated stuff (e.g. electron builds from 5 years ago) and thus don't support screen sharing on Wayland.