Alternative Thumbnails is a feature available in the latest ReX patches.
ReX is a fork of the discontinued Revanced Extended project, which in itself was a fork of the official Revanced project.
I applied these patches using the Revanced Extended Manager on YouTube 18.33.37
Screenshots:
Here it is in action:
I'm trying this. Is very smooth!