I don't think this will work on the long run.

First, the hold on the rim must be very tight and precise or the wheel will wobble like mad.

Second, such a tight hold will be very sensitive to any kind of dirt, so it has to be sealed.

Any seal tight enough to keep extremely small dirt out will cause loads of friction.

Tight seals in general is not an option, they exist en masse with e.g. hydraulic cylinders. But for them, the friction is basically a non-issue in comparison to the overall power budget. But I cannot imagine an even halfway free wheeling wheel that will not break down after getting in contact with a bit of sand.