I don't think it's good to resort to the election to determine a complex legal ruling. It wouldn't simply be ruling him eligible it not as the case would be in court. It would just make him president if enough people want him. There are many reasons that people pick who they vote for. I would prefer a ruling on the 14th amendment issue to be based only in that and made by people who understand constitutional law.
I understand your reservations about leaving that jn the hands of the judiciary, but for that type of thing I don't think just letting the election decide is the appropriate course of action.
https://www.hairdr.com/hairlines/should-you-use-oral-minoxidil-instead-of-topical-minoxidil/