Well, the Libertarian Party (Chase Oliver's party) doesn't run a primary, it runs a national caucus. He was selected as the nominee by delegates, and if you felt so inclined, you could help choose your local delegates (or become one yourself).

Jill Stein also seems to be in favor of peace in Gaza, so she's an option as well, though she likely has less ballot access (we'll see come November).