You can. Your downvote are not federated though. That means your instance knows about them, but can't send it to lemmynsfw.com since it doesn't want to know. Consequently no other instance will know about your downvote since they ask lemmynsfw.com for who voted and who didn't and not your instance.

You will be able to downvote, but if the community in question is hosted on an instance that has disabled downvotes, your downvote won't federate to anyone else. The only people who see it will be people on the same instance as you.

For users of an instance that has disabled downvotes, their timelines silently drop all downvotes, so those users see the fediverse without the impact of any downvotes, irrelevant of where they came from or what other people see.