Otherwise you have to find ways to explain stuff to the audience when the characters grew up in that world and should already know all about it, so don't need to discuss things.

...you mean worldbuild organically like any other story set in a universe that isn't our own? Countless shows and stories have been doing that for centuries, why should anime get a special little exception?