If you can target an invisible wall, it introduces a lot of ways for things to go wrong. The spell caster is taking elements on faith and making assumptions, and those can be subverted...