Not enough interaction with the waves.

I'm not fully versed on all the physics of it, but to my understanding, the layer of silver that makes up the reflective surface of a mirror is crazy thin, like, less than the thickness of paint.

The basic concept I was explained is that the longer the wavelength (lower frequency) the easier it is for it to penetrate obstacles, specifically things that are relatively opaque to radio waves. The very high frequency (small wavelength) waves of light, are so small that almost everything interacts with them; so when they make it to the silver layer, despite that silver layer being impossibly thin, the >100THz waves, will bounce. When dealing with stuff that's much lower frequency (like 2GHz to 5Ghz, many orders of magnitude lower frequency), there's not enough of the material to interact with the wave to have any significant effect on its propagation, so it passes right through.

This is a good observation and a great question. I'm sorry I couldn't be more specific, I'm just not as well versed in the physics of it all to really get into the details; but I hope this helps.