The way I see it, if you want to be pedantic about it (it being a joke photo, so potentially unintentionally reversed by the camera, of a cake which is in 3d space and can be seen in both directions) you might as well do it properly and acknowledge that different orders exist for bits.

Indeed writing conventions are also a good point, however this is not writing. People actually working at bit level are probably more likely to see bits on a scope (so in both LSb or MSb order) than as 1 and 0s written on a piece of paper or a screen.