Honestly it's fine as long as everyone is in a similar power band. All you do is scale up encounter difficulty slightly by adding monster abilities or extra opponents. All power levels are relative to the campaign's conditions, after all.

What sucks is when one person is vastly stronger than their peers and sees no problem with this. Those people never learned to share and should be shunned.