You could technically have negative modifiers that would make it impossible for you to succeed, where others might.

You're right in that your DM likely will not even let you roll....but it's still possible.