No, that is normal. Hemispacial neglect patients have great difficulty with considering both the left and right half of an object, so they will often draw clocks wonky trying to fit all or most the numbers on the right side of the clock. Coordinating where you place the numbers (as you described it) is the normal behavior. You do not have hemispacial neglect and confusing two numbers isn't an indication of it.

Other examples include transcribing only the right half of sentences when asked to transcribe text, and drawing objects other than clocks failing to consider details on the left side, like a house but with an open/incomplete side on the left, or a flower with only petals to the right side.

People just tend to remember the clock thing because it's interesting, but they misattribute it as a more general sign of brain damage and not a very specific sign of very specific brain damage

Naw, that makes sense. Quarters are easier to eyeball than 12ths, 6ths or 3rds