The way different people write is usually split along the lines of this question. A good example demonstrating this is the Game of Thrones TV series. Martin's novels were very much written with the world building at the forefront; character's narratives were mostly secondary to what was going on in the world and if a character ended up in a deadly situation then plot armour wasn't going to save them (usually). However when the content of the novels ran out and the hollywood writers took over the plot, you almost immediately see a switch to character driven narratives because that's almost always how hollywood writes stories. Notice that basically no major characters die in the later seasons.

I think this difference is very noticeable in the TV series, even if people don't necessarily recognise this specific explanation of why the later seasons feel so different. And as a writer I think you want to at least recognise which of these styles you are personally using. As others have pointed out, if your worldbuilding seems too obviously constructed to make the plot work then that can be noticeable by the readers, but maybe that's fine if you're writing a very character focused narrative. You could even leave the details of the world fairly vague and ill defined if this is the case.

But if you want your world to feel detailed and cohesive, then I think you need to have a decent amount of the worldbuilding fleshed out before you start writing the characters. Like, by all means have your plot structure figured out, but the actual page to page writing should be informed by the worldbuilding otherwise there's a strong chance your world just feels like a cardboard backdrop to your characters.