It depends on the state. Maps in reading direction: a) Public agencies of state and municipalities, b) prisons, c) gymnasia, pools, and similar, d) places of culture (community halls, museums, etc) e) taverns and pubs. Colors red complete smoking ban, yellow exceptions possible, green separate smoking areas, grey no rules / exempt.

That's a high-level overview you get more fine-grained exceptions, say general smoking bans at hospitals but psych wards are exempt because have you ever tried to stop a schizophrenic from self-medicating.

Some people may now be wondering "wait, Bavaria has a complete ban on smoking in pubs" and, yes. They have a snuff tradition to fall back on. Also CSU = Verbotspartei.