I think it will still mostly generate the expected output, its just gonna be biased towards being lazy and making something up when asked a more difficult question. So when you try to use it further than "haha, mean racist AI", it will also bullshit you making it useless for anything more serious.

All the stuff that ChatGPT gets praised for is the result of the model absorbing factual relationships between things. If it's trained on conspiracy theories, instead of spitting ground breaking medical relationships it'll start saying you're ill because you sinned or that the 5G chips in the vaccines got activated. Or the training won't work and it'll still end up "woke" if it still manages to make factual connections despite weaker links. It might generate destructive code because it learned victim blaming and jokes on you you ran rm -rf /* because it told you so.

At best I expect it to end up reflecting their own rethoric on them, like it might go even more "woke" because it learned to return spiteful results and always go for bad faith arguments no matter what. In all cases, I expect it to backfire hilariously.