Realistically speaking, any of the major changes that happen near the end of a star's life will make their planets uninhabitable on a time scale that seems pretty long from a human perspective. Imagine the last 100 years of climate change, but it just keeps getting worse at the same pace for a million years. By the time a star swells into a giant or explodes in a supernova, there won't be anyone around to notice.