You can buy nearly any budget machine and load Linux off a USB stick, but most people just take whatever they have and their last windows action is to download a boot image and write it to a USB stick, then boot off the stick and tell it to use the whole disk

Then use your backup system to restore your documents, pictures, web and mail configuration, and game settings and saves to your Linux machine