Second buildroot as the way to go. This is what I use to build systems for single application touchscreen HMIs. It's dead simple too, unless you're messing with a custom kernel config and/ or using obscure hardware without ready made device tree blobs.