Get a P.O. Box for returns/exchanges, so you don't have to give out your home address.
Use a VoIP service if you need a business phone #. Callcentric is cheap and reliable.
Use an email redirect service like SimpleLogin or AnonAddy to create an email account that's just for business, and add it to your PayPal (if you have one & plan on using it) so people don't see your personal email address on receipts.