If you're that concerned, you can get an whole house filter, an under-the-sink filtration system to filter just the kitchen tap, or you can just use a Brita pitcher. Or just buy bottled water by the 5-gallon.
If you want containers to haul and store water from a well, look on prepper and emergency storage websites like Shelf Reliance or Emergency Essentials. They have tons of products and tips.
5'0" female, 44 years old. Started Primal October 31, 2011, at a skinny fat 111.5 lbs. Low weight: 99.5 lb on a fast. Gained back to 115(!) on SAD chocolate, potato chips, and stress. Currently keeping food tracker.
I (try to) follow by-the-book primal as advocated by Mark Sisson, except for whey powder and a bit of cream. I advocate a two-month strict adjustment for newbies. But everybody is different and should tweak Primal to their own needs.