I got started with the Coopers Bitter Kit, cost me £25 in Hawkins Bazaar. Just had a check and they don't do it anymore and any Coopers kits they sell include the bottles as well (which are not essential.)
I've bought things as I've needed ever since. It's not an expensive hobby BTW so keep us posted.
I spotted this on ebay, seems like a good deal with a 32ltr fermenter included, Bulldog beer kit included too. (you'll need bottles or a keg though once its fermented).