Hi Jed,
Yes you should sterilise everything, I usually make up a gallon of steriliser in my fermenting bucket and dump everything in there. As long as they are covered in the solution you don't need to sponge them or anything, just turn the bigger stuff so all bits of it come into contact...