I wash before putting it back, did you not do the experiment in school where you put a slice of bread in a ziplock bag?!
I only use a bread knife to cut hard rolls though - otherwise I just use the table knife that I used to spread the butter or sauce... ain't nobody got time for additional washing up.