Yeah, I totally agree - except for the fact that Dean wears a very different style to Sam, so it can't be a matter of taking what doesn't fit Sam...they are obviously clothes purchased FOR Dean. But, as you suggested, not necessarily BY Dean...it could be Sam picking up a shirt or two for Dean whenever he notices that Dean's got holes in his elbows.