Honestly, I think 4-ply collars are a bit ridiculous ... and can often cause that very problem ... especially if the material is rough.

I have never needed more than a 2-ply collar, and I always buy collars that are soft, not hard/rough.

Hard/rough (and/or too tight) = collar rub.

Jack