On the alignment between supervised and self-supervised contrastive learning