If someone already has access to contacts through a group, sharing with them directly doesn’t duplicate access—the higher permission applies. If you later unshare the label from the group, that person will still keep access through the direct share, with the permission you set for them individually.