This depends on the permission the contact label owner gave you. If it’s the “Can share” permission, you can share the label with new users and manage the permissions of the existing users with access in the list.