brcompatd: Delete VLAN tags only for the correct port in del_port().