I have a Connector sink 3 topics, 2 topics have 3 partitions while the third has 6. I set the tasks.max to 12 to match the total number of partition but I only have 6 active tasks reading data from Kafka
When multiple topics are involved, Connect (which uses the RangeAssignor
) creates tasks based on the topic with the highest number of partitions. This behavior is explained in more detail here.