Skip to content

Change how the number of consumers is defined for each topic #43

@Tiihott

Description

@Tiihott

Description
The number of consumers created for a single topic is calculated using:
int numOfThreads = Math.min(numOfConsumers, listPartitionInfo.size());
But because the kafka consumer groups are designed in a way that there is actual use for having more consumers than available topic partitions, it is wiser to not limit the number of consumers based on available topic partitions.
The additional in-active consumers can replace active consumers when they fail and/or a consumer group rebalance happens.

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions