Follow

Keep Up to Date with the Most Important News

By pressing the Subscribe button, you confirm that you have read and are agreeing to our Privacy Policy and Terms of Use
Contact

Different kafka topic with different amount of partitions within the same consumer group

Can I have different kafka topic with different amount of partitions within the same consumer group?
If so, can I scale the consumers to the number of the topic with the most partitions?
Thanks

>Solution :

MEDevel.com: Open-source for Healthcare and Education

Collecting and validating open-source software for healthcare, education, enterprise, development, medical imaging, medical records, and digital pathology.

Visit Medevel

Yes, each topic can independently have any number of partitions. I’m assuming you are consuming multiple topics with the same consumer, in any case, what will happen is that the topics that have fewer partitions than consumers will be consumed by a subset of the consumers (some consumers will not get any messages from these topics since they won’t have any partition assigned)

Add a comment

Leave a Reply

Keep Up to Date with the Most Important News

By pressing the Subscribe button, you confirm that you have read and are agreeing to our Privacy Policy and Terms of Use

Discover more from Dev solutions

Subscribe now to keep reading and get access to the full archive.

Continue reading