Kafka Configuration

We are using Few properties of spring kafka in application.properties of an application like bootstrap servers ,auto-offset-reset,enable-auto-commit,serializer etc.need to provide documentation of all the properties we have for this spring kafka or atleast One URL where we have all the properties of spring kafka for both producer and consumer Could you please help me with… Read More Kafka Configuration

Different kafka topic with different amount of partitions within the same consumer group

Can I have different kafka topic with different amount of partitions within the same consumer group? If so, can I scale the consumers to the number of the topic with the most partitions? Thanks >Solution : Yes, each topic can independently have any number of partitions. I’m assuming you are consuming multiple topics with the… Read More Different kafka topic with different amount of partitions within the same consumer group

kubernetes – How to ensure running pods are terminated before new pods are created for a deployment

I have 4 replicas of a deployment running that consumer from Kafka and do some processing. When I come to deploying a new version of the application, 4 new pods are created before the existing pods are removed and in the termination grace period, the consumers will rebalance the work across all 8 pods before… Read More kubernetes – How to ensure running pods are terminated before new pods are created for a deployment

How the commit request severed by kafka internally?

when a Offsetcommit request thrown from a consumer how the kafka broker handle it internally? which are the threads are responsible to the offset commit request? >Solution : 1.All request messages (including OffsetCommit request) first arrive in the network queue. 2. And then go to the request queue (in kafka broker)by the network_thread. 3.Then IO… Read More How the commit request severed by kafka internally?