Follow

Keep Up to Date with the Most Important News

By pressing the Subscribe button, you confirm that you have read and are agreeing to our Privacy Policy and Terms of Use
Contact

How can I access the list of uncommitted messages in a topic in kafka?

How can I access the list of all uncommitted messages in a topic in kafka

>Solution :

MEDevel.com: Open-source for Healthcare and Education

Collecting and validating open-source software for healthcare, education, enterprise, development, medical imaging, medical records, and digital pathology.

Visit Medevel

To access uncommitted messages, first assumes you are committing. Otherwise, you’re just consuming a topic.

The only way to get any records from Kafka is by using consumer api.

Commits aren’t required (disable auto commit and don’t explicitly call commit methods in code). However, if the app restarts for any reason, the auto.offset.reset property will always apply to any topic you’re consuming, meaning you either skip everything or have to block your main code execution until this consumer reads everything from the beginning of the topic. One popular app that doesn’t commit any offsets or create a consumer group is the Confluent Schema Registry. Kafka Streams changelog topics also do this.

If you want "another consumer" to read the entire topic, it needs to have a different group id. That’s it

Add a comment

Leave a Reply

Keep Up to Date with the Most Important News

By pressing the Subscribe button, you confirm that you have read and are agreeing to our Privacy Policy and Terms of Use

Discover more from Dev solutions

Subscribe now to keep reading and get access to the full archive.

Continue reading