flâneur — a map of the web's best reading

Kafka Producer transactions incrementing offsets twice for a message

groups.google.com · 2,600 words · saved by 1 readers

Groups Cuộc trò chuyện Tất cả nhóm và bài viết Cuộc trò chuyện mới  Nhóm của tôi Các nhóm gần đây Nhóm yêu thích  Cuộc trò chuyện yêu thích Confluent Platform Cuộc trò chuyện 99+ Giới thiệu Bảo mật • Điều khoản     Kafka Producer transactions incrementing offsets twice for a message 3.865 lượt xem Chuyển tới thư đầu tiên chưa đọc Đăng ký  Sampath Kumar chưa đọc, 04:05:43 12 thg 1, 2018    đến Confluent Platform We are trying to implement exactly once semantics using transaction. When a message is pushed to topic the offset gets incremented by two instead of one. ex : my current offset is 10, i am pushing message to topic. my next offset needs to be 11. however next offset is updated as 12. In the consumer side received only 1 message and my consumer group says lag of 1 even though my consumer is still running. This is happening only when we use transactions. When next message is pushed offset moved to 14 and consumer received 1 message only. We are using Kafka 1.0 f

Kafka Producer transactions incrementing offsets twice for a message Groups Groups     Kafka Producer transactions incrementing offsets twice for a message 4,192 views Skip to first unread message  Sampath Kumar unread, Jan 11, 2018, 1:05:43 PM 1/11/18    Reply to author Sign in to reply to author Forward Sign in to forward Delete You do not have permission to delete messages in this group Copy link Report message Show original message Either email addresses are anonymous for this group or you need the view member email addresses

Explore this link on the map →

related reading