/Python/Kafka get last offset of topic python

Kafka get last offset of topic python

from kafka import SimpleClient
from kafka.protocol.offset import OffsetRequest, OffsetResetStrategy
from kafka.common import OffsetRequestPayload

client = SimpleClient(brokers)

partitions = client.topic_partitions[topic]
offset_requests = [OffsetRequestPayload(topic, p, -1, 1) for p in partitions.keys()]

offsets_responses = client.send_offset_request(offset_requests)

for r in offsets_responses:
    print "partition = %s, offset = %s"%(r.partition, r.offsets[0])

Source: stackoverflow.com

Similar codes

0 vote345 views1 answer
Load png to python
Python
1 vote350 views1 answer
Find matches between two lists python
Python
5 votes332 views1 answer
Python3 add dictionary to dictionary
Python
0 vote346 views1 answer
Production mode flask
Python
1 vote327 views1 answer
How to count backwards in for loop python
Python
0 vote327 views1 answer
Nested list flask
Python
0 vote358 views1 answer
How to config django templates with pathlib
Python
0 vote339 views1 answer
Python test mock class method
Python
2 votes318 views4 answers
How to create s3 bucket in aws cli
Python
11 votes366 views1 answer
Pandas xlsx to csv
Python