/Python/Kafka get last offset of topic python

Kafka get last offset of topic python

from kafka import SimpleClient
from kafka.protocol.offset import OffsetRequest, OffsetResetStrategy
from kafka.common import OffsetRequestPayload

client = SimpleClient(brokers)

partitions = client.topic_partitions[topic]
offset_requests = [OffsetRequestPayload(topic, p, -1, 1) for p in partitions.keys()]

offsets_responses = client.send_offset_request(offset_requests)

for r in offsets_responses:
    print "partition = %s, offset = %s"%(r.partition, r.offsets[0])

Source: stackoverflow.com

Similar codes

52 votes176 views6 answers
Save json to file
Python
21 votes187 views1 answer
Python remove last characters from string
Python
2 votes183 views3 answers
Python beep
Python
0 vote174 views1 answer
Python spacing problems
Python
0 vote166 views1 answer
Spotify recommendations
Python
0 vote180 views1 answer
How to import flask restful using pip
Python Flask
83 votes167 views3 answers
Deleting a file using python
Python
2 votes116 views1 answer
Pandas column statistics
Python
0 vote154 views2 answers
1000
Python
2 votes149 views1 answer
Hardest python questions
Python