/Python/Kafka get last offset of topic python

Kafka get last offset of topic python

from kafka import SimpleClient
from kafka.protocol.offset import OffsetRequest, OffsetResetStrategy
from kafka.common import OffsetRequestPayload

client = SimpleClient(brokers)

partitions = client.topic_partitions[topic]
offset_requests = [OffsetRequestPayload(topic, p, -1, 1) for p in partitions.keys()]

offsets_responses = client.send_offset_request(offset_requests)

for r in offsets_responses:
    print "partition = %s, offset = %s"%(r.partition, r.offsets[0])

Source: stackoverflow.com

Similar codes

1 vote318 views1 answer
Creating an apis with python and flask
Python Flask
-1 vote300 views1 answer
How to remove an element from dictionary using his value python
Python
-1 vote211 views1 answer
Expected ")" pylance python
Python
0 vote304 views1 answer
Merge two Querysets in Python Django while preserving Queryset methods
Python Django
0 vote250 views1 answer
Check accessability of the file
Python
0 vote277 views1 answer
Add vertical line in plot python
Python
0 vote263 views1 answer
Conda install nltk
Python
23 votes267 views6 answers
Flask post
Python
0 vote252 views1 answer
Python convert xml to dictionary
Python
1 vote284 views2 answers
How to append to an empty dataframe pandas
Python