/Python/Kafka get last offset of topic python

Kafka get last offset of topic python

from kafka import SimpleClient
from kafka.protocol.offset import OffsetRequest, OffsetResetStrategy
from kafka.common import OffsetRequestPayload

client = SimpleClient(brokers)

partitions = client.topic_partitions[topic]
offset_requests = [OffsetRequestPayload(topic, p, -1, 1) for p in partitions.keys()]

offsets_responses = client.send_offset_request(offset_requests)

for r in offsets_responses:
    print "partition = %s, offset = %s"%(r.partition, r.offsets[0])

Source: stackoverflow.com

Similar codes

0 vote223 views1 answer
R sample() funciton in python
Python
0 vote204 views1 answer
Python digit string
Python
0 vote226 views1 answer
Equivalent of spread in R in python
Python
0 vote260 views2 answers
Where should favicon.ico be placed in flask app
Python Flask
2 votes200 views3 answers
Display entire row pandas
Python
0 vote231 views2 answers
How to print aligned dictionary python
Python
0 vote208 views1 answer
Pybind11 python37_d.dll access violation
Python
7 votes207 views2 answers
Python print error traceback
Python
2 votes230 views3 answers
How to set background image in python tkinter
Python
0 vote233 views1 answer
Append to l'st python
Python