/Python/Kafka get last offset of topic python

Kafka get last offset of topic python

from kafka import SimpleClient
from kafka.protocol.offset import OffsetRequest, OffsetResetStrategy
from kafka.common import OffsetRequestPayload

client = SimpleClient(brokers)

partitions = client.topic_partitions[topic]
offset_requests = [OffsetRequestPayload(topic, p, -1, 1) for p in partitions.keys()]

offsets_responses = client.send_offset_request(offset_requests)

for r in offsets_responses:
    print "partition = %s, offset = %s"%(r.partition, r.offsets[0])

Source: stackoverflow.com

Similar codes

0 vote216 views1 answer
Create requirements file and load it in new envirnment.
Python
1 vote220 views1 answer
Installing more modules in pypy
Python
0 vote248 views1 answer
Torch.unsqueze
Python
0 vote219 views1 answer
Print a string with spaces between characters python
Python
0 vote245 views1 answer
Tkinter titre fenetre
Python
4 votes224 views2 answers
Python linux command
Python
0 vote225 views1 answer
Concatenação de Strings
Python
2 votes221 views1 answer
Flask form
Python
0 vote223 views1 answer
Python create dataframe by row
Python
34 votes225 views2 answers
Create a df in pandas
Python