/Python/Kafka get last offset of topic python

Kafka get last offset of topic python

from kafka import SimpleClient
from kafka.protocol.offset import OffsetRequest, OffsetResetStrategy
from kafka.common import OffsetRequestPayload

client = SimpleClient(brokers)

partitions = client.topic_partitions[topic]
offset_requests = [OffsetRequestPayload(topic, p, -1, 1) for p in partitions.keys()]

offsets_responses = client.send_offset_request(offset_requests)

for r in offsets_responses:
    print "partition = %s, offset = %s"%(r.partition, r.offsets[0])

Source: stackoverflow.com

Similar codes

2 votes329 views2 answers
Remove first item from list python
Python
0 vote326 views1 answer
UserWarning: Using slow pure-python SequenceMatcher. Install python-Levenshtein to remove this warning warnings.warn('Using slow pure-python SequenceMatcher. Install python-Levenshtein to remove this warning'
Python
0 vote310 views1 answer
Converting double spaces int single spaces python
Python
0 vote338 views1 answer
Numpy count occurrences in interval array
Python
1 vote313 views1 answer
How to print something with tkinter
Python
0 vote309 views2 answers
Turtle keep window open
Python
0 vote318 views1 answer
Conda install nltk
Python
29 votes325 views6 answers
Install python ubuntu
Python
0 vote315 views1 answer
How to create a numpy array with constant value
Python
0 vote347 views1 answer
Spacy get number of tokens
Python