/Python/Kafka get last offset of topic python

Kafka get last offset of topic python

from kafka import SimpleClient
from kafka.protocol.offset import OffsetRequest, OffsetResetStrategy
from kafka.common import OffsetRequestPayload

client = SimpleClient(brokers)

partitions = client.topic_partitions[topic]
offset_requests = [OffsetRequestPayload(topic, p, -1, 1) for p in partitions.keys()]

offsets_responses = client.send_offset_request(offset_requests)

for r in offsets_responses:
    print "partition = %s, offset = %s"%(r.partition, r.offsets[0])

Source: stackoverflow.com

Similar codes

4 votes322 views1 answer
Video streaming flask
Python Flask
0 vote270 views2 answers
Pandas drop a list of rows
Python
0 vote314 views1 answer
How to handle response from tkinter messagebox.askquestion() function in Python
Python
0 vote299 views1 answer
Malier module python
Python
3 votes270 views2 answers
Numpy array sorting
Python
7 votes241 views1 answer
Data frame do nympy
Python
1 vote286 views1 answer
Python change name of the imported function
Python
0 vote281 views1 answer
How to define the range of values in seaborn heatmap
Python
1 vote286 views1 answer
Python selenium web scraping example
Python
147 votes309 views6 answers
Python if file exists
Python