/Python/Kinesis Client get_records example

Kinesis Client get_records example

import boto3
import json
from datetime import datetime
import time

my_stream_name = 'python-stream'

kinesis_client = boto3.client('kinesis', region_name='us-east-1')

response = kinesis_client.describe_stream(StreamName=my_stream_name)

my_shard_id = response['StreamDescription']['Shards'][0]['ShardId']

shard_iterator = kinesis_client.get_shard_iterator(StreamName=my_stream_name,
                                                      ShardId=my_shard_id,
                                                      ShardIteratorType='LATEST')

my_shard_iterator = shard_iterator['ShardIterator']

record_response = kinesis_client.get_records(ShardIterator=my_shard_iterator,
                                              Limit=2)

while 'NextShardIterator' in record_response:
    record_response = kinesis_client.get_records(ShardIterator=record_response['NextShardIterator'],
                                                  Limit=2)

    print record_response

    # wait for 5 seconds
    time.sleep(5)

Source: arundhaj.com

Similar codes

6 votes249 views2 answers
Python how to drop columns from dataframe
Python
1 vote269 views2 answers
Ast python
Python
15 votes258 views3 answers
How to get a row from a dataframe in python
Python
1 vote295 views1 answer
Pandas dataframe sort by column name first 10 values
Python
0 vote255 views1 answer
Not to display column tree odoo 8
Python
8 votes244 views2 answers
Python iterate list reverse
Python
0 vote234 views2 answers
Save image from jupyter notebook
Python
0 vote244 views1 answer
How to loadh5 file in python
Python
0 vote274 views1 answer
Pandas find fifth caracter in field and change cell based on that number
Python
0 vote293 views1 answer
Df.fillna("tagline",inplace=True) in jupyter notebook
Python