Chunk size in python large size

def rows(f, chunksize=1024, sep='|'):
    """
    Read a file where the row separator is '|' lazily.

    Usage:

    >>> with open('big.csv') as f:
    >>>     for r in rows(f):
    >>>         process(r)
    """
    row = ''
    while (chunk := f.read(chunksize)) != '':   # End of file
        while (i := chunk.find(sep)) != -1:     # No separator found
            yield row + chunk[:i]
            chunk = chunk[i+1:]
            row = ''
        row += chunk
    yield row

Source: stackoverflow.com

Similar codes

0 vote369 views2 answers
How to make an instagram report bot python
Python
1 vote345 views1 answer
Python set timezone of datetime
Python
5 votes366 views6 answers
Valid Palindrome
Python
0 vote339 views1 answer
TypeError: Object of type DictProxy is not JSON serializable
Python
0 vote359 views1 answer
Set colour to inserplaintext qtextedit in python
Python
0 vote420 views1 answer
Black python
Python
0 vote333 views1 answer
Xpath start-with
Python
2 votes338 views1 answer
Python hashlib.sha512()
Python
0 vote360 views1 answer
Remove cog in discord.py
Python
1 vote352 views1 answer
Python text tkinter not typable
Python