Chunk size in python large size

def rows(f, chunksize=1024, sep='|'):
    """
    Read a file where the row separator is '|' lazily.

    Usage:

    >>> with open('big.csv') as f:
    >>>     for r in rows(f):
    >>>         process(r)
    """
    row = ''
    while (chunk := f.read(chunksize)) != '':   # End of file
        while (i := chunk.find(sep)) != -1:     # No separator found
            yield row + chunk[:i]
            chunk = chunk[i+1:]
            row = ''
        row += chunk
    yield row

Source: stackoverflow.com

Similar codes

0 vote262 views3 answers
How to count null values in pandas and return as percentage
Python
0 vote245 views1 answer
Add last item of array at the first index of the array python
Python
0 vote273 views1 answer
How to set up pygame
Python
0 vote260 views1 answer
Remove first 2 rows in pandas
Python
2 votes266 views1 answer
Python recursion save value
Python
0 vote277 views1 answer
Kivymd simple button
Python
5 votes278 views3 answers
Stop function python
Python
10 votes265 views2 answers
Prime number
Python
0 vote308 views1 answer
Get admin url of instance django
Python Django
0 vote243 views1 answer
Uninstalling/removing a package is very easy with pip:
Python