Chunk size in python large size

def rows(f, chunksize=1024, sep='|'):
    """
    Read a file where the row separator is '|' lazily.

    Usage:

    >>> with open('big.csv') as f:
    >>>     for r in rows(f):
    >>>         process(r)
    """
    row = ''
    while (chunk := f.read(chunksize)) != '':   # End of file
        while (i := chunk.find(sep)) != -1:     # No separator found
            yield row + chunk[:i]
            chunk = chunk[i+1:]
            row = ''
        row += chunk
    yield row

Source: stackoverflow.com

Similar codes

0 vote296 views1 answer
Arrays with name instead of index python
Python
0 vote322 views1 answer
How to make html files open in chrome using python
Python
-2 votes315 views2 answers
+= python
Python
1 vote326 views1 answer
Creating an interface tkinter
Python
1 vote318 views1 answer
How to remove python3 on mac
Python
2 votes317 views1 answer
Python for loop m to n
Python
1 vote315 views1 answer
Backup django db from one database to another
Python
1 vote330 views1 answer
How to make table using python
Python
3 votes298 views2 answers
Python 3.7.9 download
Python
7 votes334 views4 answers
Qr code in python
Python