Chunk size in python large size

def rows(f, chunksize=1024, sep='|'):
    """
    Read a file where the row separator is '|' lazily.

    Usage:

    >>> with open('big.csv') as f:
    >>>     for r in rows(f):
    >>>         process(r)
    """
    row = ''
    while (chunk := f.read(chunksize)) != '':   # End of file
        while (i := chunk.find(sep)) != -1:     # No separator found
            yield row + chunk[:i]
            chunk = chunk[i+1:]
            row = ''
        row += chunk
    yield row

Source: stackoverflow.com

Similar codes

0 vote314 views1 answer
Add metadata png PIL
Python
1 vote301 views1 answer
Barplot syntax in python
Python
0 vote293 views1 answer
Run exe for python and wait until finish
Python
1 vote293 views1 answer
Discord music queue python
Python
4 votes289 views5 answers
Print hello in python
Python
0 vote333 views1 answer
How to let only admins do a command in discord.py
Python
12 votes299 views5 answers
Python find intersection of two lists
Python
0 vote296 views1 answer
Convert to pdf fresh little library that outputs our notebook in a nice LaTex format without installing/doing anything else.
Python
0 vote294 views1 answer
Load text file line in listbox python tkinter site:stackoverflow.com
Python
0 vote296 views1 answer
Does the queen brush her teeth
Python