Chunk size in python large size

def rows(f, chunksize=1024, sep='|'):
    """
    Read a file where the row separator is '|' lazily.

    Usage:

    >>> with open('big.csv') as f:
    >>>     for r in rows(f):
    >>>         process(r)
    """
    row = ''
    while (chunk := f.read(chunksize)) != '':   # End of file
        while (i := chunk.find(sep)) != -1:     # No separator found
            yield row + chunk[:i]
            chunk = chunk[i+1:]
            row = ''
        row += chunk
    yield row

Source: stackoverflow.com

Similar codes

0 vote268 views1 answer
Np choose explain
Python
98 votes308 views6 answers
Python remove last character from string
Python
10 votes278 views3 answers
Image to text python
Python
67 votes258 views6 answers
Deleting duplicates in list python
Python
0 vote258 views2 answers
How to terminate a program cv2 python
Python
11 votes267 views3 answers
Discord.py add reaction to message
Python
0 vote257 views2 answers
How to import image in python
Python
1 vote244 views5 answers
Delete csr python
Python
0 vote224 views1 answer
Python no mathcing key method found
Python
0 vote306 views1 answer
Django set random password
Python