Just make your reader subscriptable by wrapping it into a list. Obviously this will break on really large files (see alternatives in the Updates below): >>> reader = csv.reader(open(‘big.csv’, ‘rb’)) >>> lines = list(reader) >>> print lines[:100] … Further reading: How do you split a list into evenly sized chunks in Python? Update 1 (list … Read more
Here is another way: var chunks = []; int chunkSize = 2; for (var i = 0; i < letters.length; i += chunkSize) { chunks.add(letters.sublist(i, i+chunkSize > letters.length ? letters.length : i + chunkSize)); } return chunks; Run it on dartpad
def chunker(seq, size): return (seq[pos:pos + size] for pos in range(0, len(seq), size)) # (in python 2 use xrange() instead of range() to avoid allocating a list) Works with any sequence: text = “I am a very, very helpful text” for group in chunker(text, 7): print(repr(group),) # ‘I am a ‘ ‘very, v’ ‘ery hel’ … Read more
Here’s a generator that yields evenly-sized chunks: def chunks(lst, n): “””Yield successive n-sized chunks from lst.””” for i in range(0, len(lst), n): yield lst[i:i + n] import pprint pprint.pprint(list(chunks(range(10, 75), 10))) [[10, 11, 12, 13, 14, 15, 16, 17, 18, 19], [20, 21, 22, 23, 24, 25, 26, 27, 28, 29], [30, 31, 32, 33, … Read more
You can write it fairly simply as a list generator: def split(a, n): k, m = divmod(len(a), n) return (a[i*k+min(i, m):(i+1)*k+min(i+1, m)] for i in range(n)) Example: >>> list(split(range(11), 3)) [[0, 1, 2, 3], [4, 5, 6, 7], [8, 9, 10]]
The error shows that the machine does not have enough memory to read the entire CSV into a DataFrame at one time. Assuming you do not need the entire dataset in memory all at one time, one way to avoid the problem would be to process the CSV in chunks (by specifying the chunksize parameter): … Read more
What is the most “pythonic” way to iterate over a list in chunks?
How do you split a list into evenly sized chunks?
This is a working example of reading a text file per stream to accomplish what you are trying to do. I have tested it with a 100 MB text file, and it worked well, but you have to see if larger files work as well. This is the example. Just bring a RichTextBox to your … Read more