This happens when a python extension (written in C) tries to access a memory beyond reach. You can trace it in following ways. Add sys.settrace at the very first line of the code. Use gdb as described by Mark in this answer.. At the command prompt gdb python (gdb) run /path/to/script.py ## wait for segfault … Read more
Because this is still a very high result on google and no one else has mentioned it yet, I thought I would mention the new possibility of ‘true’ shared memory which was introduced in python version 3.8.0: https://docs.python.org/3/library/multiprocessing.shared_memory.html I have here included a small contrived example (tested on linux) where numpy arrays are used, which … Read more
I routinely use tens of gigabytes of data in just this fashion e.g. I have tables on disk that I read via queries, create data and append back. It’s worth reading the docs and late in this thread for several suggestions for how to store your data. Details which will affect how you store your … Read more
Python understands 1.2e34, as a float, but you can cast it to an int. int(1.2e34). If you want to loop between 1 and n inclusive, you would normally use range(1, n+1). Thus, in Python 3: for i in range(1, int(1.2e34)+1): print(i) # or do whatever you want — As FHTMitchell pointed out, in Python 2, … Read more