Python deep getsizeof list with contents?

by

10000 * [x] will produce a list of 10000 times the same object, so the sizeof is actually closer to correct than you think. However, a deep sizeof is very problematic because it’s impossible to tell Python when you want to stop the measurement. Every object references a typeobject. Should the typeobject be counted? What if the reference to the typeobject is the last one, so if you deleted the object the typeobject would go away as well? What about if you have multiple (different) objects in the list refer to the same string object? Should it be counted once, or multiple times?

In short, getting the size of a data structure is very complicated, and sys.getsizeof() should never have been added :S

More Related Contents:

  1. How do I read a large csv file with pandas?
  2. How can I explicitly free memory in Python?
  3. How do I profile memory usage in Python?
  4. Python 32-bit memory limits on 64bit windows
  5. Does Python have a stack/heap and how is memory managed?
  6. Python subprocess.Popen “OSError: [Errno 12] Cannot allocate memory”
  7. What is the recommended way of allocating memory for a typed memory view?
  8. Memory errors and list limits?
  9. Python readlines() usage and efficient practice for reading
  10. How unique is Python’s id()?
  11. Python Django Global Variables
  12. Get total physical memory in Python
  13. more efficient way to calculate distance in numpy?
  14. Tracking *maximum* memory usage by a Python function
  15. Extracting a zipfile to memory?
  16. Python: Reducing memory usage of dictionary
  17. Python: How to read huge text file into memory
  18. Measure Object Size Accurately in Python – Sys.GetSizeOf not functioning
  19. Deep version of sys.getsizeof [duplicate]
  20. Python in-memory zip library
  21. SQLite Performance Benchmark — why is :memory: so slow…only 1.5X as fast as disk?
  22. When to use == and when to use is?
  23. Data size in memory vs. on disk
  24. Are strings pooled in Python?
  25. How to get largest possible precision? (Python – Decimal)
  26. Python multiprocessing application is getting stuck in docker container
  27. In Python, what is `sys.maxsize`?
  28. Limit Python VM memory
  29. Why is lxml.etree.iterparse() eating up all my memory?
  30. Why doesn’t Python’s mmap work with large files?

Leave a Comment