How can I check the memory usage of objects in iPython?

by

Unfortunately this is not possible, but there are a number of ways of approximating the answer:

  1. for very simple objects (e.g. ints, strings, floats, doubles) which are represented more or less as simple C-language types you can simply calculate the number of bytes as with John Mulder’s solution.

  2. For more complex objects a good approximation is to serialize the object to a string using cPickle.dumps. The length of the string is a good approximation of the amount of memory required to store an object.

There is one big snag with solution 2, which is that objects usually contain references to other objects. For example a dict contains string-keys and other objects as values. Those other objects might be shared. Since pickle always tries to do a complete serialization of the object it will always over-estimate the amount of memory required to store an object.

More Related Contents:

  1. How to increase Jupyter notebook Memory limit?
  2. How to clear variables in ipython?
  3. How do I read a large csv file with pandas?
  4. IPython Notebook locale error [duplicate]
  5. How do I profile memory usage in Python?
  6. How to make IPython notebook matplotlib plot inline
  7. ipython reads wrong python version
  8. Does Python have a stack/heap and how is memory managed?
  9. How to display full output in Jupyter, not only last result?
  10. Selection with .loc in python
  11. Python readlines() usage and efficient practice for reading
  12. How can I check if code is executed in the IPython notebook?
  13. How to install a Python package from within IPython?
  14. Autoreload of modules in IPython [duplicate]
  15. Multiprocessing working in Python but not in iPython
  16. How to hide in IPython notebook
  17. How do I get interactive plots again in Spyder/IPython/matplotlib?
  18. Python: Reducing memory usage of dictionary
  19. Connecting to a remote IPython instance
  20. `ipython` tab autocomplete does not work on imported module
  21. Python: How to read huge text file into memory
  22. Prevent Python from caching the imported modules
  23. SQLite Performance Benchmark — why is :memory: so slow…only 1.5X as fast as disk?
  24. Convert JSON IPython notebook (.ipynb) to .py file
  25. Share data between IPython Notebooks
  26. Are strings pooled in Python?
  27. Jupyter | The kernel appears to have died. It will restart automatically |
  28. In Python, what is `sys.maxsize`?
  29. Limit Python VM memory
  30. My plot in ipython does not show with pyplot.show()

Leave a Comment