What is the difference between len() and sys.getsizeof() methods in python?

by

They are not the same thing at all.

len() queries for the number of items contained in a container. For a string that’s the number of characters:

Return the length (the number of items) of an object. The argument may be a sequence (string, tuple or list) or a mapping (dictionary).

sys.getsizeof() on the other hand returns the memory size of the object:

Return the size of an object in bytes. The object can be any type of object. All built-in objects will return correct results, but this does not have to hold true for third-party extensions as it is implementation specific.

Python string objects are not simple sequences of characters, 1 byte per character.

Specifically, the sys.getsizeof() function includes the garbage collector overhead if any:

getsizeof() calls the object’s __sizeof__ method and adds an additional garbage collector overhead if the object is managed by the garbage collector.

String objects do not need to be tracked (they cannot create circular references), but string objects do need more memory than just the bytes per character. In Python 2, __sizeof__ method returns (in C code):

Py_ssize_t res;
res = PyStringObject_SIZE + PyString_GET_SIZE(v) * Py_TYPE(v)->tp_itemsize;
return PyInt_FromSsize_t(res);

where PyStringObject_SIZE is the C struct header size for the type, PyString_GET_SIZE basically is the same as len() and Py_TYPE(v)->tp_itemsize is the per-character size. In Python 2.7, for byte strings, the size per character is 1, but it’s PyStringObject_SIZE that is confusing you; on my Mac that size is 37 bytes:

>>> sys.getsizeof('')
37

For unicode strings the per-character size goes up to 2 or 4 (depending on compilation options). On Python 3.3 and newer, Unicode strings take up between 1 and 4 bytes per character, depending on the contents of the string.

More Related Contents:

  1. Results from my program [closed]
  2. How do I properly start creating a programming language in python? [closed]
  3. How to use pip with Python 3.x alongside Python 2.x
  4. How do you create nested dict in Python?
  5. board-drawing code to move an oval
  6. Remove text between () and []
  7. Python: Exporting environment variables in subprocess.Popen(..)
  8. Python regex for unicode capitalized words
  9. Multiple conditions with if/elif statements [duplicate]
  10. Merging dataframes based on date range
  11. Reading XML file and fetching its attributes value in Python
  12. Unexpected IndexError while removing list items [duplicate]
  13. Easier way to enable verbose logging
  14. How can I use io.StringIO() with the csv module?
  15. Avoid Twitter API limitation with Tweepy
  16. How do I make the screen ignore the background color of some image?
  17. How to use PyCharm to debug Scrapy projects
  18. Python 2.7 on Ubuntu
  19. Enforcing python version in setup.py
  20. Type error Unhashable type:set
  21. Loading text file containing both float and string using numpy.loadtxt
  22. python for increment inner loop
  23. What is the easiest way to achieve realtime plotting in pyqtgraph
  24. How to convert integers in list to string in python
  25. Plotly legend next to each subplot, Python
  26. get errors when import lxml.etree to python
  27. Upload file with Selenium Webdriver Python
  28. Why does using from __future__ import print_function breaks Python2-style print? [closed]
  29. Skip elements on a condition based in a list comprehension in python
  30. Python – reference inner class from other inner class

Leave a Comment