Why is startswith slower than slicing

by

Some of the performance difference can be explained by taking into account the time it takes the . operator to do its thing:

>>> x = 'foobar'
>>> y = 'foo'
>>> sw = x.startswith
>>> %timeit x.startswith(y)
1000000 loops, best of 3: 316 ns per loop
>>> %timeit sw(y)
1000000 loops, best of 3: 267 ns per loop
>>> %timeit x[:3] == y
10000000 loops, best of 3: 151 ns per loop

Another portion of the difference can be explained by the fact that startswith is a function, and even no-op function calls take a bit of time:

>>> def f():
...     pass
... 
>>> %timeit f()
10000000 loops, best of 3: 105 ns per loop

This does not totally explain the difference, since the version using slicing and len calls a function and is still faster (compare to sw(y) above — 267 ns):

>>> %timeit x[:len(y)] == y
1000000 loops, best of 3: 213 ns per loop

My only guess here is that maybe Python optimizes lookup time for built-in functions, or that len calls are heavily optimized (which is probably true). It might be possible to test that with a custom len func. Or possibly this is where the differences identified by LastCoder kick in. Note also larsmans‘ results, which indicate that startswith is actually faster for longer strings. The whole line of reasoning above applies only to those cases where the overhead I’m talking about actually matters.

More Related Contents:

  1. Does R have function startswith or endswith like python? [closed]
  2. Why does this recursion return 0?
  3. Does Python IDE have a module which imports math functions such as cos or sin? [closed]
  4. cartesian product in pandas
  5. How to print a single backslash?
  6. Calling Java/Scala function from a task
  7. Keep other columns when doing groupby
  8. What does `ValueError: cannot reindex from a duplicate axis` mean?
  9. How to make program go back to the top of the code instead of closing [duplicate]
  10. Print a string as hexadecimal bytes
  11. Conditionally fill column values based on another columns value in pandas
  12. Why is looping over range() in Python faster than using a while loop?
  13. How to increment a datetime by one day?
  14. Return a download and rendered page in one Flask response
  15. Why is my Python App Engine app using the Translate API getting an error of ImportError: No module named apiclient.discovery?
  16. Python: give start and end of week data from a given date
  17. How can I create a Word document using Python? [closed]
  18. Finding label location in a DataFrame Index
  19. Custom Titlebar with frame in PyQt5
  20. AttributeError: module ‘tensorflow.python.keras.utils.generic_utils’ has no attribute ‘populate_dict_with_module_objects’
  21. Custom logarithmic axis scaling in matplotlib
  22. Combine values of same keys in a list of dicts
  23. Find the index of the k smallest values of a numpy array
  24. Prevent memory error in itertools.permutation
  25. Displaying better error message than “No JSON object could be decoded”
  26. Resize fields in Django Admin
  27. How do I get the user agent with Flask?
  28. Creating a list in Python with multiple copies of a given object in a single line
  29. How to document Python packages using Sphinx
  30. Pytorch ValueError: optimizer got an empty parameter list

Leave a Comment