Ignore case in Python strings [duplicate]

by

Here is a benchmark showing that using str.lower is faster than the accepted answer’s proposed method (libc.strcasecmp):

#!/usr/bin/env python2.7
import random
import timeit

from ctypes import *
libc = CDLL('libc.dylib') # change to 'libc.so.6' on linux

with open('/usr/share/dict/words', 'r') as wordlist:
    words = wordlist.read().splitlines()
random.shuffle(words)
print '%i words in list' % len(words)

setup = 'from __main__ import words, libc; gc.enable()'
stmts = [
    ('simple sort', 'sorted(words)'),
    ('sort with key=str.lower', 'sorted(words, key=str.lower)'),
    ('sort with cmp=libc.strcasecmp', 'sorted(words, cmp=libc.strcasecmp)'),
]

for (comment, stmt) in stmts:
    t = timeit.Timer(stmt=stmt, setup=setup)
    print '%s: %.2f msec/pass' % (comment, (1000*t.timeit(10)/10))

typical times on my machine:

235886 words in list
simple sort: 483.59 msec/pass
sort with key=str.lower: 1064.70 msec/pass
sort with cmp=libc.strcasecmp: 5487.86 msec/pass

So, the version with str.lower is not only the fastest by far, but also the most portable and pythonic of all the proposed solutions here.
I have not profiled memory usage, but the original poster has still not given a compelling reason to worry about it. Also, who says that a call into the libc module doesn’t duplicate any strings?

NB: The lower() string method also has the advantage of being locale-dependent. Something you will probably not be getting right when writing your own “optimised” solution. Even so, due to bugs and missing features in Python, this kind of comparison may give you wrong results in a unicode context.

More Related Contents:

  1. Case insensitive ‘in’
  2. Case insensitive replace
  3. case-insensitive list sorting, without lowercasing the result?
  4. Finding all possible case permutations in Python [duplicate]
  5. Empty string python zapier
  6. How do I concatenate items in a list to a single string?
  7. Fast punctuation removal with pandas
  8. Converting integer to string in Python
  9. Checking whether a string starts with XXXX
  10. Find the nth occurrence of substring in a string
  11. Stripping non printable characters from a string in python
  12. How can I check if character in a string is a letter? (Python)
  13. How can I convert each item in the list to string, for the purpose of joining them? [duplicate]
  14. Python __str__ versus __unicode__
  15. Get last “column” after .str.split() operation on column in pandas DataFrame
  16. How can I tell if a string repeats itself in Python?
  17. str.strip() strange behavior
  18. How do I change the string representation of a Python class? [duplicate]
  19. Left justify string values in a pandas DataFrame
  20. Python – How can I pad a string with spaces from the right and left?
  21. Splitting List That Contains Strings and Integers
  22. Replace special characters in a string in Python
  23. Split string by count of characters
  24. convert a string which is a list into a proper list python
  25. How can I put an actual backslash in a string literal (not use it for an escape sequence)?
  26. How to detect string byte encoding?
  27. String Replacement Combinations
  28. split string in python to get one value?
  29. What does backward-slash b do in Python?
  30. Why do I get “TypeError: not all arguments converted during string formatting” trying to check for an even/odd number?

Leave a Comment