Search in lists of lists by given index

by

Here’s the Pythonic way to do it:

data = [['a','b'], ['a','c'], ['b','d']]
search="c"
any(e[1] == search for e in data)

Or… well, I’m not going to claim this is the “one true Pythonic way” to do it because at some point it becomes a little subjective what is Pythonic and what isn’t, or which method is more Pythonic than another. But using any() is definitely more typical Python style than a for loop as in e.g. RichieHindle’s answer,

Of course there is a hidden loop in the implementation of any, although it breaks out of the loop as soon as it finds a match.

Since I was bored I made a timing script to compare performance of the different suggestions, modifying some of them as necessary to make the API the same. Now, we should bear in mind that fastest is not always best, and being fast is definitely not the same thing as being Pythonic. That being said, the results are… strange. Apparently for loops are very fast, which is not what I expected, so I’d take these with a grain of salt without understanding why they’ve come out the way they do.

Anyway, when I used the list defined in the question with three sublists of two elements each, from fastest to slowest I get these results:

  1. RichieHindle’s answer with the for loop, clocking in at 0.22 μs
  2. Terence Honles’ first suggestion which creates a list, at 0.36 μs
  3. Pierre-Luc Bedard’s answer (last code block), at 0.43 μs
  4. Essentially tied between Markus’s answer and the for loop from the original question, at 0.48 μs
  5. Coady’s answer using operator.itemgetter(), at 0.53 μs
  6. Close enough to count as a tie between Alex Martelli’s answer with ifilter() and Anon’s answer, at 0.67 μs (Alex’s is consistently about half a microsecond faster)
  7. Another close-enough tie between jojo’s answer, mine, Brandon E Taylor’s (which is identical to mine), and Terence Honles’ second suggestion using any(), all coming in at 0.81-0.82 μs
  8. And then user27221’s answer using nested list comprehensions, at 0.95 μs

Obviously the actual timings are not meaningful on anyone else’s hardware, but the differences between them should give some idea of how close the different methods are.

When I use a longer list, things change a bit. I started with the list in the question, with three sublists, and appended another 197 sublists, for a total of 200 sublists each of length two. Using this longer list, here are the results:

  1. RichieHindle’s answer, at the same 0.22 μs as with the shorter list
  2. Coady’s answer using operator.itemgetter(), again at 0.53 μs
  3. Terence Honles’ first suggestion which creates a list, at 0.36 μs
  4. Another virtual tie between Alex Martelli’s answer with ifilter() and Anon’s answer, at 0.67 μs
  5. Again a close-enough tie between my answer, Brandon E Taylor’s identical method, and Terence Honles’ second suggestion using any(), all coming in at 0.81-0.82 μs

Those are the ones that keep their original timing when the list is extended. The rest, which don’t, are

  1. The for loop from the original question, at 1.24 μs
  2. Terence Honles’ first suggestion which creates a list, at 7.49 μs
  3. Pierre-Luc Bedard’s answer (last code block), at 8.12 μs
  4. Markus’s answer, at 10.27 μs
  5. jojo’s answer, at 19.87 μs
  6. And finally user27221’s answer using nested list comprehensions, at 60.59 μs

More Related Contents:

  1. Most efficient way to build single-element list from string with or without spaces? [closed]
  2. Replace list object based on indexes of another list (Python)
  3. How to group dataframe rows into list in pandas groupby
  4. python : list index out of range error while iteratively popping elements
  5. Circular list iterator in Python
  6. Insert an element at a specific index in a list and return the updated list
  7. Python copy a list of lists [duplicate]
  8. Calculating arithmetic mean (one type of average) in Python [duplicate]
  9. Iterate a list with indexes in Python
  10. Check list of words in another string [duplicate]
  11. Converting list of tuples into a dictionary
  12. List sorting with multiple attributes and mixed order
  13. Insert element in Python list after every nth element
  14. How to merge multiple lists into one list in python? [duplicate]
  15. How to convert a string of space- and comma- separated numbers into a list of int? [duplicate]
  16. What is the difference between sets and lists in Python?
  17. Best and/or fastest way to create lists in python
  18. What is the ‘pythonic’ equivalent to the ‘fold’ function from functional programming?
  19. How to remove multiple items from a list in just one statement?
  20. Co-occurrence matrix from nested list of words
  21. How to flatten a tuple in python
  22. Zip with list output instead of tuple
  23. Fastest way to search a list in python
  24. Turning a list into nested lists in python
  25. Python list slice syntax used for no obvious reason
  26. How to replace elements in a list using dictionary lookup
  27. Convert List to Pandas Dataframe Column
  28. Python – shuffle only some elements of a list
  29. What is the cost/ complexity of insert in list at some location?
  30. Check list monotonicity

Leave a Comment