Remove dictionary from list

by 
thelist[:] = [d for d in thelist if d.get('id') != 2]

Edit: as some doubts have been expressed in a comment about the performance of this code (some based on misunderstanding Python’s performance characteristics, some on assuming beyond the given specs that there is exactly one dict in the list with a value of 2 for key ‘id’), I wish to offer reassurance on this point.

On an old Linux box, measuring this code:

$ python -mtimeit -s"lod=[{'id':i, 'name':'nam%s'%i} for i in range(99)]; import random" "thelist=list(lod); random.shuffle(thelist); thelist[:] = [d for d in thelist if d.get('id') != 2]"
10000 loops, best of 3: 82.3 usec per loop

of which about 57 microseconds for the random.shuffle (needed to ensure that the element to remove is not ALWAYS at the same spot;-) and 0.65 microseconds for the initial copy (whoever worries about performance impact of shallow copies of Python lists is most obviously out to lunch;-), needed to avoid altering the original list in the loop (so each leg of the loop does have something to delete;-).

When it is known that there is exactly one item to remove, it’s possible to locate and remove it even more expeditiously:

$ python -mtimeit -s"lod=[{'id':i, 'name':'nam%s'%i} for i in range(99)]; import random" "thelist=list(lod); random.shuffle(thelist); where=(i for i,d in enumerate(thelist) if d.get('id')==2).next(); del thelist[where]"
10000 loops, best of 3: 72.8 usec per loop

(use the next builtin rather than the .next method if you’re on Python 2.6 or better, of course) — but this code breaks down if the number of dicts that satisfy the removal condition is not exactly one. Generalizing this, we have:

$ python -mtimeit -s"lod=[{'id':i, 'name':'nam%s'%i} for i in range(33)]*3; import random" "thelist=list(lod); where=[i for i,d in enumerate(thelist) if d.get('id')==2]; where.reverse()" "for i in where: del thelist[i]"
10000 loops, best of 3: 23.7 usec per loop

where the shuffling can be removed because there are already three equispaced dicts to remove, as we know. And the listcomp, unchanged, fares well:

$ python -mtimeit -s"lod=[{'id':i, 'name':'nam%s'%i} for i in range(33)]*3; import random" "thelist=list(lod); thelist[:] = [d for d in thelist if d.get('id') != 2]"
10000 loops, best of 3: 23.8 usec per loop

totally neck and neck, with even just 3 elements of 99 to be removed. With longer lists and more repetitions, this holds even more of course:

$ python -mtimeit -s"lod=[{'id':i, 'name':'nam%s'%i} for i in range(33)]*133; import random" "thelist=list(lod); where=[i for i,d in enumerate(thelist) if d.get('id')==2]; where.reverse()" "for i in where: del thelist[i]"
1000 loops, best of 3: 1.11 msec per loop
$ python -mtimeit -s"lod=[{'id':i, 'name':'nam%s'%i} for i in range(33)]*133; import random" "thelist=list(lod); thelist[:] = [d for d in thelist if d.get('id') != 2]"
1000 loops, best of 3: 998 usec per loop

All in all, it’s obviously not worth deploying the subtlety of making and reversing the list of indices to remove, vs the perfectly simple and obvious list comprehension, to possibly gain 100 nanoseconds in one small case — and lose 113 microseconds in a larger one;-). Avoiding or criticizing simple, straightforward, and perfectly performance-adequate solutions (like list comprehensions for this general class of “remove some items from a list” problems) is a particularly nasty example of Knuth’s and Hoare’s well-known thesis that “premature optimization is the root of all evil in programming”!-)

More Related Contents:

  1. How do I convert two lists into a dictionary?
  2. Convert [key1,val1,key2,val2] to a dict?
  3. Why can’t I use a list as a dict key in python?
  4. Remove duplicate dict in list in Python
  5. How can I get list of values from dict?
  6. list to dictionary conversion with multiple values per key?
  7. How to overcome TypeError: unhashable type: ‘list’
  8. List of dicts to/from dict of lists
  9. How can I make a dictionary from separate lists of keys and values?
  10. Appending a dictionary to a list – I see a pointer like behavior
  11. How to convert list of key-value tuples into dictionary?
  12. Combining Dictionaries Of Lists In Python
  13. Most Pythonic Way to Build Dictionary From Single List
  14. Make dictionary from list with python [duplicate]
  15. Get a list of values from a list of dictionaries?
  16. how to convert list of dict to dict
  17. How do I return dictionary keys as a list in Python?
  18. Why can’t I use a list as a dict key in python? Exactly what can and cannot be used, and why?
  19. convert csv file to list of dictionaries
  20. Changing one dict changes all dicts in a list of dicts [duplicate]
  21. Appending to list in Python dictionary [duplicate]
  22. Getting the difference (delta) between two lists of dictionaries
  23. Python: iterating over list vs over dict items efficiency
  24. How can I convert string values from a dictionary, into int/float datatypes?
  25. Python Accessing Values in A List of Dictionaries
  26. How to extract all values from a dictionary in Python?
  27. How do I send list of dictionary as Body parameter together with Files in FastAPI?
  28. How to convert only numbers in a mixed list into float
  29. In what case would I use a tuple as a dictionary key? [closed]
  30. Comparing 2 lists consisting of dictionaries with unique keys in python

Leave a Comment