When is not a good time to use python generators?

by

Use a list instead of a generator when:

1) You need to access the data multiple times (i.e. cache the results instead of recomputing them):

for i in outer:           # used once, okay to be a generator or return a list
    for j in inner:       # used multiple times, reusing a list is better
         ...

2) You need random access (or any access other than forward sequential order):

for i in reversed(data): ...     # generators aren't reversible

s[i], s[j] = s[j], s[i]          # generators aren't indexable

3) You need to join strings (which requires two passes over the data):

s="".join(data)                # lists are faster than generators in this use case

4) You are using PyPy which sometimes can’t optimize generator code as much as it can with normal function calls and list manipulations.

More Related Contents:

  1. Difference between Python’s Generators and Iterators
  2. How to print a generator expression?
  3. Can iterators be reset in Python?
  4. What’s the shortest way to count the number of items in a generator/iterator?
  5. If range() is a generator in Python 3.3, why can I not call next() on a range?
  6. Is there an expression for an infinite iterator?
  7. Why does next raise a ‘StopIteration’, but ‘for’ do a normal return?
  8. Best way to loop over a python string backwards
  9. How can I count the number of items in an arbitrary iterable (such as a generator)?
  10. Understanding generators in Python
  11. A weighted version of random.choice
  12. Lazy Method for Reading Big File in Python?
  13. How can I iterate over files in a given directory?
  14. Get the first item from an iterable that matches a condition
  15. Resetting generator object in Python
  16. How to len(generator()) [duplicate]
  17. Is there any built-in way to get the length of an iterable in python?
  18. Python generator that groups another iterable into groups of N
  19. Length of generator output [duplicate]
  20. Python equivalent of MATLAB’s “ismember” function
  21. How to get the n next values of a generator in a list (python)
  22. Processing time gets longer and longer after each iteration (TensorFlow)
  23. Python range() and zip() object type
  24. Best way to receive the ‘return’ value from a python generator
  25. Flatten an irregular (arbitrarily nested) list of lists
  26. What does the “yield” keyword do in Python?
  27. Why do list comprehensions write to the loop variable, but generators don’t? [duplicate]
  28. Multiplying a huge number times random() (Python)
  29. Pass multiple parameters to concurrent.futures.Executor.map?
  30. How do I re-map python dict keys

Leave a Comment