Square braces not required in list comprehensions when used in a function

by

This is a generator expression. To get it to work in the standalone case, use braces:

y = (x for x in range(10))

and y becomes a generator. You can iterate over generators, so it works where an iterable is expected, such as the sum function.

Usage examples and pitfalls:

>>> y = (x for x in range(10))
>>> y
<generator object <genexpr> at 0x0000000001E15A20>
>>> sum(y)
45

Be careful when keeping generators around, you can only go through them once. So after the above, if you try to use sum again, this will happen:

>>> sum(y)
0

So if you pass a generator where actually a list or a set or something similar is expected, you have to be careful. If the function or class stores the argument and tries to iterate over it multiple times, you will run into problems. For example consider this:

def foo(numbers):
    s = sum(numbers)
    p = reduce(lambda x,y: x*y, numbers, 1)
    print "The sum is:", s, "and the product:", p

it will fail if you hand it a generator:

>>> foo(x for x in range(1, 10))
The sum is: 45 and the product: 1

You can easily get a list from the values a generator produces:

>>> y = (x for x in range(10))
>>> list(y)
[0, 1, 2, 3, 4, 5, 6, 7, 8, 9]

You can use this to fix the previous example:

>>> foo(list(x for x in range(1, 10)))
The sum is: 45 and the product: 362880

However keep in mind that if you build a list from a generator, you will need to store every value. This might use a lot more memory in situations where you have lots of items.

Why use a generator in your situation?

The much lower memory consumption is the reason why sum(generator expression) is better than sum(list): The generator version only has to store a single value, while the list-variant has to store N values. Therefore you should always use a generator where you don’t risk side-effects.

More Related Contents:

  1. Advanced Nested List Comprehension Syntax
  2. Nested list comprehensions
  3. Nested dictionary comprehension python
  4. What does ** (double star/asterisk) and * (star/asterisk) do for parameters?
  5. if/else in a list comprehension
  6. What is the difference between ‘/’ and ‘//’ when used for division?
  7. Python’s most efficient way to choose longest string in list?
  8. “x not in y” or “not x in y”
  9. Using break in a list comprehension
  10. How can I get around declaring an unused variable in a for loop?
  11. Appending item to lists within a list comprehension
  12. What do backticks mean to the Python interpreter? Example: `num`
  13. Why isn’t assigning to an empty list (e.g. [] = “”) an error?
  14. Recursive list comprehension in Python?
  15. What does “ mean in Python?
  16. How to normalize a 2-dimensional numpy array in python less verbose?
  17. Reversing a list using slice notation
  18. Using while in list comprehension or generator expressions
  19. Getting a default value on index out of range in Python [duplicate]
  20. Python – is there a “don’t care” symbol for tuple assignments?
  21. Python: Make class iterable
  22. Python: format string with custom delimiters [duplicate]
  23. How to include a quote in a raw Python string
  24. List comprehension: Returning two (or more) items for each item [duplicate]
  25. Get the first element of each tuple in a list in Python [duplicate]
  26. Python: SyntaxError: keyword can’t be an expression
  27. eval fails in list comprehension [duplicate]
  28. range(len(list)) or enumerate(list)? [duplicate]
  29. Creating a Python list comprehension with an if and break
  30. Why is Python’s list comprehension loop order backwards? [duplicate]

Leave a Comment