List comprehension without [ ] in Python

by

The other respondents were correct in answering that you had discovered a generator expression (which has a notation similar to list comprehensions but without the surrounding square brackets).

In general, genexps (as they are affectionately known) are more memory efficient and faster than list comprehensions.

HOWEVER, it the case of ''.join(), a list comprehension is both faster and more memory efficient. The reason is that join needs to make two passes over the data, so it actually needs a real list. If you give it one, it can start its work immediately. If you give it a genexp instead, it cannot start work until it builds-up a new list in memory by running the genexp to exhaustion:

~ $ python -m timeit '"".join(str(n) for n in xrange(1000))'
1000 loops, best of 3: 335 usec per loop
~ $ python -m timeit '"".join([str(n) for n in xrange(1000)])'
1000 loops, best of 3: 288 usec per loop

The same result holds when comparing itertools.imap versus map:

~ $ python -m timeit -s'from itertools import imap' '"".join(imap(str, xrange(1000)))'
1000 loops, best of 3: 220 usec per loop
~ $ python -m timeit '"".join(map(str, xrange(1000)))'
1000 loops, best of 3: 212 usec per loop

More Related Contents:

  1. How to create the following lists with list comprehensions? [closed]
  2. List comprehension vs map
  3. Creating a dictionary from a csv file?
  4. Double Iteration in List Comprehension
  5. List vs generator comprehension speed with join function [duplicate]
  6. Nested For Loops Using List Comprehension
  7. How can I do assignments in a list comprehension?
  8. yield in list comprehensions and generator expressions
  9. Split a list into nested lists on a value
  10. How to frame two for loops in list comprehension python
  11. How to return a subset of a list that matches a condition [duplicate]
  12. In Python, is it better to use list comprehensions or for-each loops?
  13. Why results of map() and list comprehension are different? [duplicate]
  14. The truth value of an array with more than one element is ambigous when trying to index an array
  15. list.extend and list comprehension [duplicate]
  16. Comprehension on a nested iterables?
  17. How can I use list comprehensions to process a nested list?
  18. How can I collect the results of a repeated calculation in a list, dictionary etc. (make a copy of a list with each element modified)?
  19. How can I get around declaring an unused variable in a list comprehension?
  20. How can I create a list of elements from an iterator (convert the iterator to a list)?
  21. python list comprehension double for
  22. Are list comprehensions syntactic sugar for `list(generator expression)` in Python 3?
  23. Duplicate elements in a list [duplicate]
  24. Appending to a list comprehension in Python returns None [duplicate]
  25. List comprehension scope error from Python debugger
  26. range(len(list)) or enumerate(list)? [duplicate]
  27. Creating a Python list comprehension with an if and break
  28. Square braces not required in list comprehensions when used in a function
  29. How to parallelize list-comprehension calculations in Python?
  30. How does all() in python work on empty lists

Leave a Comment