Easiest way to ignore blank lines when reading a file in Python

by

I would stack generator expressions:

with open(filename) as f_in:
    lines = (line.rstrip() for line in f_in) # All lines including the blank ones
    lines = (line for line in lines if line) # Non-blank lines

Now, lines is all of the non-blank lines. This will save you from having to call strip on the line twice. If you want a list of lines, then you can just do:

with open(filename) as f_in:
    lines = (line.rstrip() for line in f_in) 
    lines = list(line for line in lines if line) # Non-blank lines in a list

You can also do it in a one-liner (exluding with statement) but it’s no more efficient and harder to read:

with open(filename) as f_in:
    lines = list(line for line in (l.strip() for l in f_in) if line)

Update:

I agree that this is ugly because of the repetition of tokens. You could just write a generator if you prefer:

def nonblank_lines(f):
    for l in f:
        line = l.rstrip()
        if line:
            yield line

Then call it like:

with open(filename) as f_in:
    for line in nonblank_lines(f_in):
        # Stuff

update 2:

with open(filename) as f_in:
    lines = filter(None, (line.rstrip() for line in f_in))

and on CPython (with deterministic reference counting)

lines = filter(None, (line.rstrip() for line in open(filename)))

In Python 2 use itertools.ifilter if you want a generator and in Python 3, just pass the whole thing to list if you want a list.

More Related Contents:

  1. create a loop inside a loop in python
  2. TypeError: Missing 1 required positional argument: ‘self’
  3. Error: pandas hashtable keyerror
  4. Writing a pandas DataFrame to CSV file
  5. Python Windows Authentication username and password is not working
  6. How to get Linux console window width in Python
  7. python; modifying list inside a function
  8. Tkinter adding line number to text widget
  9. Intersection of two graphs in Python, find the x value
  10. How do I restart a program based on user input?
  11. How to add timezone into a naive datetime instance in python [duplicate]
  12. How to use append with pickle in python?
  13. Django [Errno 13] Permission denied: ‘/var/www/media/animals/user_uploads’
  14. Crawling with an authenticated session in Scrapy
  15. Using Numpy Vectorize on Functions that Return Vectors
  16. How to get rid of the infobar “Chrome is being controlled by automated test software” through Selenium
  17. Can someone explain this: 0.2 + 0.1 = 0.30000000000000004? [duplicate]
  18. Why does += of a list within a Python tuple raise TypeError but modify the list anyway? [duplicate]
  19. Python references
  20. Numpy individual element access slower than for lists
  21. Choosing a function randomly
  22. Making a python user-defined class sortable, hashable
  23. How to allow list append() method to return the new list
  24. What is your favorite Python mocking library? [closed]
  25. Pythonic Circular List
  26. Importing a function from a class in another file? [duplicate]
  27. How do I use OpenCV’s remap function?
  28. Adding colors to a 3d quiver plot in matplotlib
  29. Retrieve the two highest item from a list containing 100,000 integers
  30. What’s the correct way to set up Django translation?

Leave a Comment