Filtering os.walk() dirs and files

by

This solution uses fnmatch.translate to convert glob patterns to regular expressions (it assumes the includes only is used for files):

import fnmatch
import os
import os.path
import re

includes = ['*.doc', '*.odt'] # for files only
excludes = ['/home/paulo-freitas/Documents'] # for dirs and files

# transform glob patterns to regular expressions
includes = r'|'.join([fnmatch.translate(x) for x in includes])
excludes = r'|'.join([fnmatch.translate(x) for x in excludes]) or r'$.'

for root, dirs, files in os.walk('/home/paulo-freitas'):

    # exclude dirs
    dirs[:] = [os.path.join(root, d) for d in dirs]
    dirs[:] = [d for d in dirs if not re.match(excludes, d)]

    # exclude/include files
    files = [os.path.join(root, f) for f in files]
    files = [f for f in files if not re.match(excludes, f)]
    files = [f for f in files if re.match(includes, f)]

    for fname in files:
        print fname

More Related Contents:

  1. Truth value of a Series is ambiguous. Use a.empty, a.bool(), a.item(), a.any() or a.all()
  2. Logical operators for Boolean indexing in Pandas
  3. Detect and exclude outliers in a pandas DataFrame
  4. Filtering Pandas DataFrames on dates
  5. Using os.walk() to recursively traverse directories in Python
  6. How to do a recursive sub-folder search and return files in a list?
  7. OpenCV: Choosing HSV thresholds for color filtering
  8. os.walk without digging into directories below
  9. Creating lowpass filter in SciPy – understanding methods and units
  10. How do I filter a pandas DataFrame based on value counts?
  11. os.walk without hidden folders
  12. using os.remove() in os.walk() for loop returns FileNotFoundError
  13. filter items in a python dictionary where keys contain a specific string
  14. Travel directory tree with limited recursion depth
  15. Need the path for particular files using os.walk() [duplicate]
  16. os.walk very slow, any way to optimise?
  17. How to remove repititve pattern from an image using FFT
  18. Remove spurious small islands of noise in an image – Python OpenCV
  19. Making object JSON serializable with regular encoder
  20. What is the difference between using squared brackets or dot to access a column?
  21. Check if something is (not) in a list in Python
  22. How to retry after exception?
  23. replace column values in one dataframe by values of another dataframe
  24. xlsxwriter: is there a way to open an existing worksheet in my workbook?
  25. Is there any Python equivalent to partial classes?
  26. can you add HTTPS functionality to a python flask web server?
  27. RegEx Get string between two strings that has line breaks
  28. Pandas – Compute z-score for all columns
  29. Can I access a class variable from an instance?
  30. How to create a self resizing grid of buttons in tkinter?

Leave a Comment