Yes: use Python 3.5 (which is still currently a RC, but should be out momentarily). In Python 3.5, os.walk was rewritten to be more efficient. This work done as part of PEP 471. Extracted from the PEP: Python’s built-in os.walk() is significantly slower than it needs to be, because — in addition to calling os.listdir() … Read more
os.walk gives you the path to the directory as the first value in the loop, just use os.path.join() to create full filename: shpfiles = [] for dirpath, subdirs, files in os.walk(path): for x in files: if x.endswith(“.shp”): shpfiles.append(os.path.join(dirpath, x)) I renamed path in the loop to dirpath to not conflict with the path variable you … Read more
I think the easiest and most stable approach would be to copy the functionality of os.walk straight out of the source and insert your own depth-controlling parameter. import os import os.path as path def walk(top, topdown=True, onerror=None, followlinks=False, maxdepth=None): islink, join, isdir = path.islink, path.join, path.isdir try: names = os.listdir(top) except OSError, err: if onerror … Read more
The files variable contain only the filenames. When trying to manipulate the files you have to add the full path: for root, dirs, files in os.walk(base): for f in files: if regex.match(f): os.remove(os.path.join(root, f))
No, there is no option to os.walk() that’ll skip those. You’ll need to do so yourself (which is easy enough): for root, dirs, files in os.walk(path): files = [f for f in files if not f[0] == ‘.’] dirs[:] = [d for d in dirs if not d[0] == ‘.’] # use files and dirs … Read more
This solution uses fnmatch.translate to convert glob patterns to regular expressions (it assumes the includes only is used for files): import fnmatch import os import os.path import re includes = [‘*.doc’, ‘*.odt’] # for files only excludes = [‘/home/paulo-freitas/Documents’] # for dirs and files # transform glob patterns to regular expressions includes = r’|’.join([fnmatch.translate(x) for … Read more
Don’t use os.walk. Example: import os root = “C:\\” for item in os.listdir(root): if os.path.isfile(os.path.join(root, item)): print item
You should be using the dirpath which you call root. The dirnames are supplied so you can prune it if there are folders that you don’t wish os.walk to recurse into. import os result = [os.path.join(dp, f) for dp, dn, filenames in os.walk(PATH) for f in filenames if os.path.splitext(f)[1] == ‘.txt’] Edit: After the latest … Read more
This will give you the desired result #!/usr/bin/python import os # traverse root directory, and list directories as dirs and files as files for root, dirs, files in os.walk(“.”): path = root.split(os.sep) print((len(path) – 1) * ‘—‘, os.path.basename(root)) for file in files: print(len(path) * ‘—‘, file)