Python recursive folder read

by

Make sure you understand the three return values of os.walk:

for root, subdirs, files in os.walk(rootdir):

has the following meaning:

  • root: Current path which is “walked through”
  • subdirs: Files in root of type directory
  • files: Files in root (not in subdirs) of type other than directory

And please use os.path.join instead of concatenating with a slash! Your problem is filePath = rootdir + "https://stackoverflow.com/" + file – you must concatenate the currently “walked” folder instead of the topmost folder. So that must be filePath = os.path.join(root, file). BTW “file” is a builtin, so you don’t normally use it as variable name.

Another problem are your loops, which should be like this, for example:

import os
import sys

walk_dir = sys.argv[1]

print('walk_dir=" + walk_dir)

# If your current working directory may change during script execution, it"s recommended to
# immediately convert program arguments to an absolute path. Then the variable root below will
# be an absolute path as well. Example:
# walk_dir = os.path.abspath(walk_dir)
print('walk_dir (absolute) = ' + os.path.abspath(walk_dir))

for root, subdirs, files in os.walk(walk_dir):
    print('--\nroot=" + root)
    list_file_path = os.path.join(root, "my-directory-list.txt')
    print('list_file_path=" + list_file_path)

    with open(list_file_path, "wb') as list_file:
        for subdir in subdirs:
            print('\t- subdirectory ' + subdir)

        for filename in files:
            file_path = os.path.join(root, filename)

            print('\t- file %s (full path: %s)' % (filename, file_path))

            with open(file_path, 'rb') as f:
                f_content = f.read()
                list_file.write(('The file %s contains:\n' % filename).encode('utf-8'))
                list_file.write(f_content)
                list_file.write(b'\n')

If you didn’t know, the with statement for files is a shorthand:

with open('filename', 'rb') as f:
    dosomething()

# is effectively the same as

f = open('filename', 'rb')
try:
    dosomething()
finally:
    f.close()

More Related Contents:

  1. python program to divide numbers in file in selected order [closed]
  2. How do I delete a file or folder in Python?
  3. UnicodeDecodeError: ‘charmap’ codec can’t decode byte X in position Y: character maps to
  4. How do I concatenate text files in Python?
  5. Get last n lines of a file, similar to tail
  6. How can I open multiple files using “with open” in Python?
  7. Read .mat files in Python
  8. Reading from a frequently updated file
  9. open() in Python does not create a file if it doesn’t exist
  10. Does reading an entire file leave the file handle open?
  11. How to make file creation an atomic operation?
  12. Get name of current script in Python
  13. How to delete specific strings from a file?
  14. Replace string within file contents [duplicate]
  15. Batch Renaming of Files in a Directory
  16. How to solve “OSError: telling position disabled by next() call”
  17. An integer is required? open()
  18. Python Random Access File
  19. How can I read large text files line by line, without loading them into memory? [duplicate]
  20. Parsing apache log files
  21. Trying to use open(filename, ‘w’ ) gives IOError: [Errno 2] No such file or directory if directory doesn’t exist
  22. Python file operations
  23. Purpose of #!/usr/bin/python3 shebang
  24. Speed up writing to files
  25. Checking if a website is up via Python
  26. python write string directly to tarfile
  27. Saving response from Requests to file
  28. Batch equivalent of “source” on Windows: how to run a Python script from a virtualenv
  29. Python – How to check if a file is used by another application?
  30. how to count the total number of lines in a text file using python

Leave a Comment