How to process huge text files that contain EOF / Ctrl-Z characters using Python on Windows?

by

It’s easy to use Python to delete the DOS EOF chars; for example,

def delete_eof(fin, fout):
    BUFSIZE = 2**15
    EOFCHAR = chr(26)
    data = fin.read(BUFSIZE)
    while data:
        fout.write(data.translate(None, EOFCHAR))
        data = fin.read(BUFSIZE)

import sys
ipath = sys.argv[1]
opath = ipath + ".new"
with open(ipath, "rb") as fin, open(opath, "wb") as fout:
    delete_eof(fin, fout)

That takes a file path as its first argument, and copies the file but without chr(26) bytes to the same file path with .new appended. Fiddle to taste.

By the way, are you sure that DOS EOF characters are your only problem? It’s hard to conceive of a sane way in which they could end up in files intended to be treated as text files.

More Related Contents:

  1. Add advanced features to a tkinter Text widget
  2. How to display text on the screen without a window using Python
  3. Convert 11/2/1998 to 110298 [duplicate]
  4. How to add to the PYTHONPATH in Windows, so it finds my modules/packages?
  5. How to clear the interpreter console?
  6. RuntimeError on windows trying python multiprocessing
  7. How to start a python file while Windows starts?
  8. OpenCV 2.4 VideoCapture not working on Windows
  9. Windows Scipy Install: No Lapack/Blas Resources Found
  10. Run Python script without Windows console appearing
  11. Popen waiting for child process even when the immediate child has terminated
  12. How to remove anaconda from windows completely?
  13. How can I find where Python is installed on Windows?
  14. Compulsory usage of if __name__==”__main__” in windows while using multiprocessing [duplicate]
  15. Installing Numpy on 64bit Windows 7 with Python 2.7.3 [closed]
  16. How can I escape latex code received through user input?
  17. Python worker failed to connect back
  18. mixed slashes with os.path.join on windows
  19. Running powershell script within python script, how to make python print the powershell output while it is running
  20. How to handle a signal.SIGINT on a Windows OS machine?
  21. Tkinter: Mouse drag a window without borders, eg. overridedirect(1)
  22. python’s webbrowser launches IE, instead of default browser, on Windows relative path
  23. Tensorflow r1.0 : could not a find a version that satisfies the requirement tensorflow
  24. IOError: [Errno 13] Permission denied when trying to open hidden file in “w” mode
  25. How do I eliminate Windows consoles from spawned processes in Python (2.7)? [duplicate]
  26. How do I read text from the Windows clipboard in Python?
  27. How to get the text cursor position in Windows?
  28. Making Python scripts run on Windows without specifying “.py” extension
  29. How to change the location of the pointer in python?
  30. Why python executable opens new window instance when function by multiprocessing module is called on windows

Leave a Comment