CSV in Python adding an extra carriage return, on Windows

by

Python 3:

The official csv documentation recommends opening the file with newline="" on all platforms to disable universal newlines translation:

with open('output.csv', 'w', newline="", encoding='utf-8') as f:
    writer = csv.writer(f)
    ...

The CSV writer terminates each line with the lineterminator of the dialect, which is '\r\n' for the default excel dialect on all platforms because that’s what RFC 4180 recommends.

Python 2:

On Windows, always open your files in binary mode ("rb" or "wb"), before passing them to csv.reader or csv.writer.

Although the file is a text file, CSV is regarded a binary format by the libraries involved, with \r\n separating records. If that separator is written in text mode, the Python runtime replaces the \n with \r\n, hence the \r\r\n observed in the file.

See this previous answer.

More Related Contents:

  1. CSV file written with Python has blank lines between each row
  2. Python 2 CSV writer produces wrong line terminator on Windows
  3. portable way to write csv file in python 2 or python 3
  4. UnicodeDecodeError: ‘utf-8’ codec can’t decode byte 0x96 in position 35: invalid start byte
  5. pickle.load() raising EOFError in Windows
  6. How can I stop Python’s csv.DictWriter.writerows from adding empty lines between rows in Windows?
  7. Python3: writing csv files
  8. How can I install pip on Windows?
  9. Request UAC elevation from within a Python script?
  10. Python csv string to array
  11. rpy2 install on windows 7
  12. Python Pandas read_csv skip rows but keep header
  13. Line reading chokes on 0x1A
  14. Loading UTF-8 file in Python 3 using numpy.genfromtxt
  15. Filter string data based on its string length
  16. Why is pandas.to_datetime slow for non standard time format such as ‘2014/12/31’
  17. How can I use newline ‘\n’ in an f-string to format output?
  18. Python Pandas – Read csv file containing multiple tables
  19. Find all CSV files in a directory using Python
  20. Calculate summary statistics of columns in dataframe
  21. Launch IPython notebook with selected browser
  22. Extract csv file specific columns to list in Python
  23. Open File in Another Directory (Python)
  24. double quoted elements in csv cant read with pandas
  25. Python – re-ordering columns in a csv
  26. How to calculate length of string in pixels for specific font and size?
  27. PythonMagick can’t find my pdf files
  28. UnicodeDecodeError when reading CSV file in Pandas
  29. How to upload a CSV file in FastAPI and convert it into JSON?
  30. ValueError: x and y must be the same size

Leave a Comment