Pandas df.to_csv(“file.csv” encode=”utf-8″) still gives trash characters for minus sign

by

Your “bad” output is UTF-8 displayed as CP1252.

On Windows, many editors assume the default ANSI encoding (CP1252 on US Windows) instead of UTF-8 if there is no byte order mark (BOM) character at the start of the file. While a BOM is meaningless to the UTF-8 encoding, its UTF-8-encoded presence serves as a signature for some programs. For example, Microsoft Office’s Excel requires it even on non-Windows OSes. Try:

df.to_csv('file.csv',encoding='utf-8-sig')

That encoder will add the BOM.

More Related Contents:

  1. UnicodeDecodeError when reading CSV file in Pandas with Python
  2. Writing a pandas DataFrame to CSV file
  3. How to make separator in pandas read_csv more flexible wrt whitespace, for irregular separators?
  4. Skip rows during csv import pandas
  5. How to avoid Python/Pandas creating an index in a saved csv?
  6. datetime dtypes in pandas read_csv
  7. What is the fastest way to upload a big csv file in notebook to work with python pandas?
  8. python – Using pandas structures with large csv(iterate and chunksize)
  9. Pandas read csv file with float values results in weird rounding and decimal digits
  10. Using numpy.genfromtxt to read a csv file with strings containing commas
  11. How to keep leading zeros in a column when reading CSV with Pandas?
  12. Key error when selecting columns in pandas dataframe after read_csv
  13. Precision lost while using read_csv in pandas
  14. Python Pandas: How to read only first n rows of CSV files in?
  15. Prevent pandas read_csv treating first row as header of column names
  16. OSError: Initializing from file failed on csv in Pandas
  17. How to avoid pandas creating an index in a saved csv
  18. Pandas – write Multiindex rows with to_csv
  19. Read CSV into a dataFrame with varying row lengths using Pandas
  20. How to add header row to a pandas DataFrame
  21. Read specific columns with pandas or other python module
  22. Convert percent string to float in pandas read_csv
  23. UnicodeDecodeError: ‘utf-8’ codec can’t decode byte 0x8b in position 1: invalid start byte, while reading csv file in pandas
  24. Easiest way to read csv files with multiprocessing in Pandas
  25. Calculate summary statistics of columns in dataframe
  26. pandas read csv with extra commas in column
  27. double quoted elements in csv cant read with pandas
  28. how to specify the datetime format in read_csv
  29. UnicodeDecodeError when reading CSV file in Pandas
  30. How to return a csv file/Pandas DataFrame in JSON format using FastAPI?

Leave a Comment