UnicodeDecodeError: ‘utf-8’ codec can’t decode byte 0x8b in position 1: invalid start byte, while reading csv file in pandas

by

It’s still most likely gzipped data. gzip’s magic number is 0x1f 0x8b, which is consistent with the UnicodeDecodeError you get.

You could try decompressing the data on the fly:

with open('destinations.csv', 'rb') as fd:
    gzip_fd = gzip.GzipFile(fileobj=fd)
    destinations = pd.read_csv(gzip_fd)

Or use pandas’ built-in gzip support:

destinations = pd.read_csv('destinations.csv', compression='gzip')

More Related Contents:

  1. python pandas read_csv delimiter in column data
  2. pandas.read_csv from string or package data
  3. Pandas ParserError EOF character when reading multiple csv files to HDF5
  4. How to change column names from numbers to names [closed]
  5. How to provide a reproducible copy of your DataFrame with to_clipboard()
  6. How to read a file with a semi colon separator in pandas
  7. Find column whose name contains a specific string
  8. How to get rid of “Unnamed: 0” column in a pandas DataFrame read in from CSV file?
  9. pandas: merge (join) two data frames on multiple columns
  10. Pandas Extract Number from String
  11. Pandas split column into multiple columns by comma
  12. How to read file with space separated values in pandas
  13. Pandas: ValueError: cannot convert float NaN to integer
  14. Count number of words per row
  15. pandas or python equivalent of tidyr complete
  16. pandas DataFrame output end of csv
  17. Use Multiple Character Delimiter in Python Pandas read_csv
  18. Get pandas.read_csv to read empty values as empty string instead of nan
  19. Panda’s Write CSV – Append vs. Write
  20. Loading multiple csv files of a folder into one dataframe
  21. Pandas number rows within group in increasing order
  22. Pandas dataframe read_csv on bad data
  23. Pandas groupby to to_csv
  24. Load CSV to Pandas MultiIndex DataFrame
  25. pandas read csv with extra commas in column
  26. AttributeError: module ‘numpy’ has no attribute ‘__version__’
  27. bash: Python import – Command not found for pandas
  28. How to upload a CSV file in FastAPI and convert it into a Pandas Dataframe?
  29. pandas.read_csv FileNotFoundError: File b’\xe2\x80\xaa’ despite correct path
  30. Parsing a pipe-delimited file in Python

Leave a Comment