Python Pandas Error tokenizing data

by

you could also try;

data = pd.read_csv('file1.csv', on_bad_lines="skip")

Do note that this will cause the offending lines to be skipped.

Edit

For Pandas < 1.3.0 try

data = pd.read_csv("file1.csv", error_bad_lines=False)

as per pandas API reference.

More Related Contents:

  1. How do I read a large csv file with pandas?
  2. How to add pandas data to an existing csv file?
  3. How to read a file with a semi colon separator in pandas
  4. Pandas split column into multiple columns by comma
  5. How to read file with space separated values in pandas
  6. Convert commas decimal separators to dots within a Dataframe
  7. How to efficiently handle European decimal separators using the pandas read_csv function?
  8. Pandas: ValueError: cannot convert float NaN to integer
  9. Python Pandas read_csv skip rows but keep header
  10. pandas DataFrame output end of csv
  11. Use Multiple Character Delimiter in Python Pandas read_csv
  12. Get pandas.read_csv to read empty values as empty string instead of nan
  13. Pandas – Strip white space
  14. Filter string data based on its string length
  15. Why is pandas.to_datetime slow for non standard time format such as ‘2014/12/31’
  16. UnicodeDecodeError: ‘utf-8’ codec can’t decode byte 0x96 in position 35: invalid start byte
  17. Loading multiple csv files of a folder into one dataframe
  18. Pandas read_csv dtype leading zeros
  19. pandas.read_csv from string or package data
  20. Pandas ParserError EOF character when reading multiple csv files to HDF5
  21. Pandas groupby to to_csv
  22. Python Pandas – Read csv file containing multiple tables
  23. Is there a way to speed up handling large CSVs and dataframes in python?
  24. Load CSV to Pandas MultiIndex DataFrame
  25. Pandas to_csv call is prepending a comma
  26. How to upload a CSV file in FastAPI and convert it into a Pandas Dataframe?
  27. pandas.read_csv FileNotFoundError: File b’\xe2\x80\xaa’ despite correct path
  28. start index at 1 for Pandas DataFrame
  29. pandas – convert string into list of strings [duplicate]
  30. Bin values based on ranges with pandas [duplicate]

Leave a Comment