Convert percent string to float in pandas read_csv

by

You were very close with your df attempt. Try changing:

df['col'] = df['col'].astype(float)

to:

df['col'] = df['col'].str.rstrip('%').astype('float') / 100.0
#                     ^ use str funcs to elim '%'     ^ divide by 100
# could also be:     .str[:-1].astype(...

Pandas supports Python’s string processing functions on string columns. Just precede the string function you want with .str and see if it does what you need. (This includes string slicing, too, of course.)

Above we utilize .str.rstrip() to get rid of the trailing percent sign, then we divide the array in its entirety by 100.0 to convert from percentage to actual value. For example, 45% is equivalent to 0.45.

Although .str.rstrip('%') could also just be .str[:-1], I prefer to explicitly remove the ‘%’ rather than blindly removing the last char, just in case…

More Related Contents:

  1. Python Pandas: How to read only first n rows of CSV files in?
  2. UnicodeDecodeError when reading CSV file in Pandas with Python
  3. Writing a pandas DataFrame to CSV file
  4. Skip rows during csv import pandas
  5. How to avoid Python/Pandas creating an index in a saved csv?
  6. datetime dtypes in pandas read_csv
  7. What is the fastest way to upload a big csv file in notebook to work with python pandas?
  8. python – Using pandas structures with large csv(iterate and chunksize)
  9. Pandas read csv file with float values results in weird rounding and decimal digits
  10. How to keep leading zeros in a column when reading CSV with Pandas?
  11. pandas to_csv output quoting issue
  12. Key error when selecting columns in pandas dataframe after read_csv
  13. Precision lost while using read_csv in pandas
  14. Prevent pandas read_csv treating first row as header of column names
  15. OSError: Initializing from file failed on csv in Pandas
  16. ValueError : I/O operation on closed file
  17. How to avoid pandas creating an index in a saved csv
  18. Pandas – write Multiindex rows with to_csv
  19. How to add header row to a pandas DataFrame
  20. Read specific columns with pandas or other python module
  21. Conditional row read of csv in pandas
  22. Easiest way to read csv files with multiprocessing in Pandas
  23. Load CSV to Pandas MultiIndex DataFrame
  24. pandas read csv with extra commas in column
  25. double quoted elements in csv cant read with pandas
  26. how to specify the datetime format in read_csv
  27. UnicodeDecodeError when reading CSV file in Pandas
  28. How to upload a CSV file in FastAPI and convert it into a Pandas Dataframe?
  29. How to return a csv file/Pandas DataFrame in JSON format using FastAPI?
  30. pandas.read_csv FileNotFoundError: File b’\xe2\x80\xaa’ despite correct path

Leave a Comment