How to replace a value in pandas, with NaN?

by

You can replace this just for that column using replace:

df['workclass'].replace('?', np.NaN)

or for the whole df:

df.replace('?', np.NaN)

UPDATE

OK I figured out your problem, by default if you don’t pass a separator character then read_csv will use commas ',' as the separator.

Your data and in particular one example where you have a problematic line:

54, ?, 180211, Some-college, 10, Married-civ-spouse, ?, Husband, Asian-Pac-Islander, Male, 0, 0, 60, South, >50K

has in fact a comma and a space as the separator so when you passed the na_value=['?'] this didn’t match because all your values have a space character in front of them all which you can’t observe.

if you change your line to this:

rawfile = pd.read_csv(filename, header=None, names=DataLabels, sep=',\s', na_values=["?"])

then you should find that it all works:

27      54               NaN  180211  Some-college             10

More Related Contents:

  1. Select nan column in pandas
  2. How to identify and label similar rows in a pandas data frame
  3. Renaming column names in Pandas
  4. How can I use the apply() function for a single column?
  5. Filtering Pandas DataFrames on dates
  6. Remove duplicates by columns A, keeping the row with the highest value in column B
  7. How can I display full (non-truncated) dataframe information in HTML when converting from Pandas dataframe to HTML?
  8. Seaborn Barplot – Displaying Values
  9. How can I map True/False to 1/0 in a Pandas DataFrame?
  10. Pandas create new column with count from groupby
  11. How to qcut with non unique bin edges?
  12. pandas: to_numeric for multiple columns
  13. Search for “does-not-contain” on a DataFrame in pandas
  14. Pandas select rows and columns based on boolean condition
  15. Access to table objects on Webpage Using Python Selenium
  16. Pandas: convert dtype ‘object’ to int
  17. Most efficient way to sort an array into bins specified by an index array?
  18. How can I subclass a Pandas DataFrame?
  19. What are Python pandas equivalents for R functions like str(), summary(), and head()?
  20. UnicodeDecodeError: (‘utf-8’ codec) while reading a csv file [duplicate]
  21. Transform vs. aggregate in Pandas
  22. Pip Install Timeout Issue
  23. ‘A value is trying to be set on a copy of a slice from a DataFrame’ error while using ‘iloc’
  24. Background with range on seaborn based on two columns
  25. Pandas: Shift down values by one row within a group
  26. how to multiply multiple columns by a column in Pandas
  27. pandas.read_csv from string or package data
  28. Pandas – select column using other column value as column name
  29. Python making combined bar and line plot with secondary y-axis
  30. bash: Python import – Command not found for pandas

Leave a Comment