Dropping infinite values from dataframes in pandas?

by

First replace() infs with NaN:

df.replace([np.inf, -np.inf], np.nan, inplace=True)

and then drop NaNs via dropna():

df.dropna(subset=["col1", "col2"], how="all", inplace=True)

For example:

>>> df = pd.DataFrame({"col1": [1, np.inf, -np.inf], "col2": [2, 3, np.nan]})
>>> df
   col1  col2
0   1.0   2.0
1   inf   3.0
2  -inf   NaN

>>> df.replace([np.inf, -np.inf], np.nan, inplace=True)
>>> df
   col1  col2
0   1.0   2.0
1   NaN   3.0
2   NaN   NaN

>>> df.dropna(subset=["col1", "col2"], how="all", inplace=True)
>>> df
   col1  col2
0   1.0   2.0
1   NaN   3.0

The same method also works for Series.

More Related Contents:

  1. Replacing values represented by 'UN' with NaN
  2. Convert pandas dataframe to NumPy array
  3. Strings in a DataFrame, but dtype is object
  4. What does axis in pandas mean?
  5. FutureWarning: elementwise comparison failed; returning scalar, but in the future will perform elementwise comparison
  6. pandas select from Dataframe using startswith
  7. How to map numeric data into categories / bins in Pandas dataframe
  8. What’s the fastest way in Python to calculate cosine similarity given sparse matrix data?
  9. Restart cumsum and get index if cumsum more than value
  10. How can I map True/False to 1/0 in a Pandas DataFrame?
  11. What does the term “broadcasting” mean in Pandas documentation?
  12. Pandas: Subtracting two date columns and the result being an integer
  13. Convert timedelta64[ns] column to seconds in Python Pandas DataFrame
  14. Select multiple ranges of columns in Pandas DataFrame
  15. ‘DataFrame’ object has no attribute ‘sort’
  16. Pandas pd.Series.isin performance with set versus array
  17. Improve Row Append Performance On Pandas DataFrames
  18. Difference between data type ‘datetime64[ns]’ and ‘
  19. python pandas flatten a dataframe to a list
  20. Precision lost while using read_csv in pandas
  21. Get week start date (Monday) from a date column in Python (pandas)?
  22. What is dtype(‘O’), in pandas?
  23. pandas distinction between str and object types
  24. NumPy version of “Exponential weighted moving average”, equivalent to pandas.ewm().mean()
  25. Python Pandas – Missing required dependencies [‘numpy’] 1
  26. Pandas: Difference between largest and smallest value within group
  27. What’s the best way to sum all values in a Pandas dataframe? [duplicate]
  28. Split Python sequence (time series/array) into subsequences with overlap
  29. Add density curve on the histogram
  30. Numpy.dtype has the wrong size, try recompiling

Leave a Comment