Remove row with null value from pandas data frame

by

This should do the work:

df = df.dropna(how='any',axis=0)

It will erase every row (axis=0) that has “any” Null value in it.

EXAMPLE:

#Recreate random DataFrame with Nan values
df = pd.DataFrame(index = pd.date_range('2017-01-01', '2017-01-10', freq='1d'))
# Average speed in miles per hour
df['A'] = np.random.randint(low=198, high=205, size=len(df.index))
df['B'] = np.random.random(size=len(df.index))*2

#Create dummy NaN value on 2 cells
df.iloc[2,1]=None
df.iloc[5,0]=None

print(df)
                A         B
2017-01-01  203.0  1.175224
2017-01-02  199.0  1.338474
2017-01-03  198.0       NaN
2017-01-04  198.0  0.652318
2017-01-05  199.0  1.577577
2017-01-06    NaN  0.234882
2017-01-07  203.0  1.732908
2017-01-08  204.0  1.473146
2017-01-09  198.0  1.109261
2017-01-10  202.0  1.745309

#Delete row with dummy value
df = df.dropna(how='any',axis=0)

print(df)

                A         B
2017-01-01  203.0  1.175224
2017-01-02  199.0  1.338474
2017-01-04  198.0  0.652318
2017-01-05  199.0  1.577577
2017-01-07  203.0  1.732908
2017-01-08  204.0  1.473146
2017-01-09  198.0  1.109261
2017-01-10  202.0  1.745309

See the reference for further detail.

If everything is OK with your DataFrame, dropping NaNs should be as easy as that. If this is still not working, make sure you have the proper datatypes defined for your column (pd.to_numeric comes to mind…)

More Related Contents:

  1. How do I select rows from a DataFrame based on column values?
  2. Aggregation in Pandas
  3. Convert DataFrame column type from string to datetime
  4. How to apply a function to two columns of Pandas dataframe
  5. How to convert an XML file to nice pandas dataframe?
  6. Dynamically evaluate an expression from a formula in Pandas
  7. Constructing pandas DataFrame from values in variables gives “ValueError: If using all scalar values, you must pass an index”
  8. Can pandas automatically read dates from a CSV file?
  9. df.append() is not appending to the DataFrame
  10. How to get rid of “Unnamed: 0” column in a pandas DataFrame read in from CSV file?
  11. pandas dataframe str.contains() AND operation
  12. Pandas groupby mean – into a dataframe?
  13. pandas groupby without turning grouped by column into index
  14. Tilde sign in pandas DataFrame
  15. Drop columns whose name contains a specific string from pandas DataFrame
  16. Find the unique values in a column and then sort them
  17. how do I calculate a rolling idxmax
  18. Python Pandas How to assign groupby operation results back to columns in parent dataframe?
  19. Redefining the Index in a Pandas DataFrame object
  20. python Pandas DataFrame copy(deep=False) vs copy(deep=True) vs ‘=’
  21. From password-protected Excel file to pandas DataFrame
  22. How to filter a pandas dataframe based on the length of a entry
  23. How can repetitive rows of data be collected in a single row in pandas?
  24. Group dataframe and get sum AND count?
  25. How is pandas groupby method actually working?
  26. Replace value for a selected cell in pandas DataFrame without using index
  27. Python pandas: how to remove nan and -inf values
  28. pandas extract year from datetime: df[‘year’] = df[‘date’].year is not working
  29. How to upload a CSV file in FastAPI and convert it into a Pandas Dataframe?
  30. pandas.read_csv FileNotFoundError: File b’\xe2\x80\xaa’ despite correct path

Leave a Comment