How can I remove all duplicates so that NONE are left in a data frame?

by

This will extract the rows which appear only once (assuming your data frame is named df):

df[!(duplicated(df) | duplicated(df, fromLast = TRUE)), ]

How it works: The function duplicated tests whether a line appears at least for the second time starting at line one. If the argument fromLast = TRUE is used, the function starts at the last line.

Boths boolean results are combined with | (logical ‘or’) into a new vector which indicates all lines appearing more than once. The result of this is negated using ! thereby creating a boolean vector indicating lines appearing only once.

More Related Contents:

  1. Finding ALL duplicate rows, including “elements with smaller subscripts”
  2. Remove duplicated rows
  3. data.table with two string columns of set elements, extract unique rows with each row unsorted
  4. Merging rows with the same ID variable [duplicate]
  5. Aggregate / summarize multiple variables per group (e.g. sum, mean)
  6. Collapse / concatenate / aggregate a column to a single comma separated string within each group
  7. Order Bars in ggplot2 bar graph
  8. Sort (order) data frame rows by multiple columns
  9. Replacing NAs with latest non-NA value
  10. Filter data.frame rows by a logical condition
  11. Evaluate expression given as a string
  12. Pass a data.frame column name to a function
  13. What is the difference between require() and library()?
  14. How to sort a character vector where elements contain letters and numbers in R?
  15. Plot two graphs in same plot in R
  16. Paste multiple columns together
  17. Using R to download zipped data file, extract, and import data
  18. Count number of occurences for each unique value
  19. Extracting specific columns from a data frame
  20. How does one reorder columns in a data frame?
  21. Group by multiple columns in dplyr, using string vector input
  22. Fitting a density curve to a histogram in R
  23. Changing date format in R
  24. How to perform natural (lexicographic) sorting in R? [duplicate]
  25. Test if characters are in a string
  26. How to order data by value within ggplot facets
  27. How to filter a data frame
  28. Create categorical variable in R based on range
  29. Apply several summary functions (sum, mean, etc.) on several variables by group in one call
  30. Order of operator precedence when using “:” (the colon)

Leave a Comment