Find duplicate records in MongoDB

by

Use aggregation on name and get name with count > 1:

db.collection.aggregate([
    {"$group" : { "_id": "$name", "count": { "$sum": 1 } } },
    {"$match": {"_id" :{ "$ne" : null } , "count" : {"$gt": 1} } }, 
    {"$project": {"name" : "$_id", "_id" : 0} }
]);

To sort the results by most to least duplicates:

db.collection.aggregate([
    {"$group" : { "_id": "$name", "count": { "$sum": 1 } } },
    {"$match": {"_id" :{ "$ne" : null } , "count" : {"$gt": 1} } }, 
    {"$sort": {"count" : -1} },
    {"$project": {"name" : "$_id", "_id" : 0} }     
]);

To use with another column name than “name”, change “$name” to “$column_name“

More Related Contents:

  1. Mongodb aggregation $group, restrict length of array
  2. $lookup on ObjectId’s in an array
  3. Check if every element in array matches condition
  4. MongoDB nested lookup with 3 levels
  5. How to aggregate sum in MongoDB to get a total count?
  6. MongoDB : Aggregation framework : Get last dated document per grouping ID
  7. MongoDB Full and Partial Text Search
  8. Matching ObjectId to String for $graphLookup
  9. MongoDB vs. Cassandra [closed]
  10. Mongodb Join on _id field from String to ObjectId
  11. Rounding to 2 decimal places using MongoDB aggregation framework
  12. $unwind empty array
  13. How to get back the Original document back after aggregation
  14. How do I do a “NOT IN” query in Mongo?
  15. Mongo sort on a calculated condition
  16. MongoDB update with condition
  17. MongoDB lookup when foreign field is an array of objects
  18. Search on multiple collections in MongoDB
  19. Using stored JavaScript functions in the Aggregation pipeline, MapReduce or runCommand
  20. MongoDB – The argument to $size must be an Array, but was of type: EOO / missing
  21. How to flatten a subdocument into root level in MongoDB?
  22. How to stop insertion of Duplicate documents in a mongodb collection
  23. $skip and $limit in aggregation framework
  24. Is mongodb running?
  25. Mongodb Aggregation Framework | Group over multiple values?
  26. count array occurrences across all documents with mongo
  27. MongoDB normalization, foreign key and joining
  28. Mongodb concat int and string
  29. Return actual type of a field in MongoDB
  30. Get a document in MongoDB without specifying collection

Leave a Comment