Is Mongodb Aggregation framework faster than map/reduce?

by

Every test I have personally run (including using your own data) shows aggregation framework being a multiple faster than map reduce, and usually being an order of magnitude faster.

Just taking 1/10th of the data you posted (but rather than clearing OS cache, warming the cache first – because I want to measure performance of the aggregation, and not how long it takes to page in the data) I got this:

MapReduce: 1,058ms
Aggregation Framework: 133ms

Removing the $match from aggregation framework and {query:} from mapReduce (because both would just use an index and that’s not what we want to measure) and grouping the entire dataset by key2 I got:

MapReduce: 18,803ms
Aggregation Framework: 1,535ms

Those are very much in line with my previous experiments.

More Related Contents:

  1. Does MongoDB’s $in clause guarantee order
  2. Check if every element in array matches condition
  3. MongoDB aggregation comparison: group(), $group and MapReduce
  4. Why is the final reduce step extremely slow in this MapReduce? (HiveQL, HDFS MapReduce)
  5. Find all duplicate documents in a MongoDB collection by a key field
  6. Mongodb Aggregation Framework: Does $group use index?
  7. Remove Duplicates from MongoDB
  8. MongoDB ranged pagination
  9. MongoDB ‘count()’ is very slow. How do we refine/work around with it?
  10. MongoDB’s performance on aggregation queries
  11. Is it safe to shallow clone with –depth 1, create commits, and pull updates again?
  12. Why is my Rust program slower than the equivalent Java program?
  13. Return only matched sub-document elements within a nested array
  14. Converting string to date in mongodb
  15. MongoDB Regex Search on Integer Value
  16. MongoDB Duplicate Documents even after adding unique key
  17. Given n points on a 2D plane, find the maximum number of points that lie on the same straight line
  18. Why is a conditional move not vulnerable to Branch Prediction Failure?
  19. Run-length decoding in MATLAB
  20. Find duplicate records in MongoDB
  21. MongoDB aggregation with Java driver
  22. MongoDB: Calculate dwell time between every status value change
  23. SUMIFS function in Google Spreadsheet
  24. Optimizing File Cacheing and HTTP2
  25. How to access overall document count during arithmetic aggregation expression
  26. How to deal with the timezone issue when storing dates in utc using mongod?
  27. Sum in nested document MongoDB
  28. mongodb get _id as string in find query
  29. Projecting a list of lists efficiently in F#
  30. mongodb aggregate query isn’t returning proper sum on using $sum

Leave a Comment