MongoDB’s performance on aggregation queries

by

The idea is that you improve the performance of aggregation queries by using MapReduce on a sharded database that is distributed over multiple machines.

I did some comparisons of the performance of Mongo’s Mapreduce with a group-by-select statement in Oracle on the same machine. I did find that Mongo was approximately 25 times slower. This means that I have to shard the data over at least 25 machines to get the same performance with Mongo as Oracle delivers on a single machine. I used a collection/table with approximately 14 million documents/rows.

Exporting the data from mongo via mongoexport.exe and using the exported data as an external table in Oracle and doing a group-by in Oracle was much faster than using Mongo’s own MapReduce.

More Related Contents:

  1. Is Mongodb Aggregation framework faster than map/reduce?
  2. MongoDB ranged pagination
  3. MongoDB ‘count()’ is very slow. How do we refine/work around with it?
  4. High-performance merging of ordered sets
  5. Google app script timeout ~ 5 minutes?
  6. What is the purpose of the EBP frame pointer register?
  7. nth fibonacci number in sublinear time
  8. Algorithm to calculate the number of divisors of a given number
  9. Why are difference lists more efficient than regular concatenation in Haskell?
  10. Analyzing Code for Efficiency?
  11. Apache Spark: map vs mapPartitions?
  12. Reading GHC Core
  13. CSS3 Transitions: Is “transition: all” slower than “transition: x”?
  14. Size of store buffers on Intel hardware? What exactly is a store buffer?
  15. Avoid stalling pipeline by calculating conditional early
  16. Android studio takes too much memory
  17. Most efficient list to data.frame method?
  18. Tools to measure MPI communication costs [closed]
  19. Has anyone actually implemented a Fibonacci-Heap efficiently?
  20. Order of the code and performance
  21. Bulk inserts taking longer than expected using Dapper
  22. Why are compilers so stupid?
  23. In SQLite, do prepared statements really improve performance?
  24. latency vs throughput in intel intrinsics
  25. how do numactl & perf change memory placement policy of child processes?
  26. What’s a fast way to space-out bits within a word?
  27. Performance comparison of a Vec and a boxed slice
  28. 64-bit Performance Advantages
  29. Do 128bit cross lane operations in AVX512 give better performance?
  30. SET vs. SELECT – What’s the difference?

Leave a Comment