How to continue insertion after duplicate key error using PyMongo

by

You need to use insert_many method and set the ordered option to False.

db_stock.insert_many(<list of documents>)

As mentioned in the ordered option documentation:

ordered (optional): If True (the default) documents will be inserted on the server serially, in the order provided. If an error occurs all remaining inserts are aborted. If False, documents will be inserted on the server in arbitrary order, possibly in parallel, and all document inserts will be attempted.

Which means that insertion will continue even if there is duplicate key error.

Demo:

>>> c.insert_many([{'_id': 2}, {'_id': 3}])
<pymongo.results.InsertManyResult object at 0x7f5ca669ef30>
>>> list(c.find())
[{'_id': 2}, {'_id': 3}]
>>> try:
...     c.insert_many([{'_id': 2}, {'_id': 3}, {'_id': 4}, {'_id': 5}], ordered=False)
... except pymongo.errors.BulkWriteError:
...     list(c.find())
... 
[{'_id': 2}, {'_id': 3}, {'_id': 4}, {'_id': 5}]

As you can see document with _id 4, 5 were inserted into the collection.

It worth noting that this is also possible in the shell using the insertMany method. All you need is set the undocumented option ordered to false.

db.collection.insertMany(
    [ 
        { '_id': 2 }, 
        { '_id': 3 },
        { '_id': 4 }, 
        { '_id': 5 }
    ],
    { 'ordered': false }
)

More Related Contents:

  1. Query Mongodb on month, day, year… of a datetime
  2. Append item to MongoDB document array in PyMongo without re-insertion
  3. Append item to MongoDB document array in PyMongo without re-insertion
  4. How to convert a pymongo.cursor.Cursor into a dict?
  5. mongodb: insert if not exists
  6. How to import data from mongodb to pandas?
  7. search by ObjectId in mongodb with pymongo
  8. Insert a Pandas Dataframe into mongodb using PyMongo
  9. How to sort mongodb with pymongo
  10. Authenticate After Picking the Database
  11. Fast or Bulk Upsert in pymongo
  12. How to make a query date in mongodb using pymongo?
  13. How to Ignore Duplicate Key Errors Safely Using insert_many
  14. Getting Spark, Python, and MongoDB to work together
  15. Using .sort with PyMongo
  16. How to run raw mongodb commands from pymongo
  17. ImportError: No module named objectid
  18. “Large data” workflows using pandas [closed]
  19. TypeError: ObjectId(”) is not JSON serializable
  20. How can I use ‘Not Like’ operator in MongoDB
  21. Pymongo keeps refusing the connection at 27017
  22. Why is PyMongo 3 giving ServerSelectionTimeoutError?
  23. JSON ValueError: Expecting property name: line 1 column 2 (char 1)
  24. How to get ordered dictionaries in pymongo?
  25. mongodb cursor id not valid error
  26. Delete every non utf-8 symbols from string
  27. while loop with two specific conditions [duplicate]
  28. Refering to a directory in a Flask app doesn’t work unless the path is absolute
  29. error: command ‘gcc’ failed with exit status 1 while installing eventlet
  30. Converting JSON String to Dictionary Not List

Leave a Comment