How to use append with pickle in python?

by

Pickle streams are entirely self-contained, and so unpickling will unpickle one object at a time.

Therefore, to unpickle multiple streams, you should repeatedly unpickle the file until you get an EOFError:

>>> f=open('a.p', 'wb')
>>> pickle.dump({1:2}, f)
>>> pickle.dump({3:4}, f)
>>> f.close()
>>> 
>>> f=open('a.p', 'rb')
>>> pickle.load(f)
{1: 2}
>>> pickle.load(f)
{3: 4}
>>> pickle.load(f)
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
EOFError

so your unpickle code might look like

import pickle
objs = []
while 1:
    try:
        objs.append(pickle.load(f))
    except EOFError:
        break

More Related Contents:

  1. a python library that accepts some text, and replaces phone numbers, names, and so on with tokens
  2. urllib and “SSL: CERTIFICATE_VERIFY_FAILED” Error
  3. Python Variable Declaration
  4. Python script to do something at the same time every day [duplicate]
  5. Integer division in Python 2 and Python 3
  6. Cleanest way to get last item from Python iterator
  7. Datetime Timezone conversion using pytz
  8. Using openCV to overlay transparent image onto another image
  9. pydot and graphviz error: Couldn’t import dot_parser, loading of dot files will not be possible
  10. Decompile Python 2.7 .pyc [closed]
  11. How to print double quotes around a variable?
  12. How to set justification on Tkinter Text box
  13. ‘^’ is ignored by Python – how to escape ‘^’ character in Popen Windows?
  14. Why is the time complexity of Python’s list.append() method O(1)?
  15. Trying to use open(filename, ‘w’ ) gives IOError: [Errno 2] No such file or directory if directory doesn’t exist
  16. Import Python Script Into Another?
  17. Can json.loads ignore trailing commas?
  18. Faithfully Preserve Comments in Parsed XML
  19. Python: Splat/unpack operator * in python cannot be used in an expression?
  20. ‘virtualenv’ is not recognized as an internal or external command, operable program or batch file
  21. Sound generation / synthesis with python?
  22. Sending a file over TCP sockets in Python
  23. How to make a simple multithreaded socket server in Python that remembers clients
  24. Calling Python script from C++ and using its output
  25. Python 2: SMTPServerDisconnected: Connection unexpectedly closed
  26. Redo for loop iteration in Python
  27. Catching exception in context manager __enter__()
  28. confused about random_state in decision tree of scikit learn
  29. Is possible to mapping view with class using mapper in SqlAlchemy?
  30. Python 2.7 : LookupError: unknown encoding: cp65001 [duplicate]

Leave a Comment