Why do I get “Pickle – EOFError: Ran out of input” reading an empty file?

by

Most of the answers here have dealt with how to mange EOFError exceptions, which is really handy if you’re unsure about whether the pickled object is empty or not.

However, if you’re surprised that the pickle file is empty, it could be because you opened the filename through ‘wb’ or some other mode that could have over-written the file.

for example:

filename="cd.pkl"
with open(filename, 'wb') as f:
    classification_dict = pickle.load(f)

This will over-write the pickled file. You might have done this by mistake before using:

...
open(filename, 'rb') as f:

And then got the EOFError because the previous block of code over-wrote the cd.pkl file.

When working in Jupyter, or in the console (Spyder) I usually write a wrapper over the reading/writing code, and call the wrapper subsequently. This avoids common read-write mistakes, and saves a bit of time if you’re going to be reading the same file multiple times through your travails

More Related Contents:

  1. What is the difference between rb and r+b modes in file objects [duplicate]
  2. pickle – putting more than 1 object in a file? [duplicate]
  3. Turn the whole file uppercase
  4. Is explicitly closing files important?
  5. Can’t pickle when using multiprocessing Pool.map()
  6. Directory-tree listing in Python
  7. How to write to a CSV line by line?
  8. Open file in a relative location in Python
  9. check what files are open in Python
  10. How to convert a file to utf-8 in Python?
  11. Read from a log file as it’s being written using python
  12. Is close() necessary when using iterator on a Python file object [duplicate]
  13. Finding duplicate files and removing them
  14. Compare two files report difference in python
  15. Python 2.7: Print to File
  16. How to pickle a python function with its dependencies?
  17. How to change the serialization method used by the multiprocessing module?
  18. Best method for reading newline delimited files and discarding the newlines?
  19. How to safely write to a file?
  20. What is the idiomatic way to iterate over a binary file?
  21. Read from File, or STDIN
  22. Detect duplicate MP3 files with different bitrates and/or different ID3 tags?
  23. Error with double backslash in Windows path in Python [duplicate]
  24. Sending a file over TCP sockets in Python
  25. Is there a way to efficiently yield every file in a directory containing millions of files?
  26. Common use-cases for pickle in Python
  27. Read random lines from huge CSV file
  28. How to hash a large object (dataset) in Python?
  29. What is the difference between .py and .pyc files? [duplicate]
  30. how to count the total number of lines in a text file using python

Leave a Comment