Python file.tell() giving strange numbers?

by

It’s a documented behaviour caused by UNIX-style line endings:

file.tell()

Return the file’s current position, like stdio‘s ftell().

Note: On Windows, tell() can return illegal values (after an fgets()) when reading files with Unix-style line-endings. Use binary mode
(‘rb’) to circumvent this problem.

The above documentation is taken from the python2.7.4 documentation. The documentation for python3 changed a bit, since there is now a hierarchy of classes that handle I/O and I can’t find this bit of information. Your test shows that the behaviour didn’t change anyway. Also the source code for python3.3 has an XXX Windows support below is likely incomplete comment before the function called by tell.

There is an issue in python bug tracker related to this, and the final comment by Catalin Iacob is:

I tried to reproduce this, picked a file on my disk and indeed I got a
negative number, but that file has Unix line endings. This is
documented at http://docs.python.org/2/library/stdtypes.html#file.tell
so probably there’s nothing to do then.

As for Armin’s report in msg180145, even though it’s not intuitive,
this matches ftell’s behavior on Windows, as documented in the Remarks
section of
http://msdn.microsoft.com/en-us/library/0ys3hc0b%28v=vs.100%29.aspx.
The tell() method on fileobjects is explicitly documented as matching
ftell behavior: “Return the file’s current position, like stdio‘s
ftell()”. So even though it’s not intuitive at all, it’s probably
better to leave it as is. tell() returns the intuitive non zero
position when opening with ‘a’ on Python3 and on Python 2.7 when using
io.open so it’s fixed for the future anyway.

So it seems like a “wontfix” bug. Someone should probably open an issue(commented the issue) because this fact is not mentioned at all in python3 documentation.

According to Antoine Pitrou python3 doesn’t use ftell() at all, hence this seems to be a different bug. Also the bug is not reproducible in python3.2.3 and was probably introduced when fixing this issue (at least, it’s the only change I can find to the implementation of tell() between 3.2.3 and 3.3)

Last edit: According to the io module documentation the tell method does not return the number of bytes since the beginning of a file. The returned value is an “opaque number”, which means that the only way you can use it is to pass it to seek to get back at that position. Other operations aren’t meaningful. The fact that until python3.2.3 the value returned was what you’d expect was only an implementation detail.

Note that the information in this section of the documentation is simply wrong and, hopefully, it will be fixed in the future.

More Related Contents:

  1. How to handle special cases in my Python code?
  2. How to select random key with common values?
  3. max() functions with string argument
  4. pygame.event.get() not returning any events when inside a thread
  5. Integer division in Python 2 and Python 3
  6. pythonw.exe or python.exe?
  7. Matplotlib: Specify format of floats for tick labels
  8. How to set Python’s default version to 3.x on OS X? [duplicate]
  9. “list index out of range” when using sys.argv[1]
  10. Py2exe for Python 3.0
  11. Why can’t I use the method __cmp__ in Python 3 as for Python 2?
  12. Python Binomial Coefficient
  13. How to use type hints in python 3.6?
  14. Why doesn’t Python recognize my utf-8 encoded source file?
  15. How do I include files with pyinstaller?
  16. How to Install and Use TkDnD with Python Tkinter on OSX?
  17. Accessing items in an collections.OrderedDict by index
  18. Checking for NaN presence in a container
  19. Why is a class __dict__ a mappingproxy?
  20. What is the difference between int() and floor() in Python 3?
  21. Python map object is not subscriptable [duplicate]
  22. Changing User Agent in Python 3 for urrlib.request.urlopen
  23. How to fix “no module named ‘app_one'”
  24. Python 3 bytes formatting
  25. Calling Python script from C++ and using its output
  26. json.decoder.JSONDecodeError: Extra data: line 2 column 1 (char 190) [duplicate]
  27. Why isn’t isnumeric working?
  28. Why are str.count(”) and len(str) giving different outputs when used on an empty string?
  29. Convert binary string to bytearray in Python 3
  30. ‘is’ operator behaves unexpectedly with floats

Leave a Comment