NLTK v3.2: Unable to nltk.pos_tag()

by

EDITED

This issue has been resolved from NLTK v3.2.1. Upgrading your NLTK version would resolve the issue, e.g. pip install -U nltk.

I faced the same issue and the error encountered was as follows;

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "C:\Python27\lib\site-packages\nltk-3.2-py2.7.egg\nltk\tag\__init__.py", line 110, in pos_tag
tagger = PerceptronTagger()
  File "C:\Python27\lib\site-packages\nltk-3.2-py2.7.egg\nltk\tag\perceptron.py", line 141, in __init__
self.load(AP_MODEL_LOC)
  File "C:\Python27\lib\site-packages\nltk-3.2-py2.7.egg\nltk\tag\perceptron.py", line 209, in load
self.model.weights, self.tagdict, self.classes = load(loc)
  File "C:\Python27\lib\site-packages\nltk-3.2-py2.7.egg\nltk\data.py", line 801, in load
opened_resource = _open(resource_url)
  File "C:\Python27\lib\site-packages\nltk-3.2-py2.7.egg\nltk\data.py", line 924, in _open
return urlopen(resource_url)
  File "C:\Python27\lib\urllib2.py", line 126, in urlopen
return _opener.open(url, data, timeout)
  File "C:\Python27\lib\urllib2.py", line 391, in open
response = self._open(req, data)
  File "C:\Python27\lib\urllib2.py", line 414, in _open
'unknown_open', req)
  File "C:\Python27\lib\urllib2.py", line 369, in _call_chain
result = func(*args)
  File "C:\Python27\lib\urllib2.py", line 1206, in unknown_open
raise URLError('unknown url type: %s' % type)
urllib2.URLError: <urlopen error unknown url type: c>

The URLError that you mentioned was due to a bug in the perceptron.py file within the NLTK library for Windows.
In my machine, the file is at this location 

C:\Python27\Lib\site-packages\nltk-3.2-py2.7.egg\nltk\tag\perceptron.py

(Basically look at an equivalent location within yours wherever you have the Python27 folder)

The bug was basically in the code to find the corresponding location for the averaged_perceptron_tagger within your machine. One can have a look at the line 801 and 924 mentioned in the data.py file regarding this.

I think the NLTK developer community recently fixed this bug in the code. Have a look at this commit made to their code a few days back.

https://github.com/nltk/nltk/commit/d3de14e58215beebdccc7b76c044109f6197d1d9#diff-26b258372e0d13c2543de8dbb1841252

The snippet where the change was made is as follows;

self.tagdict = {}
self.classes = set()
    if load:
        AP_MODEL_LOC = 'file:'+str(find('taggers/averaged_perceptron_tagger/'+PICKLE))
          self.load(AP_MODEL_LOC)
        # Initially it was:AP_MODEL_LOC = str(find('taggers/averaged_perceptron_tagger/'+PICKLE)) 

def tag(self, tokens):

Updating the file to the most recent commit worked for me and was able to use the nltk.pos_tag command. I believe this would resolve your problem as well (assuming you have everything else set up).

More Related Contents:

  1. How to install Poppler on Windows?
  2. What are good grep tools for Windows? [closed]
  3. How do you loop through each line in a text file using a windows batch file?
  4. How to See the Contents of Windows library (*.lib)
  5. How do I escape ampersands in batch files?
  6. How to use random in BATCH script?
  7. Why does %date% produce a different result in batch file executed as scheduled task?
  8. Node.js/Windows error: ENOENT, stat ‘C:\Users\RT\AppData\Roaming\npm’
  9. In Windows cmd, how do I prompt for user input and use the result in another command?
  10. Batch script loop
  11. FORFILES date -after- (date calc in cmd file)
  12. Create an empty file on the commandline in windows (like the linux touch command)
  13. How do I make my GUI behave well when Windows font scaling is greater than 100%
  14. What is the proper way to test if a parameter is empty in a batch file?
  15. In Windows: How do you programatically launch a process in administrator mode under another user context?
  16. How to set the PATH environment variable in Jenkins configuration on Windows?
  17. Concurrency in a GIT repo on a network shared folder
  18. How to run a command in the background on Windows?
  19. how to get program files x86 env variable?
  20. Why “The system cannot find the batch label specified” is thrown even if label exists?
  21. Running Cython in Windows x64 – fatal error C1083: Cannot open include file: ‘basetsd.h’: No such file or directory
  22. How to I launch a ruby script from the command line by just its name?
  23. Which versions of Windows support/require which CPU multimedia extensions? (How to check if SSE or AVX are fully usable?)
  24. How to pass environment variables as parameters by reference to another batch file?
  25. How to install NodeJS project locally without internet connection?
  26. How to identify Windows 10 background store processes that have non-displayed windows that are programmatically visible and minimizable?
  27. Registry vs. INI file for storing user configurable application settings [closed]
  28. Is there a Windows/MSVC equivalent to the -rpath linker flag?
  29. Run batch file in Windows Installer Commit
  30. UTF-16 to UTF-8 conversion (for scripting in Windows)

Leave a Comment