How to use malt parser in python nltk

by

Edited

Note that is answer is no longer working because of the updated version of the MaltParser API in NLTK since August 2015. This answer is kept for legacy sake.

Please see this answers to get MaltParser working with NLTK:

Disclaimer: This is not an eternal solutions. The answer in the above link (posted on Feb 2016) will work for now. But when MaltParser or NLTK API changes, it might also change the syntax to using MaltParser in NLTK.

A couple problems with your setup:

  • The input to train_from_file must be a file in CoNLL format, not a pre-trained model. For an mco file, you pass it to the MaltParser constructor using the mco and working_directory parameters.
  • The default java heap allocation is not large enough to load that particular mco file, so you’ll have to tell java to use more heap space with the -Xmx parameter. Unfortunately this wasn’t possible with the existing code so I just checked in a change to allow an additional constructor parameters for java args. See here.

So here’s what you need to do:

First, get the latest NLTK revision:

git clone https://github.com/nltk/nltk.git

(NOTE: If you can’t use the git version of NLTK, then you’ll have to update the file malt.py manually or copy it from here to have your own version.)

Second, rename the jar file to malt.jar, which is what NLTK expects:

cd /usr/lib/
ln -s maltparser-1.7.2.jar malt.jar

Then add an environment variable pointing to malt parser:

export MALTPARSERHOME="/Users/dhg/Downloads/maltparser-1.7.2"

Finally, load and use malt parser in python:

>>> import nltk
>>> parser = nltk.parse.malt.MaltParser(working_dir="/home/rohith/malt-1.7.2", 
...                                     mco="engmalt.linear-1.7", 
...                                     additional_java_args=['-Xmx512m'])
>>> txt = "This is a test sentence"
>>> graph = parser.raw_parse(txt)
>>> graph.tree().pprint()
'(This (sentence is a test))'

More Related Contents:

  1. How to use Stanford Parser in NLTK using Python
  2. Creating a new corpus with NLTK
  3. Python NLTK pos_tag not returning the correct part-of-speech tag
  4. Stopword removal with NLTK
  5. Ordinal numbers replacement
  6. How to config nltk data directory from code?
  7. Classification using movie review corpus in NLTK/Python
  8. Convert words between verb/noun/adjective forms
  9. nltk NaiveBayesClassifier training for sentiment analysis
  10. NLTK Named Entity recognition to a Python list
  11. Computing N Grams using Python
  12. Using NLTK and WordNet; how do I convert simple tense verb into its present, past or past participle form?
  13. How do I tokenize a string sentence in NLTK?
  14. How to get rid of punctuation using NLTK tokenizer?
  15. English grammar for parsing in NLTK
  16. NLTK and language detection
  17. Fast/Optimize N-gram implementations in python
  18. Extract Word from Synset using Wordnet in NLTK 3.0
  19. How do I do dependency parsing in NLTK?
  20. training data format for NLTK punkt
  21. Difference between Python’s collections.Counter and nltk.probability.FreqDist
  22. Saving nltk drawn parse tree to image file
  23. Creating a custom categorized corpus in NLTK and Python
  24. tag generation from a text content
  25. NLTK WordNet Lemmatizer: Shouldn’t it lemmatize all inflections of a word?
  26. What is NLTK POS tagger asking me to download?
  27. Implementing Bag-of-Words Naive-Bayes classifier in NLTK
  28. Fast n-gram calculation
  29. Using the Python NLTK (2.0b5) on the Google App Engine
  30. How to tweak the NLTK sentence tokenizer

Leave a Comment