NLTK Tagging spanish words using a corpus

by

First you need to read the tagged sentence from a corpus. NLTK provides a nice interface to no bother with different formats from the different corpora; you can simply import the corpus use the corpus object functions to access the data. See http://nltk.googlecode.com/svn/trunk/nltk_data/index.xml .

Then you have to choose your choice of tagger and train the tagger. There are more fancy options but you can start with the N-gram taggers.

Then you can use the tagger to tag the sentence you want. Here’s an example code:

from nltk.corpus import cess_esp as cess
from nltk import UnigramTagger as ut
from nltk import BigramTagger as bt

# Read the corpus into a list, 
# each entry in the list is one sentence.
cess_sents = cess.tagged_sents()

# Train the unigram tagger
uni_tag = ut(cess_sents)

sentence = "Hola , esta foo bar ."

# Tagger reads a list of tokens.
uni_tag.tag(sentence.split(" "))

# Split corpus into training and testing set.
train = int(len(cess_sents)*90/100) # 90%

# Train a bigram tagger with only training data.
bi_tag = bt(cess_sents[:train])

# Evaluates on testing data remaining 10%
bi_tag.evaluate(cess_sents[train+1:])

# Using the tagger.
bi_tag.tag(sentence.split(" "))

Training a tagger on a large corpus may take a significant time. Instead of training a tagger every time we need one, it is convenient to save a trained tagger in a file for later re-use.

Please look at Storing Taggers section in http://nltk.googlecode.com/svn/trunk/doc/book/ch05.html

More Related Contents:

  1. Refering to a directory in a Flask app doesn’t work unless the path is absolute
  2. How to check if a word is an English word with Python?
  3. Ordinal numbers replacement
  4. How to config nltk data directory from code?
  5. pip issue installing almost any library
  6. wordnet lemmatization and pos tagging in python
  7. nltk NaiveBayesClassifier training for sentiment analysis
  8. All synonyms for word in python? [duplicate]
  9. Opening A large JSON file
  10. Using NLTK and WordNet; how do I convert simple tense verb into its present, past or past participle form?
  11. How to get rid of punctuation using NLTK tokenizer?
  12. English grammar for parsing in NLTK
  13. NLTK and language detection
  14. How to get synonyms from nltk WordNet Python
  15. Fast/Optimize N-gram implementations in python
  16. Extract Word from Synset using Wordnet in NLTK 3.0
  17. How do I do dependency parsing in NLTK?
  18. Counting the Frequency of words in a pandas data frame
  19. Extract list of Persons and Organizations using Stanford NER Tagger in NLTK
  20. How to get all the hyponyms of a word/synset in python nltk and wordnet?
  21. SSL error downloading NLTK data
  22. Difference between Python’s collections.Counter and nltk.probability.FreqDist
  23. Spell Checker for Python
  24. Tokenize a paragraph into sentence and then into words in NLTK
  25. Creating a custom categorized corpus in NLTK and Python
  26. What is NLTK POS tagger asking me to download?
  27. downloading error using nltk.download()
  28. How to use malt parser in python nltk
  29. NLTK download SSL: Certificate verify failed
  30. How to tweak the NLTK sentence tokenizer

Leave a Comment