LDA model generates different topics everytime i train on the same corpus

by

Why does the same LDA parameters and corpus generate different topics everytime?

Because LDA uses randomness in both training and inference steps.

And how do i stabilize the topic generation?

By resetting the numpy.random seed to the same value every time a model is trained or inference is performed, with numpy.random.seed:

SOME_FIXED_SEED = 42

# before training/inference:
np.random.seed(SOME_FIXED_SEED)

(This is ugly, and it makes Gensim results hard to reproduce; consider submitting a patch. I’ve already opened an issue.)

More Related Contents:

  1. Topic distribution: How do we see which document belong to which topic after doing LDA in python
  2. Extract email id from text file by showing path
  3. How to remove English words from a file containing Dari words?
  4. how to count average sentence length (in words) from a text file contains 100 sentences using python [closed]
  5. feature extraction in python for nlp
  6. Ordinal numbers replacement
  7. How to config nltk data directory from code?
  8. Classification using movie review corpus in NLTK/Python
  9. Convert words between verb/noun/adjective forms
  10. nltk NaiveBayesClassifier training for sentiment analysis
  11. How to calculate the sentence similarity using word2vec model of gensim with python
  12. Python – RegEx for splitting text into sentences (sentence-tokenizing) [duplicate]
  13. Using NLTK and WordNet; how do I convert simple tense verb into its present, past or past participle form?
  14. How to get rid of punctuation using NLTK tokenizer?
  15. How to check whether a sentence is correct (simple grammar check in Python)?
  16. English grammar for parsing in NLTK
  17. Fast/Optimize N-gram implementations in python
  18. Extract Word from Synset using Wordnet in NLTK 3.0
  19. How do I do dependency parsing in NLTK?
  20. training data format for NLTK punkt
  21. Efficiently count word frequencies in python
  22. Fuzzy String Comparison
  23. Creating a custom categorized corpus in NLTK and Python
  24. Pandas dataframe groupby text value that occurs in two columns
  25. How to compute precision, recall, accuracy and f1-score for the multiclass case with scikit learn?
  26. Expanding English language contractions in Python
  27. NLTK WordNet Lemmatizer: Shouldn’t it lemmatize all inflections of a word?
  28. What is NLTK POS tagger asking me to download?
  29. How to use malt parser in python nltk
  30. How to tweak the NLTK sentence tokenizer

Leave a Comment