bigrams instead of single words in termdocument matrix using R and Rweka

by

Inspired by Anthony’s comment, I found out that you can specify the number of threads that the parallel library uses by default (specify it before you call the NgramTokenizer):

# Sets the default number of threads to use
options(mc.cores=1)

Since the NGramTokenizer seems to hang on the parallel::mclapply call, changing the number of threads seems to work around it.

More Related Contents:

  1. How can I find compound words, removing spaces between them and replace them in my corpus?
  2. Editing legend (text) labels in ggplot
  3. Read a text file in R line by line
  4. R-Project no applicable method for ‘meta’ applied to an object of class “character”
  5. Why and where are \n newline characters getting introduced to c()?
  6. Convert written number to number in R
  7. Finding 2 & 3 word Phrases Using R TM Package
  8. R tm package invalid input in ‘utf8towcs’
  9. agrep: only return best match(es)
  10. Detect text language in R
  11. How to make geom_text plot within the canvas’s bounds
  12. Recognize PDF table using R
  13. Emoticons in Twitter Sentiment Analysis in r
  14. list of word frequencies using R
  15. How do I scrape / automatically download PDF files from a document search web interface in R?
  16. Text-mining with the tm-package – word stemming
  17. R text file and text mining…how to load data
  18. Get the difference between dates in terms of weeks, months, quarters, and years
  19. Subscripts in plots in R
  20. Suppress output of a function
  21. dplyr filter: Get rows with minimum of variable, but only the first if multiple minima
  22. How to convert dataframe into time series?
  23. Plot over multiple pages
  24. How to generate a matrix of combinations
  25. Removing display of row names from data frame
  26. Writing robust R code: namespaces, masking and using the `::` operator
  27. How to change order of array dimensions
  28. Get column index from label in a data frame
  29. Combined plot of ggplot2 (Not in a single Plot), using par() or layout() function? [duplicate]
  30. Is there a way to output text to the R console in color

Leave a Comment