Use scikit-learn to classify into multiple categories

by

What you want is called multi-label classification. Scikits-learn can do that. See here: http://scikit-learn.org/dev/modules/multiclass.html.

I’m not sure what’s going wrong in your example, my version of sklearn apparently doesn’t have WordNGramAnalyzer. Perhaps it’s a question of using more training examples or trying a different classifier? Though note that the multi-label classifier expects the target to be a list of tuples/lists of labels.

The following works for me:

import numpy as np
from sklearn.pipeline import Pipeline
from sklearn.feature_extraction.text import CountVectorizer
from sklearn.svm import LinearSVC
from sklearn.feature_extraction.text import TfidfTransformer
from sklearn.multiclass import OneVsRestClassifier

X_train = np.array(["new york is a hell of a town",
                    "new york was originally dutch",
                    "the big apple is great",
                    "new york is also called the big apple",
                    "nyc is nice",
                    "people abbreviate new york city as nyc",
                    "the capital of great britain is london",
                    "london is in the uk",
                    "london is in england",
                    "london is in great britain",
                    "it rains a lot in london",
                    "london hosts the british museum",
                    "new york is great and so is london",
                    "i like london better than new york"])
y_train = [[0],[0],[0],[0],[0],[0],[1],[1],[1],[1],[1],[1],[0,1],[0,1]]
X_test = np.array(['nice day in nyc',
                   'welcome to london',
                   'hello welcome to new york. enjoy it here and london too'])   
target_names = ['New York', 'London']

classifier = Pipeline([
    ('vectorizer', CountVectorizer(min_n=1,max_n=2)),
    ('tfidf', TfidfTransformer()),
    ('clf', OneVsRestClassifier(LinearSVC()))])
classifier.fit(X_train, y_train)
predicted = classifier.predict(X_test)
for item, labels in zip(X_test, predicted):
    print '%s => %s' % (item, ', '.join(target_names[x] for x in labels))

For me, this produces the output:

nice day in nyc => New York
welcome to london => London
hello welcome to new york. enjoy it here and london too => New York, London

Hope this helps.

More Related Contents:

  1. Save classifier to disk in scikit-learn
  2. How to get most informative features for scikit-learn classifiers?
  3. Scikit-learn: How to obtain True Positive, True Negative, False Positive and False Negative
  4. Mixing categorial and continuous data in Naive Bayes classifier using scikit-learn
  5. scikit-learn .predict() default threshold
  6. difference between arrays in numpy
  7. value error in python script
  8. Label encoding across multiple columns in scikit-learn
  9. Principal Component Analysis (PCA) in Python
  10. How can I plot a confusion matrix? [duplicate]
  11. scikit-learn DBSCAN memory usage
  12. Preprocessing in scikit learn – single sample – Depreciation warning
  13. Predict classes or class probabilities?
  14. How to convert a Scikit-learn dataset to a Pandas dataset
  15. UndefinedMetricWarning: F-score is ill-defined and being set to 0.0 in labels with no predicted samples
  16. Keep same dummy variable in training and testing data
  17. scikit-learn GridSearchCV with multiple repetitions
  18. Feature/Variable importance after a PCA analysis
  19. Using hyphen/dash in python repository name and package name
  20. Cross-validation metrics in scikit-learn for each data split
  21. difference between StratifiedKFold and StratifiedShuffleSplit in sklearn
  22. ValueError: n_splits=10 cannot be greater than the number of members in each class
  23. TfidfVectorizer in scikit-learn : ValueError: np.nan is an invalid document
  24. ImportError: cannot import name cross_validation
  25. How to use sklearn fit_transform with pandas and return dataframe instead of numpy array?
  26. Got continuous is not supported error in RandomForestRegressor
  27. confused about random_state in decision tree of scikit learn
  28. Can I send callbacks to a KerasClassifier?
  29. How to get most informative features for scikit-learn classifier for different class?
  30. ImportError: No module named sklearn.cross_validation

Leave a Comment