How to get most informative features for scikit-learn classifiers?

by

The classifiers themselves do not record feature names, they just see numeric arrays. However, if you extracted your features using a Vectorizer/CountVectorizer/TfidfVectorizer/DictVectorizer, and you are using a linear model (e.g. LinearSVC or Naive Bayes) then you can apply the same trick that the document classification example uses. Example (untested, may contain a bug or two):

def print_top10(vectorizer, clf, class_labels):
    """Prints features with the highest coefficient values, per class"""
    feature_names = vectorizer.get_feature_names()
    for i, class_label in enumerate(class_labels):
        top10 = np.argsort(clf.coef_[i])[-10:]
        print("%s: %s" % (class_label,
              " ".join(feature_names[j] for j in top10)))

This is for multiclass classification; for the binary case, I think you should use clf.coef_[0] only. You may have to sort the class_labels.

More Related Contents:

  1. Save classifier to disk in scikit-learn
  2. Scikit-learn: How to obtain True Positive, True Negative, False Positive and False Negative
  3. Mixing categorial and continuous data in Naive Bayes classifier using scikit-learn
  4. scikit-learn .predict() default threshold
  5. Multiclass Classification
  6. Accuracy Score ValueError: Can’t Handle mix of binary and continuous target
  7. Predict classes or class probabilities?
  8. Use scikit-learn to classify into multiple categories
  9. Why is Random Forest with a single tree much better than a Decision Tree classifier?
  10. How to get precision, recall and f-measure from confusion matrix in Python [duplicate]
  11. Feature/Variable importance after a PCA analysis
  12. Recovering features names of explained_variance_ratio_ in PCA with sklearn
  13. Custom transformer for sklearn Pipeline that alters both X and y
  14. What is exactly sklearn.pipeline.Pipeline?
  15. difference between StratifiedKFold and StratifiedShuffleSplit in sklearn
  16. Save MinMaxScaler model in sklearn
  17. memory issues when transforming np.array using to_categorical
  18. confusion matrix error “Classification metrics can’t handle a mix of multilabel-indicator and multiclass targets”
  19. Can anyone explain me StandardScaler?
  20. What are the pros and cons between get_dummies (Pandas) and OneHotEncoder (Scikit-learn)?
  21. TfidfVectorizer in scikit-learn : ValueError: np.nan is an invalid document
  22. scikit-learn random state in splitting dataset
  23. How to compute precision, recall, accuracy and f1-score for the multiclass case with scikit learn?
  24. scikit-learn: how to scale back the ‘y’ predicted result
  25. Using Smote with Gridsearchcv in Scikit-learn
  26. confused about random_state in decision tree of scikit learn
  27. Does GridSearchCV perform cross-validation?
  28. Can I send callbacks to a KerasClassifier?
  29. How to get most informative features for scikit-learn classifier for different class?
  30. Does the SVM in sklearn support incremental (online) learning?

Leave a Comment