Mixing categorial and continuous data in Naive Bayes classifier using scikit-learn

by

You have at least two options:

  • Transform all your data into a categorical representation by computing percentiles for each continuous variables and then binning the continuous variables using the percentiles as bin boundaries. For instance for the height of a person create the following bins: “very small”, “small”, “regular”, “big”, “very big” ensuring that each bin contains approximately 20% of the population of your training set. We don’t have any utility to perform this automatically in scikit-learn but it should not be too complicated to do it yourself. Then fit a unique multinomial NB on those categorical representation of your data.

  • Independently fit a gaussian NB model on the continuous part of the data and a multinomial NB model on the categorical part. Then transform all the dataset by taking the class assignment probabilities (with predict_proba method) as new features: np.hstack((multinomial_probas, gaussian_probas)) and then refit a new model (e.g. a new gaussian NB) on the new features.

More Related Contents:

  1. Save classifier to disk in scikit-learn
  2. How to get most informative features for scikit-learn classifiers?
  3. Scikit-learn: How to obtain True Positive, True Negative, False Positive and False Negative
  4. scikit-learn .predict() default threshold
  5. How to extract the decision rules from scikit-learn decision-tree?
  6. scikit-learn & statsmodels – which R-squared is correct?
  7. Is it possible to specify your own distance function using scikit-learn K-Means Clustering?
  8. scikit-learn DBSCAN memory usage
  9. Predict classes or class probabilities?
  10. Why is Random Forest with a single tree much better than a Decision Tree classifier?
  11. Feature/Variable importance after a PCA analysis
  12. Recovering features names of explained_variance_ratio_ in PCA with sklearn
  13. LabelEncoder for categorical features?
  14. What is exactly sklearn.pipeline.Pipeline?
  15. difference between StratifiedKFold and StratifiedShuffleSplit in sklearn
  16. Scikit Learn OneHotEncoder fit and transform Error: ValueError: X has different shape than during fitting
  17. memory issues when transforming np.array using to_categorical
  18. Clustering values by their proximity in python (machine learning?) [duplicate]
  19. How to find the importance of the features for a logistic regression model?
  20. TfidfVectorizer in scikit-learn : ValueError: np.nan is an invalid document
  21. scikit-learn random state in splitting dataset
  22. Scikit Learn GridSearchCV without cross validation (unsupervised learning)
  23. How to compute precision, recall, accuracy and f1-score for the multiclass case with scikit learn?
  24. scikit-learn: how to scale back the ‘y’ predicted result
  25. Using Smote with Gridsearchcv in Scikit-learn
  26. confused about random_state in decision tree of scikit learn
  27. Does GridSearchCV perform cross-validation?
  28. Can I send callbacks to a KerasClassifier?
  29. How to get most informative features for scikit-learn classifier for different class?
  30. Does the SVM in sklearn support incremental (online) learning?

Leave a Comment