ValueError: n_splits=10 cannot be greater than the number of members in each class

by

Stratification means to keep the ratio of each class in each fold. So if your original dataset has 3 classes in the ratio of 60%, 20% and 20% then stratification will try to keep that ratio in each fold.

In your case,

X = ["hey", "join now", "hello", "join today", "join us now", "not today",
     "join this trial", " hey hey", " no", "hola", "bye", "join today", 
     "no","join join"]
y = ["n", "r", "n", "r", "r", "n", "n", "n", "n", "y", "n", "n", "n", "y"]

You have a total of 14 samples (members) with the distribution:

class    number of members         percentage
 'n'        9                        64
 'r'        3                        22
 'y'        2                        14

So StratifiedKFold will try to keep that ratio in each fold. Now you have specified 10 folds (n_splits). So that means in a single fold, for class ‘y’ to maintain the ratio, at least 2 / 10 = 0.2 members. But we cannot give less than 1 member (sample) so that’s why its throwing an error there.

If instead of n_splits=10, you have set n_splits=2, then it would have worked, because than the number of members for ‘y’ will be 2 / 2 = 1. For n_splits = 10 to work correctly, you need to have atleast 10 samples for each of your classes.

More Related Contents:

  1. scikit-learn GridSearchCV with multiple repetitions
  2. Cross-validation metrics in scikit-learn for each data split
  3. scikit-learn cross validation, negative values with mean squared error
  4. difference between StratifiedKFold and StratifiedShuffleSplit in sklearn
  5. Using explicit (predefined) validation set for grid search with sklearn
  6. Does GridSearchCV perform cross-validation?
  7. Model help using Scikit-learn when using GridSearch
  8. difference between arrays in numpy
  9. value error in python script
  10. Label encoding across multiple columns in scikit-learn
  11. Principal Component Analysis (PCA) in Python
  12. How to get most informative features for scikit-learn classifiers?
  13. what is the difference between ‘transform’ and ‘fit_transform’ in sklearn
  14. How can I plot a confusion matrix? [duplicate]
  15. scikit-learn DBSCAN memory usage
  16. Preprocessing in scikit learn – single sample – Depreciation warning
  17. Why is Random Forest with a single tree much better than a Decision Tree classifier?
  18. Feature/Variable importance after a PCA analysis
  19. How do I calculate a word-word co-occurrence matrix with sklearn?
  20. Using hyphen/dash in python repository name and package name
  21. Recovering features names of explained_variance_ratio_ in PCA with sklearn
  22. What is exactly sklearn.pipeline.Pipeline?
  23. Model definition does not give any output
  24. TfidfVectorizer in scikit-learn : ValueError: np.nan is an invalid document
  25. ImportError: cannot import name cross_validation
  26. TypeError: cannot perform reduce with flexible type
  27. Eliminating warnings from scikit-learn [duplicate]
  28. Stratified Sampling in Pandas
  29. scikit-learn: how to scale back the ‘y’ predicted result
  30. Does the SVM in sklearn support incremental (online) learning?

Leave a Comment