confused about random_state in decision tree of scikit learn

by

This is explained in the documentation

The problem of learning an optimal decision tree is known to be NP-complete under several aspects of optimality and even for simple concepts. Consequently, practical decision-tree learning algorithms are based on heuristic algorithms such as the greedy algorithm where locally optimal decisions are made at each node. Such algorithms cannot guarantee to return the globally optimal decision tree. This can be mitigated by training multiple trees in an ensemble learner, where the features and samples are randomly sampled with replacement.

So, basically, a sub-optimal greedy algorithm is repeated a number of times using random selections of features and samples (a similar technique used in random forests). The random_state parameter allows controlling these random choices.

The interface documentation specifically states:

If int, random_state is the seed used by the random number generator; If RandomState instance, random_state is the random number generator; If None, the random number generator is the RandomState instance used by np.random.

So, the random algorithm will be used in any case. Passing any value (whether a specific int, e.g., 0, or a RandomState instance), will not change that. The only rationale for passing in an int value (0 or otherwise) is to make the outcome consistent across calls: if you call this with random_state=0 (or any other value), then each and every time, you’ll get the same result.

More Related Contents:

  1. How to extract the decision rules from scikit-learn decision-tree?
  2. Why is Random Forest with a single tree much better than a Decision Tree classifier?
  3. sklearn error ValueError: Input contains NaN, infinity or a value too large for dtype(‘float64’)
  4. Save classifier to disk in scikit-learn
  5. Accuracy Score ValueError: Can’t Handle mix of binary and continuous target
  6. Is it possible to specify your own distance function using scikit-learn K-Means Clustering?
  7. How to get most informative features for scikit-learn classifiers?
  8. How to get precision, recall and f-measure from confusion matrix in Python [duplicate]
  9. How to install xgboost package in python (windows platform)?
  10. Feature/Variable importance after a PCA analysis
  11. Recovering features names of explained_variance_ratio_ in PCA with sklearn
  12. LabelEncoder for categorical features?
  13. Custom transformer for sklearn Pipeline that alters both X and y
  14. What is exactly sklearn.pipeline.Pipeline?
  15. difference between StratifiedKFold and StratifiedShuffleSplit in sklearn
  16. Save MinMaxScaler model in sklearn
  17. confusion matrix error “Classification metrics can’t handle a mix of multilabel-indicator and multiclass targets”
  18. Scikit-learn: How to obtain True Positive, True Negative, False Positive and False Negative
  19. Can anyone explain me StandardScaler?
  20. What are the pros and cons between get_dummies (Pandas) and OneHotEncoder (Scikit-learn)?
  21. TfidfVectorizer in scikit-learn : ValueError: np.nan is an invalid document
  22. scikit-learn random state in splitting dataset
  23. Mixing categorial and continuous data in Naive Bayes classifier using scikit-learn
  24. Tensorflow Precision / Recall / F1 score and Confusion matrix
  25. Can I send callbacks to a KerasClassifier?
  26. How to get most informative features for scikit-learn classifier for different class?
  27. Model help using Scikit-learn when using GridSearch
  28. Does the SVM in sklearn support incremental (online) learning?
  29. Determining the most contributing features for SVM classifier in sklearn
  30. scikit-learn .predict() default threshold

Leave a Comment