Random state (Pseudo-random number) in Scikit learn

by

train_test_split splits arrays or matrices into random train and test subsets. That means that everytime you run it without specifying random_state, you will get a different result, this is expected behavior. For example:

Run 1:

>>> a, b = np.arange(10).reshape((5, 2)), range(5)
>>> train_test_split(a, b)
[array([[6, 7],
        [8, 9],
        [4, 5]]),
 array([[2, 3],
        [0, 1]]), [3, 4, 2], [1, 0]]

Run 2

>>> train_test_split(a, b)
[array([[8, 9],
        [4, 5],
        [0, 1]]),
 array([[6, 7],
        [2, 3]]), [4, 2, 0], [3, 1]]

It changes. On the other hand if you use random_state=some_number, then you can guarantee that the output of Run 1 will be equal to the output of Run 2, i.e. your split will be always the same.
It doesn’t matter what the actual random_state number is 42, 0, 21, … The important thing is that everytime you use 42, you will always get the same output the first time you make the split.
This is useful if you want reproducible results, for example in the documentation, so that everybody can consistently see the same numbers when they run the examples.
In practice I would say, you should set the random_state to some fixed number while you test stuff, but then remove it in production if you really need a random (and not a fixed) split.

Regarding your second question, a pseudo-random number generator is a number generator that generates almost truly random numbers. Why they are not truly random is out of the scope of this question and probably won’t matter in your case, you can take a look here form more details.

More Related Contents:

  1. Should I use `random.seed` or `numpy.random.seed` to control random number generation in `scikit-learn`?
  2. scikit-learn random state in splitting dataset
  3. Python, How to remove gaps between text and variable?
  4. Shuffling a list of objects
  5. Random string generation with upper case letters and digits
  6. Generate random numbers with a given (numerical) distribution
  7. How to get a random number between a float range?
  8. sklearn error ValueError: Input contains NaN, infinity or a value too large for dtype(‘float64’)
  9. What is the most pythonic way to pop a random element from a list?
  10. Save classifier to disk in scikit-learn
  11. where to put freeze_support() in a Python script?
  12. Use scikit-learn to classify into multiple categories
  13. Custom transformer for sklearn Pipeline that alters both X and y
  14. Scikit Learn SVC decision_function and predict
  15. RuntimeWarning: numpy.dtype size changed, may indicate binary incompatibility
  16. Save MinMaxScaler model in sklearn
  17. sklearn plot confusion matrix with labels
  18. confusion matrix error “Classification metrics can’t handle a mix of multilabel-indicator and multiclass targets”
  19. LabelEncoder: TypeError: ‘>’ not supported between instances of ‘float’ and ‘str’
  20. What are the pros and cons between get_dummies (Pandas) and OneHotEncoder (Scikit-learn)?
  21. Run an OLS regression with Pandas Data Frame
  22. How to generate a random UUID which is reproducible (with a seed) in Python
  23. How to upgrade scikit-learn package in anaconda
  24. Mixing categorial and continuous data in Naive Bayes classifier using scikit-learn
  25. Using scikit to determine contributions of each feature to a specific class prediction
  26. Vectorizing `numpy.random.choice` for given 2D array of probabilities along an axis
  27. Comparing Matlab and Numpy code that uses random number generation
  28. Model help using Scikit-learn when using GridSearch
  29. Determining the most contributing features for SVM classifier in sklearn
  30. Maximal Length of List to Shuffle with Python random.shuffle?

Leave a Comment