Maximal Length of List to Shuffle with Python random.shuffle?

by

TL;DR: It “breaks” on lists with over 2080 elements, but don’t worry too much 🙂

Complete answer:

First of all, notice that “shuffling” a list can be understood (conceptually) as generating all possible permutations of the elements of the lists, and picking one of these permutations at random.

Then, you must remember that all self-contained computerised random number generators are actually “pseudo” random. That is, they are not actually random, but rely on a series of factors to try and generate a number that is hard to be guessed in advanced, or purposefully reproduced. Among these factors is usually the previous generated number. So, in practice, if you use a random generator continuously a certain number of times, you’ll eventually start getting the same sequence all over again (this is the “period” that the documentation refers to).

Finally, the docstring on Lib/random.py (the random module) says that “The period [of the random number generator] is 2**19937-1.”

So, given all that, if your list is such that there are 2**19937 or more permutations, some of these will never be obtained by shuffling the list. You’d (again, conceptually) generate all permutations of the list, then generate a random number x, and pick the xth permutation. Next time, you generate another random number y, and pick the yth permutation. And so on. But, since there are more permutations than you’ll get random numbers (because, at most after 2**19937-1 generated numbers, you’ll start getting the same ones again), you’ll start picking the same permutations again.

So, you see, it’s not exactly a matter of how long your list is (though that does enter into the equation). Also, 2**19937-1 is quite a long number. But, still, depending on your shuffling needs, you should bear all that in mind. On a simplistic case (and with a quick calculation), for a list without repeated elements, 2081 elements would yield 2081! permutations, which is more than 2**19937.

More Related Contents:

  1. Shuffling a list of objects
  2. Why does random.shuffle return None?
  3. Shuffle an array with python, randomize array item order with python
  4. Better way to shuffle two numpy arrays in unison
  5. Python – shuffle only some elements of a list
  6. Can Python’s set absence of ordering be considered random order?
  7. How can I randomly select an item from a list?
  8. How do I create a list of random numbers without duplicates?
  9. Consistently create same random numpy array
  10. How to generate a random number with a specific amount of digits?
  11. Python random sample with a generator / iterable / iterator
  12. Random row selection in Pandas dataframe
  13. How to generate random numbers that are different? [duplicate]
  14. Sampling uniformly distributed random points inside a spherical volume
  15. How to generate random strings in Python?
  16. Binary random array with a specific proportion of ones?
  17. How can I create a random number that is cryptographically secure in python?
  18. Difference between np.random.seed() and np.random.RandomState()
  19. Should I use `random.seed` or `numpy.random.seed` to control random number generation in `scikit-learn`?
  20. Create random list of integers in Python
  21. Python: Random selection per group
  22. Generating Discrete random variables with specified weights using SciPy or NumPy
  23. How to hash a string into 8 digits?
  24. Random non overlapping circles(with circle number controlled) in python and pygame
  25. Getting random row through SQLAlchemy
  26. Vectorizing `numpy.random.choice` for given 2D array of probabilities along an axis
  27. Comparing Matlab and Numpy code that uses random number generation
  28. Working with floating point NumPy arrays for comparison and related operations
  29. Random Python dictionary key, weighted by values
  30. Generate random number in range excluding some numbers

Leave a Comment