Why is numpy.array so slow?

by

Numpy is optimised for large amounts of data. Give it a tiny 3 length array and, unsurprisingly, it performs poorly.

Consider a separate test

import timeit

reps = 100

pythonTest = timeit.Timer('a = [0.] * 1000000')
numpyTest = timeit.Timer('a = numpy.zeros(1000000)', setup='import numpy')
uninitialised = timeit.Timer('a = numpy.empty(1000000)', setup='import numpy')
# empty simply allocates the memory. Thus the initial contents of the array 
# is random noise

print 'python list:', pythonTest.timeit(reps), 'seconds'
print 'numpy array:', numpyTest.timeit(reps), 'seconds'
print 'uninitialised array:', uninitialised.timeit(reps), 'seconds'

And the output is

python list: 1.22042918205 seconds
numpy array: 1.05412316322 seconds
uninitialised array: 0.0016028881073 seconds

It would seem that it is the zeroing of the array that is taking all the time for numpy. So unless you need the array to be initialised then try using empty.

More Related Contents:

  1. numpy: most efficient frequency counts for unique values in an array
  2. Why is numpy’s einsum faster than numpy’s built in functions?
  3. Roll rows of a matrix independently
  4. Numpy sum elements in array based on its value
  5. Efficiently return the index of the first value satisfying condition in array
  6. Link ATLAS/MKL to an installed Numpy
  7. Bin elements per row – Vectorized 2D Bincount for NumPy
  8. Fastest way to grow a numpy numeric array
  9. Vectorized searchsorted numpy
  10. Most efficient way to forward-fill NaN values in numpy array
  11. Numpy: Fix array with rows of different lengths by filling the empty elements with zeros
  12. Why “numpy.any” has no short-circuit mechanism?
  13. Vectorizing Haversine distance calculation in Python
  14. Efficient evaluation of a function at every cell of a NumPy array
  15. why isn’t numpy.mean multithreaded?
  16. Why list comprehension is much faster than numpy for multiplying arrays?
  17. Why is `np.sum(range(N))` very slow?
  18. Why is a `for` over a Python list faster than over a Numpy array?
  19. Performance: Matlab vs Python
  20. Are NumPy’s math functions faster than Python’s?
  21. Max in a sliding window in NumPy array
  22. Efficiently replace elements in array based on dictionary – NumPy / Python
  23. Why is Numpy much faster at creating a Zero array compared to replacing the values of an existing array with zeros?
  24. Getting days since last occurence in Pandas DataFrame?
  25. Multiple matrix multiplication
  26. What is the most efficient way to check if a value exists in a NumPy array?
  27. Efficient dot products of large memory-mapped arrays
  28. Creating a numpy array of 3D coordinates from three 1D arrays
  29. Split Python sequence (time series/array) into subsequences with overlap
  30. numpy faster than numba and cython , how to improve numba code

Leave a Comment