Numpy vs Cython speed

by

With slight modification, version 3 becomes twice as fast:

@cython.boundscheck(False)
@cython.wraparound(False)
@cython.nonecheck(False)
def process2(np.ndarray[DTYPE_t, ndim=2] array):

    cdef unsigned int rows = array.shape[0]
    cdef unsigned int cols = array.shape[1]
    cdef unsigned int row, col, row2
    cdef np.ndarray[DTYPE_t, ndim=2] out = np.empty((rows, cols))

    for row in range(rows):
        for row2 in range(rows):
            for col in range(cols):
                out[row, col] += array[row2, col] - array[row, col]

    return out

The bottleneck in your calculation is memory access. Your input array is C ordered, which means that moving along the last axis makes the smallest jump in memory. Therefore your inner loop should be along axis 1, not axis 0. Making this change cuts the run time in half.

If you need to use this function on small input arrays then you can reduce the overhead by using np.empty instead of np.ones. To reduce the overhead further use PyArray_EMPTY from the numpy C API.

If you use this function on very large input arrays (2**31) then the integers used for indexing (and in the range function) will overflow. To be safe use:

cdef Py_ssize_t rows = array.shape[0]
cdef Py_ssize_t cols = array.shape[1]
cdef Py_ssize_t row, col, row2

instead of

cdef unsigned int rows = array.shape[0]
cdef unsigned int cols = array.shape[1]
cdef unsigned int row, col, row2

Timing:

In [2]: a = np.random.rand(10000, 10)
In [3]: timeit process(a)
1 loops, best of 3: 3.53 s per loop
In [4]: timeit process2(a)
1 loops, best of 3: 1.84 s per loop

where process is your version 3.

More Related Contents:

  1. numpy faster than numba and cython , how to improve numba code
  2. Most efficient way to map function over numpy array
  3. Performance of Pandas apply vs np.vectorize to create new column from existing columns
  4. numpy: most efficient frequency counts for unique values in an array
  5. Why is numpy’s einsum faster than numpy’s built in functions?
  6. Numpy sum elements in array based on its value
  7. Implement MATLAB’s im2col ‘sliding’ in Python
  8. Frequency counts for unique values in a NumPy array
  9. Force NumPy ndarray to take ownership of its memory in Cython
  10. Most efficient way to forward-fill NaN values in numpy array
  11. Python’s sum vs. NumPy’s numpy.sum
  12. Why does numpy.zeros takes up little space
  13. Pandas pd.Series.isin performance with set versus array
  14. Numpy and line intersections
  15. Efficiently detect sign-changes in python
  16. Efficiently Calculating a Euclidean Distance Matrix Using Numpy
  17. Efficient way to take the minimum/maximum n values and indices from a matrix using NumPy
  18. Simple wrapping of C code with cython
  19. Why list comprehension is much faster than numpy for multiplying arrays?
  20. numpy float: 10x slower than builtin in arithmetic operations?
  21. Fastest save and load options for a numpy array
  22. Filtering (reducing) a NumPy Array
  23. No speedup when summing uint16 vs uint64 arrays with NumPy?
  24. Difference between np.int, np.int_, int, and np.int_t in cython?
  25. Python Numpy Data Types Performance
  26. how to speed up a vector cross product calculation
  27. What is the most efficient way to check if a value exists in a NumPy array?
  28. Efficient dot products of large memory-mapped arrays
  29. Passing C++ vector to Numpy through Cython without copying and taking care of memory management automatically
  30. What is the most efficient way of doing square root of sum of square of two numbers?

Leave a Comment