Most efficient way to map function over numpy array

by

I’ve tested all suggested methods plus np.array(map(f, x)) with perfplot (a small project of mine).

Message #1: If you can use numpy’s native functions, do that.

If the function you’re trying to vectorize already is vectorized (like the x**2 example in the original post), using that is much faster than anything else (note the log scale):

enter image description here

If you actually need vectorization, it doesn’t really matter much which variant you use.

enter image description here

Code to reproduce the plots:

import numpy as np
import perfplot
import math


def f(x):
    # return math.sqrt(x)
    return np.sqrt(x)


vf = np.vectorize(f)


def array_for(x):
    return np.array([f(xi) for xi in x])


def array_map(x):
    return np.array(list(map(f, x)))


def fromiter(x):
    return np.fromiter((f(xi) for xi in x), x.dtype)


def vectorize(x):
    return np.vectorize(f)(x)


def vectorize_without_init(x):
    return vf(x)


b = perfplot.bench(
    setup=np.random.rand,
    n_range=[2 ** k for k in range(20)],
    kernels=[
        f,
        array_for,
        array_map,
        fromiter,
        vectorize,
        vectorize_without_init,
    ],
    xlabel="len(x)",
)
b.save("out1.svg")
b.show()

More Related Contents:

  1. numpy: most efficient frequency counts for unique values in an array
  2. Roll rows of a matrix independently
  3. Numpy sum elements in array based on its value
  4. Efficiently return the index of the first value satisfying condition in array
  5. Link ATLAS/MKL to an installed Numpy
  6. Bin elements per row – Vectorized 2D Bincount for NumPy
  7. Fastest way to grow a numpy numeric array
  8. Vectorized searchsorted numpy
  9. Implement MATLAB’s im2col ‘sliding’ in Python
  10. Python’s sum vs. NumPy’s numpy.sum
  11. Numpy: Fix array with rows of different lengths by filling the empty elements with zeros
  12. Why “numpy.any” has no short-circuit mechanism?
  13. Vectorizing Haversine distance calculation in Python
  14. Numpy and line intersections
  15. Why is numpy.array so slow?
  16. Efficient evaluation of a function at every cell of a NumPy array
  17. why isn’t numpy.mean multithreaded?
  18. Why is `np.sum(range(N))` very slow?
  19. Why is a `for` over a Python list faster than over a Numpy array?
  20. Performance: Matlab vs Python
  21. Are NumPy’s math functions faster than Python’s?
  22. Max in a sliding window in NumPy array
  23. Efficiently replace elements in array based on dictionary – NumPy / Python
  24. Why is Numpy much faster at creating a Zero array compared to replacing the values of an existing array with zeros?
  25. Getting days since last occurence in Pandas DataFrame?
  26. Multiple matrix multiplication
  27. Creating a numpy array of 3D coordinates from three 1D arrays
  28. Split Python sequence (time series/array) into subsequences with overlap
  29. numpy faster than numba and cython , how to improve numba code
  30. What is the most efficient way of doing square root of sum of square of two numbers?

Leave a Comment