Efficient thresholding filter of an array with numpy

by

b = a[a>threshold] this should do

I tested as follows:

import numpy as np, datetime
# array of zeros and ones interleaved
lrg = np.arange(2).reshape((2,-1)).repeat(1000000,-1).flatten()

t0 = datetime.datetime.now()
flt = lrg[lrg==0]
print datetime.datetime.now() - t0

t0 = datetime.datetime.now()
flt = np.array(filter(lambda x:x==0, lrg))
print datetime.datetime.now() - t0

I got

$ python test.py
0:00:00.028000
0:00:02.461000

http://docs.scipy.org/doc/numpy/user/basics.indexing.html#boolean-or-mask-index-arrays

More Related Contents:

  1. Using strides for an efficient moving average filter
  2. Taking subarrays from numpy array with given stride/stepsize
  3. ‘and’ (boolean) vs ‘&’ (bitwise) – Why difference in behavior with lists vs numpy arrays?
  4. Unable to allocate array with shape and data type
  5. Python/NumPy first occurrence of subarray
  6. What is the internal precision of numpy.float128?
  7. How to use filter, map, and reduce in Python 3
  8. Replacing Numpy elements if condition is met
  9. Use a.any() or a.all()
  10. How to make a multidimension numpy array with a varying row size?
  11. Restart cumsum and get index if cumsum more than value
  12. ValueError: numpy.dtype has the wrong size, try recompiling
  13. Implement MATLAB’s im2col ‘sliding’ in Python
  14. subsampling every nth entry in a numpy array
  15. Python’s sum vs. NumPy’s numpy.sum
  16. When should I use hstack/vstack vs append vs concatenate vs column_stack?
  17. Type hinting / annotation (PEP 484) for numpy.ndarray
  18. Numpy vs Cython speed
  19. pandas distinction between str and object types
  20. convert string representation of array to numpy array in python
  21. Add multiple values to one numpy array index
  22. numpy reverse multidimensional array
  23. How do I get Pylint to recognize NumPy members?
  24. Form a big 2d array from multiple smaller 2d arrays
  25. Sieve of Eratosthenes – Primes between X and N
  26. mean from pandas and numpy differ
  27. Is there a MATLAB accumarray equivalent in numpy?
  28. Generate random locations within a triangular domain
  29. Why does numpy.histogram (Python) leave off one element as compared to hist in Matlab?
  30. sparse 3d matrix/array in Python?

Leave a Comment