How to profile cython functions line-by-line

by

Robert Bradshaw helped me to get Robert Kern’s line_profiler tool working for cdef functions and I thought I’d share the results on stackoverflow.

In short, set up a regular .pyx file and build script and add the following before your call to cythonize.

# Thanks to @tryptofame for proposing an updated snippet
from Cython.Compiler.Options import get_directive_defaults
directive_defaults = get_directive_defaults()

directive_defaults['linetrace'] = True
directive_defaults['binding'] = True

Furthermore, you need to define the C macro CYTHON_TRACE=1 by modifying your extensions setup such that

extensions = [
    Extension("test", ["test.pyx"], define_macros=[('CYTHON_TRACE', '1')])
]

A working example using the %%cython magic in the iPython notebook is here:
http://nbviewer.ipython.org/gist/tillahoffmann/296501acea231cbdf5e7

More Related Contents:

  1. How do I profile a Python script?
  2. Cannot open include file: ‘io.h’: No such file or directory
  3. How do I profile memory usage in Python?
  4. Collapse multiple submodules to one Cython extension
  5. Force NumPy ndarray to take ownership of its memory in Cython
  6. Wrapping a C library in Python: C, Cython or ctypes?
  7. Can Cython compile to an EXE?
  8. Cython: “fatal error: numpy/arrayobject.h: No such file or directory”
  9. Making an executable in Cython
  10. Using cProfile results with KCacheGrind
  11. ImportError after cython embed
  12. Counting python method calls within another method
  13. Simple wrapping of C code with cython
  14. Tracking *maximum* memory usage by a Python function
  15. Interpretation vs dynamic dispatch penalty in Python
  16. Searching for a string in a large text file – profiling various methods in python
  17. Numpy vs Cython speed
  18. Running Cython in Windows x64 – fatal error C1083: Cannot open include file: ‘basetsd.h’: No such file or directory
  19. Mixing cdef and regular python attributes in cdef class
  20. How to compile .c code from Cython with gcc
  21. Accurate timing of functions in python
  22. How to profile PyCuda code with the Visual Profiler?
  23. Is there any working memory profiler for Python3 [closed]
  24. Are executables produced with Cython really free of the source code?
  25. Large Performance difference when summing ints vs floats in Cython vs NumPy
  26. Fast string array – Cython
  27. numpy faster than numba and cython , how to improve numba code
  28. How can I profile a multithread program in Python?
  29. Extending python – to swig, not to swig or Cython
  30. Call python code from c via cython

Leave a Comment