Call python code from c via cython

by

If you rename the quacker.pyx to quacker.py, everything is actually correct. The only problem is that your program won’t search for python modules in the current directory, resulting in the output:

Exception NameError: "name 'quack' is not defined" in 'caller.call_quack' ignored

If you add the current directory to the PYTHONPATH environment variable however, the output becomes the one you’d expect:

$ PYTHONPATH=".:$PYTHONPATH" ./main 
Quack!

When running the python shell, according to the documentation the current directory (or the directory containing the script) is added to the sys.path variable automatically, but when creating a simple program using Py_Initialize and Py_Finalize this does not seem to happen. Since the PYTHONPATH variable is also used to populate the sys.path python variable, the workaround above produces the correct result.

Alternatively, below the Py_Intialize line, you could add an empty string to sys.path as follows by just executing some python code, specified as a string:

PyRun_SimpleString("import sys\nsys.path.insert(0,'')");

After recompiling, just running ./main should then work.

Edit

It’s actually interesting to see what’s going on if you run the code as specified in the question, so without renaming the quacker.pyx file. In that case, the initcaller() function tries to import the quacker module, but since no quacker.py or quacker.pyc exists, the module cannot be found, and the initcaller() function produces an error.

Now, this error is reported the python way, by raising an exception. But the code in the main.c file doesn’t check for this. I’m no expert in this, but in my tests adding the following code below initcaller() seemed to work:

if (PyErr_Occurred())
{
    PyErr_Print();
    return -1;
}

The output of the program then becomes the following:

Traceback (most recent call last):
  File "caller.pyx", line 1, in init caller (caller.c:836)
    from quacker import quack
ImportError: No module named quacker

By calling the initquacker() function before initcaller(), the module name quacker already gets registered so the import call that’s done inside initcaller() will detect that it’s already loaded and the call will succeed.

More Related Contents:

  1. Wrapping a C library in Python: C, Cython or ctypes?
  2. How to compile .c code from Cython with gcc
  3. Difference between np.int, np.int_, int, and np.int_t in cython?
  4. Using Cython To Link Python To A Shared Library
  5. Wrapping a pre-initialized pointer in a cython class
  6. Passing C++ vector to Numpy through Cython without copying and taking care of memory management automatically
  7. Passing numpy arrays in Cython to a C function that requires dynamically allocated arrays
  8. Extending python – to swig, not to swig or Cython
  9. How to generate random binary numbers 0 or 1 with length of N and with option to control the probability of having 0 or 1?
  10. Make executable file from multiple pyx files using cython
  11. Compiling with cython and mingw produces gcc: error: unrecognized command line option ‘-mno-cygwin’
  12. Speed comparison with Project Euler: C vs Python vs Erlang vs Haskell
  13. What is the recommended way of allocating memory for a typed memory view?
  14. Verifying compatibility in compiling extension types, and using them with cdef
  15. It is more efficient to use if-return-return or if-else-return?
  16. Compile main Python program using Cython
  17. How to tell distutils to use gcc?
  18. calling dot products and linear algebra operations in Cython?
  19. Why does numpy.zeros takes up little space
  20. Accessing OpenCV CUDA Functions from Python (No PyCUDA)
  21. Cython class AttributeError
  22. I have Python on my Ubuntu system, but gcc can’t find Python.h
  23. Where can I find source or algorithm of Python’s hash() function?
  24. Fortran – Cython Workflow
  25. Python ? (conditional/ternary) operator for assignments [duplicate]
  26. Definition of def, cdef and cpdef in cython
  27. Can Cython code be compiled to a dll so C++ application can call it?
  28. C++ conversion from NumPy array to Mat (OpenCV)
  29. Cython: (Why / When) Is it preferable to use Py_ssize_t for indexing?
  30. Multithreading with Python and C api

Leave a Comment