How to run celery on windows?

by

Celery 4.0+ does not officially support window already. But it still works on window for some development/test purpose.

Use eventlet instead as below:

pip install eventlet
celery -A <module> worker -l info -P eventlet

It works for me on window 10 + celery 4.1 + python 3.

This solution solved the following exception:

[2017-11-16 21:19:46,938: ERROR/MainProcess] Task handler raised error: ValueError('need more than 0 values to unpack',)
Traceback (most recent call last):
  File "c:\users\wchen8\work\venv\weinsta\lib\site-packages\billiard\pool.py", line 358, in workloop
    result = (True, prepare_result(fun(*args, **kwargs)))
  File "c:\users\wchen8\work\venv\weinsta\lib\site-packages\celery\app\trace.py", line 525, in _fast_trace_task
    tasks, accept, hostname = _loc
ValueError: need more than 0 values to unpack

===== update 2018-11 =====

Eventlet has an issue on subprocess.CalledProcessError:

https://github.com/celery/celery/issues/4063

https://github.com/eventlet/eventlet/issues/357

https://github.com/eventlet/eventlet/issues/413

So try gevent instead.

pip install gevent
celery -A <module> worker -l info -P gevent

This works for me on window 10 + celery 4.2 + python 3.6

More Related Contents:

  1. Retrieve list of tasks in a queue in Celery
  2. How to dynamically add / remove periodic tasks to Celery (celerybeat)
  3. Cancel an already executing task with Celery?
  4. How to check task status in Celery?
  5. Running “unique” tasks with celery
  6. Reporting yielded results of long-running Celery task
  7. Celery Received unregistered task of type (run example)
  8. How to chain a Celery task that returns a list into a group?
  9. How can I schedule a Task to execute at a specific time using celery?
  10. Distributed task queues (Ex. Celery) vs crontab scripts
  11. Understanding celery task prefetching
  12. Running Scrapy spiders in a Celery task
  13. Celery: is there a way to write custom JSON Encoder/Decoder?
  14. Django Celery Logging Best Practice
  15. Detect whether Celery is Available/Running
  16. How to combine Celery with asyncio?
  17. Is it worth using Python’s re.compile?
  18. How to match any string from a list of strings in regular expressions in python?
  19. Basic explanation of python functions
  20. How to convert a string of space- and comma- separated numbers into a list of int? [duplicate]
  21. How to scrape a public tableau dashboard? [closed]
  22. Keras custom loss function: Accessing current input pattern
  23. What’s the difference between ‘r+’ and ‘a+’ when open file in python? [duplicate]
  24. Create an object using Python’s C API
  25. Pip is not working for Python 3.10 on Ubuntu
  26. heatmap-like plot, but for categorical variables in seaborn
  27. Django Multiple Databases – relation does not exist; LINE 1: SELECT COUNT(*) AS “__count” FROM
  28. How to document default None/null in OpenAPI/Swagger using FastAPI?
  29. Pandas: Selecting rows based on value counts of a particular column
  30. How to measure download speed and progress using requests?

Leave a Comment