Reporting yielded results of long-running Celery task

by

In order for Celery to know what the current state of the task is, it sets some metadata in whatever result backend you have. You can piggy-back on that to store other kinds of metadata.

def yielder():
    for i in range(2**100):
        yield i

@task
def report_progress():
    for progress in yielder():
        # set current progress on the task
        report_progress.backend.mark_as_started(
            report_progress.request.id,
            progress=progress)

def view_function(request):
    task_id = request.session['task_id']
    task = AsyncResult(task_id)
    progress = task.info['progress']
    # do something with your current progress

I wouldn’t throw a ton of data in there, but it works well for tracking the progress of a long-running task.

More Related Contents:

  1. Cancel an already executing task with Celery?
  2. Running “unique” tasks with celery
  3. How can I schedule a Task to execute at a specific time using celery?
  4. Distributed task queues (Ex. Celery) vs crontab scripts
  5. Running Scrapy spiders in a Celery task
  6. Django Celery Logging Best Practice
  7. Detect whether Celery is Available/Running
  8. Django CSRF check failing with an Ajax POST request
  9. Having Django serve downloadable files
  10. How can I enable CORS on Django REST Framework
  11. Django upgrading to 1.9 error “AppRegistryNotReady: Apps aren’t loaded yet.”
  12. Iterating through two lists in Django templates
  13. How to check task status in Celery?
  14. Split views.py in several files
  15. How to execute a GROUP BY … COUNT or SUM in Django ORM?
  16. Any way to make {% extends ‘…’ %} conditional? – Django
  17. How do I extend the Django Group model?
  18. When to use Serializer’s create() and ModelViewset’s perform_create()
  19. What is choice_set in this Django app tutorial?
  20. Django REST Framework serializer field required=false
  21. Why doesn’t django’s model.save() call full_clean()?
  22. How do I prevent fixtures from conflicting with django post_save signal code?
  23. What’s the best solution for OpenID with Django? [closed]
  24. How can I get the current language in Django?
  25. QuerySet, Object has no attribute id – Django
  26. Good ways to sort a queryset? – Django
  27. Django — Conditional Login Redirect
  28. How do I access dictionary keys that contain hyphens from within a Django template?
  29. How to properly use the “choices” field option in Django
  30. How to use custom AdminSite class?

Leave a Comment