Django Celery Logging Best Practice

by

When your logger initialized in the beginning of “another module” it links to another logger. Which handle your messages. It can be root logger, or usually I see in Django projects – logger with name ''.

Best way here, is overriding your logging config:

LOGGING = {
    'version': 1,
    'disable_existing_loggers': True,
    'formatters': {
        'simple': {
            'format': '%(levelname)s %(message)s',
             'datefmt': '%y %b %d, %H:%M:%S',
            },
        },
    'handlers': {
        'console': {
            'level': 'DEBUG',
            'class': 'logging.StreamHandler',
            'formatter': 'simple'
        },
        'celery': {
            'level': 'DEBUG',
            'class': 'logging.handlers.RotatingFileHandler',
            'filename': 'celery.log',
            'formatter': 'simple',
            'maxBytes': 1024 * 1024 * 100,  # 100 mb
        },
    },
    'loggers': {
        'celery': {
            'handlers': ['celery', 'console'],
            'level': 'DEBUG',
        },
    }
}

from logging.config import dictConfig
dictConfig(LOGGING)

In this case I suppose it should work as you assume.

P.S. dictConfig added in Python2.7+.

More Related Contents:

  1. Detect whether Celery is Available/Running
  2. Cancel an already executing task with Celery?
  3. How to check task status in Celery?
  4. Running “unique” tasks with celery
  5. Reporting yielded results of long-running Celery task
  6. How can I schedule a Task to execute at a specific time using celery?
  7. Distributed task queues (Ex. Celery) vs crontab scripts
  8. Running Scrapy spiders in a Celery task
  9. Naming Python loggers
  10. Django Setup Default Logging
  11. No module named MySQLdb
  12. Mac OS X – EnvironmentError: mysql_config not found
  13. Django datetime issues (default=datetime.now())
  14. How to compare dates in Django templates
  15. Django [Errno 13] Permission denied: ‘/var/www/media/animals/user_uploads’
  16. URL-parameters and logic in Django class-based views (TemplateView)
  17. Creating a list of dictionaries with same keys? [duplicate]
  18. ValueError at /image/ Tensor Tensor(“activation_5/Softmax:0”, shape=(?, 4), dtype=float32) is not an element of this graph
  19. How do I perform query filtering in django templates
  20. Django Multiple Choice Field / Checkbox Select Multiple
  21. Django REST: Uploading and serializing multiple images
  22. Django Rest Framework – Authentication credentials were not provided
  23. Django: Calculate the Sum of the column values through query
  24. “no such table” exception
  25. What is an efficient way of inserting thousands of records into an SQLite table using Django?
  26. Proper way to consume data from RESTFUL API in django
  27. How do I convert kilometres to degrees in Geodjango/GEOS?
  28. how to add annotate data in django-rest-framework queryset responses?
  29. Django – Working with multiple forms
  30. How to check Django version

Leave a Comment