Access django models inside of Scrapy

by

If anyone else is having the same problem, this is how I solved it.

I added this to my scrapy settings.py file:

def setup_django_env(path):
    import imp, os
    from django.core.management import setup_environ

    f, filename, desc = imp.find_module('settings', [path])
    project = imp.load_module('settings', f, filename, desc)       

    setup_environ(project)

setup_django_env('/path/to/django/project/')

Note: the path above is to your django project folder, not the settings.py file.

Now you will have full access to your django models inside of your scrapy project.

More Related Contents:

  1. ValueError: invalid literal for int() with base 10:
  2. Datetime On Django on models?
  3. django.core.exceptions.ImproperlyConfigured: Requested setting INSTALLED_APPS, but settings are not configured. plz help me out plz
  4. What is a “slug” in Django?
  5. Django. Override save for model
  6. Django – how to create a file and save it to a model’s FileField?
  7. How do I do a not equal in Django queryset filtering?
  8. Django: add image in an ImageField from image url
  9. Python script for Django app to access models without using manage.py shell
  10. Django signals vs. overriding save method
  11. Django Model Field Default Based Off Another Field in Same Model
  12. How do I restrict foreign keys choices to related objects only in django
  13. django template system, calling a function inside a model
  14. Custom ordering in Django
  15. Django: Why do some model fields clash with each other?
  16. How do I extend the Django Group model?
  17. Django values_list vs values
  18. ‘NOT NULL constraint failed’ after adding to models.py
  19. Why doesn’t django’s model.save() call full_clean()?
  20. “_set” in a queryset object in Django
  21. Nested inlines in the Django admin?
  22. Django – form.save() is not creating ModelForm
  23. Override a form in Django admin
  24. What is the best way to access stored procedures in Django’s ORM
  25. QuerySet, Object has no attribute id – Django
  26. How can I set a default value for a field in a Django model?
  27. Django Multiple Databases – relation does not exist; LINE 1: SELECT COUNT(*) AS “__count” FROM
  28. Single Table Inheritance in Django
  29. Django admin: How to display the field marked as “editable=False” in the model?
  30. Django: How to create a model dynamically just for testing

Leave a Comment