python: [Errno 10054] An existing connection was forcibly closed by the remote host

by

This can be caused by the two sides of the connection disagreeing over whether the connection timed out or not during a keepalive. (Your code tries to reused the connection just as the server is closing it because it has been idle for too long.) You should basically just retry the operation over a new connection. (I’m surprised your library doesn’t do this automatically.)

More Related Contents:

  1. Importing Tweets via Python using Tweepy
  2. Python Google Web Crawler
  3. Sending “User-agent” using Requests library in Python
  4. TypeError: can’t use a string pattern on a bytes-like object in re.findall()
  5. How to run Scrapy from within a Python script
  6. regex for Twitter username
  7. Scrapy – Reactor not Restartable [duplicate]
  8. How to pass a user defined argument in scrapy spider
  9. Anyone know of a good Python based web crawler that I could use?
  10. How can I get tweets older than a week (using tweepy or other python libraries)
  11. Click a Button in Scrapy
  12. How to add a location filter to tweepy module
  13. How to apply NLTK word_tokenize library on a Pandas dataframe for Twitter data?
  14. how to filter duplicate requests based on url in scrapy
  15. Pandas max value index
  16. crawl site that has infinite scrolling using python
  17. How can I use different pipelines for different spiders in a single Scrapy project
  18. getting Forbidden by robots.txt: scrapy
  19. Python: maximum recursion depth exceeded while calling a Python object
  20. Avoid Twitter API limitation with Tweepy
  21. Managing Tweepy API Search
  22. httplib CannotSendRequest error in WSGI
  23. How can I scrape tooltips value from a Tableau graph embedded in a webpage
  24. Python: Disable images in Selenium Google ChromeDriver
  25. syntaxError: ‘continue’ not properly in loop
  26. Locally run all of the spiders in Scrapy
  27. Creating a generic scrapy spider
  28. Get data from Twitter using Tweepy and store in csv file
  29. Scrapy CrawlSpider doesn’t crawl the first landing page
  30. find a word on a website and get its page link

Leave a Comment