by: adminPosted on:

and make sure DOWNLOAD_DELAY and RANDOMIZE_DOWNLOAD_DELAY aren’t allowed because they reduce concurrency and aren’t required with the Scraper API.

HTTP Rotating & Static

  • 200 thousand IPs
  • Locations: US, EU
  • Monthly price: from $39
  • 1 day moneyback guarantee

Visit stormproxies.com

Frequently Asked Questions about Set RETRY_TIMES to 5 to tell Scrapy to retry any failed requests

Leave a Reply

Your email address will not be published. Required fields are marked *