by: adminPosted on: November 16, 2021 and make sure DOWNLOAD_DELAY and RANDOMIZE_DOWNLOAD_DELAY aren’t allowed because they reduce concurrency and aren’t required with the Scraper API. HTTP & SOCKS Rotating Residential 32 million IPs for all purposes Worldwide locations 3 day moneyback guarantee Visit shifter.io Frequently Asked Questions about Set RETRY_TIMES to 5 to tell Scrapy to retry any failed requests