Hey! I’ve had some success with a coupon codescraper using Puppeteer. It’s faster than Selenium and handles JavaScript-heavy sites better.
For avoiding blocks, I use a combination of rotating IPs and randomizing my request intervals. It’s not foolproof, but it works most of the time.
Also, check out the “scrapy-rotating-proxies” package if you’re using Scrapy. It’s a lifesaver.
For avoiding blocks, I use a combination of rotating IPs and randomizing my request intervals. It’s not foolproof, but it works most of the time.
Also, check out the “scrapy-rotating-proxies” package if you’re using Scrapy. It’s a lifesaver.