Hey! I’ve been scraping torrents for a while now, and honestly, Scrapy is still my go-to.
For sites that are super locked down, I use a combo of residential proxies (I like Smartproxy) and a headless browser like Puppeteer.
Captchas are the worst, but I’ve found that using a service like Anti-Captcha works better than trying to bypass them manually.
Also, make sure to throttle your requests to avoid getting blocked.
For sites that are super locked down, I use a combo of residential proxies (I like Smartproxy) and a headless browser like Puppeteer.
Captchas are the worst, but I’ve found that using a service like Anti-Captcha works better than trying to bypass them manually.
Also, make sure to throttle your requests to avoid getting blocked.