OP here—thanks for all the suggestions!
Gonna try Scrapy + Splash for the JS-heavy stuff. Also, didn’t think about adding proxies to instant scraper—definitely gonna test that.
Anyone got tips for avoiding IP bans with it? Heard rotating proxies are a must.
Gonna try Scrapy + Splash for the JS-heavy stuff. Also, didn’t think about adding proxies to instant scraper—definitely gonna test that.
Anyone got tips for avoiding IP bans with it? Heard rotating proxies are a must.
