OP here—thanks for all the tips!
Tried slowing down requests + randomizing UAs, and it’s way better. Still getting blocked on a few sites tho (looking at you, Zillow).
Gonna test Puppeteer Extra and see if that helps.
Anyone got a sweet spot for session length? Like, is 10 mins too long for one IP?
Also, is Luminati really worth the extra $$$ over brightdata rotating residential ip address?
Tried slowing down requests + randomizing UAs, and it’s way better. Still getting blocked on a few sites tho (looking at you, Zillow).
Gonna test Puppeteer Extra and see if that helps.
Anyone got a sweet spot for session length? Like, is 10 mins too long for one IP?
Also, is Luminati really worth the extra $$$ over brightdata rotating residential ip address?