Honestly, brightdata rotating proxy is *good*, but it’s not magic. If a site really wants to block scrapers, they’ll find a way.
I’ve had luck combining it with residential proxies from Luminati (same parent company as brightdata). The mix of datacenter and residential IPs seems to confuse detection systems a bit more.
Also, randomizing user-agents is a must. Sites like WhatIsMyBrowser can help you spot if your scraper’s giving itself away.
I’ve had luck combining it with residential proxies from Luminati (same parent company as brightdata). The mix of datacenter and residential IPs seems to confuse detection systems a bit more.
Also, randomizing user-agents is a must. Sites like WhatIsMyBrowser can help you spot if your scraper’s giving itself away.