Yo, thanks for all the replies! Super helpful.
I tried slowing down my Google web scraper and added some proxies (cheap ones tho, lol). So far, no ban, but I’m still kinda nervous.
Anyone got experience with ScrapingBee? Is it worth the $$$ or should I stick to tweaking my own setup?
Also, big shoutout to the person who mentioned AWS Lambda—gonna try that next!
I tried slowing down my Google web scraper and added some proxies (cheap ones tho, lol). So far, no ban, but I’m still kinda nervous.
Anyone got experience with ScrapingBee? Is it worth the $$$ or should I stick to tweaking my own setup?
Also, big shoutout to the person who mentioned AWS Lambda—gonna try that next!
