Wow, thanks for all the suggestions, everyone! I think I’m gonna start with Puppeteer and see how it goes. I’ve already set up some rotating proxies from Bright Data, so fingers crossed it works out.
Quick question though—anyone have tips on handling captchas? I’ve heard some scrapers can bypass them, but not sure if that’s true. Also, how often do you guys rotate your headers? Daily? Per request?
Thanks again, y’all are the best! 🙌
Quick question though—anyone have tips on handling captchas? I’ve heard some scrapers can bypass them, but not sure if that’s true. Also, how often do you guys rotate your headers? Daily? Per request?
Thanks again, y’all are the best! 🙌