Thanks for all the suggestions, everyone! I ended up trying out Bright Data based on the recs here, and so far, it’s been working great for my scraping needs.
I did run into a couple of CAPTCHA issues, but their support helped me tweak the settings.
Quick question though—anyone have tips on optimizing request rates to avoid getting flagged? I’m still figuring out the sweet spot.
Cheers again for the help!
I did run into a couple of CAPTCHA issues, but their support helped me tweak the settings.
Quick question though—anyone have tips on optimizing request rates to avoid getting flagged? I’m still figuring out the sweet spot.
Cheers again for the help!