Wow, thanks for all the suggestions, everyone! I didn’t expect so many options for *how to write a script to go to a website*. I think I’ll give Puppeteer a shot first since I’m more comfortable with JS.
Quick question though—anyone know how to handle sites with heavy anti-bot measures? I tried Selenium, but I keep getting blocked. Is there a way around that, or should I just switch to something like Playwright?
Also, shoutout to the person who mentioned Octoparse. I’ll definitely check that out for simpler tasks. Thanks again, y’all!
Quick question though—anyone know how to handle sites with heavy anti-bot measures? I tried Selenium, but I keep getting blocked. Is there a way around that, or should I just switch to something like Playwright?
Also, shoutout to the person who mentioned Octoparse. I’ll definitely check that out for simpler tasks. Thanks again, y’all!