Wow, thanks so much for all the suggestions, everyone! I think I’m gonna give Selenium a shot first since I’m already kinda familiar with Python. The lazy loading tips are super helpful—I’ll definitely try using WebDriverWait.
Quick question though: for those of you using Selenium, do you have any tips for handling captchas? I’ve noticed some sites throw them up when I try to scrape a page to download images from a website.
Also, I’ll check out Octoparse and ParseHub for simpler projects. Thanks again, y’all are awesome! 🙌
Quick question though: for those of you using Selenium, do you have any tips for handling captchas? I’ve noticed some sites throw them up when I try to scrape a page to download images from a website.
Also, I’ll check out Octoparse and ParseHub for simpler projects. Thanks again, y’all are awesome! 🙌