Is Selenium Scraping Still the Best Option for Dynamic Websites? or How Do You Handle CAPTCHAs When D

16 Replies, 627 Views

Wow, didn’t expect so many replies!

Tried the `WebDriverWait` trick and it’s already way better—no more random div fails. Also, gonna test out those proxy suggestions for CAPTCHAs.

Playwright’s tempting, but you’re right—might not be worth the switch yet.

One follow-up: anyone got tips for handling infinite scroll pages? My script keeps missing content.

Thanks y’all!

Messages In This Thread



Users browsing this thread: 2 Guest(s)