Thanks for all the tips, folks! I’ve been playing with Playwright based on your suggestions, and the auto-wait is indeed a lifesaver.
Still running into some issues with sites blocking headless, though. Tried the --disable-blink-features trick, but no dice. Anyone got a workaround for super stubborn sites?
Also, anyone using browser automation for scraping? Curious how you handle CAPTCHAs without getting banned.
Still running into some issues with sites blocking headless, though. Tried the --disable-blink-features trick, but no dice. Anyone got a workaround for super stubborn sites?
Also, anyone using browser automation for scraping? Curious how you handle CAPTCHAs without getting banned.
