What's the best way to automate tasks with Headless Chrome? or Headless Chrome for web scraping—any t

20 Replies, 994 Views

Playwright’s my jam for scraping. The built-in waits are a lifesaver, and it’s way less flaky than headless chrome with Puppeteer.

For avoiding blocks, I do:
- Rotate user-agents
- Mimic scroll behavior
- Use session cookies

Oh, and don’t forget `--disable-dev-shm-usage` if you’re running in Docker.



Users browsing this thread: 1 Guest(s)