+- Proxy Community (https://proxycommunity.com/forum)
+-- Forum: Technical Community Support (https://proxycommunity.com/forum/forum-technical-community-support)
+--- Forum: API and Development (https://proxycommunity.com/forum/forum-api-and-development)
+--- Thread: What's the best way to automate tasks with Headless Chrome? or Headless Chrome for web scraping—any t (/thread-what-s-the-best-way-to-automate-tasks-with-headless-chrome-or-headless-chrome-for-web-scraping%E2%80%94any-t)
“” - ghostCipherX - 05-04-2025
Playwright’s my jam for scraping. The built-in waits are a lifesaver, and it’s way less flaky than headless chrome with Puppeteer.
For avoiding blocks, I do:
- Rotate user-agents
- Mimic scroll behavior
- Use session cookies
Oh, and don’t forget `--disable-dev-shm-usage` if you’re running in Docker.